Feat (optim): add Cailey SGD optimizer #1081
| Job | Run time |
|---|---|
| 16m 21s | |
| 11m 58s | |
| 19m 31s | |
| 11m 54s | |
| 17m 36s | |
| 14m 2s | |
| 17m 33s | |
| 13m 49s | |
| 1h 43m 54s | |
| 1h 14m 59s | |
| 1h 44m 43s | |
| 55m 8s | |
| 1h 46m 7s | |
| 1h 25m 30s | |
| 17m 58s | |
| 11m 31s | |
| 18m 56s | |
| 12m 38s | |
| 17m 9s | |
| 7m 21s | |
| 18m 15s | |
| 15m 19s | |
| 1h 41m 57s | |
| 1h 17m 1s | |
| 1h 45m 54s | |
| 1h 22m 35s | |
| 1h 46m 26s | |
| 1h 16m 45s | |
| 22h 2m 50s |