Commit Graph

3 Commits

Author SHA1 Message Date
arampacha
30f2ee4127
reinstantiate opt_state recursively when there are nested lists (#47) 2021-07-15 03:09:40 +03:00
arampacha
3aef752fce
upd clm script (#43)
* update resuming behaviour

* adds temporary hack to enable resuming w multisteps and adafactor
2021-07-14 00:52:59 +03:00
arampacha
92539be4cb
Training script update (#40)
* adds cleaner streaming script

* resume from checkpoint w/ MultiSteps

* adds gradient clipping

* upd run_clm_flax.py
2021-07-13 18:38:04 +03:00