This website requires JavaScript.
Explore
Help
Sign In
marian-nmt
/
marian
Watch
1
Star
1
Fork
0
You've already forked marian
mirror of
https://github.com/marian-nmt/marian.git
synced
2024-09-11 06:15:56 +03:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
cfc33f5498
marian
/
VERSION
2 lines
8 B
Plaintext
Raw
Normal View
History
Unescape
Escape
Merged PR 25686: Loading checkpoints from main node only via MPI Enables loading of model checkpoints from main node only via MPI. Until now the checkpoint needed to present in the same location on all nodes. That could be done either via writing to a shared filesystem (problematic due to bad syncing) or by manual copying to the same local location, e.g. /tmp on each node (while writing only happened to one main location). Now, marian can resume training from only one location on the main node. The remaining nodes do not need to have access. E.g. local /tmp on the main node can be used, or race conditons on shared storage are avoided. Also avoids creating files for logging on more than one node. This is a bit wonky, done via environment variable lookup.
2022-09-21 23:39:54 +03:00
v1.11.9
Reference in New Issue
Copy Permalink