Helsinki-NLP/OPUS-MT-train
1
1
Fork 0
mirror of https://github.com/Helsinki-NLP/OPUS-MT-train.git synced 2024-08-17 16:20:50 +03:00
Code Issues Packages Projects Releases Wiki Activity

a note about setting up some environment specifications

Browse Source
This commit is contained in:
Joerg Tiedemann 2022-02-03 22:34:54 +02:00
parent f660332c1f
commit 3d478d7602
2 changed files with 13 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -18,6 +18,9 @@ git submodule update --init --recursive --remote
make install
```
Look into `lib/env.mk` and adust any settings that you need in your environment.
For CSC-users: adjust `lib/env/puhti.mk` and `lib/env/puhti.mk` to match yoursetup (especially the locations where Marian-NMT and other tools are installed and the CSC project that you are using).
Training a multilingual NMT model (Finnish and Estonian to Danish, Swedish and English):
```

10
doc/Setup.md
View File

@ -35,6 +35,16 @@ Optional (recommended) software:
* [fast_align](https://github.com/clab/fast_align)
## Adjust environment setup
Environment variables are mostly specified in `lib/env.mk`. Adjust the settings to match your environment! You maye have to re-run `make install` after the adjustments or compile/install tools manually.
## CSC users
OPUS-MT-train is developed to run on the CSC HPC infrastructure and supports `puhti` and `mahti`. There are some hard-coded settings that match our particular environment in our CSC project. You need to adjust those settings in `lib/env/puhti.mk` and `lib/env/puhti.mk`. This includes at least the paths to important tools such as Marian-NMT and others. You also need to set the CSC project identifier (`CSCPROJECT`) to match the project that you use for requestion billing units!
## Mac OSX