mirror of
https://github.com/moses-smt/mosesdecoder.git
synced 2024-12-27 05:55:02 +03:00
b5584fdecf
Don't write glue grammar or unknown word label files unless the sentence
offset is 0. This prevents multiple instances of extract-ghkm writing
to the same two files when extract-parallel is used.
TODO Better solutions might be:
1. modify extract-parallel so that it only configures one instance of
extract-ghkm to write the glue / unknown-lhs files (like the current
workaround, this assumes file chunks are representative of the whole)
2. add multithreading support directly to extract-ghkm
3. write distinct output files for each extract-ghkm instance and
combine them on completion
|
||
|---|---|---|
| .. | ||
| Alignment.cpp | ||
| Alignment.h | ||
| AlignmentGraph.cpp | ||
| AlignmentGraph.h | ||
| ComposedRule.cpp | ||
| ComposedRule.h | ||
| Exception.h | ||
| ExtractGHKM.cpp | ||
| ExtractGHKM.h | ||
| Jamfile | ||
| Main.cpp | ||
| Node.cpp | ||
| Node.h | ||
| Options.h | ||
| ParseTree.cpp | ||
| ParseTree.h | ||
| ScfgRule.cpp | ||
| ScfgRule.h | ||
| ScfgRuleWriter.cpp | ||
| ScfgRuleWriter.h | ||
| Span.cpp | ||
| Span.h | ||
| Subgraph.cpp | ||
| Subgraph.h | ||
| XmlTreeParser.cpp | ||
| XmlTreeParser.h | ||