Lane Schwartz
3a4e63c558
Ensure directory exists for outputting hypergraphs
2013-03-22 12:14:28 -04:00
Lane Schwartz
b2bba0bae3
Work on compression and defaults for outputting hypergraphs.
2013-03-21 16:48:47 -04:00
Lane Schwartz
28c980d58e
Allow hypergraph output to be in plain text, gzip, or bzip2.
...
The output-search-graph-hypergraph flag now takes two params:
* The first param must be "none", "gzip", or "bzip2"
* The second param is the hypergraph directory,
which must already exist
2013-03-21 15:19:31 -04:00
Lane Schwartz
22c77f7331
Work on decreasing memory requirement for outputting hypergraph
2013-03-21 12:17:49 -04:00
Hieu Hoang
2d252d2dd0
memory leak
2013-03-15 16:11:15 +00:00
Hieu Hoang
3da09b921c
memory leak
2013-03-15 12:30:39 +00:00
Hieu Hoang
21c51194fa
add -print-alignment-info
2013-03-13 12:12:33 +00:00
Lane Schwartz
ec69acf3d4
Don't open all hypergraph output files at once.
2013-03-04 12:07:37 -05:00
Lane Schwartz
8573a66da0
Close hypergraph output files.
2013-03-04 09:15:46 -05:00
Lane Schwartz
4adeb7e338
Output feature weights to a separate file when producing hypergraph
2013-02-22 16:28:48 -05:00
Lane Schwartz
04f107fbb0
Add flag to output search graph in Kenneth's hypergraph format.
2013-02-22 16:28:48 -05:00
Lane Schwartz
774ed64f2e
Work to allow output search graph in HTK standard lattice format
2013-02-22 16:28:47 -05:00
Lane Schwartz
2e6b5e7a23
Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder
2013-02-14 12:03:35 -05:00
Lane Schwartz
f9a46adc31
Specify -start-translation-id to tell Moses the line number of the first sentence
2013-02-13 15:52:40 -05:00
Hieu Hoang
1a8cd20b51
-print-id for christian buck and phi
2013-02-11 18:01:33 +00:00
Hieu Hoang
623289465c
change argument -include-alignment-in-n-best to -include-segmentation-in-n-best. Avoids confusion with word alignment
2012-11-14 16:57:33 +00:00
Hieu Hoang
f96b33de83
only include moses root when compiling
2012-11-14 13:43:04 +00:00
Hieu Hoang
0bc0b85358
resolved merge conflicts
2012-11-12 21:12:01 +00:00
Hieu Hoang
125fdbcff6
move moses-cmd/src/* to moses-cmd/
2012-11-12 20:42:29 +00:00
Hieu Hoang
44f24bd673
resolved merge conflicts
2012-11-12 20:35:32 +00:00
Hieu Hoang
6b354f1e90
move moses/src/* to moses/
2012-11-12 20:21:32 +00:00
Hieu Hoang
5e3ef23cef
move moses/src/* to moses/
2012-11-12 19:56:18 +00:00
Kenneth Heafield
1bae8e1701
Why was mira pulling in IOWrapper?
2012-11-12 18:27:38 +00:00
Kenneth Heafield
b9b2874abc
There's no need for the _lib suffix on IOWrapper. Also, why does this library exist?
2012-11-12 18:13:29 +00:00
Barry Haddow
0d26c2f521
Sync showweights order with nbest
2012-11-09 12:11:49 +00:00
Hieu Hoang
88b2f05e03
process empty lines regardless
2012-11-09 01:26:21 -08:00
Hieu Hoang
397e704b49
terminal and non-terminal word alignments stored in 2 separate objects
2012-10-19 15:10:10 +01:00
Barry Haddow
848aafb644
Merge remote branch 'github/master' into miramerge
...
Conflicts:
moses/src/AlignmentInfo.cpp
moses/src/AlignmentInfo.h
moses/src/ChartHypothesis.cpp
moses/src/ChartTrellisNode.cpp
moses/src/LM/Implementation.cpp
moses/src/LM/Ken.cpp
moses/src/TargetPhrase.cpp
moses/src/TargetPhrase.h
2012-10-08 17:54:59 +01:00
Kenneth Heafield
483e6b666b
Print usage information before exit
2012-10-05 17:49:52 +01:00
Barry Haddow
0a950ee9f4
Merge remote branch 'github/master' into miramerge
...
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.
Conflicts:
Jamroot
OnDiskPt/TargetPhrase.cpp
moses-cmd/src/Main.cpp
moses/src/AlignmentInfo.cpp
moses/src/AlignmentInfo.h
moses/src/ChartTranslationOptionCollection.cpp
moses/src/ChartTranslationOptionCollection.h
moses/src/GenerationDictionary.cpp
moses/src/Jamfile
moses/src/Parameter.cpp
moses/src/PhraseDictionary.cpp
moses/src/StaticData.cpp
moses/src/StaticData.h
moses/src/TargetPhrase.h
moses/src/TranslationSystem.cpp
moses/src/TranslationSystem.h
moses/src/Word.cpp
phrase-extract/score.cpp
regression-testing/Jamfile
scripts/ems/experiment.meta
scripts/ems/experiment.perl
scripts/training/train-model.perl
2012-09-26 22:49:33 +01:00
Barry Haddow
1ce788e2b8
Fixes for regression tests
2012-09-26 14:40:06 +01:00
Kenneth Heafield
15b0ae1aef
Single-threaded compilation fixes
2012-09-21 18:34:48 -04:00
Barry Haddow
bfae09725c
Add option to dump OOVs to file
2012-09-21 08:55:37 +01:00
Barry Haddow
54433bb221
Take notice of calc in t-option flag
2012-09-04 17:50:30 +01:00
Lane Schwartz
357845c1a4
Removed duplicate usage printout when moses is called with no parameters.
2012-09-04 17:32:55 +01:00
Jonathan Clark
6f008096ea
Use Moses' Timer class, which is based on wall-time instead of the C clock() function, which measures clock ticks used within the *process* rather than each thread. This makes timings more meaningful in multi-threaded mode. However, these timings will still be inaccurate on Windows (second-level only).
2012-08-10 15:32:00 -04:00
Hieu Hoang
97f46537b7
wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles
2012-07-30 21:07:19 +01:00
Barry Haddow
2b4e61d826
Merge branch 'trunk' into miramerge
...
Compiles, not tested.
Conflicts:
Jamroot
OnDiskPt/PhraseNode.h
OnDiskPt/TargetPhrase.cpp
OnDiskPt/TargetPhrase.h
OnDiskPt/TargetPhraseCollection.cpp
mert/BleuScorer.cpp
mert/Data.cpp
mert/FeatureData.cpp
moses-chart-cmd/src/Main.cpp
moses/src/AlignmentInfo.h
moses/src/ChartManager.cpp
moses/src/LM/Ken.cpp
moses/src/LM/Ken.h
moses/src/LMList.h
moses/src/LexicalReordering.h
moses/src/PhraseDictionaryTree.h
moses/src/ScoreIndexManager.h
moses/src/StaticData.h
moses/src/TargetPhrase.h
moses/src/Word.cpp
scripts/ems/experiment.meta
scripts/ems/experiment.perl
scripts/training/train-model.perl
2012-07-17 13:36:50 +01:00
Eva Hasler
b00e4b3115
move deps into IOWrapper_lib
2012-07-03 16:22:59 +01:00
Hieu Hoang
75e038f4cf
create namespace for all classes
2012-07-02 17:05:11 +01:00
Hieu Hoang
121e258e84
namespace all classes in mert directory
2012-06-30 21:39:10 +01:00
Hieu Hoang
b1ce27d01f
commented all classes in OnDiskPt and moses-cmd
2012-06-28 23:19:28 -04:00
Eva Hasler
e1c1a5343c
merge
2012-06-07 11:16:52 +01:00
Eva Hasler
6a6a35c65e
fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation
2012-06-01 01:49:42 +01:00
Hieu Hoang
465c5cbf97
move all executables into bin
2012-05-31 12:55:05 +01:00
Colin Cherry
3c44d04baf
Merge branch 'master' into miramerge
...
Conflicts:
Jamroot
mert/FeatureStats.cpp
moses-cmd/src/IOWrapper.h
scripts/training/mert-moses.pl
scripts/training/train-model.perl.missing_bin_dir
2012-05-30 12:39:53 -04:00
Hieu Hoang
45870348ff
xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution
2012-05-30 12:47:20 +01:00
Hieu Hoang
ef26388aff
eclipse project
2012-05-28 17:29:46 +01:00
Barry Haddow
c397d2068b
Merge branch 'trunk' into miramerge. Still to fix build.
...
Conflicts:
Jamroot
mert/Data.cpp
mert/Data.h
mert/FeatureArray.cpp
mert/FeatureArray.h
mert/FeatureData.cpp
mert/FeatureData.h
mert/FeatureStats.cpp
mert/FeatureStats.h
mert/mert.cpp
moses-chart-cmd/src/IOWrapper.h
moses-chart-cmd/src/Main.cpp
moses-cmd/src/IOWrapper.cpp
moses-cmd/src/IOWrapper.h
moses-cmd/src/Main.cpp
moses/src/GlobalLexicalModel.cpp
moses/src/Jamfile
moses/src/Parameter.cpp
moses/src/PhraseDictionary.cpp
moses/src/ScoreIndexManager.h
moses/src/TargetPhrase.h
regression-testing/tests/phrase.lexicalized-reordering-bin/truth/results.txt
regression-testing/tests/phrase.lexicalized-reordering-cn/truth/results.txt
regression-testing/tests/phrase.lexicalized-reordering/truth/results.txt
regression-testing/tests/phrase.multiple-translation-system-lr/truth/results.txt
regression-testing/tests/phrase.show-weights.lex-reorder/truth/results.txt
regression-testing/tests/phrase.show-weights/truth/results.txt
scripts/ems/experiment.meta
scripts/ems/experiment.perl
scripts/training/filter-model-given-input.pl
scripts/training/mert-moses.pl
2012-05-24 21:11:35 +01:00
Hieu Hoang
4888e114ed
Check factor is not null before outputting
2012-05-17 16:25:53 +01:00