moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 15:04:05 +03:00
Code Issues Packages Projects Releases Wiki Activity
9,811 Commits 136 Branches 26 Tags 147 MiB
9d4f1c8555
Commit Graph

1347 Commits

Author SHA1 Message Date
Lane Schwartz
8ffdf3ab99 Fixed interaction of --install-scripts and --git 2012-08-09 11:04:24 -04:00
Hieu Hoang
3aa66aeab6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-09 12:22:54 +01:00
Lane Schwartz
2556dfc0e5 If --install-scripts is provided with no argument, install to $prefix/scripts 
If --prefix is specified, but --install-scripts is not, do not install scripts
 2012-08-08 16:50:33 -04:00
Lane Schwartz
da5429318b KenLM maximum n-gram order can now be set via a compile-time flag 2012-08-08 16:22:13 -04:00
Lane Schwartz
c55931f352 If --prefix is specified, but --install-scripts is not, install scripts in $prefix/scripts 2012-08-08 14:43:36 -04:00
Hieu Hoang
a8117c0afd redirect more to stderr. Split input extract files every 50m lines, instead of 10m lines 2012-08-08 14:15:31 +01:00
Hieu Hoang
efdb983e0c redirect parallel scoring to standard err, appending to existing 2012-08-07 15:38:42 +01:00
Kenneth Heafield
44c64476ec Remove dead --with-giza option 2012-08-03 20:19:27 -04:00
Hieu Hoang
b71760177e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-01 17:03:25 +01:00
annirvine
9c5557f752 mert-moses.pl regex fixed to handle scientific notation 2012-07-31 14:56:43 -04:00
Hieu Hoang
431a4f19f1 delete temporary files 2012-07-31 15:05:18 +01:00
Hieu Hoang
a1ab8e354a cleanup of variables. Need to delete temporary files 2012-07-31 02:21:48 +01:00
Hieu Hoang
d8daac9bb4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-19 22:22:53 +01:00
Hieu Hoang
d57216575a undo changes to make scripts handle directories with spaces. Karel gave up, and it messing up cruise control 2012-07-19 22:21:41 +01:00
Hieu Hoang
23bbf12752 redirect stderr from extract program to stderr of script that runs it, for easier debugging 2012-07-18 22:53:47 +01:00
Hieu Hoang
f0a3e67717 redirect stderr from extract program to stderr of script that runs it, for easier debugging. Recursive create of output directory, in case output directory doesn't exist 2012-07-18 22:33:49 +01:00
Hieu Hoang
8206950336 under changes to make scripts handle directories with spaces. 2012-07-18 22:06:45 +01:00
Hieu Hoang
b609473645 under changes to make scripts handle directories with spaces. Karel gave up, and it messing up cruise control 2012-07-18 11:02:24 +01:00
Barry Haddow
2b4e61d826 Merge branch 'trunk' into miramerge 
Compiles, not tested.

Conflicts:
	Jamroot
	OnDiskPt/PhraseNode.h
	OnDiskPt/TargetPhrase.cpp
	OnDiskPt/TargetPhrase.h
	OnDiskPt/TargetPhraseCollection.cpp
	mert/BleuScorer.cpp
	mert/Data.cpp
	mert/FeatureData.cpp
	moses-chart-cmd/src/Main.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartManager.cpp
	moses/src/LM/Ken.cpp
	moses/src/LM/Ken.h
	moses/src/LMList.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionaryTree.h
	moses/src/ScoreIndexManager.h
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/Word.cpp
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-07-17 13:36:50 +01:00
Karel Bílek
bc64284b31 Merge remote-tracking branch 'upstream/master' 2012-07-17 04:37:16 +02:00
Karel Bílek
ad257b27d9 spaces in filepath does not wreak havoc anymore 2012-07-17 04:36:27 +02:00
Karel Bílek
f461dc3e96 czech prefixes 2012-07-14 03:32:10 +02:00
Rico Sennrich
bed4bc08ad distortion limit for recaser should be 0 2012-07-11 16:57:05 +02:00
Rico Sennrich
be1f959a1a truecase corpus before training recaser 
gives better results in (small) test, and the code already had a placeholder for it.
(without truecasing, the recaser is more likely to uppercase words like "the" if they are often sentence-initial in the training corpus)

If people don't want the default behavior changed, I can disable truecasing by default and add a command line parameter to enable it.
 2012-07-11 16:27:00 +02:00
Hieu Hoang
8180181a89 Merge https://github.com/moses-smt/mosesdecoder 2012-07-10 09:19:31 +01:00
Hieu Hoang
7d982bcd8e comments 2012-07-10 09:18:37 +01:00
Ales Tamchyna
0594a7706d fixed off-by-one bug 2012-07-06 14:18:39 -04:00
Ales Tamchyna
19d8afe7df adding reduce-topt-count.pl, filters translation options that will be discarded by the decoder 2012-07-06 13:48:05 -04:00
Hieu Hoang
8d57651d0f move mert-moses-multi.pl 2012-07-06 12:58:06 +01:00
phikoehn
61b9d91b22 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-07-06 05:14:03 +01:00
phikoehn
51589a25e7 fix for leading, trailing, and multiple spaces, suggested by Yang Gao 2012-07-06 05:12:50 +01:00
Barry Haddow
afd654eb74 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-05 21:02:15 +01:00
Barry Haddow
278ec10603 Add warning 2012-07-05 21:01:59 +01:00
Eva Hasler
f592c222fe revert mode changes 2012-07-04 12:25:21 +01:00
Eva Hasler
027a20730e merge Jamfiles 2012-07-04 11:49:07 +01:00
phikoehn
34c07e0ca8 bug fix 2012-07-03 20:01:59 +01:00
phikoehn
c8b2e89573 integrated sparse lexical features into experiment.perl, needs some more testing. 2012-07-03 06:20:09 +01:00
phikoehn
ff79f9f054 fix conflict 
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder

Conflicts:
	scripts/ems/experiment.perl
 2012-07-03 00:05:13 +01:00
phikoehn
ce65a47f0d count bin feature 2012-07-03 00:00:21 +01:00
phikoehn
cce3f03f75 count bin feature 2012-07-02 23:59:17 +01:00
Hieu Hoang
dea9e778a2 bug creating filtering script when using factored model 2012-07-02 20:07:17 +01:00
Pidong Wang
eecefbede6 add multi-threading feature to the tokenizer.perl 2012-06-30 23:04:09 +08:00
Hieu Hoang
3a44cd3f69 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-28 18:35:57 -04:00
Hieu Hoang
62321765a3 change to install of tokenizer files. Thanks to Tom Hoar 2012-06-28 18:35:27 -04:00
Ales Tamchyna
4c6d2e7b88 updated path to mert in mert-moses.pl 2012-06-28 08:56:06 -04:00
phikoehn
462f5f992d bug fix 2012-06-28 13:03:41 +01:00
phikoehn
6af0b62b8a bug fix 2012-06-26 22:49:59 +01:00
Hieu Hoang
93bff3f201 lock m_vocab variable access in Encode() and Lookup(). Other functions are still not threadsafe 2012-06-26 13:33:34 -04:00
Hieu Hoang
debe090426 Change Bin to RealBin. Thanks to Tom Hoar 2012-06-26 11:57:23 -04:00
phikoehn
7cd8356752 minor bug fixes 2012-06-25 23:38:46 +01:00
phikoehn
135e38d355 escape bar character with proper html escape sequence 2012-06-25 23:37:59 +01:00
phikoehn
765e789c0c Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-06-25 23:37:28 +01:00
phikoehn
9bbe553a86 allow nbest distinct in experiment.perl 2012-06-25 23:37:01 +01:00
Hieu Hoang
5a7db584b8 Merge https://github.com/moses-smt/mosesdecoder 2012-06-16 00:46:03 +01:00
Christophe Servan
04f10eba6d Add some comments to take account of previous Hieu's move of the c++ code from the training directory to the root directory 2012-06-16 00:53:28 +03:00
Colin Cherry
07a5c67ebc Merge branch 'master' into miramerge 
Conflicts:
	Jamroot
	misc/queryPhraseTable.cpp
	scripts/training/train-model.perl
 2012-06-14 17:08:16 -04:00
Colin Cherry
742f2d047f Fixed a bug in --return-best-dev 2012-06-12 23:02:04 -04:00
Colin Cherry
4d284b25ad Added --return-best-dev to mert-moses.pl 
Copies the run*.moses.ini with the highest development BLEU to
moses.ini, instead of copying the weights from the last run of
optimization.
Recommended when using kbmira (and probably pro).
 2012-06-12 09:16:11 -04:00
Hieu Hoang
eaefd61bc9 minor warning 2012-06-08 17:30:40 +01:00
Hieu Hoang
0e621fe2d3 gzip grammar files 2012-06-08 00:43:47 +01:00
Hieu Hoang
22c038d93a take out debugging info 2012-06-08 00:20:49 +01:00
Hieu Hoang
01b84656bf default pt implementation if no phrase table specified 2012-06-08 00:19:56 +01:00
Hieu Hoang
82ca9fba69 delete example suffix array files 2012-06-07 19:40:10 +01:00
Hieu Hoang
03ce774d0e suffix array creation script also creates glue grammar 2012-06-07 19:37:11 +01:00
Hieu Hoang
66800a3907 various filtered moses.ini work now 2012-06-07 18:43:51 +01:00
Hieu Hoang
842d1cb6fd Merge github.com:moses-smt/mosesdecoder 2012-06-07 17:54:11 +01:00
Hieu Hoang
21c80f4fbe pass number of ff from experiment.perl to train-model.perl for suffix array only 2012-06-07 17:53:52 +01:00
Hieu Hoang
5b7a9d5375 warning - undefined variablr 2012-06-07 16:14:12 +01:00
Hieu Hoang
e9c33669eb apply previous commit to TUNING:filter step 2012-06-07 16:01:19 +01:00
Hieu Hoang
05fc5ffce3 phrase table type deduced in experiment.perl. Passed to train-model.perl 2012-06-07 15:46:58 +01:00
Eva Hasler
e1c1a5343c merge 2012-06-07 11:16:52 +01:00
Hieu Hoang
0b59bee21c sa extraction works 2012-06-06 19:17:21 +01:00
Hieu Hoang
797b36a73a change output of build-suffix-array step to phrase-table. 2012-06-06 18:47:27 +01:00
Hieu Hoang
156b5db0fe Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-06 15:52:03 +01:00
Hieu Hoang
86a1886cb4 get rid of mention of --with-giza arg 2012-06-05 18:15:43 +01:00
Barry Haddow
175cd5754c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-03 22:36:15 +01:00
Barry Haddow
25f5def387 Fix for case where no ttable is to be created 2012-06-03 22:03:41 +01:00
Tetsuo Kiso
35f4da44b8 Add a flag to set Batch MIRA's hyperparameters to mert-moses.pl. 
- Add the descriptions to the usage.
- Initialize the variable $sum.
- Close file handle.
 2012-06-02 19:55:56 +09:00
Hieu Hoang
c6756f8301 start integrating adam's suffix array 2012-06-01 19:28:22 +01:00
Hieu Hoang
f0f4893a3d start integrating adam's suffix array 2012-06-01 16:18:34 +01:00
Hieu Hoang
86666c2a1f start integrating adam's suffix array 2012-06-01 16:06:37 +01:00
Hieu Hoang
7e546e1529 -external-bin-dir is not required if not running mkcls or giza/mgiza. Convert relative to absoluate paths using File::Spec::Unix 2012-06-01 14:11:38 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Hieu Hoang
417d5ee57b move biconcor to / 2012-05-31 23:32:24 +01:00
Hieu Hoang
48faedb3bd move giza2bal.pl back into script/training 2012-05-31 18:04:29 +01:00
Hieu Hoang
a5ca652a76 move c++ code out of /script/ to / 2012-05-31 17:58:10 +01:00
Hieu Hoang
4eef94b121 move c++ code out of /script/ to / 2012-05-31 17:24:06 +01:00
Hieu Hoang
b57aff1947 rename train-model.perl 2012-05-31 16:59:54 +01:00
Hieu Hoang
fba6128ae2 update examples 2012-05-31 16:55:10 +01:00
Hieu Hoang
220ee4cd36 add -external-bin-dir for giza++/mgiza directory. Ignore -bin-dir and -script-root-dir 2012-05-31 16:52:37 +01:00
Hieu Hoang
c80ac7d7e4 update examples 2012-05-31 14:46:38 +01:00
Hieu Hoang
465c5cbf97 move all executables into bin 2012-05-31 12:55:05 +01:00
Colin Cherry
3c44d04baf Merge branch 'master' into miramerge 
Conflicts:
	Jamroot
	mert/FeatureStats.cpp
	moses-cmd/src/IOWrapper.h
	scripts/training/mert-moses.pl
	scripts/training/train-model.perl.missing_bin_dir
 2012-05-30 12:39:53 -04:00
Hieu Hoang
d25805858d xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution 2012-05-30 13:04:02 +01:00
Hieu Hoang
21cd9e6286 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-30 09:53:02 +01:00
phikoehn
2e370ed11b more escaping in tokenizer; wrapper for berkeley parser (german) 2012-05-30 00:58:18 +01:00
Hieu Hoang
c85b96a6c6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-29 19:14:49 +01:00
Colin Cherry
fd577d7a65 Batch k-best MIRA is written and integrated into mert-moses.pl 
Regression tests all check out, and kbmira seems to work fine
on a Hansard French->English task.

HypPackEnumerator class may be of interest to pro.cpp and future
optimizers, as it abstracts a lot of the boilerplate involved in
enumerating multiple k-best lists.

MiraWeightVector is not really mira-specific - just a weight vector
that enables efficient averaging. Could be useful to a perceptron
as well. Same goes for MiraFeatureVector.

Interaction with sparse features is written, but untested.
 2012-05-29 13:38:57 -04:00
Hieu Hoang
ac764f9dce Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-29 15:29:33 +01:00
phikoehn
6d1165654c script updates and added ems config help 2012-05-28 20:15:58 +01:00
Hieu Hoang
ef26388aff eclipse project 2012-05-28 17:29:46 +01:00
Phil Williams
db1e6040b2 Fix bug in previous commit. 2012-05-27 17:58:13 +01:00
Phil Williams
e3e62846bf train-model.perl: add -alt-direct-rule-score-1 and 
-alt-direct-rule-score-2 options, which use either
p(RHS_t|RHS_s,LHS) or p(LHS,RHS_t|RHS_s), respectively,
as a grammar rule's direct translation score.
 2012-05-27 12:43:16 +01:00
Phil Williams
82580280bc Fix compile error by using std::size_t instead of size_t. 
Thanks to Tomas Hudik for reporting that.
 2012-05-26 13:13:23 +01:00
Hieu Hoang
7b0d04f341 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-26 12:29:45 +01:00
Hieu Hoang
cae4f803c3 faster consolidating - redirect to stdout then zip 2012-05-26 12:27:50 +01:00
Hieu Hoang
4c90c88733 make phrase-table.half naming consistent. Requested by Phil Williams 2012-05-26 12:21:32 +01:00
Phil Williams
145df588c2 Fix some input handling bugs in pcfg-extract and pcfg-score. 2012-05-26 12:15:34 +01:00
phikoehn
07fafd51b5 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-05-26 00:10:08 +01:00
phikoehn
561b9ac956 minor fixes 2012-05-26 00:09:50 +01:00
phikoehn
180dd773f6 bolt specific settings 2012-05-26 00:06:34 +01:00
Phil Williams
a72744c49b Fix bug in previous commit. 2012-05-25 17:39:21 +01:00
Phil Williams
90c0bc9f5c Add an optional PCFG scoring feature for target syntax models (similar to 
the p_cfg feature used in Marcu, Wang, Echihabi, and Knight (2006)).
 2012-05-25 17:29:47 +01:00
Hieu Hoang
b8cf0deb65 Merge github.com:moses-smt/mosesdecoder 2012-05-25 17:13:47 +01:00
Hieu Hoang
721ce923cc add -snt2cooc to train-model.perl. For giza's reduced memory snt2cooc.perl 2012-05-25 15:06:35 +01:00
Hieu Hoang
911133c38d Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2012-05-25 12:44:21 +01:00
Hieu Hoang
fcf817fda2 add --parallel to sorting options 2012-05-25 12:42:11 +01:00
Barry Haddow
d4a2414bf0 Merge branch 'trunk' into miramerge 2012-05-25 09:59:11 +01:00
Barry Haddow
c397d2068b Merge branch 'trunk' into miramerge. Still to fix build. 
Conflicts:
	Jamroot
	mert/Data.cpp
	mert/Data.h
	mert/FeatureArray.cpp
	mert/FeatureArray.h
	mert/FeatureData.cpp
	mert/FeatureData.h
	mert/FeatureStats.cpp
	mert/FeatureStats.h
	mert/mert.cpp
	moses-chart-cmd/src/IOWrapper.h
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses/src/GlobalLexicalModel.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/ScoreIndexManager.h
	moses/src/TargetPhrase.h
	regression-testing/tests/phrase.lexicalized-reordering-bin/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering-cn/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering/truth/results.txt
	regression-testing/tests/phrase.multiple-translation-system-lr/truth/results.txt
	regression-testing/tests/phrase.show-weights.lex-reorder/truth/results.txt
	regression-testing/tests/phrase.show-weights/truth/results.txt
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/filter-model-given-input.pl
	scripts/training/mert-moses.pl
 2012-05-24 21:11:35 +01:00
Hieu Hoang
042a9cca8d delete pt.half after use 2012-05-24 17:10:55 +01:00
Hieu Hoang
2b8eeac75e Minor error 2012-05-24 16:47:40 +01:00
Hieu Hoang
e42f8d36ae parallel scoring 2012-05-24 15:20:23 +01:00
Hieu Hoang
d979b4454d parallel scoring 2012-05-24 15:05:23 +01:00
Hieu Hoang
f91b19fa41 Works with phrase-table scoring 2012-05-23 19:26:37 +01:00
Hieu Hoang
f33538ea55 Works with phrase-table scoring 2012-05-23 19:12:23 +01:00
Hieu Hoang
761ac4f0fc parallel extract. Works with reordering 2012-05-23 19:02:36 +01:00
Hieu Hoang
ce3ad73ebf coc filename determined from phrase-table.half name, rather than passed as argument 2012-05-23 17:20:40 +01:00
Hieu Hoang
349409d1c6 GZip scoring on the fly 2012-05-23 16:38:31 +01:00
Hieu Hoang
3de14f6279 Gzip phrase-table.half.e2f.sorted on the fly 2012-05-23 15:55:03 +01:00
Hieu Hoang
947bee50b3 GZip extract.sorted 2012-05-23 15:36:34 +01:00
Hieu Hoang
3d67e33b9e GZip extract on the fly 2012-05-23 15:10:21 +01:00
Hieu Hoang
ba99159763 Gzip consolidate on the fly 2012-05-23 14:41:49 +01:00
Hieu Hoang
6a563e2fca rollback parallel training and zipping. Zipping slows it done. A LOT. Redo more carefully 2012-05-23 13:04:02 +01:00
Hieu Hoang
89c8d5643d rollback parallel training and zipping. Zipping slows it done. A LOT. Redo more carefully 2012-05-23 13:04:02 +01:00
phikoehn
66548574fe Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-05-23 05:08:59 +01:00
phikoehn
c4a6e1eedd Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-05-23 05:08:59 +01:00
phikoehn
657b80177a increased robustness: tolerate empty trees and alignment lines 2012-05-23 05:06:32 +01:00
phikoehn
07daeff292 increased robustness: tolerate empty trees and alignment lines 2012-05-23 05:06:32 +01:00
Christophe Servan
858f7428df Update scripts/training/mert-moses-multi.pl 2012-05-22 18:49:23 +03:00
Christophe Servan
41133e22af Update scripts/training/mert-moses-multi.pl 2012-05-22 18:49:23 +03:00
Christophe Servan
dd527f9c55 fix some bugs at feature and score file creation 2012-05-22 18:47:58 +03:00
Christophe Servan
c508456c91 fix some bugs at feature and score file creation 2012-05-22 18:47:58 +03:00
Eva Hasler
1d50838395 add mteval-v13a.pl 2012-05-18 19:10:37 +01:00
Hieu Hoang
776dd7856e add script to reverse word alignment 2012-05-17 17:59:48 +01:00
Hieu Hoang
05acaf15e8 add script to reverse word alignment 2012-05-17 17:59:48 +01:00
hieu
8e64ae94c8 link error 2012-05-16 10:13:25 +01:00
hieu
cd5d84f800 link error 2012-05-16 10:13:25 +01:00
Phil Williams
f0d4b37255 Add --GZOutput option to extract-ghkm. 2012-05-15 20:00:38 +01:00
Phil Williams
ab8a10daf2 Add --GZOutput option to extract-ghkm. 2012-05-15 20:00:38 +01:00
Hieu Hoang
d04420a65d Begin integrating Adam's suffix arrays into EMS 2012-05-14 19:44:53 +01:00
Hieu Hoang
1008b7c27b Begin integrating Adam's suffix arrays into EMS 2012-05-14 19:44:53 +01:00
Hieu Hoang
92fe4ac1af Begin integrating Adam's suffix arrays into EMS 2012-05-14 18:56:10 +01:00
Hieu Hoang
93d0cc8313 Begin integrating Adam's suffix arrays into EMS 2012-05-14 18:56:10 +01:00
Hieu Hoang
b018a65f30 use sort args in extract-parallel too. Change hiero extraction to new procedure too 2012-05-13 19:23:10 +01:00
Hieu Hoang
444d568355 use sort args in extract-parallel too. Change hiero extraction to new procedure too 2012-05-13 19:23:10 +01:00
Hieu Hoang
db445d92f8 add -sort-compress arg to train-model.perl. Wrapper for gsort --compress-program 2012-05-13 11:06:02 +01:00
Hieu Hoang
6095a36afb add -sort-compress arg to train-model.perl. Wrapper for gsort --compress-program 2012-05-13 11:06:02 +01:00
Hieu Hoang
299e0555b9 use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:54:08 +01:00
Hieu Hoang
cb4d4b28cb use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:54:08 +01:00
Hieu Hoang
e74f67abc5 use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:23:59 +01:00
Hieu Hoang
2e0c1d9d0a use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:23:59 +01:00
Hieu Hoang
066c209fcb use new gzipped extract file. Always save extract files already sorted 2012-05-12 15:41:07 +01:00
Hieu Hoang
1d6123ab22 use new gzipped extract file. Always save extract files already sorted 2012-05-12 15:41:07 +01:00
Hieu Hoang
9c6c2ad84a write gzipped files if filename is *.gz. 2012-05-11 23:41:51 +01:00
Hieu Hoang
d919e5a85f write gzipped files if filename is *.gz. 2012-05-11 23:41:51 +01:00
Hieu Hoang
ea8d6ed94e gzip output files from consolidate 2012-05-11 18:28:59 +01:00
Hieu Hoang
83423a2f93 gzip output files from consolidate 2012-05-11 18:28:59 +01:00
Hieu Hoang
de8a2e7667 gzip output files from extract-rules 2012-05-11 18:18:01 +01:00
Hieu Hoang
745351a890 gzip output files from extract-rules 2012-05-11 18:18:01 +01:00
Hieu Hoang
8ff5030e33 gzip output files from extract 2012-05-11 18:10:54 +01:00
Hieu Hoang
402f705b49 gzip output files from extract 2012-05-11 18:10:54 +01:00
Hieu Hoang
069d24e9f5 zipped output file 2012-05-11 12:25:20 +01:00
Hieu Hoang
e5907c0efc zipped output file 2012-05-11 12:25:20 +01:00
Hieu Hoang
283ae161a6 zipped output file 2012-05-11 12:20:49 +01:00
Hieu Hoang
35e06c7415 zipped output file 2012-05-11 12:20:49 +01:00
Hieu Hoang
abf13f7e47 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-11 12:18:17 +01:00
Hieu Hoang
4816cbe74a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-11 12:18:17 +01:00
Hieu Hoang
269aecccd0 zipped output file 2012-05-11 12:18:02 +01:00
Hieu Hoang
1b04b5544b zipped output file 2012-05-11 12:18:02 +01:00
Christian Federmann
9b5a4278b7 Rolled back unnecessary gzFile casts. 2012-05-11 08:41:55 +02:00
Christian Federmann
1b666bdf01 Rolled back unnecessary gzFile casts. 2012-05-11 08:41:55 +02:00
Hieu Hoang
5fb97e4d58 closing gz file 2012-05-10 23:49:15 +01:00
Hieu Hoang
ebc33f63e9 closing gz file 2012-05-10 23:49:15 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Hieu Hoang
2816586584 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:58:28 +01:00
Hieu Hoang
a1721d9801 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:58:28 +01:00
Kenneth Heafield
55038fb959 And InputFileStream too 2012-05-10 12:56:52 -04:00
Kenneth Heafield
947a17aa4c And InputFileStream too 2012-05-10 12:56:52 -04:00
Hieu Hoang
7473514b56 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:52:06 +01:00
Hieu Hoang
c40b420826 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:52:06 +01:00
Kenneth Heafield
8e187d521e Extract AlignmentPhrase.o used in multiple places. 2012-05-10 12:49:14 -04:00
Kenneth Heafield
7a3750a204 Extract AlignmentPhrase.o used in multiple places. 2012-05-10 12:49:14 -04:00
Hieu Hoang
d00dab903d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:44:09 +01:00
Hieu Hoang
a3b8af29b1 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:44:09 +01:00
Kenneth Heafield
7db07c260b Extract tables-core.o to prevent it from being compiled with and without boost macros. Also, kill a use of SafeGetline. 2012-05-10 12:42:56 -04:00
Kenneth Heafield
3c3aa84c5d Extract tables-core.o to prevent it from being compiled with and without boost macros. Also, kill a use of SafeGetline. 2012-05-10 12:42:56 -04:00
Hieu Hoang
a528624167 xcode 2012-05-10 17:28:30 +01:00
Hieu Hoang
b56f6df98c xcode 2012-05-10 17:28:30 +01:00
Hieu Hoang
f328b141ff Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:20:49 +01:00
Hieu Hoang
173bfd5e08 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:20:49 +01:00