Commit Graph

10899 Commits

Author SHA1 Message Date
Hieu Hoang
89f88fdb6b refactor parsing of args for language models 2013-08-28 11:05:47 +01:00
Lane Schwartz
08225d8e57 Re-enable backward LM code.
This commit updates that code to take into account Hieu's major refactoring.

Additionally, this commit re-instates changes from
commit 8459a86 (moses/LM/Jamfile, moses/LM/Ken.h, moses/LM/Ken.cpp),
commit d340218 (moses/LM/Ken.h),
commit 95e3a37 (moses/LM/Ken.h, moses/LM/Ken.cpp), and
commit aacc936 (moses/LM/Jamfile, moses/LM/Ken.cpp)

The above changes appear to have been improperly discarded
during the merge in commit 4894df6 and then again in commit 3ed17bb.
2013-08-27 15:55:07 -04:00
Nadir Durrani
4156c7acb6 Config files 2013-08-27 13:47:09 +01:00
Nadir Durrani
40f4267373 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-08-27 13:22:39 +01:00
Nadir Durrani
cde350a009 Code to generate Operation Sequences 2013-08-27 13:22:01 +01:00
Hieu Hoang
de888f2ab4 store arbitary key-value in translation rules 2013-08-27 09:42:24 +01:00
Kenneth Heafield
1a9a964b68 presize vector 2013-08-26 23:37:37 +01:00
Kenneth Heafield
c60e953e1e Kludgy fix to force boost libraries to be static by default 2013-08-26 23:36:53 +01:00
Kenneth Heafield
02c9d448ea Script shouldn't trudge forward on error 2013-08-26 21:40:54 +01:00
Ulrich Germann
a58efc8ddf Initial check-in. 2013-08-26 16:56:49 +01:00
Nadir Durrani
696c0eff61 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-08-26 13:22:57 +01:00
nadir
fb35e1f3c9 Training Scripts for Factored OSM 2013-08-26 13:21:04 +01:00
phikoehn
2e53bda77a Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2013-08-25 20:30:52 +01:00
phikoehn
79a2c98ff7 better ems support for different binarizers and reordering models 2013-08-25 20:30:37 +01:00
Nadir Durrani
1444837ff9 Factored-based OSM 2013-08-25 13:23:42 +01:00
Hieu Hoang
f544d3aced mark with LEGACY 2013-08-23 21:34:10 +01:00
Hieu Hoang
83df3629a9 mark GetTargetPhraseCollectionNonCache with LEGACY 2013-08-23 21:08:53 +01:00
Hieu Hoang
de9decc30d mark GetTargetPhraseCollection with LEGACY 2013-08-23 21:02:03 +01:00
Hieu Hoang
5625f37eb1 delete ChartBasedFeatureContext 2013-08-23 15:00:47 +01:00
Hieu Hoang
3ad3cd9004 delete ChartBasedFeatureContext 2013-08-23 14:39:42 +01:00
Hieu Hoang
1d653c87aa delete PhraseBasedFeatureContext 2013-08-23 14:25:25 +01:00
Hieu Hoang
4dfb625536 beautify 2013-08-23 13:53:30 +01:00
Hieu Hoang
0613d98beb delete PhraseBasedFeatureContext 2013-08-23 13:38:31 +01:00
Kenneth Heafield
9186ae2d82 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 10:21:37 +01:00
Kenneth Heafield
c4dc57f8a3 swap 2013-08-22 10:16:24 +01:00
Kenneth Heafield
6b5c1a09e4 unwind library, cleanup 2013-08-22 10:16:12 +01:00
Hieu Hoang
5accd5f2e5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 09:24:58 +01:00
Hieu Hoang
21c91dede2 delete GetWordPenaltyProducer(). Need non-const version only for mira 2013-08-22 09:24:46 +01:00
Hieu Hoang
734c546c86 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-21 15:58:27 +01:00
Hieu Hoang
fcf426a098 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 15:58:17 +01:00
Kenneth Heafield
37c22cd4da Also use unwind for for tcmalloc 2013-08-21 14:29:00 +01:00
Kenneth Heafield
74dcf5792d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-21 10:17:06 +01:00
Kenneth Heafield
b1d7340b78 Add --full-tcmalloc to link against the non-minimal tcmalloc library 2013-08-21 10:16:33 +01:00
Hieu Hoang
9e60195995 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5 caching error for compact pt 2013-08-20 16:06:48 +01:00
Hieu Hoang
c60608a760 Merge pull request #44 from jgwinnup/master
Fixed bug in tokenizer.perl where comma separated lists of single characters aren't handled correctly, updated Russian NBP list
2013-08-17 05:09:19 -07:00
Jeremy Gwinnup
a5fb4d1550 Fixed bug in tokenizer.perl where comma separated lists of single
characters aren't handled correctly

input> A,B,C,D,E,F

yielded> A, B,C , D,E , F

now yields> A, B, C, D, E, F

Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
Hieu Hoang
51ac2d6567 Merge branch 'hieu_opt_input' of ../hh 2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38 prevent segfault in OSM model when used in factored model with decomposed phrase-tables 2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417 caching for Marcin's phrase table 2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca Merge ../mosesdecoder into hieu_opt_input 2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243 delete duplicate parameter 2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c Merge pull request #43 from jgwinnup/master
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59 beautify 2013-08-15 21:14:04 +01:00