Hieu Hoang
89f88fdb6b
refactor parsing of args for language models
2013-08-28 11:05:47 +01:00
Lane Schwartz
08225d8e57
Re-enable backward LM code.
...
This commit updates that code to take into account Hieu's major refactoring.
Additionally, this commit re-instates changes from
commit 8459a86
(moses/LM/Jamfile, moses/LM/Ken.h, moses/LM/Ken.cpp),
commit d340218
(moses/LM/Ken.h),
commit 95e3a37
(moses/LM/Ken.h, moses/LM/Ken.cpp), and
commit aacc936
(moses/LM/Jamfile, moses/LM/Ken.cpp)
The above changes appear to have been improperly discarded
during the merge in commit 4894df6
and then again in commit 3ed17bb
.
2013-08-27 15:55:07 -04:00
Nadir Durrani
4156c7acb6
Config files
2013-08-27 13:47:09 +01:00
Nadir Durrani
40f4267373
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-08-27 13:22:39 +01:00
Nadir Durrani
cde350a009
Code to generate Operation Sequences
2013-08-27 13:22:01 +01:00
Hieu Hoang
de888f2ab4
store arbitary key-value in translation rules
2013-08-27 09:42:24 +01:00
Kenneth Heafield
1a9a964b68
presize vector
2013-08-26 23:37:37 +01:00
Kenneth Heafield
c60e953e1e
Kludgy fix to force boost libraries to be static by default
2013-08-26 23:36:53 +01:00
Kenneth Heafield
02c9d448ea
Script shouldn't trudge forward on error
2013-08-26 21:40:54 +01:00
Ulrich Germann
a58efc8ddf
Initial check-in.
2013-08-26 16:56:49 +01:00
Nadir Durrani
696c0eff61
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-08-26 13:22:57 +01:00
nadir
fb35e1f3c9
Training Scripts for Factored OSM
2013-08-26 13:21:04 +01:00
phikoehn
2e53bda77a
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2013-08-25 20:30:52 +01:00
phikoehn
79a2c98ff7
better ems support for different binarizers and reordering models
2013-08-25 20:30:37 +01:00
Nadir Durrani
1444837ff9
Factored-based OSM
2013-08-25 13:23:42 +01:00
Hieu Hoang
f544d3aced
mark with LEGACY
2013-08-23 21:34:10 +01:00
Hieu Hoang
83df3629a9
mark GetTargetPhraseCollectionNonCache with LEGACY
2013-08-23 21:08:53 +01:00
Hieu Hoang
de9decc30d
mark GetTargetPhraseCollection with LEGACY
2013-08-23 21:02:03 +01:00
Hieu Hoang
5625f37eb1
delete ChartBasedFeatureContext
2013-08-23 15:00:47 +01:00
Hieu Hoang
3ad3cd9004
delete ChartBasedFeatureContext
2013-08-23 14:39:42 +01:00
Hieu Hoang
1d653c87aa
delete PhraseBasedFeatureContext
2013-08-23 14:25:25 +01:00
Hieu Hoang
4dfb625536
beautify
2013-08-23 13:53:30 +01:00
Hieu Hoang
0613d98beb
delete PhraseBasedFeatureContext
2013-08-23 13:38:31 +01:00
Kenneth Heafield
9186ae2d82
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-22 10:21:37 +01:00
Kenneth Heafield
c4dc57f8a3
swap
2013-08-22 10:16:24 +01:00
Kenneth Heafield
6b5c1a09e4
unwind library, cleanup
2013-08-22 10:16:12 +01:00
Hieu Hoang
5accd5f2e5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-22 09:24:58 +01:00
Hieu Hoang
21c91dede2
delete GetWordPenaltyProducer(). Need non-const version only for mira
2013-08-22 09:24:46 +01:00
Hieu Hoang
734c546c86
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-21 15:58:27 +01:00
Hieu Hoang
fcf426a098
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 15:58:17 +01:00
Kenneth Heafield
37c22cd4da
Also use unwind for for tcmalloc
2013-08-21 14:29:00 +01:00
Kenneth Heafield
74dcf5792d
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-21 10:17:06 +01:00
Kenneth Heafield
b1d7340b78
Add --full-tcmalloc to link against the non-minimal tcmalloc library
2013-08-21 10:16:33 +01:00
Hieu Hoang
9e60195995
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5
caching error for compact pt
2013-08-20 16:06:48 +01:00
Hieu Hoang
c60608a760
Merge pull request #44 from jgwinnup/master
...
Fixed bug in tokenizer.perl where comma separated lists of single characters aren't handled correctly, updated Russian NBP list
2013-08-17 05:09:19 -07:00
Jeremy Gwinnup
a5fb4d1550
Fixed bug in tokenizer.perl where comma separated lists of single
...
characters aren't handled correctly
input> A,B,C,D,E,F
yielded> A, B,C , D,E , F
now yields> A, B, C, D, E, F
Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
Hieu Hoang
51ac2d6567
Merge branch 'hieu_opt_input' of ../hh
2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38
prevent segfault in OSM model when used in factored model with decomposed phrase-tables
2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417
caching for Marcin's phrase table
2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc
add method to reduce cache size
2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d
caching target phrase for OnDisk pt
2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1
caching target phrase for OnDisk pt
2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef
caching target phrase for OnDisk pt
2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca
Merge ../mosesdecoder into hieu_opt_input
2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9
Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input
2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde
Merge branch 'master' of github.com:hieuhoang/mosesdecoder
2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243
delete duplicate parameter
2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c
Merge pull request #43 from jgwinnup/master
...
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59
beautify
2013-08-15 21:14:04 +01:00