Hieu Hoang
4dfb625536
beautify
2013-08-23 13:53:30 +01:00
Hieu Hoang
0613d98beb
delete PhraseBasedFeatureContext
2013-08-23 13:38:31 +01:00
Kenneth Heafield
9186ae2d82
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-22 10:21:37 +01:00
Kenneth Heafield
c4dc57f8a3
swap
2013-08-22 10:16:24 +01:00
Kenneth Heafield
6b5c1a09e4
unwind library, cleanup
2013-08-22 10:16:12 +01:00
Hieu Hoang
5accd5f2e5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-22 09:24:58 +01:00
Hieu Hoang
21c91dede2
delete GetWordPenaltyProducer(). Need non-const version only for mira
2013-08-22 09:24:46 +01:00
Hieu Hoang
734c546c86
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-21 15:58:27 +01:00
Hieu Hoang
fcf426a098
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 15:58:17 +01:00
Kenneth Heafield
37c22cd4da
Also use unwind for for tcmalloc
2013-08-21 14:29:00 +01:00
Kenneth Heafield
74dcf5792d
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-08-21 10:17:06 +01:00
Kenneth Heafield
b1d7340b78
Add --full-tcmalloc to link against the non-minimal tcmalloc library
2013-08-21 10:16:33 +01:00
Hieu Hoang
9e60195995
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5
caching error for compact pt
2013-08-20 16:06:48 +01:00
Hieu Hoang
c60608a760
Merge pull request #44 from jgwinnup/master
...
Fixed bug in tokenizer.perl where comma separated lists of single characters aren't handled correctly, updated Russian NBP list
2013-08-17 05:09:19 -07:00
Jeremy Gwinnup
a5fb4d1550
Fixed bug in tokenizer.perl where comma separated lists of single
...
characters aren't handled correctly
input> A,B,C,D,E,F
yielded> A, B,C , D,E , F
now yields> A, B, C, D, E, F
Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
Hieu Hoang
51ac2d6567
Merge branch 'hieu_opt_input' of ../hh
2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38
prevent segfault in OSM model when used in factored model with decomposed phrase-tables
2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417
caching for Marcin's phrase table
2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc
add method to reduce cache size
2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d
caching target phrase for OnDisk pt
2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1
caching target phrase for OnDisk pt
2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef
caching target phrase for OnDisk pt
2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca
Merge ../mosesdecoder into hieu_opt_input
2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9
Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input
2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde
Merge branch 'master' of github.com:hieuhoang/mosesdecoder
2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243
delete duplicate parameter
2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c
Merge pull request #43 from jgwinnup/master
...
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59
beautify
2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2
minor renaming
2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07
move caching code to PhraseDictionary. Available to all phrase tables
2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5
add phrase table caching
2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af
Added option to output unknown words with prefix 'UNK'
2013-08-15 11:30:08 -04:00
Hieu Hoang
5fa6e506b1
Jamroot error
2013-08-15 15:39:40 +01:00
phikoehn
c002a81c96
fixed logic errors
2013-08-15 13:36:56 +01:00
phikoehn
b368085609
xml constraint
2013-08-15 11:46:45 +01:00
Hieu Hoang
abfe02f154
refactor input score handling to use Evaluate(inputtype, inputpath). Not a placeholder factor anymore
2013-08-14 16:53:06 +01:00
Hieu Hoang
2b030339e0
Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input
2013-08-14 12:38:26 +01:00
Hieu Hoang
8419a3af35
beautify
2013-08-14 12:37:22 +01:00
Hieu Hoang
bfdedf682b
convert weight-p to PhrasePenalty. /Nicola Bertoldi
2013-08-14 12:36:40 +01:00
Hieu Hoang
896b751066
Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input
2013-08-13 21:33:31 +01:00
Hieu Hoang
073b60db35
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:47:03 +01:00
Hieu Hoang
efc765ddff
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36
use input path for unknown word processing in phrase-based
2013-08-13 20:01:13 +01:00
Hieu Hoang
563cdc527a
use input path for unknown word processing in phrase-based
2013-08-13 19:44:52 +01:00
Hieu Hoang
dcf170a047
refactor bleu score feature function. Still segfaults when running mira
2013-08-13 16:41:35 +01:00
Hieu Hoang
3775e37ee5
refactor bleu score feature function. Still segfaults when running mira
2013-08-13 16:39:37 +01:00
Hieu Hoang
aa7eabf850
add parameter argument -feature-add for mira BLEU score feature
2013-08-13 15:34:03 +01:00
Hieu Hoang
0d60b7f2dd
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 12:16:55 +01:00
Hieu Hoang
f676100328
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 12:12:58 +01:00
