Hieu Hoang
9e60195995
patch segfault for target phrase caching. Only occurs when multithreading.
2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5
caching error for compact pt
2013-08-20 16:06:48 +01:00
Hieu Hoang
c60608a760
Merge pull request #44 from jgwinnup/master
...
Fixed bug in tokenizer.perl where comma separated lists of single characters aren't handled correctly, updated Russian NBP list
2013-08-17 05:09:19 -07:00
Jeremy Gwinnup
a5fb4d1550
Fixed bug in tokenizer.perl where comma separated lists of single
...
characters aren't handled correctly
input> A,B,C,D,E,F
yielded> A, B,C , D,E , F
now yields> A, B, C, D, E, F
Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
Hieu Hoang
51ac2d6567
Merge branch 'hieu_opt_input' of ../hh
2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38
prevent segfault in OSM model when used in factored model with decomposed phrase-tables
2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417
caching for Marcin's phrase table
2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc
add method to reduce cache size
2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d
caching target phrase for OnDisk pt
2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1
caching target phrase for OnDisk pt
2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef
caching target phrase for OnDisk pt
2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca
Merge ../mosesdecoder into hieu_opt_input
2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9
Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input
2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde
Merge branch 'master' of github.com:hieuhoang/mosesdecoder
2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243
delete duplicate parameter
2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c
Merge pull request #43 from jgwinnup/master
...
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59
beautify
2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2
minor renaming
2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07
move caching code to PhraseDictionary. Available to all phrase tables
2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5
add phrase table caching
2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af
Added option to output unknown words with prefix 'UNK'
2013-08-15 11:30:08 -04:00
Hieu Hoang
5fa6e506b1
Jamroot error
2013-08-15 15:39:40 +01:00
phikoehn
c002a81c96
fixed logic errors
2013-08-15 13:36:56 +01:00
phikoehn
b368085609
xml constraint
2013-08-15 11:46:45 +01:00
Hieu Hoang
abfe02f154
refactor input score handling to use Evaluate(inputtype, inputpath). Not a placeholder factor anymore
2013-08-14 16:53:06 +01:00
Hieu Hoang
2b030339e0
Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input
2013-08-14 12:38:26 +01:00
Hieu Hoang
8419a3af35
beautify
2013-08-14 12:37:22 +01:00
Hieu Hoang
bfdedf682b
convert weight-p to PhrasePenalty. /Nicola Bertoldi
2013-08-14 12:36:40 +01:00
Hieu Hoang
896b751066
Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input
2013-08-13 21:33:31 +01:00
Hieu Hoang
073b60db35
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:47:03 +01:00
Hieu Hoang
efc765ddff
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36
use input path for unknown word processing in phrase-based
2013-08-13 20:01:13 +01:00
Hieu Hoang
563cdc527a
use input path for unknown word processing in phrase-based
2013-08-13 19:44:52 +01:00
Hieu Hoang
dcf170a047
refactor bleu score feature function. Still segfaults when running mira
2013-08-13 16:41:35 +01:00
Hieu Hoang
3775e37ee5
refactor bleu score feature function. Still segfaults when running mira
2013-08-13 16:39:37 +01:00
Hieu Hoang
aa7eabf850
add parameter argument -feature-add for mira BLEU score feature
2013-08-13 15:34:03 +01:00
Hieu Hoang
0d60b7f2dd
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 12:16:55 +01:00
Hieu Hoang
f676100328
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 12:12:58 +01:00
Hieu Hoang
af74ee1968
delete duplicate m_inputPathMatrix in TranslationOptionList
2013-08-13 11:44:58 +01:00
Hieu Hoang
4676bca90f
minor renaming
2013-08-13 10:33:04 +01:00
Hieu Hoang
154ca336d6
separate out ChartTranslationOption into its own files
2013-08-12 19:01:06 +01:00
Hieu Hoang
9c2c862719
don't hold shared_ptr in RuleCubeItem. Hold only reference to it. Save some speed
2013-08-12 17:35:22 +01:00
Hieu Hoang
249aefc0c3
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-08-12 13:04:29 +01:00
Hieu Hoang
02c7af3fb8
Mira changes. Manually applied Eva's patch
2013-08-12 13:03:26 +01:00
Hieu Hoang
c07d8cb43f
beautify
2013-08-12 10:35:03 +01:00
Hieu Hoang
2a240b59b2
delete debug messages
2013-08-12 10:34:38 +01:00
Hieu Hoang
46fce4029c
create ChartTranslationOption class that store pointer to target phrase. Don't store target phrase itself. QUicker, but still not as quick as storing pointer to target phrase in hypo
2013-08-12 10:34:45 +01:00
Hieu Hoang
8756ad8ffd
beautify
2013-08-09 18:17:18 +01:00
Hieu Hoang
a867063a3b
convert to using shared pointers in ChartTranslationOptions
2013-08-09 18:16:31 +01:00
Hieu Hoang
4db9aa2973
convert to using shared pointers in ChartTranslationOptions
2013-08-09 15:20:45 +01:00
