Commit Graph

4402 Commits

Author SHA1 Message Date
Hieu Hoang
e7faa978b0 comment out include to google profiler 2012-07-02 20:23:09 +01:00
Hieu Hoang
6327721ae2 Merge https://github.com/hieuhoang/mosesdecoder 2012-07-02 20:09:33 +01:00
Hieu Hoang
5d5ee9e6b1 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-02 20:09:11 +01:00
Hieu Hoang
dea9e778a2 bug creating filtering script when using factored model 2012-07-02 20:07:17 +01:00
Hieu Hoang
c0140ba2e9 more comments 2012-07-02 20:01:07 +01:00
Hieu Hoang
f5d54a4db0 test 2012-07-02 19:29:27 +01:00
Hieu Hoang
e1919e98d0 test 2012-07-02 19:25:49 +01:00
Kenneth Heafield
4ecfb9e005 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-02 12:56:40 -04:00
Kenneth Heafield
be2b2224fb Extract hack to force recompilation if arguments change 2012-07-02 12:56:14 -04:00
Hieu Hoang
75e038f4cf create namespace for all classes 2012-07-02 17:05:11 +01:00
Oliver Wilson
5e624b522c Merge branch 'master' into asynclm 2012-07-02 16:00:05 +01:00
Oliver Wilson
65ddbf30b7 Implement batched LM requests. 2012-07-02 15:57:54 +01:00
Hieu Hoang
b5aa04feb7 compile error 2012-07-02 10:23:26 +01:00
Rico Sennrich
ea4d0a4785 fix encoding issue
Error that occurred for phrase tables without phrase alignment:

  File "tmcombine.py", line 377, in write_phrase_table
    line = b"%s ||| %s ||| %s 2.718 %s||| %s ||| %s\n" %(src,target,features,origin_features,alignment,comments)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 26: ordinal not in range(128)  File "tmcombine.py", line 377, in write_phrase_table
2012-07-01 20:48:12 +02:00
Hieu Hoang
2025587439 Merge https://github.com/moses-smt/mosesdecoder 2012-06-30 21:39:55 +01:00
Hieu Hoang
121e258e84 namespace all classes in mert directory 2012-06-30 21:39:10 +01:00
Hieu Hoang
e3dd3a8d2c namespace all classes in mert directory 2012-06-30 20:23:45 +01:00
Hieu Hoang
1cf1c2e515 create namespace for all classes in phrase-extract 2012-06-30 16:56:53 +01:00
Pidong Wang
eecefbede6 add multi-threading feature to the tokenizer.perl 2012-06-30 23:04:09 +08:00
Hieu Hoang
ef9db932aa add namespace to phrase-extract 2012-06-30 15:43:47 +01:00
Hieu Hoang
b1ce27d01f commented all classes in OnDiskPt and moses-cmd 2012-06-28 23:19:28 -04:00
Hieu Hoang
85624125ce commented all classes in OnDiskPt and moses-chart-cmd. Leave ken's lm directory 2012-06-28 20:14:45 -04:00
Hieu Hoang
647e320629 commented all classes in OnDiskPt and moses-chart-cmd. Leave ken's lm directory 2012-06-28 20:12:31 -04:00
Hieu Hoang
8476b6a771 Merge https://github.com/moses-smt/mosesdecoder 2012-06-28 18:36:15 -04:00
Hieu Hoang
3a44cd3f69 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-28 18:35:57 -04:00
Hieu Hoang
7e47845ad7 Merge https://github.com/moses-smt/mosesdecoder 2012-06-28 18:35:42 -04:00
Hieu Hoang
62321765a3 change to install of tokenizer files. Thanks to Tom Hoar 2012-06-28 18:35:27 -04:00
Hieu Hoang
f2878bcdeb commented all classes in moses lib 2012-06-28 18:29:46 -04:00
Kenneth Heafield
c7e02eb677 KenLM e3b5c55910 including rest costs for probing 2012-06-28 10:58:59 -04:00
Kenneth Heafield
f6b3354f39 unistd.h for gcc 4.7.0 2012-06-28 09:20:34 -04:00
Ales Tamchyna
4c6d2e7b88 updated path to mert in mert-moses.pl 2012-06-28 08:56:06 -04:00
phikoehn
462f5f992d bug fix 2012-06-28 13:03:41 +01:00
Hieu Hoang
ed18b2191d comment classes A-M with doxygen-compatible comments. Lots of @todo 2012-06-26 19:45:02 -04:00
phikoehn
6af0b62b8a bug fix 2012-06-26 22:49:59 +01:00
Colin Cherry
65df386581 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2012-06-26 17:07:27 -04:00
Colin Cherry
58c3280c2c HypPackEnumerator now stores MiraFeatureVectors, as opposed to
FeatureDataItems. Uses roughly half the memory.
2012-06-26 17:02:32 -04:00
Barry Haddow
1013634d33 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-26 21:30:29 +01:00
Hieu Hoang
3c7b7ac9f5 rollback 2012-06-26 16:31:38 -04:00
Hieu Hoang
a4f69bb187 xcode for threaded mert 2012-06-26 16:30:17 -04:00
Barry Haddow
2021545d48 update to use git repo 2012-06-26 21:30:11 +01:00
Colin Cherry
32299593fa Added debugging info to kbmira. 2012-06-26 16:29:20 -04:00
Hieu Hoang
fbd54800c6 Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2012-06-26 13:35:06 -04:00
Hieu Hoang
153e80053c lock m_vocab variable access in Encode() and Lookup(). Other functions are still not threadsafe 2012-06-26 13:33:50 -04:00
Hieu Hoang
93bff3f201 lock m_vocab variable access in Encode() and Lookup(). Other functions are still not threadsafe 2012-06-26 13:33:34 -04:00
Hieu Hoang
87e2ec0762 move tokenizer data to share folder. Thanks to Tom Hoar 2012-06-26 12:20:46 -04:00
Hieu Hoang
272f39a487 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-26 11:57:34 -04:00
Hieu Hoang
debe090426 Change Bin to RealBin. Thanks to Tom Hoar 2012-06-26 11:57:23 -04:00
Hieu Hoang
c1f0944da8 change to . Thanks to Tom Hoar 2012-06-26 11:54:16 -04:00
phikoehn
7cd8356752 minor bug fixes 2012-06-25 23:38:46 +01:00
phikoehn
135e38d355 escape bar character with proper html escape sequence 2012-06-25 23:37:59 +01:00