Commit Graph

11421 Commits

Author SHA1 Message Date
Hieu Hoang
172a33c53c probing pt source vocab 2014-03-19 13:20:00 +00:00
Hieu Hoang
f4befcf125 probing pt source vocab 2014-03-19 12:59:55 +00:00
Hieu Hoang
49d3564a1b changes to probing pt v2 2014-03-19 11:39:27 +00:00
Hieu Hoang
31857c47a2 Merge branch 'master' into nikolay_probingPT 2014-02-05 17:14:51 +00:00
Rico Sennrich
d26fe4cc4d fix truecaser with XML input (didn't do anything depending on formatting/whitespace) 2014-01-29 23:01:53 +00:00
Matthias Huck
86ee3e15a4 new version of the score tool
which is now capable of dealing with additional properties in an appropriate manner
2014-01-29 18:37:42 +00:00
Kenneth Heafield
ffd62e994e Fix C++11 compilation error / Chris Dyer 2014-01-27 22:25:43 -08:00
Kenneth Heafield
14e02978fc KenLM 5cc905bc2d214efa7de2db56a9a672b749a95591
Avoid unspecified behavior of mmap when a file is resized reported by Christian Hardmeier
Fixes for Mavericks and a workaround for Boost's broken semaphore
Clean clang compile (of kenlm)

Merged some of 744376b3fb but also undid some of it because it was just masking a fundaemntal problem with pread rather than working around windows limitations
2014-01-27 16:51:35 -08:00
Hieu Hoang
b68a906fdd output list of available feature functions, separated by space, rather than lines 2014-01-25 10:58:00 +00:00
Hieu Hoang
9745924937 output list of available feature functions, separated by space, rather than lines 2014-01-25 10:39:47 +00:00
Hieu Hoang
9054df951e Merge branch 'master' of github.com:moses-smt/mosesdecoder into hieu 2014-01-24 23:00:20 +00:00
Hieu Hoang
b6d47733da remove duplicate spaces caused when XML are stripped 2014-01-24 18:09:55 +00:00
Hieu Hoang
dc3d5b8d38 source labelling for test set. 2014-01-24 16:33:30 +00:00
Hieu Hoang
878e7ab899 source labelling for tuning set. More debugging message in filtering script 2014-01-24 16:21:47 +00:00
Jie Jiang
ec55ef5fe2 windows gui code 2014-01-24 11:12:03 +00:00
Hieu Hoang
38d106bd56 everything works. Tested with en-cs. V. slow 2014-01-23 18:32:24 +00:00
Hieu Hoang
6a10f8ce71 corrected phrase-table name / type mixup when creating filtering script 2014-01-23 17:09:56 +00:00
Hieu Hoang
1a74c80cdb everything should work. Not yest tested 2014-01-23 14:24:45 +00:00
Hieu Hoang
2387f3123c bjam 2014-01-23 13:14:59 +00:00
Hieu Hoang
1aad3dfdce moved 2014-01-23 13:07:33 +00:00
Hieu Hoang
6c3b8587ba bjam 2014-01-23 00:51:03 +00:00
Hieu Hoang
5800ff848c bjam 2014-01-22 20:57:06 +00:00
Hieu Hoang
52ab05a154 set scores and alignments (almost) 2014-01-22 18:41:58 +00:00
Hieu Hoang
e505a462a7 probing hash pt compiles. Need to hook up vocab 2014-01-22 18:24:51 +00:00
Hieu Hoang
63b9eac201 integration of Nikolay's probing pt into Moses 2014-01-22 13:06:10 +00:00
Hieu Hoang
40adac9f18 Merge branch 'master' into hieu 2014-01-21 19:21:47 +00:00
Hieu Hoang
05de672bd8 need to 'label' target side too 2014-01-21 19:21:24 +00:00
Hieu Hoang
39858ce1ff leak 2014-01-21 18:07:12 +00:00
Hieu Hoang
fcadf4511a leak 2014-01-21 17:11:16 +00:00
Hieu Hoang
47c0a72842 add source labeller to EMS 2014-01-21 16:09:01 +00:00
Hieu Hoang
cd52af6273 Merge branch 'hieu' of /home/s0565741/workspace/github/mosesdecoder into hieu 2014-01-21 15:34:26 +00:00
Hieu Hoang
4bf5c04b1b Merge branch 'master' into hieu 2014-01-21 14:10:57 +00:00
Hieu Hoang
27152ccce4 add source labeller to EMS 2014-01-20 23:26:06 +00:00
Hieu Hoang
c537d940a9 compile manual-label program 2014-01-20 19:27:46 +00:00
Hieu Hoang
b03e035b5d output glue rules 2014-01-20 18:37:48 +00:00
Hieu Hoang
4c009e31e8 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into hieu 2014-01-20 17:08:02 +00:00
Hieu Hoang
8fe07d1c9c oops. Minor compile error 2014-01-20 17:01:53 +00:00
Hieu Hoang
839d1c6978 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-01-20 16:26:45 +00:00
Hieu Hoang
b448e77639 register feature function HyperParameterAsWeight 2014-01-20 16:12:46 +00:00
Rico Sennrich
c8108ca71d some sparse feature functions couldn't be set to be non-tuneable in moses.ini 2014-01-20 15:56:36 +00:00
Rico Sennrich
5d2b4d8efc sparse feature weights can now be set in moses.ini; overrides weights in weight-file. 2014-01-20 15:54:17 +00:00
Hieu Hoang
ade7400fc7 minor error 2014-01-20 15:42:17 +00:00
Rico Sennrich
043444b293 copy weights of untuneable features from original config in mert 2014-01-20 10:06:42 +00:00
Rico Sennrich
bc0cac59be unescape "|" (for compatibility with escape-special-chars scripts) 2014-01-18 12:23:21 +00:00
Hieu Hoang
4d080a5bcb Merge branch 'master' into hieu 2014-01-17 18:09:18 +00:00
Hieu Hoang
58197b538e eclipse 2014-01-17 18:03:42 +00:00
Hieu Hoang
20e7d078a6 add feature function HyperParameterAsWeight 2014-01-17 17:59:36 +00:00
Hieu Hoang
1632194a9e syntax error 2014-01-17 17:08:34 +00:00
Hieu Hoang
0ff626a716 -extract-command for train-model.perl to override the extract program to be used 2014-01-17 15:43:51 +00:00
Rico Sennrich
742e59f1e0 minor optimization (minimize performance impact of SoftMatchingFeature code if disabled) 2014-01-17 11:57:52 +00:00