Commit Graph

11553 Commits

Author SHA1 Message Date
Hieu Hoang
1e116a21ae add FF RuleAmbiguity 2014-04-11 10:29:57 +01:00
Hieu Hoang
9644a30858 add FF RuleAmbiguity 2014-04-11 10:22:03 +01:00
Hieu Hoang
1686686e65 start on FF ReferenceComparison 2014-04-10 21:47:06 +01:00
Hieu Hoang
91d6bfe0d5 start on FF ReferenceComparison 2014-04-10 21:34:34 +01:00
Hieu Hoang
65326f205f -stack 0 means no stack pruning 2014-04-09 10:33:33 +01:00
Hieu Hoang
0e98f1bc06 bug in ControlRecombinationState 2014-04-09 09:59:52 +01:00
Hieu Hoang
af408f4228 eclipse 2014-04-08 22:09:43 +01:00
Hieu Hoang
4c634023ce add FF CountNonTerms 2014-04-08 17:19:26 +01:00
Hieu Hoang
f507c0f82d output correct source non-term from on-disk phrase-table 2014-04-07 17:23:13 +01:00
Hieu Hoang
2ea2224ba1 output source side of rule, if available 2014-04-07 12:00:13 +01:00
Hieu Hoang
09dc0e9913 add FF/SetSourcePhrase 2014-04-06 16:57:54 +01:00
Hieu Hoang
a17bead267 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-05 14:48:41 +01:00
Hieu Hoang
b7b502fbf5 eclipse 2014-04-04 22:34:38 +01:00
Rico Sennrich
395285d879 more logging for incremental chart search 2014-04-04 15:54:48 +01:00
Hieu Hoang
59098ac664 merge 2014-04-04 11:20:06 +01:00
Hieu Hoang
ee03e0f0e3 meteor scorer requires FDStream. Only gcc 2014-04-03 23:35:04 +01:00
Hieu Hoang
afb3d01344 eclipse 2014-04-03 23:27:08 +01:00
Hieu Hoang
b5784c9c77 eclipse 2014-04-03 23:23:21 +01:00
Hieu Hoang
5297620e8e eclipse 2014-04-03 23:15:05 +01:00
Hieu Hoang
f6956bfe99 eclipse 2014-04-03 23:14:19 +01:00
Hieu Hoang
67b1cbce13 error in constrained decoding 2014-04-03 18:03:58 +01:00
Rico Sennrich
63ca61ba0b tmcombine: don't crash if model contains sparse features or other data
(no adaptation; tmcombine will copy sparse features / data from first model)
2014-03-27 15:27:10 +00:00
Rico Sennrich
1f435340f0 faster pruning in chart decoding 2014-03-26 11:23:59 +00:00
Hieu Hoang
4a91739ad5 eclipse 2014-03-24 16:09:28 +00:00
Hieu Hoang
d9fb9ce23c eclipse 2014-03-24 16:05:17 +00:00
Hieu Hoang
4ccb001b29 eclipse 2014-03-24 16:03:44 +00:00
Rico Sennrich
c8682e9420 target-syntax: use SoftMatchingFeature to assign non-terminal to unknown words 2014-03-24 14:57:24 +00:00
Phil Williams
cea86d6750 Transliteration support for syntax models. 2014-03-21 22:13:38 +00:00
Rico Sennrich
ba52fa163b use | as default escape sequence for "|" (for consistency with tokenizer.perl) 2014-03-21 19:19:03 +00:00
Rico Sennrich
fb16df8c00 typo in last commit 2014-03-21 11:59:41 +00:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory.
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Hieu Hoang
1c6061e781 bug when adding reordering model to ini file /jian zhang 2014-03-19 00:27:59 +00:00
Kenneth Heafield
fc61084743 Compiler warning 2014-03-17 07:18:11 -07:00
Kenneth Heafield
6bbf437ff7 Surround locks with WITH_THREADS 2014-03-17 07:08:25 -07:00
Phil Williams
69f92bd6e4 moses_chart: implement -output-unknowns option. 2014-03-17 13:09:54 +00:00
Hieu Hoang
ea5577c598 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-14 09:05:50 +00:00
Hieu Hoang
c501e5fab6 accidental error in perl script 2014-03-14 09:04:49 +00:00
Phil Williams
04dbd3c7aa moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span 2014-03-14 08:49:09 +00:00
Hieu Hoang
0e308e41ca recommit Rico's change to score format 2014-03-13 18:30:24 +00:00
Hieu Hoang
711bd9c163 eclipse 2014-03-13 18:25:01 +00:00
Nadir Durrani
054a648713 Transliteration Script - Modifications 2014-03-13 13:10:38 +00:00
Ulrich Germann
9e104ed6a1 Reverted to version prior to last check-in. 2014-03-12 19:18:25 +00:00
Ulrich Germann
b26eabba39 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2014-03-11 22:29:55 +00:00
Kenneth Heafield
d6df82514b I like gzip 2014-03-11 11:35:38 -07:00
Kenneth Heafield
8ae4d153c8 Consolidated, consistent rt target fixes single-threaded build 2014-03-11 11:29:40 -07:00
Kenneth Heafield
e1d8f5c2ae Do not compile pcqueue_test for single-threaded builds 2014-03-11 11:11:24 -07:00
Ulrich Germann
f1449cd7fe Merge branch 'dynamic-phrase-tables' 2014-03-11 14:17:42 +00:00
Ulrich Germann
c02fbf7664 Completely rewritten. Now multi-threaded. 2014-03-11 13:57:42 +00:00
Ulrich Germann
76eb3d56b9 Proper initialization of class members of InputFeature. 2014-03-11 13:56:40 +00:00
Ulrich Germann
d93c93df87 Reformatting for readability. 2014-03-11 13:55:16 +00:00