Commit Graph

11534 Commits

Author SHA1 Message Date
Hieu Hoang
afb3d01344 eclipse 2014-04-03 23:27:08 +01:00
Hieu Hoang
b5784c9c77 eclipse 2014-04-03 23:23:21 +01:00
Hieu Hoang
5297620e8e eclipse 2014-04-03 23:15:05 +01:00
Hieu Hoang
f6956bfe99 eclipse 2014-04-03 23:14:19 +01:00
Hieu Hoang
67b1cbce13 error in constrained decoding 2014-04-03 18:03:58 +01:00
Rico Sennrich
63ca61ba0b tmcombine: don't crash if model contains sparse features or other data
(no adaptation; tmcombine will copy sparse features / data from first model)
2014-03-27 15:27:10 +00:00
Rico Sennrich
1f435340f0 faster pruning in chart decoding 2014-03-26 11:23:59 +00:00
Rico Sennrich
c8682e9420 target-syntax: use SoftMatchingFeature to assign non-terminal to unknown words 2014-03-24 14:57:24 +00:00
Phil Williams
cea86d6750 Transliteration support for syntax models. 2014-03-21 22:13:38 +00:00
Rico Sennrich
ba52fa163b use | as default escape sequence for "|" (for consistency with tokenizer.perl) 2014-03-21 19:19:03 +00:00
Rico Sennrich
fb16df8c00 typo in last commit 2014-03-21 11:59:41 +00:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory.
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Hieu Hoang
1c6061e781 bug when adding reordering model to ini file /jian zhang 2014-03-19 00:27:59 +00:00
Kenneth Heafield
fc61084743 Compiler warning 2014-03-17 07:18:11 -07:00
Kenneth Heafield
6bbf437ff7 Surround locks with WITH_THREADS 2014-03-17 07:08:25 -07:00
Phil Williams
69f92bd6e4 moses_chart: implement -output-unknowns option. 2014-03-17 13:09:54 +00:00
Hieu Hoang
ea5577c598 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-14 09:05:50 +00:00
Hieu Hoang
c501e5fab6 accidental error in perl script 2014-03-14 09:04:49 +00:00
Phil Williams
04dbd3c7aa moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span 2014-03-14 08:49:09 +00:00
Hieu Hoang
0e308e41ca recommit Rico's change to score format 2014-03-13 18:30:24 +00:00
Hieu Hoang
711bd9c163 eclipse 2014-03-13 18:25:01 +00:00
Nadir Durrani
054a648713 Transliteration Script - Modifications 2014-03-13 13:10:38 +00:00
Ulrich Germann
9e104ed6a1 Reverted to version prior to last check-in. 2014-03-12 19:18:25 +00:00
Ulrich Germann
b26eabba39 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2014-03-11 22:29:55 +00:00
Kenneth Heafield
d6df82514b I like gzip 2014-03-11 11:35:38 -07:00
Kenneth Heafield
8ae4d153c8 Consolidated, consistent rt target fixes single-threaded build 2014-03-11 11:29:40 -07:00
Kenneth Heafield
e1d8f5c2ae Do not compile pcqueue_test for single-threaded builds 2014-03-11 11:11:24 -07:00
Ulrich Germann
f1449cd7fe Merge branch 'dynamic-phrase-tables' 2014-03-11 14:17:42 +00:00
Ulrich Germann
c02fbf7664 Completely rewritten. Now multi-threaded. 2014-03-11 13:57:42 +00:00
Ulrich Germann
76eb3d56b9 Proper initialization of class members of InputFeature. 2014-03-11 13:56:40 +00:00
Ulrich Germann
d93c93df87 Reformatting for readability. 2014-03-11 13:55:16 +00:00
Ulrich Germann
b3043d9b00 Reformatting for readability. In ReadInput: delete source only if non-NULL. 2014-03-11 13:53:54 +00:00
Kenneth Heafield
ca9e3aaf84 Fix -output-hypo-score 2014-03-10 11:50:45 -07:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Ulrich Germann
fdc504d47a Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:08:00 +00:00
Ulrich Germann
6e4035fb12 Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:06:10 +00:00
Ulrich Germann
aa8ba7d9a7 Put alignment functionality into a separate class. Not working yet --- work in progress! 2014-03-10 12:03:27 +00:00
Ulrich Germann
ff4ce426e7 Made scorer in PScoreLex public for development purposes. Reset default number of workers to 20. 2014-03-10 12:02:05 +00:00
Ulrich Germann
f7ee316e12 Added initialization of wlex21 and COOCraw during loading. 2014-03-10 11:59:58 +00:00
Ulrich Germann
aad5d67947 Added option to also count raw cooccurrences. 2014-03-10 11:58:46 +00:00
Ulrich Germann
9cf86f6191 Added class Alignment as a friend and wlex21 and COOCraw for development purposes while working on word alignment issues. 2014-03-10 11:57:40 +00:00
Ulrich Germann
9159729ad0 Made internal table COOC public for development purposes. 2014-03-10 11:56:22 +00:00
Hieu Hoang
3f7778db95 Merge pull request #63 from mjdenkowski/master
Meteor scoring for Moses MERT
2014-03-06 22:40:50 +00:00
Michael Denkowski
bb201bbde8 Meteor scoring for Moses MERT 2014-03-06 16:07:01 -05:00
Ulrich Germann
81ed9937e1 Routine check-in. 2014-03-05 11:53:05 +00:00
Ulrich Germann
2b19b71095 Routine check-in. 2014-03-04 15:51:59 +00:00
Ian Johnson
23556697c4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-03 16:50:54 +00:00
Ian Johnson
58bc0fd854 RPM installers now support updating and release numbers on SPEC and SOURCE creation. 2014-03-03 16:50:36 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
2014-03-03 13:56:19 +00:00
Ulrich Germann
6c37b8d252 Routine check-in. 2014-03-03 12:13:41 +00:00