Commit Graph

3826 Commits

Author SHA1 Message Date
Hieu Hoang
08be3b6b4f new LBLLM based on LanguageModel class 2014-07-15 00:13:35 +01:00
Hieu Hoang
b753f26d67 Merge branch 'master' into hieu.oxlm 2014-07-14 21:50:01 +01:00
Hieu Hoang
20271b8e96 sort FF by name 2014-07-14 21:49:29 +01:00
Hieu Hoang
dc1cf603de new LBLLM based on LanguageModel class 2014-07-14 21:33:38 +01:00
Hieu Hoang
7dfe943fb0 new LBLLM based on LanguageModel class 2014-07-14 20:40:33 +01:00
Hieu Hoang
f340ede6b5 new LBLLM based on LanguageModel class 2014-07-14 19:15:20 +01:00
Hieu Hoang
a402523ef5 calculate baseline score without optimisation 2014-07-11 16:26:48 +01:00
Hieu Hoang
8f5dc2b9e7 state info 2014-07-11 12:53:03 +01:00
Hieu Hoang
da825e844b 1st rough sketch. compiles with eclipse 2014-07-11 11:15:06 +01:00
Hieu Hoang
a209d0ed18 compiles with eclipse 2014-07-10 18:48:51 +01:00
Ulrich Germann
f06b145735 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-10 17:24:42 +01:00
Hieu Hoang
3c9e397132 compiles with eclipse 2014-07-10 16:14:22 +01:00
Hieu Hoang
5b2bafde76 compiles with eclipse 2014-07-10 12:16:38 +01:00
Hieu Hoang
98d464727b add LBLLM from Blunsom's group 2014-07-10 11:40:32 +01:00
Hieu Hoang
e197b110fc rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:54:16 +01:00
Hieu Hoang
12a14221e2 rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:41:08 +01:00
Hieu Hoang
587b5fd716 rename Evaluate() to EvaluateWithSourceContext() 2014-07-09 23:06:54 +01:00
Hieu Hoang
c9bd98fb0f rename Evaluate() to EvaluateInIsolation() 2014-07-09 22:35:59 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Ulrich Germann
e1c9405b23 Utilities to check gain in phrase coverage by dynamic augmentation of the phrase table in a post-editing scenario. 2014-07-09 02:39:28 +01:00
Rico Sennrich
bdf8d1a405 CreateFromString no longer requires factorDelimiter 2014-07-04 10:28:24 +01:00
Barry Haddow
c4ca243b7a Improved debug for sparse reordering 2014-06-30 12:13:33 +01:00
Barry Haddow
e2312e879c Merge remote-tracking branch 'origin/master' into sparse-reordering 2014-06-30 10:21:18 +01:00
Ulrich Germann
556e112366 Major bug fix in Mmsapt.combine_pstats. 2014-06-30 00:32:11 +01:00
Ulrich Germann
5c77f17833 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-27 01:12:22 +01:00
Ulrich Germann
9eaf506ace Renamed lookup_mmsapt.cc to ptable-lookup.cc. 2014-06-27 01:10:14 +01:00
Ulrich Germann
1e50ac587d Replaced TRACE_ERR(..) with VERBOSE(1,...) in PhraseDictionaryTree.cpp 2014-06-27 01:09:50 +01:00
Ulrich Germann
9dfb354041 Phrase probability smoothing can now be turned off in ug_bitext.cc by setting the confidence threshold to 0. 2014-06-27 01:07:23 +01:00
Ulrich Germann
40ab68b3d2 Adapted lookup_mmsapt to binary phrase tables; renamed the utility to ptable-lookup 2014-06-27 01:06:00 +01:00
Ulrich Germann
e4c35b9896 Replaced TRACE_ERR(..) with VERBOSE(1,...) in PDTAimp.h. 2014-06-27 01:02:23 +01:00
Hieu Hoang
dba4caa7c0 register PhraseDictionaryFuzzyMatch 2014-06-26 09:34:16 -04:00
Barry Haddow
961d72269a clusters for sparse reordering feature 2014-06-24 21:50:20 +01:00
Barry Haddow
69222ee32b Implement 'between' featuresr. 2014-06-24 13:37:54 +01:00
Barry Haddow
cc426190e2 Minor fix 2014-06-23 17:46:45 +01:00
Barry Haddow
6424da1387 Merge branch 'sparse-reordering' of github.com:moses-smt/mosesdecoder into sparse-reordering 2014-06-23 17:06:24 +01:00
Barry Haddow
1afa0bc8f6 Fix for hreo 2014-06-23 17:06:00 +01:00
Barry Haddow
77a4a5e133 Merge remote-tracking branch 'origin/master' into sparse-reordering
Conflicts:
	moses/FF/Factory.cpp
	moses/FF/LexicalReordering/LexicalReordering.cpp
2014-06-23 15:22:40 +01:00
Matthias Huck
15ac0821b1 removed unnecessary includes 2014-06-20 21:25:14 +01:00
Matthias Huck
f3907cd6a2 SourceGHKMTreeInputMatchFeature 2014-06-20 21:00:16 +01:00
Hieu Hoang
c460330430 debug output for PhraseProperty 2014-06-19 19:23:33 +01:00
Hieu Hoang
137126ca54 read parameter example for Skeleton FF 2014-06-18 09:08:19 +01:00
Hieu Hoang
29991e1ede iterator compile error on some compilers /Jame Zhang 2014-06-17 19:35:19 +01:00
Hieu Hoang
b5b3aa802d delete input path creation. Already doing it in ChartParser. SCFG algorithm needs a cleanup 2014-06-16 14:37:36 +01:00
Hieu Hoang
f2d3f57d07 Merge branch 'hieu' of ../mosesdecoder.hieu 2014-06-16 10:57:02 +01:00
Hieu Hoang
e2dc889150 add input path to chart cell label 2014-06-16 00:55:36 +01:00
Hieu Hoang
6e3b6d013b add SyntaxRHS FF 2014-06-15 21:41:52 +01:00
Ulrich Germann
2ac93eca5c PScoreBwd can now scales backward marginals according as specified by user. 2014-06-15 21:11:33 +01:00
Ulrich Germann
72e88c6d32 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-14 17:05:50 +01:00
Lane Schwartz
2b0f3f11c1 Revert "Merge branch 'master' of ../mosesdecoder.export.bundle"
This reverts commit a106d27bf7, reversing
changes made to 7c93c47548.
2014-06-14 10:08:48 -04:00
Ulrich Germann
5ff14f9798 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-14 13:29:52 +01:00
Ulrich Germann
1a3d7d3266 Reorganization of phrase scorers in Mmsapt. 2014-06-14 13:03:31 +01:00
Ulrich Germann
c3db1a3a67 Better labeling of feature values in lookup_mmsapt. 2014-06-14 13:02:55 +01:00
Ulrich Germann
135ce20509 Smoothing parameter in LexicalPhraseScorer2 is now a configurable paramter. 2014-06-14 13:02:08 +01:00
Ulrich Germann
450c8c5b80 Moved phrase scorers to a separate file. 2014-06-14 12:58:33 +01:00
Hieu Hoang
b5d3592a06 floor score if weight is -ve 2014-06-14 04:30:15 +01:00
Hieu Hoang
615c55b49c don't have -inf score if weight is -ve 2014-06-14 04:22:03 +01:00
Lane Schwartz
a106d27bf7 Merge branch 'master' of ../mosesdecoder.export.bundle 2014-06-13 14:50:34 -04:00
Lane Schwartz
c0d1434ed5 Make m_allWeights and m_currentWeightSetting thread-safe 2014-06-13 14:41:45 -04:00
Lane Schwartz
e32fc298e6 Refactored access to m_allWeights
in preparation for thread-specific pointers to this data
2014-06-13 13:20:09 -04:00
Matthias Huck
9b4e5963d5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-13 18:05:05 +01:00
Matthias Huck
9b9c182726 PhraseProperty destructor 2014-06-13 18:01:41 +01:00
Hieu Hoang
cef8fd3b72 merge 2014-06-13 17:42:13 +01:00
Hieu Hoang
5c57702664 merge 2014-06-13 17:08:22 +01:00
XapaJIaMnu
a797582e89 Remove more unnecessary dynamic casts 2014-06-13 17:02:08 +01:00
Matthias Huck
c40bf494ac incorporating Hieu's "redo property API" stuff again (from dea105f663) 2014-06-13 16:49:57 +01:00
Matthias Huck
a5467d89c4 Minor modification of the phrase properties framework.
Properties can save memory by not storing the value string.
2014-06-13 16:37:13 +01:00
XapaJIaMnu
a6f8a7c4c9 Remove unnecessary dynamic_cast 2014-06-13 16:10:08 +01:00
Hieu Hoang
e5184bc496 redo property API 2014-06-13 15:45:34 +01:00
Hieu Hoang
7142eb5c1f Merge ../mosesdecoder into hieu 2014-06-13 15:34:47 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
Hieu Hoang
a1053a9df8 warning for empty tags, instead of error 2014-06-13 14:53:11 +01:00
Hieu Hoang
dddadc4c81 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-13 10:35:43 +01:00
Hieu Hoang
eb78782c5d merge with master 2014-06-13 10:35:35 +01:00
Hieu Hoang
9e43830c6e bjam for ProbingPT 2014-06-13 10:20:30 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Barry Haddow
2785989e21 precalculation of feature names 2014-06-12 21:37:18 +01:00
Hieu Hoang
4ebcfc2142 bjam for ProbingPT 2014-06-12 18:38:04 +01:00
Ulrich Germann
ad9748b6ac Commented out unused variable. 2014-06-12 18:32:23 +01:00
Ulrich Germann
dd40dd8382 Made a few things in ScoreComponentCollection public. 2014-06-12 18:31:56 +01:00
Ulrich Germann
ead3fc565e Initial check-in. 2014-06-12 18:30:41 +01:00
Hieu Hoang
b6e497caa0 Merge ../mosesdecoder into nikolay_probingPT 2014-06-12 17:42:21 +01:00
Hieu Hoang
f3ec79d278 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-12 13:15:51 +01:00
Hieu Hoang
eeedaaa09c incorrectly used boost shared_ptr 2014-06-12 13:15:02 +01:00
Hieu Hoang
31f662264e incorrectly used boost shared_ptr 2014-06-12 13:10:56 +01:00
Matthias Huck
9a7e568760 SourceLabelsPhraseProperty 2014-06-11 21:08:22 +01:00
Matthias Huck
7380a83f75 CountsPhraseProperty: add comment to header 2014-06-11 20:26:24 +01:00
Matthias Huck
e693a27e4e A simple phrase property class to access the three phrase count values.
The counts are usually not needed during decoding and are not loaded
from the phrase table. This is just a workaround that can make them
available to features which have a use for them.

If you need access to the counts, copy the two marginal counts and the
joint count into an additional information property with key "Counts",
e.g. using awk:

$ zcat phrase-table.gz | awk -F' \|\|\| '  '{printf("%s {{Counts %s}}\n",$0,$5);}' | gzip -c > phrase-table.withCountsPP.gz

CountsPhraseProperty reads them from the phrase table and provides
methods GetSourceMarginal(), GetTargetMarginal(), GetJointCount().
2014-06-11 20:02:31 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
XapaJIaMnu
095877742c Add ProbingPT files to Moses 2014-06-11 11:47:00 +01:00
Hieu Hoang
8d5328a957 ignore 0 span. Don't bomb out 2014-06-11 05:05:22 +01:00
Hieu Hoang
a96b0fcce3 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-10 18:05:00 +01:00
Hieu Hoang
341969e61d Merge ../mosesdecoder into hieu 2014-06-10 18:04:55 +01:00
Hieu Hoang
a695c9b50b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78 don't load data when just showing weightd 2014-06-10 17:27:20 +01:00
Ulrich Germann
106a66eb17 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-10 14:28:59 +01:00
Hieu Hoang
a27835727e make sure int are cast to float 2014-06-10 11:18:14 +01:00
Hieu Hoang
31a5b78b91 bug in SpanLength FF 2014-06-10 10:44:25 +01:00
Hieu Hoang
8c55f98c7a bug in SpanLength FF 2014-06-10 10:29:49 +01:00
Barry Haddow
91ccf8ef72 bidirectional case 2014-06-10 10:23:48 +01:00
Hieu Hoang
0ab1142238 Merge github.com:moses-smt/mosesdecoder into hieu 2014-06-10 10:17:05 +01:00
Hieu Hoang
8edb344492 minor const£ 2014-06-10 10:16:17 +01:00
Barry Haddow
a5e5a6590b basic implementation of non-hierarchical sparse features 2014-06-09 22:17:05 +01:00
Hieu Hoang
1fb71da5b5 delete debugging messages 2014-06-09 16:17:20 +01:00
Hieu Hoang
649b31c226 span length 2014-06-09 16:01:37 +01:00
Hieu Hoang
3c6a31128d Merge ../mosesdecoder into hieu 2014-06-08 17:07:41 +01:00
Hieu Hoang
d68257c34d use standard c++ getline instead of old Moses SAFE_GETLINE 2014-06-08 16:37:12 +01:00
Hieu Hoang
45ed0a5b1f Merge ../mosesdecoder into hieu 2014-06-08 13:22:34 +01:00
Barry Haddow
3dec0abf0a Call sparse reordering 2014-06-06 21:08:09 +01:00
Hieu Hoang
747661ba3e sparse features in on-disk-pt 2014-06-06 20:35:58 +01:00
Barry Haddow
4aa4fe0a04 Pass scc, not scores 2014-06-06 20:25:45 +01:00
Matthias Huck
a19aaada06 formatting 2014-06-06 20:16:40 +01:00
Matthias Huck
98a117ca37 rule-limit=0: unlimited 2014-06-06 20:16:19 +01:00
Matthias Huck
2ec50239e7 rule-limit=0: unlimited 2014-06-06 20:05:59 +01:00
Hieu Hoang
091ce3f016 Merge ../mosesdecoder into hieu 2014-06-06 17:25:26 +01:00
Barry Haddow
18d1bceea0 Move sparse reordering object to LR config 2014-06-06 14:20:23 +01:00
Hieu Hoang
e25e7b69be span length 2014-06-06 10:40:40 +01:00
phikoehn
ceadacd3af Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be allow < > in factors 2014-06-05 21:31:09 +01:00
Hieu Hoang
d95bd5bdae span length property 2014-06-05 20:57:00 +01:00
Hieu Hoang
a17a45fa7f span length 2014-06-05 17:20:38 +01:00
Hieu Hoang
b8e8d6a3d2 span length 2014-06-05 17:19:06 +01:00
Hieu Hoang
ce2a69ba25 Merge ../mosesdecoder into hieu 2014-06-05 17:18:26 +01:00
Hieu Hoang
33a0b97cc9 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-05 17:15:24 +01:00
Hieu Hoang
d29bf716a4 minor change to debugging output. Memory pt used by both pb and chart-based models 2014-06-05 17:15:08 +01:00
Jun-ya NORIMATSU
cc71e0ee54 bugfix. 2014-06-05 19:26:27 +09:00
Jun-ya NORIMATSU
0659c31c05 Merge remote-tracking branch 'origin/master' 2014-06-05 14:24:44 +09:00
Jun-ya NORIMATSU
1180f5dd70 bug fix. 2014-06-05 14:24:10 +09:00
Ulrich Germann
5116f0072b Minor edits to ug_bitext.h. Added min_diverse to ug_bitext::job to ensure minimum number of translation alternatives before sampling stops. 2014-06-05 01:50:55 +01:00
Ulrich Germann
b92d599727 Bug fix in mmlex-lookup. 2014-06-05 01:48:11 +01:00
Ulrich Germann
2f109621bf Added configurable options and SetTableLimit to Mmsapt. 2014-06-05 01:47:29 +01:00
Ulrich Germann
a40fcbae02 Added utility lookup_mmsapt 2014-06-05 01:45:34 +01:00
Ulrich Germann
22ec93b85c Added operator [] to TargetPhraseCollection. 2014-06-05 01:44:11 +01:00
Ulrich Germann
c7a0520a18 Made moses shut up by changing unconditional 'cerr's to VERBOSE(1,...) 2014-06-05 01:43:26 +01:00
Ulrich Germann
004b8c9078 Changed Phrase.m_words from private to protected. 2014-06-05 01:41:50 +01:00
Ulrich Germann
3145bf3cc4 Commented out unused variable. 2014-06-05 01:40:51 +01:00
Ulrich Germann
0e98a08446 Commented out unused variable. 2014-06-05 01:40:27 +01:00
Ulrich Germann
5ae57f09d7 Commented out unused variable. 2014-06-05 01:39:44 +01:00
Ulrich Germann
ce853731ae Added mmsapt lookup utility. 2014-06-05 01:38:55 +01:00
Hieu Hoang
21da8299b8 eclipse 2014-06-04 23:02:11 +01:00
Hieu Hoang
c5aac0676e don't output SpanLength property if no non-terms 2014-06-04 17:15:54 +01:00
Hieu Hoang
4a3ac7411d span length 2014-06-04 16:52:57 +01:00
Barry Haddow
2a6a99c8bf Merge remote-tracking branch 'origin/master' into sparse-reordering 2014-06-04 16:25:21 +01:00
Hieu Hoang
8e2c4a89c0 Merge ../mosesdecoder into hieu 2014-06-04 12:53:06 +01:00
Barry Haddow
1a4b641421 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-03 22:13:17 +01:00
Ulrich Germann
8dee1725fb Removed Phrase penalty as a built-in feature function. 2014-06-03 21:36:04 +01:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Hieu Hoang
fcf9e4b51c Merge ../mosesdecoder into hieu 2014-06-03 17:11:16 +01:00
Kenneth Heafield
346a8f41b0 Use boost::ref for Visual Studio / Mike Ladwig 2014-06-03 08:48:10 -07:00
Ulrich Germann
9cda39f802 Major bug fix in setting ug_bitext::jstats.my_cnt2. 2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be Added phrase feature function for log counts. 2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3 TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values. 2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3 Added more phrase table features and configuration options to Mmsapt. 2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e Added some code to Word.cpp to allow factor-less decoding.
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Hieu Hoang
038f213d10 Merge ../mosesdecoder into hieu 2014-06-03 13:24:12 +01:00
Jun-ya NORIMATSU
65bf623228 tuning. 2014-06-03 16:13:32 +09:00
Hieu Hoang
3f49dfaaef Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-02 18:18:28 +01:00
Hieu Hoang
39ef678b32 Merge ../mosesdecoder into hieu 2014-06-02 18:18:17 +01:00
Hieu Hoang
31a583b0bc update comments for Evaluate() to say something about stackVec 2014-06-02 18:17:39 +01:00
Barry Haddow
5b0c696710 Range check in OSM 2014-06-02 16:23:55 +01:00
Hieu Hoang
934dd9b0ad Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-01 20:37:44 +01:00
Hieu Hoang
e260241d1f Merge ../mosesdecoder into hieu 2014-06-01 20:30:05 +01:00
Hieu Hoang
94b43823e0 can use NieceTerminal FF as non-tuneable 2014-06-01 20:29:55 +01:00
Ulrich Germann
ce435d22bf Mmsapt now adds the phrase penalty only if num_features specified
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Hieu Hoang
c6d80b5303 Merge ../mosesdecoder into hieu 2014-05-31 19:53:59 +01:00
Hieu Hoang
c4d0f7dc93 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-05-31 19:52:41 +01:00
Hieu Hoang
7909dcf094 add decoder arg -weight-add 2014-05-31 19:52:30 +01:00
Ulrich Germann
d1e5a544f1 Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none). 2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Ulrich Germann
c452875343 Mmsapt/ug_bitext:
- Sampling now uses a static seed for consistency between runs.
- (In order to have consistency guarantees, specify workers=1 in the
- Mmsapt line in moses.ini; otherwise the randomness of thread scheduling may
  cause inconsistencies between runs.
- Denominator for fwd phrase probabilities can now be chosen via an
  external argument.
2014-05-31 14:29:44 +01:00
Hieu Hoang
1ecad718b1 merge 2014-05-31 00:26:42 +01:00
Marcin Junczys-Dowmunt
71818ee994 missing intialization of member 2014-05-30 17:53:17 +02:00
Marcin Junczys-Dowmunt
6cdd2b6019 optional soft constraints for constrained decodings, multiple reference files 2014-05-30 17:36:19 +02:00
Barry Haddow
10e26ef00d config of sparse reordering 2014-05-30 11:27:59 +01:00
Hieu Hoang
e173e8ffab merge 2014-05-29 00:27:09 +01:00
Hieu Hoang
5e55ef089e merge 2014-05-28 22:52:22 +01:00
Hieu Hoang
e9d3052790 hard/soft constraints wrong way round 2014-05-28 22:51:26 +01:00
Barry Haddow
912c9c1f55 Configuration 2014-05-27 13:36:58 +01:00
Barry Haddow
244d9cd824 Stub out sparse reordering class 2014-05-27 11:05:56 +01:00
Barry Haddow
1bd851411f fix includes 2014-05-27 09:52:18 +01:00
Barry Haddow
1c00f8d9a7 Should be with other LR classes 2014-05-26 13:47:32 +01:00
Barry Haddow
c1be2d47e5 Merge remote-tracking branch 'origin/master' into sparse-reordering
Conflicts:
	moses/FF/Factory.cpp
2014-05-26 11:48:51 +01:00
Hieu Hoang
bbfc6b1c76 hard constraint 2014-05-25 00:48:10 +01:00
Hieu Hoang
6774595f21 call ReadParameters() 2014-05-24 17:26:24 +01:00
Hieu Hoang
6b7059e801 Merge ../mosesdecoder into hieu 2014-05-21 13:45:13 +01:00
Hieu Hoang
401c4940cf debugged FF NieceTerminal 2014-05-21 13:43:32 +01:00
Hieu Hoang
b60ac0321f rename DuplicateWord -> NieceTerminal 2014-05-20 20:02:49 +01:00
Hieu Hoang
3f93534624 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-05-20 19:52:31 +01:00
Hieu Hoang
e31ce4d3be add FF DuplicateWord 2014-05-20 19:51:46 +01:00
Hieu Hoang
409c8d5349 Merge ../mosesdecoder into hieu 2014-05-20 00:16:58 +01:00
Matthias Huck
d921d23f7d comment 2014-05-19 22:09:27 +01:00
Matthias Huck
1740478238 Framework for additional phrase properties in decoding.
Derive your property class from PhraseProperty. Do any expensive string
processing of the property value in there, not in the feature
implementation, and provide methods to access the information in
appropriate data formats. The property value string will thus have to
be processed only once (on loading) rather than each time the respective
phrase is applied and your feature needs to access the property value.
2014-05-19 21:54:08 +01:00
Ulrich Germann
380b2da2d0 Bug fix in and in connection with Mmsapt::combine_pstats(). 2014-05-19 21:34:58 +01:00
Hieu Hoang
238864a53e Merge ../mosesdecoder into hieu 2014-05-16 16:17:01 +01:00
Hieu Hoang
65a1e176e5 bugs in FF MaxSpanFreeNonTermSource 2014-05-16 16:16:20 +01:00
Hieu Hoang
1e96ffcf3d rename FF RuleAmbiguity to RuleScope 2014-05-16 12:47:43 +01:00
Hieu Hoang
0989087a5b comment 2014-05-16 10:39:26 +01:00
Hieu Hoang
35c812f5df Merge ../mosesdecoder into hieu 2014-05-13 18:24:17 +01:00
Barry Haddow
294ad4f24f Only tuneable 2014-05-13 12:02:50 +01:00
Phil Williams
fc85c26eda moses_chart: remove ChartTrellis* k-best code 2014-05-13 10:24:30 +01:00