Commit Graph

3826 Commits

Author SHA1 Message Date
Matthias Huck
1523f3315d PhraseOrientationFeature for chart-based decoding: a first simple version,
with lots of log output
2014-09-12 13:51:04 +01:00
Matthias Huck
58842b8ffb PhraseOrientationFeature dummy. Does not do anything yet. 2014-09-09 18:17:05 +01:00
Ulrich Germann
db6e5de641 Added initial code for utility to count features of PhraseDictionaryBitextSampling. 2014-09-08 11:03:05 +01:00
Ulrich Germann
5571ec91c6 Code cleanup. 2014-09-08 09:26:09 +01:00
Ulrich Germann
a86d49fc88 Added bias to bitext sampling. 2014-09-08 09:26:08 +01:00
Ulrich Germann
cef6460981 Initial check-in. 2014-09-08 09:26:08 +01:00
Ulrich Germann
a87a9ff207 Moved class PhrasePair back to ug_bitext.
Moved function expand() from mmsapt.cc to ug_bitext.h.
Added new lookup function to class Bitext.
Bug fixes related to inverse lookup in class Bitext.
2014-09-08 09:26:08 +01:00
Ulrich Germann
b588df77f0 Bug fix related to threading. 2014-09-08 09:26:08 +01:00
Ulrich Germann
2405293aaa Fiddling around with the code. Not for production. 2014-09-08 09:26:08 +01:00
Ulrich Germann
90c91ae9bb Added fakelib stringdist. 2014-09-08 09:26:08 +01:00
Ulrich Germann
9af3a61678 Added try-align2. 2014-09-08 09:26:08 +01:00
Ulrich Germann
a028fec7af Work in progress. 2014-09-08 09:26:08 +01:00
Ulrich Germann
25b733e35d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-08 09:25:41 +01:00
Michael Denkowski
3304030a4e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-04 11:19:32 -04:00
Michael Denkowski
6c33bc99dc Option to add TM-specific word and phrase counts 2014-09-04 11:17:42 -04:00
Michael Denkowski
756bcf0f15 Option to add TM-specific word and phrase counts 2014-09-04 01:49:26 -04:00
Rico Sennrich
2a46e8ccea parse chart compression for faster CYK+ parsing with syntax systems. 2014-09-01 18:16:22 +01:00
mnadejde
8ba6853dcd Delete InternalStructStatelessFF.h 2014-09-01 13:58:11 +01:00
mnadejde
76cd3df393 Delete InternalStructStatelessFF.cpp 2014-09-01 13:57:56 +01:00
Ulrich Germann
ab35f6d4a3 Back to the standard default max phrase length of 20 with --with-mm. 2014-08-31 13:27:17 +01:00
Michael Denkowski
1c45d780d4 all-restrict mode for MultiModel (restrict to phrases in first model) 2014-08-26 13:43:23 -04:00
Hieu Hoang
97e5a30d3a compiles with clang on osx 2014-08-25 18:07:42 +01:00
Michael Denkowski
da0ed4df81 tunable=false option for mmsapt 2014-08-18 19:22:50 -04:00
Michael Denkowski
93e99be108 Mode to pass through "all" scores in MultiModel 2014-08-18 17:57:05 -04:00
Hieu Hoang
00a338d576 clang only function 2014-08-14 16:44:20 +01:00
Hieu Hoang
303387f9ac compiles with clang on osx 2014-08-14 16:17:21 +01:00
Hieu Hoang
fcbd64b3ac eclipse 2014-08-14 14:04:25 +01:00
Hieu Hoang
2bbaf69409 Merge branch 'master' into bo-safe 2014-08-13 18:52:14 +01:00
Hieu Hoang
94c44c03d5 merge 2014-08-13 18:03:05 +01:00
Barry Haddow
27eee55a57 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-11 11:49:38 +01:00
Barry Haddow
79b6b60237 Fix seg fault in lattice samples 2014-08-11 09:40:34 +01:00
Hieu Hoang
734d3fc33f minor move 2014-08-09 17:33:45 +01:00
Hieu Hoang
18c1c4a132 method rename 2014-08-08 18:11:30 +01:00
Hieu Hoang
4863cc79c3 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-08 17:56:07 +01:00
Matthias Huck
62e345a18b SoftSourceSyntacticConstraintsFeature 2014-08-08 17:33:11 +01:00
Hieu Hoang
3d884bb098 method rename 2014-08-08 16:41:16 +01:00
Matthias Huck
856e20b1a8 SoftSourceSyntacticConstraintsFeature 2014-08-08 16:41:07 +01:00
Matthias Huck
0d756c1d8d SoftSourceSyntacticConstraintsFeature 2014-08-08 16:30:02 +01:00
Hieu Hoang
c723035d0f method rename 2014-08-08 16:18:24 +01:00
Barry Haddow
c5b3f67877 Fix output of sparse features in hypergraph 2014-08-08 16:05:50 +01:00
Hieu Hoang
efa5befb16 method rename 2014-08-08 15:59:34 +01:00
Hieu Hoang
319bb3ccfa method rename 2014-08-08 15:42:23 +01:00
Paul Baltescu
d75c4e1ae5 OxLM integration. 2014-08-08 01:18:05 +01:00
Matthias Huck
d1706a54dd OrientationPhraseProperty 2014-08-07 21:43:09 +01:00
Matthias Huck
3da03f4459 tiny changes 2014-08-07 21:42:30 +01:00
Barry Haddow
b5a1f02606 Implement hypergraph output for chart moses 2014-08-07 21:20:10 +01:00
Matthias Huck
c27cbf55ea source labels: integration into EMS 2014-08-07 21:02:51 +01:00
Hieu Hoang
cda9d1d5ae Merge branch 'master' into dynsapt 2014-08-07 10:22:00 +01:00
Barry Haddow
fbe73dd06f Stub out chart hypergraph output 2014-08-06 16:37:09 +01:00
Barry Haddow
ae2a52bd21 template-ise, preparing for chart version 2014-08-06 15:56:34 +01:00
Barry Haddow
c99a889420 Refactor hypergraph output code 2014-08-06 15:29:39 +01:00
Hieu Hoang
23f10cc73f move notice about czech prefixes to share/README 2014-08-06 15:03:37 +01:00
Barry Haddow
9106854ec7 Output edge scores correctly 2014-08-06 12:35:03 +01:00
Barry Haddow
ff188c454a Sparse features trainable with hg mira
(In phrase-based Moses)
2014-08-06 11:38:51 +01:00
Ulrich Germann
95b04d2558 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-08-05 21:28:06 +01:00
Ulrich Germann
5480499309 Fixed (?) problem with multiple identical extractable target phrases per source phrase occurrence. 2014-08-05 21:26:29 +01:00
Michael Denkowski
a371e732c8 Lower verbosity, sync with current version 2014-08-05 16:08:12 -04:00
Michael Denkowski
13942b77ab Add alias PhraseDictionaryBitextSampling 2014-08-05 14:47:07 -04:00
Michael Denkowski
e7c36ee804 Simulated post-editing merge: XML update, parallel SPE script, MERT 2014-08-05 14:20:00 -04:00
Barry Haddow
6549d24d35 Incremental scoring of hypotheses.
Don't score full score vectors in hypotheses, just
the increments. The full score breakdowns (required for
nbest lists) are calculated lazily.
2014-08-05 17:57:57 +01:00
Hieu Hoang
3f29ed10f1 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-05 11:00:01 +01:00
Hieu Hoang
84d6b25802 TargetPhrase to have pointer to the phrase table that creates it 2014-08-05 10:59:48 +01:00
Hieu Hoang
f447a23067 TargetPhrase to have pointer to the phrase table that creates it 2014-08-05 10:26:42 +01:00
Ulrich Germann
f32a313a05 Mmsapt now uses timespec on linux, timeval om MacOS for time stamps. 2014-08-05 02:22:20 +01:00
Hieu Hoang
e863592f40 TargetPhrase to have pointer to the phrase table that creates it 2014-08-04 19:28:04 +01:00
Hieu Hoang
11471de9b8 mac osx 2014-08-04 18:50:10 +01:00
Ulrich Germann
c269abb083 Added num_read_write.cc to fakelib mm. 2014-08-04 17:52:08 +01:00
Ulrich Germann
9fad5d3eb0 Eliminated dependence on endian.h and related byte swapping on big-endian machines. 2014-08-04 17:52:08 +01:00
Hieu Hoang
abe68be588 initialise m_container 2014-08-04 15:59:32 +01:00
Hieu Hoang
3f3912772d initialise m_container 2014-08-04 15:46:40 +01:00
Hieu Hoang
5f90ccdb13 initialise m_container 2014-08-04 15:20:22 +01:00
Hieu Hoang
f844bd12d9 clean up TargetPhrase 2014-08-04 15:14:40 +01:00
Hieu Hoang
9ead26071e move methods for PDAimp into .cpp file 2014-08-04 14:41:12 +01:00
Marcin Junczys-Dowmunt
5c9017c632 Forgot to add SetFeaturesToApply 2014-08-03 19:44:43 +02:00
Marcin Junczys-Dowmunt
ff6ed8cd21 Fixed segfault for features depending on factors not in phrase table (i.e. added by generation models) 2014-08-03 18:03:42 +02:00
Hieu Hoang
688bf4c061 each target phrase knows what decode graph created it 2014-08-02 17:15:01 +01:00
Hieu Hoang
fbbc756117 add virtual void ChangeSource(InputType *&input) const
to FeatureFunction
2014-08-01 22:41:24 +01:00
Marcin Junczys-Dowmunt
f616954a03 Put back destructor in OpSequenceModel.* 2014-07-31 23:00:09 +02:00
Marcin Junczys-Dowmunt
73a822975d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-31 22:44:20 +02:00
Marcin Junczys-Dowmunt
8930d50076 Added support to OSM for all KenLM model types 2014-07-31 22:44:12 +02:00
hieu
5741ef2635 compile error in gcc 4.4 2014-07-30 18:01:51 +01:00
Ulrich Germann
f9d167345a Changed feature and parameter names for Mmsapt / PhraseDictionaryBitextSampling as requested by PK. 2014-07-29 13:57:00 +01:00
Ulrich Germann
6a1beb770d Cleanup work to get rid of compiler warnings. 2014-07-29 13:51:44 +01:00
Barry Haddow
52a1056f9e Cache FNames to make sparse lex reorder faster 2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef Remove, don't just comment out 2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe Unused code 2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29 Avoid dynamic_cast in critcal path code. 2014-07-24 16:01:54 +01:00
Hieu Hoang
0716005430 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428 delete PhraseTableImplementation. Old enum 2014-07-18 20:36:53 +01:00
Rico Sennrich
b0fbf80dc0 remove unnecessary code, and floor NPLM scores 2014-07-18 14:39:54 +01:00
Hieu Hoang
1347b153ee compiles with c++11. Used by oxlm 2014-07-17 23:13:06 +01:00
Ulrich Germann
3194c4783d Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
2014-07-17 21:31:40 +01:00
Ulrich Germann
51c4d116f3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 21:06:30 +01:00
Rico Sennrich
eb5336ad9c thread-safety, precomputation and caching for NeuralLMWrapper
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
2014-07-17 16:50:08 +01:00
Ulrich Germann
5915e2b1cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 15:53:07 +01:00
Hieu Hoang
69c27a3020 name change 2014-07-16 13:21:51 +01:00
Hieu Hoang
ce014e0b35 cleanup 2014-07-15 17:47:36 +01:00
Hieu Hoang
3b0ab6e6de scores matches. State info from hash 2014-07-15 17:14:32 +01:00
Hieu Hoang
7cb8ef5933 scores matches for 1st best, but not nbest 2014-07-15 16:46:19 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00