moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-11-10 10:59:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,079 Commits 136 Branches 26 Tags 147 MiB
fad3ef687a
Commit Graph

4094 Commits

Author SHA1 Message Date
Paul Baltescu
f1a220ede9 Fix OxLM. 2014-10-08 22:53:05 +01:00
Paul Baltescu
8f74ecd8f3 Fix OxLM. 2014-10-08 22:08:42 +01:00
XapaJIaMnu
7306182337 Refactor the BilingualLM for chart to make it faster. Untested 2014-10-08 19:53:31 +01:00
XapaJIaMnu
e4d7779108 Rename BilingualLM_NPLM so that it is not confused with a sparse feature 2014-10-08 19:52:49 +01:00
Hieu Hoang
85eae6b9f2 delete lineNumber variable from ChartManager. It should always be carried by the input sentence itself 2014-10-08 19:23:26 +01:00
Hieu Hoang
1743f7eeb2 Merge ../mosesdecoder into merge-cmd 2014-10-08 17:55:07 +01:00
Hieu Hoang
deb2187428 delete lineNumber variable from Manager and TranslationTask. It should always be carried by the input sentence itself 2014-10-07 19:28:44 +01:00
Hieu Hoang
433186ae25 delete lineNumber variable from Manager and TranslationTask. It should always be carried by the input sentence itself 2014-10-07 19:16:30 +01:00
Ulrich Germann
576931b088 Mmsapt now adds word alignment info to target phrases. 2014-10-07 18:08:31 +01:00
Hieu Hoang
2f290f1d6d standardize GetIOWrapper(). 2014-10-03 16:08:15 +01:00
Hieu Hoang
65bd64ca6a move lattice sample collector from Main to IOWrapper 2014-10-03 15:30:06 +01:00
Hieu Hoang
62fe00b1a5 delete m_latticeSamplesCollector 2014-10-03 15:04:55 +01:00
Hieu Hoang
25db86d16b delete m_latticeSamplesCollector 2014-10-03 14:57:27 +01:00
Hieu Hoang
056913df57 delete nbestOut 2014-10-03 12:30:18 +01:00
Hieu Hoang
fe9a2561a3 Merge ../mosesdecoder into merge-cmd 2014-10-02 18:42:44 +01:00
Hieu Hoang
2468e2108a duplicate n-best stream processing 2014-10-02 18:39:40 +01:00
Hieu Hoang
e41d2ba08b sort out suppressSingleBestOutput variable 2014-10-02 17:08:29 +01:00
Michael Denkowski
fc4388e19c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-10-02 11:15:31 -04:00
Michael Denkowski
5013e11dc5 XML option for runtime weight-overwrite 2014-10-02 11:15:03 -04:00
Hieu Hoang
af225a6d55 only 1 constructor for IOWrapper 2014-10-02 16:00:36 +01:00
Hieu Hoang
b907fb7492 merge TranslationTask and IOWrapper. Move m_wordGraphCollector into IOWrapper 2014-10-02 14:57:04 +01:00
Hieu Hoang
f8b762a6ec merge TranslationTask and IOWrapper. Move m_detailedTranslationCollector into IOWrapper 2014-10-02 14:18:12 +01:00
Hieu Hoang
c45967c9b4 merge TranslationTask and IOWrapper. Move m_searchGraphOutputCollector into IOWrapper 2014-10-02 12:20:49 +01:00
Hieu Hoang
0843a2a901 merge TranslationTask and IOWrapper. Move m_alignmentInfoCollector into IOWrapper 2014-10-02 11:22:52 +01:00
Hieu Hoang
00365257fa merge TranslationTask and IOWrapper. Move m_unknownsStream into IOWrapper 2014-10-01 19:24:58 +01:00
Hieu Hoang
8611dc8cdf merge TranslationTask and IOWrapper. Move m_nBestOutputCollector into IOWrapper 2014-10-01 18:21:57 +01:00
Hieu Hoang
8d0f74c6e4 merge TranslationTask and IOWrapper. Move m_singleBestOutputCollector into IOWrapper 2014-10-01 17:43:51 +01:00
Paul Baltescu
1d28f5186b Rename OxLM features. 2014-09-30 15:57:20 +01:00
Hieu Hoang
33ed15ef19 move misc common functions into moses/ 2014-09-30 14:22:38 +01:00
Ulrich Germann
a01b6d6257 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-30 13:24:34 +01:00
Hieu Hoang
c20af584e7 move TranslationTask into moses/ 2014-09-30 12:59:31 +01:00
Hieu Hoang
c40faed0d6 separate out class TranslationTask into it's on file 2014-09-30 12:25:36 +01:00
Hieu Hoang
85261aa190 Merge ../mosesdecoder into merge-cmd 2014-09-30 10:32:29 +01:00
Hieu Hoang
87afd853e5 warn against using SRILM 1.7.1 2014-09-30 10:06:52 +01:00
Hieu Hoang
55db902f5f move IOWrapper into moses/ 2014-09-29 17:58:20 +01:00
Hieu Hoang
d60571341d move LatticeMBR into moses/ 2014-09-29 17:34:11 +01:00
Paul Baltescu
26ef9fddaa Optional back-off to POS tags in OxLM. 2014-09-29 17:25:26 +01:00
Hieu Hoang
08d6f77cea move TranslationAnalysis for both moses-cmd and moses-char-cmd into moses/ 2014-09-29 17:16:11 +01:00
Paul Baltescu
c5ad6f9839 Correctly map the source unknown token. 2014-09-29 01:05:43 +01:00
Paul Baltescu
edde0324dd Fix Bilingual OxLM context word order. 2014-09-28 16:53:41 +01:00
Paul Baltescu
c8ac4532ff Make query cache sentence specific. 2014-09-27 15:28:42 +01:00
Paul Baltescu
822aaa7dae Convert moses words to oxlm word ids. 2014-09-26 23:20:26 +01:00
Paul Baltescu
5c3b3f6057 Clean up OxLMMapper. 2014-09-26 16:46:04 +01:00
Paul Baltescu
3babd6dbb9 Set BilingualLM parameters nicely. 2014-09-26 16:25:48 +01:00
Paul Baltescu
a36ae66345 Skeleton for source conditioned OxLM feature. 2014-09-26 15:50:25 +01:00
Paul Baltescu
92f03662ec Rename LBLLM -> OxLM. 2014-09-26 15:18:14 +01:00
Paul Baltescu
30c3616a83 Fix compilation errors introduced by new oxlm changes. 2014-09-26 14:43:16 +01:00
Paul Baltescu
b6fa358427 Fix broken include. 2014-09-26 13:25:06 +01:00
Paul Baltescu
220c95ed9f Fix bugs in BilingualLM for chart based decoding. 2014-09-26 12:32:18 +01:00
Paul Baltescu
d162c47587 Fix a few bugs in BilingualLM for phrase based decoding. 2014-09-26 12:32:18 +01:00
Paul Baltescu
46b388885a Move BilingualLM under LM. 2014-09-26 12:32:17 +01:00
XapaJIaMnu
238e79e045 Remove unused variable that likely causes crashes 2014-09-22 13:43:55 +01:00
Philipp Koehn
33fbbc5faa allow specification of default scores for lexicalized reordering model 2014-09-21 07:43:44 +01:00
Barry Haddow
091948bff0 Improved debug 2014-09-18 17:03:19 +01:00
XapaJIaMnu
7c4301af09 fix vectors not being cleared 2014-09-16 11:24:50 +01:00
XapaJIaMnu
b0e0a6a148 Make it possible to have backend specific parameters. 2014-09-15 15:42:48 +01:00
Rico Sennrich
0861b464c5 use square brackets with output format '--brackets' (for cleaner escaping and consistency with decoder tree output) 2014-09-15 14:37:52 +01:00
XapaJIaMnu
920ce9ae1c Fix compilation 2014-09-13 09:27:46 +01:00
XapaJIaMnu
1d65a74d62 Some file renaming and fixes 2014-09-13 09:13:10 +01:00
XapaJIaMnu
9c41a01102 Abstract BilingualLM. Working 2014-09-13 08:54:58 +01:00
Matthias Huck
7e359a8892 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-09-13 00:20:52 +01:00
Matthias Huck
5ac6c42508 PhraseOrientationFeature: bugfixes 2014-09-13 00:20:17 +01:00
XapaJIaMnu
e6bda71d2e Abstract BilingualLM to Binlm_NPLM. Doesn't compile 2014-09-12 19:01:10 +01:00
Rico Sennrich
61c00ed636 n-best tree output 2014-09-12 19:17:23 +02:00
Rico Sennrich
0a127cb0f1 refactoring 2014-09-12 19:17:23 +02:00
Matthias Huck
152ddb7513 PhraseOrientationFeature 2014-09-12 18:05:27 +01:00
Matthias Huck
0ddea954f2 PhraseOrientationFeature: TODOs 
(1) For efficiancy reasons, the initialization of the phrase orientation scoring object should be done as a precomputation step
(2) Handle degenerate cases with boundary non-terminals
 2014-09-12 17:50:02 +01:00
Matthias Huck
90e6ec8d11 PhraseOrientationFeature: remove debug output 2014-09-12 17:17:40 +01:00
XapaJIaMnu
c8f17dd6f2 Start abstracting NPLM from BilingualLM 2014-09-12 17:11:19 +01:00
Matthias Huck
85a441ae11 Jamfile update for PhraseOrientationFeature 2014-09-12 13:52:46 +01:00
Matthias Huck
1523f3315d PhraseOrientationFeature for chart-based decoding: a first simple version, 
with lots of log output
 2014-09-12 13:51:04 +01:00
XapaJIaMnu
0c6e593c49 Fix a bunch of off by one and silly errors 2014-09-12 10:23:46 +01:00
XapaJIaMnu
52a85e3f22 Fix silly mistake in getTargetPhraseChart 2014-09-10 18:27:44 +01:00
XapaJIaMnu
1235e5bc27 Fix a stupid mistake in TargetWords 2014-09-10 18:04:39 +01:00
Ulrich Germann
aff577748f Merge branch 'biased-bitext-sampling' of /fs/sif0/germann/git/mosesdecoder 2014-09-10 17:52:05 +01:00
Ulrich Germann
1d834e2b48 Fixed bug with respect to adding check option to Mmsapt::Load(). 2014-09-10 18:51:20 +02:00
Ulrich Germann
a58c7ceb18 Fixed issues with ambiguity in typedef of uint64_t (conflict between boost typedef and stdint typedef). 2014-09-10 12:07:57 +02:00
Matthias Huck
58842b8ffb PhraseOrientationFeature dummy. Does not do anything yet. 2014-09-09 18:17:05 +01:00
Ulrich Germann
31578d4915 Finished code for bias loading from Mmsapt config file. 2014-09-09 18:07:26 +01:00
Ulrich Germann
cda94c7d85 Fix in biased sampling. Started code on loading and using bias in Mmsapt. 2014-09-09 17:45:48 +01:00
XapaJIaMnu
e7afe5701e Add support for moses_chart. Cleaning up needed. 2014-09-09 17:17:51 +01:00
Ulrich Germann
f86fa65a6f Added utility count-ptable-features to count features in Mmsapt given a moses.ini config line. 2014-09-08 16:56:45 +01:00
Ulrich Germann
db6e5de641 Added initial code for utility to count features of PhraseDictionaryBitextSampling. 2014-09-08 11:03:05 +01:00
Ulrich Germann
5571ec91c6 Code cleanup. 2014-09-08 09:26:09 +01:00
Ulrich Germann
a86d49fc88 Added bias to bitext sampling. 2014-09-08 09:26:08 +01:00
Ulrich Germann
cef6460981 Initial check-in. 2014-09-08 09:26:08 +01:00
Ulrich Germann
a87a9ff207 Moved class PhrasePair back to ug_bitext. 
Moved function expand() from mmsapt.cc to ug_bitext.h.
Added new lookup function to class Bitext.
Bug fixes related to inverse lookup in class Bitext.
 2014-09-08 09:26:08 +01:00
Ulrich Germann
b588df77f0 Bug fix related to threading. 2014-09-08 09:26:08 +01:00
Ulrich Germann
2405293aaa Fiddling around with the code. Not for production. 2014-09-08 09:26:08 +01:00
Ulrich Germann
90c91ae9bb Added fakelib stringdist. 2014-09-08 09:26:08 +01:00
Ulrich Germann
9af3a61678 Added try-align2. 2014-09-08 09:26:08 +01:00
Ulrich Germann
a028fec7af Work in progress. 2014-09-08 09:26:08 +01:00
Ulrich Germann
25b733e35d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-08 09:25:41 +01:00
Michael Denkowski
3304030a4e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-04 11:19:32 -04:00
Michael Denkowski
6c33bc99dc Option to add TM-specific word and phrase counts 2014-09-04 11:17:42 -04:00
Michael Denkowski
756bcf0f15 Option to add TM-specific word and phrase counts 2014-09-04 01:49:26 -04:00
Hieu Hoang
02b11bfd6d compiles on gcc 4.6.3 2014-09-02 23:27:16 +01:00
Hieu Hoang
b6428f412b eclipse 2014-09-02 22:42:07 +01:00
XapaJIaMnu
6d39032a01 More work, source_ngrams missing 2014-09-02 17:05:46 +01:00
XapaJIaMnu
b5070d8d13 int -> size_t 2014-09-02 16:07:18 +01:00
XapaJIaMnu
a15aa1dd1f Rename variable to better represent what it means. Start syntactic decoding 2014-09-02 16:05:25 +01:00
Rico Sennrich
2a46e8ccea parse chart compression for faster CYK+ parsing with syntax systems. 2014-09-01 18:16:22 +01:00
XapaJIaMnu
dd43c287f6 Support for POS backoff in factored models. Spaghetti code needs refactoring 2014-09-01 16:04:49 +01:00
XapaJIaMnu
6df221966d GetNeuralLMId requries word instead of factor 2014-09-01 15:36:39 +01:00
mnadejde
8ba6853dcd Delete InternalStructStatelessFF.h 2014-09-01 13:58:11 +01:00
mnadejde
76cd3df393 Delete InternalStructStatelessFF.cpp 2014-09-01 13:57:56 +01:00
XapaJIaMnu
d747543916 Make some parameters of neuralLM optional 2014-09-01 13:57:08 +01:00
Ulrich Germann
ab35f6d4a3 Back to the standard default max phrase length of 20 with --with-mm. 2014-08-31 13:27:17 +01:00
XapaJIaMnu
b3ff8005f5 Get state, correct 2014-08-29 19:43:13 +01:00
XapaJIaMnu
310581100e State, almost correct or correct 2014-08-29 19:32:19 +01:00
XapaJIaMnu
b05a2b8b3a Fix small indexing error 2014-08-29 18:38:46 +01:00
Hieu Hoang
b76f0ef1b9 Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-08-29 17:05:03 +01:00
Hieu Hoang
59dde14742 Merge branch 'master' into bilingual-lm 2014-08-29 17:04:42 +01:00
XapaJIaMnu
0f22a5c54b Fast version. Needs some cleanup, but works 2014-08-29 17:03:24 +01:00
XapaJIaMnu
1fd72f8546 State doesn't require whole target phrase 2014-08-29 15:28:48 +01:00
XapaJIaMnu
0ae35a60b9 Full lookup cache 2014-08-29 13:43:31 +01:00
XapaJIaMnu
1420a1a593 Caching working 2014-08-28 18:09:47 +01:00
XapaJIaMnu
80c6de1cc0 Matching scores! And bugfixing 2014-08-28 14:46:07 +01:00
XapaJIaMnu
24d0bf71bf More bugfixes. Still different result from slow and fast 2014-08-27 18:37:34 +01:00
XapaJIaMnu
5b6e8f0f43 A bunch of bugfixes and initial fast version. Still something wrong 2014-08-27 13:00:09 +01:00
Michael Denkowski
1c45d780d4 all-restrict mode for MultiModel (restrict to phrases in first model) 2014-08-26 13:43:23 -04:00
Hieu Hoang
8a2ec9c57a Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-08-26 18:13:24 +01:00
Hieu Hoang
effa3c8964 fix Jamfile 2014-08-26 18:13:20 +01:00
XapaJIaMnu
daf99effe8 Compiles, works, outputs some numbers 2014-08-26 17:24:51 +01:00
Hieu Hoang
e819fbe7e9 Merge branch 'master' into bilingual-lm 2014-08-26 16:44:20 +01:00
XapaJIaMnu
90ea86bb4b BilingualLM FF, compiles, untested. 2014-08-26 14:42:12 +01:00
XapaJIaMnu
35e8985452 nearly done, compiles, untested 2014-08-26 12:31:35 +01:00
XapaJIaMnu
b762f46865 Getting source and target words, compiling 2014-08-25 19:01:07 +01:00
Hieu Hoang
97e5a30d3a compiles with clang on osx 2014-08-25 18:07:42 +01:00
XapaJIaMnu
d6231f80de Started implementing evaluate when applied 2014-08-22 17:44:59 +01:00
XapaJIaMnu
7e3a1df2e3 Don't do anything if we don't have enough ngrams 2014-08-22 15:50:30 +01:00
XapaJIaMnu
560440a182 EvaluateWithSource compiles 2014-08-22 15:35:52 +01:00
XapaJIaMnu
e31aff517b Add scores for target side 2014-08-22 12:49:51 +01:00
XapaJIaMnu
17bdb79d21 Some neural integration 2014-08-22 12:41:13 +01:00
XapaJIaMnu
a05e3f99d6 my bad 2014-08-21 17:50:49 +01:00
XapaJIaMnu
378fe3cd9b Compiles 2014-08-21 17:46:48 +01:00
XapaJIaMnu
fbbca928b5 doesn't work 2014-08-21 17:05:06 +01:00
Hieu Hoang
b92ed7110b add Bilingual LM class 2014-08-21 16:10:20 +01:00
Hieu Hoang
114002eead add Bilingual LM class 2014-08-21 16:09:48 +01:00
Michael Denkowski
da0ed4df81 tunable=false option for mmsapt 2014-08-18 19:22:50 -04:00
Michael Denkowski
93e99be108 Mode to pass through "all" scores in MultiModel 2014-08-18 17:57:05 -04:00
Hieu Hoang
00a338d576 clang only function 2014-08-14 16:44:20 +01:00
Hieu Hoang
303387f9ac compiles with clang on osx 2014-08-14 16:17:21 +01:00
Hieu Hoang
fcbd64b3ac eclipse 2014-08-14 14:04:25 +01:00
Hieu Hoang
2bbaf69409 Merge branch 'master' into bo-safe 2014-08-13 18:52:14 +01:00
Hieu Hoang
94c44c03d5 merge 2014-08-13 18:03:05 +01:00
Barry Haddow
27eee55a57 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-11 11:49:38 +01:00
Barry Haddow
79b6b60237 Fix seg fault in lattice samples 2014-08-11 09:40:34 +01:00
Hieu Hoang
734d3fc33f minor move 2014-08-09 17:33:45 +01:00
Hieu Hoang
18c1c4a132 method rename 2014-08-08 18:11:30 +01:00
Hieu Hoang
4863cc79c3 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-08 17:56:07 +01:00
Matthias Huck
62e345a18b SoftSourceSyntacticConstraintsFeature 2014-08-08 17:33:11 +01:00
Hieu Hoang
3d884bb098 method rename 2014-08-08 16:41:16 +01:00
Matthias Huck
856e20b1a8 SoftSourceSyntacticConstraintsFeature 2014-08-08 16:41:07 +01:00
Matthias Huck
0d756c1d8d SoftSourceSyntacticConstraintsFeature 2014-08-08 16:30:02 +01:00
Hieu Hoang
c723035d0f method rename 2014-08-08 16:18:24 +01:00
Barry Haddow
c5b3f67877 Fix output of sparse features in hypergraph 2014-08-08 16:05:50 +01:00
Hieu Hoang
efa5befb16 method rename 2014-08-08 15:59:34 +01:00
Hieu Hoang
319bb3ccfa method rename 2014-08-08 15:42:23 +01:00
Paul Baltescu
d75c4e1ae5 OxLM integration. 2014-08-08 01:18:05 +01:00
Matthias Huck
d1706a54dd OrientationPhraseProperty 2014-08-07 21:43:09 +01:00
Matthias Huck
3da03f4459 tiny changes 2014-08-07 21:42:30 +01:00
Barry Haddow
b5a1f02606 Implement hypergraph output for chart moses 2014-08-07 21:20:10 +01:00
Matthias Huck
c27cbf55ea source labels: integration into EMS 2014-08-07 21:02:51 +01:00
Hieu Hoang
cda9d1d5ae Merge branch 'master' into dynsapt 2014-08-07 10:22:00 +01:00
Barry Haddow
fbe73dd06f Stub out chart hypergraph output 2014-08-06 16:37:09 +01:00
Barry Haddow
ae2a52bd21 template-ise, preparing for chart version 2014-08-06 15:56:34 +01:00
Barry Haddow
c99a889420 Refactor hypergraph output code 2014-08-06 15:29:39 +01:00
Hieu Hoang
23f10cc73f move notice about czech prefixes to share/README 2014-08-06 15:03:37 +01:00
Barry Haddow
9106854ec7 Output edge scores correctly 2014-08-06 12:35:03 +01:00
Barry Haddow
ff188c454a Sparse features trainable with hg mira 
(In phrase-based Moses)
 2014-08-06 11:38:51 +01:00
Ulrich Germann
deb12a4c9d Checking return value of fread to make the compiler shut up. 2014-08-05 23:47:02 +01:00
Ulrich Germann
95b04d2558 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-08-05 21:28:06 +01:00
Ulrich Germann
5480499309 Fixed (?) problem with multiple identical extractable target phrases per source phrase occurrence. 2014-08-05 21:26:29 +01:00
Michael Denkowski
a371e732c8 Lower verbosity, sync with current version 2014-08-05 16:08:12 -04:00
Michael Denkowski
13942b77ab Add alias PhraseDictionaryBitextSampling 2014-08-05 14:47:07 -04:00
Michael Denkowski
e7c36ee804 Simulated post-editing merge: XML update, parallel SPE script, MERT 2014-08-05 14:20:00 -04:00
Barry Haddow
6549d24d35 Incremental scoring of hypotheses. 
Don't score full score vectors in hypotheses, just
the increments. The full score breakdowns (required for
nbest lists) are calculated lazily.
 2014-08-05 17:57:57 +01:00
Hieu Hoang
3f29ed10f1 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-08-05 11:00:01 +01:00
Hieu Hoang
84d6b25802 TargetPhrase to have pointer to the phrase table that creates it 2014-08-05 10:59:48 +01:00
Hieu Hoang
f447a23067 TargetPhrase to have pointer to the phrase table that creates it 2014-08-05 10:26:42 +01:00
Ulrich Germann
f32a313a05 Mmsapt now uses timespec on linux, timeval om MacOS for time stamps. 2014-08-05 02:22:20 +01:00
Hieu Hoang
e863592f40 TargetPhrase to have pointer to the phrase table that creates it 2014-08-04 19:28:04 +01:00
Hieu Hoang
11471de9b8 mac osx 2014-08-04 18:50:10 +01:00
Ulrich Germann
c269abb083 Added num_read_write.cc to fakelib mm. 2014-08-04 17:52:08 +01:00
Ulrich Germann
9fad5d3eb0 Eliminated dependence on endian.h and related byte swapping on big-endian machines. 2014-08-04 17:52:08 +01:00
Hieu Hoang
abe68be588 initialise m_container 2014-08-04 15:59:32 +01:00
Hieu Hoang
3f3912772d initialise m_container 2014-08-04 15:46:40 +01:00
Hieu Hoang
5f90ccdb13 initialise m_container 2014-08-04 15:20:22 +01:00
Hieu Hoang
f844bd12d9 clean up TargetPhrase 2014-08-04 15:14:40 +01:00
Hieu Hoang
9ead26071e move methods for PDAimp into .cpp file 2014-08-04 14:41:12 +01:00
Marcin Junczys-Dowmunt
5c9017c632 Forgot to add SetFeaturesToApply 2014-08-03 19:44:43 +02:00
Marcin Junczys-Dowmunt
ff6ed8cd21 Fixed segfault for features depending on factors not in phrase table (i.e. added by generation models) 2014-08-03 18:03:42 +02:00
Hieu Hoang
688bf4c061 each target phrase knows what decode graph created it 2014-08-02 17:15:01 +01:00
Hieu Hoang
fbbc756117 add virtual void ChangeSource(InputType *&input) const 
to FeatureFunction
 2014-08-01 22:41:24 +01:00
Marcin Junczys-Dowmunt
f616954a03 Put back destructor in OpSequenceModel.* 2014-07-31 23:00:09 +02:00
Marcin Junczys-Dowmunt
73a822975d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-31 22:44:20 +02:00
Marcin Junczys-Dowmunt
8930d50076 Added support to OSM for all KenLM model types 2014-07-31 22:44:12 +02:00
hieu
5741ef2635 compile error in gcc 4.4 2014-07-30 18:01:51 +01:00
Ulrich Germann
f9d167345a Changed feature and parameter names for Mmsapt / PhraseDictionaryBitextSampling as requested by PK. 2014-07-29 13:57:00 +01:00
Ulrich Germann
6a1beb770d Cleanup work to get rid of compiler warnings. 2014-07-29 13:51:44 +01:00
Barry Haddow
52a1056f9e Cache FNames to make sparse lex reorder faster 2014-07-24 21:23:08 +01:00
Barry Haddow
11d5fc3fef Remove, don't just comment out 2014-07-24 16:25:53 +01:00
Barry Haddow
d43f0e40fe Unused code 2014-07-24 16:20:49 +01:00
Barry Haddow
2f31485c29 Avoid dynamic_cast in critcal path code. 2014-07-24 16:01:54 +01:00
Hieu Hoang
0716005430 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-07-18 20:37:05 +01:00
Hieu Hoang
b10760f428 delete PhraseTableImplementation. Old enum 2014-07-18 20:36:53 +01:00
Rico Sennrich
b0fbf80dc0 remove unnecessary code, and floor NPLM scores 2014-07-18 14:39:54 +01:00
Hieu Hoang
1347b153ee compiles with c++11. Used by oxlm 2014-07-17 23:13:06 +01:00
Ulrich Germann
3194c4783d Setting DEFAULT_MAX_PHRASE_LENGTH to numeric_limits<size_t>::max() breaks 
the regression test for (deprecated) PhraseDictionaryDynSuffixArray, so I
set it to 100,000 (to have virtually unlimited phrase length for
suffix array-based phrase tables.
 2014-07-17 21:31:40 +01:00
Ulrich Germann
51c4d116f3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 21:06:30 +01:00
Rico Sennrich
eb5336ad9c thread-safety, precomputation and caching for NeuralLMWrapper 
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
 2014-07-17 16:50:08 +01:00
Ulrich Germann
5915e2b1cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 15:53:07 +01:00
Hieu Hoang
69c27a3020 name change 2014-07-16 13:21:51 +01:00
Hieu Hoang
ce014e0b35 cleanup 2014-07-15 17:47:36 +01:00
Hieu Hoang
3b0ab6e6de scores matches. State info from hash 2014-07-15 17:14:32 +01:00
Hieu Hoang
7cb8ef5933 scores matches for 1st best, but not nbest 2014-07-15 16:46:19 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00
Hieu Hoang
08be3b6b4f new LBLLM based on LanguageModel class 2014-07-15 00:13:35 +01:00
Hieu Hoang
b753f26d67 Merge branch 'master' into hieu.oxlm 2014-07-14 21:50:01 +01:00
Hieu Hoang
20271b8e96 sort FF by name 2014-07-14 21:49:29 +01:00
Hieu Hoang
dc1cf603de new LBLLM based on LanguageModel class 2014-07-14 21:33:38 +01:00
Hieu Hoang
7dfe943fb0 new LBLLM based on LanguageModel class 2014-07-14 20:40:33 +01:00
Hieu Hoang
f340ede6b5 new LBLLM based on LanguageModel class 2014-07-14 19:15:20 +01:00
Hieu Hoang
a402523ef5 calculate baseline score without optimisation 2014-07-11 16:26:48 +01:00
Hieu Hoang
8f5dc2b9e7 state info 2014-07-11 12:53:03 +01:00
Hieu Hoang
da825e844b 1st rough sketch. compiles with eclipse 2014-07-11 11:15:06 +01:00
Hieu Hoang
a209d0ed18 compiles with eclipse 2014-07-10 18:48:51 +01:00
Ulrich Germann
f06b145735 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-10 17:24:42 +01:00
Hieu Hoang
3c9e397132 compiles with eclipse 2014-07-10 16:14:22 +01:00
Hieu Hoang
5b2bafde76 compiles with eclipse 2014-07-10 12:16:38 +01:00
Hieu Hoang
98d464727b add LBLLM from Blunsom's group 2014-07-10 11:40:32 +01:00
Hieu Hoang
e197b110fc rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:54:16 +01:00
Hieu Hoang
12a14221e2 rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:41:08 +01:00
Hieu Hoang
587b5fd716 rename Evaluate() to EvaluateWithSourceContext() 2014-07-09 23:06:54 +01:00
Hieu Hoang
c9bd98fb0f rename Evaluate() to EvaluateInIsolation() 2014-07-09 22:35:59 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Ulrich Germann
e1c9405b23 Utilities to check gain in phrase coverage by dynamic augmentation of the phrase table in a post-editing scenario. 2014-07-09 02:39:28 +01:00
Rico Sennrich
bdf8d1a405 CreateFromString no longer requires factorDelimiter 2014-07-04 10:28:24 +01:00
Barry Haddow
c4ca243b7a Improved debug for sparse reordering 2014-06-30 12:13:33 +01:00
Barry Haddow
e2312e879c Merge remote-tracking branch 'origin/master' into sparse-reordering 2014-06-30 10:21:18 +01:00
Ulrich Germann
556e112366 Major bug fix in Mmsapt.combine_pstats. 2014-06-30 00:32:11 +01:00
Ulrich Germann
5c77f17833 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-27 01:12:22 +01:00
Ulrich Germann
9eaf506ace Renamed lookup_mmsapt.cc to ptable-lookup.cc. 2014-06-27 01:10:14 +01:00
Ulrich Germann
1e50ac587d Replaced TRACE_ERR(..) with VERBOSE(1,...) in PhraseDictionaryTree.cpp 2014-06-27 01:09:50 +01:00
Ulrich Germann
9dfb354041 Phrase probability smoothing can now be turned off in ug_bitext.cc by setting the confidence threshold to 0. 2014-06-27 01:07:23 +01:00
Ulrich Germann
40ab68b3d2 Adapted lookup_mmsapt to binary phrase tables; renamed the utility to ptable-lookup 2014-06-27 01:06:00 +01:00
Ulrich Germann
e4c35b9896 Replaced TRACE_ERR(..) with VERBOSE(1,...) in PDTAimp.h. 2014-06-27 01:02:23 +01:00
Hieu Hoang
dba4caa7c0 register PhraseDictionaryFuzzyMatch 2014-06-26 09:34:16 -04:00
Barry Haddow
961d72269a clusters for sparse reordering feature 2014-06-24 21:50:20 +01:00