moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-08-17 07:20:48 +03:00
Code Issues Packages Projects Releases Wiki Activity
17,477 Commits 136 Branches 26 Tags 147 MiB
master
Commit Graph

5557 Commits

Author SHA1 Message Date
Hieu Hoang
f96b48a041 Merge ../mosesdecoder into perf_moses2 2016-03-11 16:38:38 +00:00
Ales Tamchyna
3e5c0e8667 minor 2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79 optimizing VW queries by caching 2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156 VW feature functions now also output extracted features for caching 2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2 return feature ids when adding features 2016-03-09 18:52:07 +01:00
Ales Tamchyna
4486c8ec43 important bug fix in target-side VW, adding optional debugging messages 2016-03-08 14:42:45 +01:00
Jeroen
ae5ad8a49e Detect write errors in LVoc. 
Write failures in LVoc::Write() were going unnoticed.  If disk space
runs out, the output file might get truncated without any indication
of failure.
 2016-03-07 18:55:18 +01:00
Ales Tamchyna
f13ba3bdfb bugfix 2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae bugfix 2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78 prepend BOS words to target sentence when training VW 2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204 removing outdated method 2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902 update vw state 2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45 finished a naive implementation of vw target context, it compiles 2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15 keep track of required context size for each VW features 2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5 towards state tracking for VW 2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656 evaluate VW with target context 2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4 towards evaluation in target context 2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873 when target context features are used in VW, do not add any score before decoding, cache it instead 2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa note 2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa pseudocode for target-context evaluation in decoding with VW 2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46 Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext 2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84 minor 2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b support training with target-context features in VW 2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953 implemented a basic target context feature 2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83 target context feature base class 2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9 new vw feature type: target context 2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c make VW feature stateful 2016-03-02 17:28:21 +01:00
Hieu Hoang
b9217cec1d Merge ../mosesdecoder into perf_moses2 2016-03-01 11:08:39 +00:00
Matthias Huck
2d6f616480 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/Model1Feature.cpp
 2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345 Model1Feature: skip-target-punctuation parameter 2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88 daily automatic beautifier 2016-02-22 00:00:40 +00:00
Hieu Hoang
e6bc481ee2 Merge ../mosesdecoder into perf_moses2 2016-02-21 23:09:46 +00:00
Matthias Huck
71a0fcbc27 Model1Feature: skip over target-side punctuation 2016-02-21 20:44:09 +00:00
Matthias Huck
e284503018 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-02-20 00:40:23 +00:00
Matthias Huck
ebb18b2dc2 WordTranslationFeature: fix loading of word lists 2016-02-20 00:39:02 +00:00
Kenneth Heafield
7a1baeecda load= option to KenLM exposing more load_method options 2016-02-20 00:07:48 +00:00
Ulrich Germann
63eefe03fd Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-02-19 10:23:21 +00:00
Ulrich Germann
98bcf53ec2 Namespace bug fix. 2016-02-18 16:39:34 +00:00
Hieu Hoang
6a363d893c Merge ../mosesdecoder into perf_moses2 2016-02-17 17:39:51 +00:00
Hieu Hoang
0a1856d510 Merge ../mosesdecoder into perf_moses2 2016-02-17 17:38:07 +00:00
Ales Tamchyna
ca6dba9108 update VW compatibility 2016-02-17 11:27:44 +01:00
Hieu Hoang
0d0f75b6e0 gets right score 2016-02-16 16:03:37 +00:00
Ulrich Germann
d7db5d2441 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-02-15 16:49:03 +00:00
Ulrich Germann
bbcd10a62d Better option handling in check-coverage3. 2016-02-15 16:48:46 +00:00
MosesAdmin
ca5178b684 daily automatic beautifier 2016-02-13 00:02:04 +00:00
Hieu Hoang
938ef79404 Merge ../mosesdecoder into perf_moses2 2016-02-12 19:40:04 +00:00
Matthias Huck
1659d6b4c8 Option for target constituent constrained phrase extraction. TargetConstituentAdjacencyFeature. 2016-02-12 17:46:57 +00:00
Ulrich Germann
490edf7a82 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-02-06 15:20:09 +00:00
Ulrich Germann
105225d398 Bug fix. 2016-02-06 15:19:44 +00:00
Hieu Hoang
06769e648d Merge ../mosesdecoder into perf_moses2 2016-02-04 13:05:36 +00:00
Barry Haddow
d48a4fc059 Fix mosesserver for hiero 2016-02-01 16:26:58 +00:00
Barry Haddow
713a8e4233 dont crash if no translation in hiero server 2016-01-29 17:13:03 +00:00
Hieu Hoang
30eb2950ca print probint pt version 2016-01-28 20:33:16 +00:00
Ulrich Germann
cf97a8599f Show all entries in check-coverage3. 2016-01-28 00:09:12 +00:00
Hieu Hoang
974510d0ce Merge ../mosesdecoder into perf_moses2 2016-01-25 14:34:28 +00:00
Ulrich Germann
c2268b559f Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-22 17:53:04 +00:00
Ulrich Germann
63b2933902 Improvements to check-coverage3.cc. 2016-01-22 17:52:40 +00:00
Ulrich Germann
56e13d152a Bug fix. 2016-01-20 20:14:38 +00:00
Ulrich Germann
2ab4e0f2fe Look-up phrases with context weights. 2016-01-20 18:44:01 +00:00
Hieu Hoang
357351f545 delete check on how total score is calculated 2016-01-19 22:34:06 +00:00
Ulrich Germann
ffdc9711e9 TrellisPath::InitTotalScore() and TrellisPath::GetScoreBreakDown() now use compute m_totalScore again in an identical fashion. 2016-01-19 18:45:23 +00:00
Ulrich Germann
cb477df36d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-15 22:52:44 +00:00
Ulrich Germann
37e68bcb31 Added Marcin Junczys-Dowmunt's implementation of Johnson et al.'s significance-based phrase table pruning to the master branch. 2016-01-15 22:52:29 +00:00
Hieu Hoang
10cc64ec3f save cache in descending order 2016-01-14 19:45:34 +00:00
Hieu Hoang
c131e3eb73 save most frequent source phrase to cache file 2016-01-14 16:00:10 +00:00
MosesAdmin
7344877741 daily automatic beautifier 2016-01-14 00:00:42 +00:00
Lane Schwartz
10debb4906 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-01-13 13:06:39 -06:00
Michael Denkowski
297691db57 Default number of workers to thread count 
(control workers with command line --threads option)
 2016-01-13 14:02:03 -05:00
Lane Schwartz
5431e91c26 Revert "eclipse" 
This reverts commit e0fb456dbb.

The reverted commit broken the moses build.
 2016-01-13 12:53:53 -06:00
Lane Schwartz
4dc2257152 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-01-13 12:39:24 -06:00
Hieu Hoang
31992defad might have deleted it by accident 2016-01-13 15:14:32 +00:00
Hieu Hoang
38f999fa3f Merge ../mosesdecoder into perf_moses2 2016-01-13 14:57:20 +00:00
Hieu Hoang
e0fb456dbb eclipse 2016-01-13 14:56:45 +00:00
MosesAdmin
c545b4160c daily automatic beautifier 2016-01-13 00:00:52 +00:00
Matthias Huck
3d051db850 TargetPreferencesFeature 2016-01-12 23:09:07 +00:00
Lane Schwartz
6089017cd8 Factored out code in Ken.cpp 2016-01-12 16:05:00 -06:00
Lane Schwartz
f964385a3b ReloadingLM now runs, reloading model before each sentence is translated 2016-01-12 15:54:21 -06:00
Lane Schwartz
b8e5ca51cb No more double LM scores 2016-01-12 15:19:07 -06:00
Lane Schwartz
d58db287c3 ReloadingLM compiles and runs, but gives double the LM score it should 2016-01-12 14:36:14 -06:00
Matthias Huck
020492b9da Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-12 18:49:44 +00:00
Lane Schwartz
70b20909b1 Merge branch 'master' of github.com:moses-smt/mosesdecoder into lane_multisrc 2016-01-12 12:49:05 -06:00
Lane Schwartz
f645511e5c Starting work on reloading LM 2016-01-12 12:44:39 -06:00
Matthias Huck
005d5506a1 SoftSourceSyntacticConstraintsFeature log output 2016-01-12 18:04:11 +00:00
Ulrich Germann
8d7dc4b446 Bug fix related to --report-all-factors. 2016-01-12 17:20:29 +00:00
Hieu Hoang
d0a48e71ad Merge ../mosesdecoder into perf_moses2 2016-01-12 09:23:07 +00:00
Ulrich Germann
256d57369a Bug fix in server as suggested by Martin Baumgärtner. 2016-01-11 15:48:36 -06:00
Ulrich Germann
074614974c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-11 21:44:23 +00:00
Ulrich Germann
fdc8e05984 Bug fix in server as suggested by Martin Baumgärtner. 2016-01-11 21:43:58 +00:00
Matthias Huck
a5a4401fe9 TargetPreferencesPhraseProperty 2016-01-11 20:14:28 +00:00
Hieu Hoang
b4e1176c5a Merge ../mosesdecoder into perf_moses2 2016-01-08 11:32:57 +00:00
Matthias Huck
8750c71ef4 PhraseOrientationFeature configuration parameters 2016-01-07 21:52:22 +00:00
Matthias Huck
97e786de12 PhraseOrientationFeature: ignore-boundary configuration parameter 2016-01-07 19:28:08 +00:00
Hieu Hoang
7577a6f84f Merge ../mosesdecoder into perf_moses2 2016-01-07 18:20:27 +00:00
Matthias Huck
fdb4abb778 PhraseOrientationFeature: default config parameter values 2016-01-07 17:36:43 +00:00
Hieu Hoang
79a642bc0e Merge ../mosesdecoder into perf_moses2 2016-01-07 13:01:02 +00:00
Hieu Hoang
5d1bc4b406 log prob 2016-01-07 12:06:49 +00:00
Hieu Hoang
859705431a use program_options to parse command line args 2016-01-07 11:11:31 +00:00
MosesAdmin
f6eaa5daa7 daily automatic beautifier 2016-01-07 00:00:37 +00:00
Hieu Hoang
bf19d71780 Merge ../mosesdecoder into perf_moses2 2016-01-06 21:03:33 +00:00
Matthias Huck
dda3f1867c Hiero phrase orientation 2016-01-06 18:52:14 +00:00
Matthias Huck
f6b0d988d9 eliminate compiler warnings 2016-01-06 17:35:19 +00:00
MosesAdmin
a2431ce62a daily automatic beautifier 2016-01-06 00:00:41 +00:00
Hieu Hoang
05236daf69 Merge ../mosesdecoder into perf_moses2 2016-01-05 10:58:15 +00:00
Ulrich Germann
9caeda5751 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-04 22:58:48 +00:00
Ulrich Germann
e594211e25 Fix bug in reporting of word alignment info in batch mode. 2016-01-04 22:53:38 +00:00
Ulrich Germann
b32d7754cd Code cleanup. 2016-01-04 22:51:43 +00:00
MosesAdmin
6e39865213 daily automatic beautifier 2015-12-30 00:00:41 +00:00
Hieu Hoang
f2c4bb53b2 Merge ../mosesdecoder into perf_moses2 2015-12-29 20:05:16 +00:00
Hieu Hoang
11809630ea add PhraseDictionaryMemoryPerSentence 2015-12-29 20:02:25 +00:00
Hieu Hoang
c093bf206e increment probing pt version 2015-12-28 21:15:43 +00:00
Hieu Hoang
94db0753bb exclude LexRO from property column 2015-12-28 16:16:23 +00:00
Hieu Hoang
73516a34c2 append lex probs to pt probs 2015-12-28 15:50:42 +00:00
Hieu Hoang
06cd3b977b append lex probs to pt probs 2015-12-28 13:00:26 +00:00
michaelhutt
cf5d093c4f fixes parameter mismatch in LM::Load 2015-12-23 13:31:49 -05:00
Hieu Hoang
50a75aef1e apply Nikolay's changes to moses2 fork 2015-12-23 13:31:23 +00:00
Nikolay Bogoychev
2951d3496e Change API version and finish up support for additional PT features 2015-12-22 21:06:07 +00:00
Nikolay Bogoychev
6c0ca3fad7 Work to support extra features in the PT 2015-12-22 20:37:06 +00:00
Hieu Hoang
139ee7e0c8 fix tokenization 2015-12-22 18:15:00 +00:00
Hieu Hoang
f3cdad40da correct phrase-table column description and number 2015-12-22 10:55:02 +00:00
Hieu Hoang
24d3e0b326 Merge ../mosesdecoder into perf_moses2 2015-12-22 10:52:37 +00:00
Hieu Hoang
ade0cb6a2f create probing pt without word alignment 2015-12-21 21:46:22 +00:00
Hieu Hoang
dc44436481 integrate compact lex RO 2015-12-20 00:10:28 +00:00
Michael Denkowski
5de46d6ae9 Utility to look up phrase table entries for a corpus 
(specifically for dynamic phrase tables like Mmsapt and PhraseDictionaryGroup)
 2015-12-18 15:08:40 -05:00
Matthias Huck
0a39efb6c8 Hiero phrase orientation: modify some parameters 2015-12-18 17:24:42 +00:00
Hieu Hoang
b836ab24fb Merge ../mosesdecoder into perf_moses2 2015-12-18 10:26:09 +00:00
Hieu Hoang
b27310d367 always compile with probing pt 2015-12-18 00:26:25 +00:00
Ulrich Germann
e84afbfc1c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-12-17 00:22:19 +00:00
Ulrich Germann
1cd6478415 Updated minor Mmsapt-related utilities to catch up with refactoring of Moses. 2015-12-17 00:21:25 +00:00
Hieu Hoang
4f0dff6a6e Merge ../mosesdecoder into perf_moses2 2015-12-15 18:15:06 +00:00
Hieu Hoang
8b00dbec2e scoring now done in the state class 2015-12-15 13:12:24 -05:00
Hieu Hoang
ffaf24419d Merge ../mosesdecoder into perf_moses2 2015-12-14 13:18:15 +00:00
MosesAdmin
dfcdb43c28 daily automatic beautifier 2015-12-13 23:07:15 +00:00
Ulrich Germann
8b2f1ba529 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-12-13 22:31:58 +00:00
Ulrich Germann
bb6e0157aa Code cleanup and refactoring. 2015-12-13 22:31:43 +00:00
Hieu Hoang
18337d2a22 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-12-13 21:36:29 +00:00
Hieu Hoang
4858875289 compile error with compact pt reported by Shaimaa Marzouk 2015-12-13 21:36:18 +00:00
Hieu Hoang
1ba9af09fe Merge ../mosesdecoder into perf_moses2 2015-12-12 18:04:54 +00:00
MosesAdmin
b0d8c397bb daily automatic beautifier 2015-12-12 18:04:13 +00:00
Hieu Hoang
d21f62b8a8 SRI minor compile error 2015-12-12 18:02:52 +00:00
Hieu Hoang
8908fdb9bd Merge ../mosesdecoder into perf_moses2 2015-12-12 17:44:49 +00:00
Ulrich Germann
b899ab8175 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-12-12 15:31:42 +00:00
Ulrich Germann
9196cd1461 Changes to PhraseDictionaryCompact and LexicalReorderingtableCompact: 
- minphr-memory and minlexr-memory are now static members of the respective classes,
  not global variables; they are interpreted by class-specific option interpretation
  functions that are called from StaticData.cpp.
- m_weight has been removed from PhraseDictionaryCompact and PhraseDecoder,
  as it was never used.
 2015-12-12 15:28:22 +00:00
MosesAdmin
10531d5f02 daily automatic beautifier 2015-12-12 00:00:41 +00:00
Hieu Hoang
ca80646157 Merge ../mosesdecoder into perf_moses2 2015-12-11 22:30:06 +00:00
Hieu Hoang
4604cc96ba eclipse 2015-12-11 22:29:24 +00:00
Hieu Hoang
b813f893da Merge ../mosesdecoder into perf_moses2 2015-12-11 20:39:21 +00:00
Hieu Hoang
d17fa2ea80 change DALM::Load() - minor compile error. Update eclipse project 2015-12-11 20:39:03 +00:00
Hieu Hoang
e5d3306519 Merge ../mosesdecoder into perf_moses2 2015-12-11 17:29:10 +00:00
Hieu Hoang
51d21b09c0 Merge ../mosesdecoder into perf_moses2 2015-12-11 17:28:31 +00:00
Ulrich Germann
65f4f1f92a Code cleanup and refactoring. 2015-12-11 13:52:48 +00:00
Ulrich Germann
40ed3df9cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/ChartParser.cpp
	moses/ChartParser.h
	moses/ConfusionNet.h
	moses/FF/CountNonTerms.cpp
	moses/FF/CountNonTerms.h
	moses/FF/SoftSourceSyntacticConstraintsFeature.cpp
	moses/FF/SoftSourceSyntacticConstraintsFeature.h
	moses/FF/SourceGHKMTreeInputMatchFeature.cpp
	moses/FF/SourceGHKMTreeInputMatchFeature.h
	moses/ForestInput.cpp
	moses/InputType.h
	moses/MockHypothesis.cpp
	moses/Sentence.cpp
	moses/Sentence.h
	moses/StaticData.cpp
	moses/StaticData.h
	moses/Syntax/F2S/GlueRuleSynthesizer.h
	moses/Syntax/T2S/GlueRuleSynthesizer.cpp
	moses/Syntax/T2S/GlueRuleSynthesizer.h
	moses/TreeInput.cpp
	moses/XmlOption.cpp
	moses/XmlOption.h
 2015-12-11 01:59:26 +00:00
Ulrich Germann
29694af6e4 Code cleanup and refactoring. 2015-12-11 01:09:22 +00:00
MosesAdmin
739165c2b0 daily automatic beautifier 2015-12-11 00:00:33 +00:00
Matthias Huck
bd3f573452 Hiero phrase orientation 2015-12-10 12:56:37 +00:00
Ulrich Germann
831dc83778 Code cleanup and refactoring. 2015-12-10 03:17:36 +00:00
Ulrich Germann
240b88c683 Passing around AllOptions or references thereto everywhere, 
strong them locally where appropriate, so that compontents can
become independent of StaticData once instantiated.
 2015-12-09 23:05:00 +00:00
Ulrich Germann
ad5e27ae56 Implemented more options in AllOptions and option groups therein. 2015-12-09 17:59:14 +00:00
Ales Tamchyna
c71aca8311 reflect recent changes in VW code 2015-12-09 17:34:08 +01:00
MosesAdmin
59365f2bd3 daily automatic beautifier 2015-12-09 00:00:35 +00:00
Ulrich Germann
fdb5d9b282 Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData. 2015-12-08 12:56:55 +00:00
Ulrich Germann
9528b56242 Set defaults in option group constructors. 2015-12-08 12:43:20 +00:00
Ulrich Germann
c1a008bf6d Reduce dependence on StaticData. 2015-12-07 23:50:56 +00:00
Ulrich Germann
c4e45fb128 Code cleanup. 2015-12-07 16:07:11 +00:00
Ulrich Germann
2be2481feb Added switch --daemon: fork and run moses server in background. The parent won't exit until the child is ready to serve. 2015-12-07 16:01:12 +00:00
Ulrich Germann
d56d900d6a Code cleanup. 2015-12-06 01:43:17 +00:00
Ulrich Germann
69e5a1cc15 Code cleanup. 2015-12-06 00:12:01 +00:00
Philipp Koehn
b6a212b9ce bug fix: server mode did not report full search graph 2015-12-05 19:21:32 +00:00
Hieu Hoang
042f304afc Merge ../mosesdecoder into perf_moses2 2015-12-04 23:41:52 +00:00
Ulrich Germann
889a33dcd6 XmlOptions are now const within Sentence. 2015-12-04 19:43:37 +00:00
Ulrich Germann
4983aa0980 Cleanup. 2015-12-04 19:32:37 +00:00
Ulrich Germann
9e1503bf63 Added variant lrfunc (in addition to lr-func) as a Mmsapt parameter to accommodate a typo in my 2015 PBML paper. 2015-12-03 16:21:11 +00:00
MosesAdmin
157be7cc51 daily automatic beautifier 2015-12-03 00:01:07 +00:00
Ulrich Germann
97d6ccec98 Merge branch 'master' of https://github.com/modernmt/mosesdecoder 2015-12-02 20:51:45 +00:00
Ulrich Germann
5a63286447 Code cleanup and bug fix in (Base)Manager::OutputSurface: 
Mark-up of unkown words in output.
 2015-12-02 20:43:56 +00:00
Ulrich Germann
0f9cca4ae4 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-11-30 01:29:28 +00:00
Ulrich Germann
11262b0a62 Added switch --version to have Moses print out the code versions it was compiled with. 2015-11-30 01:29:13 +00:00
Ulrich Germann
9a321a0ce4 Bug fix: typo prevented compilation. 2015-11-30 01:12:04 +00:00
Ulrich Germann
c165e80e48 Changes to Mmsapt. 
- added phrase table features: pfwd / pbwd weighted by each sample's
  weight (when used with biased sampling)
- a few minor internal changes ({p|j}stats.add(...) reports back
  current joint count (intended for early stopping of sampling when
  evidence is sufficient; yet to be explored experimentally).
 2015-11-29 18:39:38 +00:00
Ulrich Germann
93df2b2f19 Initialization order of members. 2015-11-29 17:57:04 +00:00
Ulrich Germann
48999749ec Unused variable. 2015-11-29 17:56:27 +00:00
Ulrich Germann
37ea003f02 Avoid compiler warning. 2015-11-28 14:54:48 +00:00
Phil Williams
7375d81e16 Fix a few compiler warnings (clang) 2015-11-27 12:20:38 +00:00
Hieu Hoang
533aff9d53 Merge ../mosesdecoder into perf_moses2 2015-11-26 20:52:02 +00:00
Ulrich Germann
c11c4cbeed Bug fix related to commit 220d82041a, 
which replaced boost::intrusive_ptr<bitext>  with shared_ptr<bitext>.
 2015-11-25 19:51:54 +00:00
Ulrich Germann
ee5edc421c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-11-25 02:18:00 +00:00
MosesAdmin
57a291421a daily automatic beautifier 2015-11-25 00:00:39 +00:00
Ulrich Germann
bb135f6a64 Cosmetic fix for having the server reporting word alignments left-to-right. 2015-11-24 20:42:53 +00:00
Ulrich Germann
ca038c5e4c Fix suggested by Martin Baumgärtner to keep server from crashing when packing word alignments. 2015-11-24 19:24:09 +00:00
Ulrich Germann
c8b859de67 Merge remote-tracking branch 'legacy/master' 
Conflicts:
	moses/server/TranslationRequest.cpp
 2015-11-24 19:22:37 +00:00
Ulrich Germann
bcb0212b5b FF registration is now in FeatureFactory::DefaultSetup, ... 
... not in the FF constructor any more.

This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
 2015-11-24 18:28:38 +00:00
Hieu Hoang
ad377a53b6 Merge branch 'master' into perf_moses2 2015-11-24 15:12:10 +00:00
Ulrich Germann
a074efc7cc Change parameters only when specified during parameter updates in server mode. 2015-11-23 16:59:39 +00:00
Ulrich Germann
6f1e39d64e Adaptation to renamed functions in Bitext class. 2015-11-23 16:57:44 +00:00
Ulrich Germann
9a7356bbed Adaptation to renamed functions in Bitext class. 2015-11-23 16:57:35 +00:00
Barry Haddow
87ec9f56c7 bugfix: options refactor broke (l)mbr 2015-11-23 12:37:11 +00:00
Barry Haddow
10df006eed Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-11-23 12:16:46 +00:00
Ulrich Germann
894644d615 Merge ../master into sync-with-mmt 2015-11-20 17:43:05 +00:00
Ulrich Germann
3f09aa40aa Additional functions for determining doc ids and document names from mapped bitexts. 2015-11-20 17:10:47 +00:00
Ulrich Germann
a767608804 Bug fix in keeping track of doc ids with uniform random sampling. 2015-11-20 17:09:18 +00:00
Ulrich Germann
1fa81806c1 Work in progress. 2015-11-20 17:07:17 +00:00
Ulrich Germann
752ac68d08 Merge branch 'moses-server-placeholder-patch' of https://github.com/ebay-hlt/mosesdecoder into ebay-hlt-moses-server-placeholder-patch 
Conflicts:
	regression-testing/Jamfile
	run-regtests.sh
 2015-11-20 14:47:59 +00:00
MosesAdmin
bf209a35a3 daily automatic beautifier 2015-11-20 00:00:42 +00:00
Evgeny Matusov
42c57d077b Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into moses-server-placeholder-patch 
Conflict in TranslationRequest solved.

Conflicts:
	moses/server/TranslationRequest.cpp
	moses/server/TranslationRequest.h
 2015-11-19 09:59:15 -07:00
Ulrich Germann
c610d0a6e7 Code decluttering. 
The class StatefuleFeatureFunction now provides an empty dummy implementation
of various (virtual) Evaluate... functions. The corresponding empty
implementations on derived classes have been removed.
 2015-11-19 13:54:24 +00:00
Evgeny Matusov
f346dcd37f another fix to debug output for moses server 2015-11-19 12:42:07 +01:00
Evgeny Matusov
aa7ef1738b another update in Debug output for Moses server 2015-11-19 12:20:48 +01:00
Evgeny Matusov
d3fb16d39f changed debug output for moses server 2015-11-19 12:03:19 +01:00
Ulrich Germann
edacfbb9fd Bug fix in server: Moses server now handles the placeholder mechanism for translations provided with the input. 2015-11-18 17:09:52 +00:00
Evgeny Matusov
4e8396744c added first version of regression testing for moses server 2015-11-18 16:21:50 +01:00
Hieu Hoang
91bd99e649 Merge ../mosesdecoder into perf_moses2 2015-11-18 12:11:16 +00:00
Ulrich Germann
220d82041a gcc-4.4.7 was struggling with boost::intrusive_ptr. Switched to shared_ptr. 2015-11-18 10:35:17 +00:00
Barry Haddow
21d8111287 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-11-18 09:50:29 +00:00
David Madl
060a5f1b47 forward declare SHyperedge in StatefulFeatureFunction, StatelessFeatureFunction 2015-11-17 16:17:09 +00:00
Hieu Hoang
86e1af8631 delete g_mosesDebug 2015-11-17 16:16:17 +00:00
David Madl
8729a2d47d Measure TimeOtherScore in Search instead of in Hypothesis 2015-11-17 16:15:13 +00:00
David Madl
5fea16a9a6 move options out of Hypothesis 2015-11-17 16:15:13 +00:00
David Madl
73ab44c126 Hypothesis: get rid of calls into Manager from constructor 2015-11-17 16:15:13 +00:00
David Madl
b1ea3d624b Dump two ugly, old overrides of Hypothesis::EvaluateWhenApplied() 
A Brief History of Time:

65ddbf3 7/2/12 Wilson, "Implement batched LM requests."
776da79 8/6/15 Hoang, "delete old unused code"
 2015-11-17 16:15:13 +00:00
David Madl
e5a8438149 document @param lhs in Phrase::CreateFromString() 2015-11-17 16:15:13 +00:00
David Madl
e36fb96557 LanguageModel, KenLM: avoid StaticData usage 
* drop global lmodel-oov-feature option, and add it to LM FF config line instead
	use oov-feature=1 (bool) option instead
* drop LanguageModel::GetWeight()
* KenLM: use m_verbosity of FF instead of IFVERBOSE macro which uses StaticData

* train-model.perl: move language model OOV feature onto LM feature spec line
 2015-11-17 16:15:13 +00:00
David Madl
3b63930943 move global Timer to Timer.h 
Move ResetUserTime(), PrintUserTime(), GetUserTime() to Timer.h

Do not reset timer in StaticData.
 2015-11-17 16:15:13 +00:00
David Madl
0dd6c31f63 FeatureFunction: enable construction without registering 2015-11-17 16:15:13 +00:00
David Madl
3288eb5f50 remove IOWrapper.cpp unused includes such as Incremental.h (and others) 2015-11-17 16:15:13 +00:00
Hieu Hoang
6432fefd3b Merge ../mosesdecoder into perf_moses2 2015-11-17 15:51:29 +00:00
Evgeny Matusov
5e1340cf63 fixed moses server placehoders ; correctly implemented the boolean parameter check function for mosesserver request parameters 2015-11-17 15:16:39 +01:00
Evgeny Matusov
66928f682f second commit of moses server placeholder fix 2015-11-17 15:06:48 +01:00
Evgeny Matusov
7c088c9a95 first commit of placeholder changes to moses server 2015-11-17 14:19:36 +01:00
MosesAdmin
fef50536d6 daily automatic beautifier 2015-11-17 00:00:49 +00:00
Phil Williams
d317fdc373 Store SHyperedge feature scores as deltas instead of totals 
This mirrors the change made for the chart decoder in commit 465b4756...
 2015-11-16 19:23:27 +00:00
Michael Denkowski
07001f7645 Model support bitmap features in PhraseDictionaryGroup 2015-11-16 11:23:18 -05:00
Michael Denkowski
9df2336d45 Per-model phrase and word counts in PhraseDictionaryGroup 2015-11-13 17:22:27 -05:00
Michael Denkowski
e3cca68ed7 mmsapt-lr-func option for PhraseDictionaryGroup 
Support also filling in gaps via averaging for LR functions of member
Mmsapt models
 2015-11-13 13:56:26 -05:00
Michael Denkowski
49f4eeca47 default-average-others option for PhraseDictionaryGroup 
Average scores of other models to fill in gaps for unseen phrases
 2015-11-12 16:33:52 -05:00
Ulrich Germann
7b8a875efb Merge branch 'master' of http://github.com/moses-smt/mosesdecoder 2015-11-12 14:02:16 +00:00
Hieu Hoang
28eee66d6e Merge ../mosesdecoder into perf_moses2 2015-11-12 13:12:25 +00:00
MosesAdmin
dad1bd6127 daily automatic beautifier 2015-11-12 00:00:40 +00:00
Ulrich Germann
b01eb7cbd0 Bug fix: m_reportAllFactors was never initialized or set. 
Removed altogether, now using m_options.output.ReportAllFactors.
 2015-11-11 19:56:43 +00:00
Ulrich Germann
e357a75972 Merge branch 'master' of ../legacy 2015-11-11 17:28:20 +00:00
Ulrich Germann
858a509d53 Added missing files. 2015-11-11 17:27:53 +00:00
Ulrich Germann
37b63f2d79 Merge branch 'master' of ../legacy into mmt-dev 
Conflicts:
	moses/FF/LexicalReordering/LexicalReordering.cpp
 2015-11-11 17:19:49 +00:00
Ulrich Germann
f247e26fed More options refactoring (OOV Handling this time). 2015-11-11 17:07:45 +00:00
Hieu Hoang
28dee22e0a Revert "move printFF out of Parameter class" 
This reverts commit 4b5466bcfe.
 2015-11-11 14:04:53 +00:00
Hieu Hoang
4b5466bcfe move printFF out of Parameter class 2015-11-11 13:52:42 +00:00
Ulrich Germann
2ab6b8f16d Merge branch 'master' of http://github.com/moses-smt/mosesdecoder 2015-11-11 01:08:22 +00:00
Ulrich Germann
9826599cb0 Enforce const-ness of command line arguments; bug fix in mosesserver.cpp. 2015-11-11 01:08:05 +00:00
Ulrich Germann
d727829387 Merge branch 'master' of https://github.com/modernmt/mosesdecoder 
Conflicts:
	moses/parameters/InputOptions.cpp
	moses/parameters/InputOptions.h
 2015-11-10 23:05:13 +00:00
Ulrich Germann
806f888c10 Moved placeholder factor variable from StaticData to InputOptions. 2015-11-10 21:44:48 +00:00
Barry Haddow
1996502fcb Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-11-10 21:35:59 +00:00
Barry Haddow
ccfe8ba018 remove unused method, and misleading comment 2015-11-10 21:35:08 +00:00
Michael Denkowski
652283c538 Consistent naming: zeros -> default-scores 
(Matches LexicalReordering)
 2015-11-10 15:48:41 -05:00