Hieu Hoang
f96b48a041
Merge ../mosesdecoder into perf_moses2
2016-03-11 16:38:38 +00:00
Ales Tamchyna
3e5c0e8667
minor
2016-03-10 14:01:47 +01:00
Ales Tamchyna
d972d50b79
optimizing VW queries by caching
2016-03-10 13:41:56 +01:00
Ales Tamchyna
6b579c2156
VW feature functions now also output extracted features for caching
2016-03-09 19:27:24 +01:00
Ales Tamchyna
1007b376b2
return feature ids when adding features
2016-03-09 18:52:07 +01:00
Ales Tamchyna
4486c8ec43
important bug fix in target-side VW, adding optional debugging messages
2016-03-08 14:42:45 +01:00
Jeroen
ae5ad8a49e
Detect write errors in LVoc.
...
Write failures in LVoc::Write() were going unnoticed. If disk space
runs out, the output file might get truncated without any indication
of failure.
2016-03-07 18:55:18 +01:00
Ales Tamchyna
f13ba3bdfb
bugfix
2016-03-07 18:04:17 +01:00
Ales Tamchyna
dab84877ae
bugfix
2016-03-07 16:31:41 +01:00
Ales Tamchyna
3bc2124f78
prepend BOS words to target sentence when training VW
2016-03-07 16:18:33 +01:00
Ales Tamchyna
f169c59204
removing outdated method
2016-03-07 15:49:53 +01:00
Ales Tamchyna
7fbbc65902
update vw state
2016-03-07 15:45:51 +01:00
Ales Tamchyna
e4487c8d45
finished a naive implementation of vw target context, it compiles
2016-03-07 15:24:39 +01:00
Ales Tamchyna
0ca54e4d15
keep track of required context size for each VW features
2016-03-07 14:25:04 +01:00
Ales Tamchyna
0704e9c2e5
towards state tracking for VW
2016-03-07 13:52:40 +01:00
Ales Tamchyna
fa8df45656
evaluate VW with target context
2016-03-07 13:17:38 +01:00
Ales Tamchyna
48d9d8e0d4
towards evaluation in target context
2016-03-07 12:41:05 +01:00
Ales Tamchyna
0484739873
when target context features are used in VW, do not add any score before decoding, cache it instead
2016-03-07 11:57:44 +01:00
Ales Tamchyna
8003d28ffa
note
2016-03-07 11:05:47 +01:00
Ales Tamchyna
97b1625ffa
pseudocode for target-context evaluation in decoding with VW
2016-03-03 17:27:40 +01:00
Ales Tamchyna
82c3254d46
Merge branch 'master' of github.com:moses-smt/mosesdecoder into vw_tgtcontext
2016-03-03 17:03:28 +01:00
Ales Tamchyna
e74e147c84
minor
2016-03-03 17:02:22 +01:00
Ales Tamchyna
396982010b
support training with target-context features in VW
2016-03-03 16:29:57 +01:00
Ales Tamchyna
b43e24f953
implemented a basic target context feature
2016-03-03 15:39:46 +01:00
Ales Tamchyna
91541f0b83
target context feature base class
2016-03-03 14:46:51 +01:00
Ales Tamchyna
4b5e49aff9
new vw feature type: target context
2016-03-03 13:50:52 +01:00
Ales Tamchyna
dce605029c
make VW feature stateful
2016-03-02 17:28:21 +01:00
Hieu Hoang
b9217cec1d
Merge ../mosesdecoder into perf_moses2
2016-03-01 11:08:39 +00:00
Matthias Huck
2d6f616480
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/Model1Feature.cpp
2016-02-22 18:30:11 +00:00
Matthias Huck
5c8c15d345
Model1Feature: skip-target-punctuation parameter
2016-02-22 18:28:23 +00:00
MosesAdmin
6da1343f88
daily automatic beautifier
2016-02-22 00:00:40 +00:00
Hieu Hoang
e6bc481ee2
Merge ../mosesdecoder into perf_moses2
2016-02-21 23:09:46 +00:00
Matthias Huck
71a0fcbc27
Model1Feature: skip over target-side punctuation
2016-02-21 20:44:09 +00:00
Matthias Huck
e284503018
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-02-20 00:40:23 +00:00
Matthias Huck
ebb18b2dc2
WordTranslationFeature: fix loading of word lists
2016-02-20 00:39:02 +00:00
Kenneth Heafield
7a1baeecda
load= option to KenLM exposing more load_method options
2016-02-20 00:07:48 +00:00
Ulrich Germann
63eefe03fd
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-02-19 10:23:21 +00:00
Ulrich Germann
98bcf53ec2
Namespace bug fix.
2016-02-18 16:39:34 +00:00
Hieu Hoang
6a363d893c
Merge ../mosesdecoder into perf_moses2
2016-02-17 17:39:51 +00:00
Hieu Hoang
0a1856d510
Merge ../mosesdecoder into perf_moses2
2016-02-17 17:38:07 +00:00
Ales Tamchyna
ca6dba9108
update VW compatibility
2016-02-17 11:27:44 +01:00
Hieu Hoang
0d0f75b6e0
gets right score
2016-02-16 16:03:37 +00:00
Ulrich Germann
d7db5d2441
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-02-15 16:49:03 +00:00
Ulrich Germann
bbcd10a62d
Better option handling in check-coverage3.
2016-02-15 16:48:46 +00:00
MosesAdmin
ca5178b684
daily automatic beautifier
2016-02-13 00:02:04 +00:00
Hieu Hoang
938ef79404
Merge ../mosesdecoder into perf_moses2
2016-02-12 19:40:04 +00:00
Matthias Huck
1659d6b4c8
Option for target constituent constrained phrase extraction. TargetConstituentAdjacencyFeature.
2016-02-12 17:46:57 +00:00
Ulrich Germann
490edf7a82
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-02-06 15:20:09 +00:00
Ulrich Germann
105225d398
Bug fix.
2016-02-06 15:19:44 +00:00
Hieu Hoang
06769e648d
Merge ../mosesdecoder into perf_moses2
2016-02-04 13:05:36 +00:00
Barry Haddow
d48a4fc059
Fix mosesserver for hiero
2016-02-01 16:26:58 +00:00
Barry Haddow
713a8e4233
dont crash if no translation in hiero server
2016-01-29 17:13:03 +00:00
Hieu Hoang
30eb2950ca
print probint pt version
2016-01-28 20:33:16 +00:00
Ulrich Germann
cf97a8599f
Show all entries in check-coverage3.
2016-01-28 00:09:12 +00:00
Hieu Hoang
974510d0ce
Merge ../mosesdecoder into perf_moses2
2016-01-25 14:34:28 +00:00
Ulrich Germann
c2268b559f
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-01-22 17:53:04 +00:00
Ulrich Germann
63b2933902
Improvements to check-coverage3.cc.
2016-01-22 17:52:40 +00:00
Ulrich Germann
56e13d152a
Bug fix.
2016-01-20 20:14:38 +00:00
Ulrich Germann
2ab4e0f2fe
Look-up phrases with context weights.
2016-01-20 18:44:01 +00:00
Hieu Hoang
357351f545
delete check on how total score is calculated
2016-01-19 22:34:06 +00:00
Ulrich Germann
ffdc9711e9
TrellisPath::InitTotalScore() and TrellisPath::GetScoreBreakDown() now use compute m_totalScore again in an identical fashion.
2016-01-19 18:45:23 +00:00
Ulrich Germann
cb477df36d
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-01-15 22:52:44 +00:00
Ulrich Germann
37e68bcb31
Added Marcin Junczys-Dowmunt's implementation of Johnson et al.'s significance-based phrase table pruning to the master branch.
2016-01-15 22:52:29 +00:00
Hieu Hoang
10cc64ec3f
save cache in descending order
2016-01-14 19:45:34 +00:00
Hieu Hoang
c131e3eb73
save most frequent source phrase to cache file
2016-01-14 16:00:10 +00:00
MosesAdmin
7344877741
daily automatic beautifier
2016-01-14 00:00:42 +00:00
Lane Schwartz
10debb4906
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-01-13 13:06:39 -06:00
Michael Denkowski
297691db57
Default number of workers to thread count
...
(control workers with command line --threads option)
2016-01-13 14:02:03 -05:00
Lane Schwartz
5431e91c26
Revert "eclipse"
...
This reverts commit e0fb456dbb
.
The reverted commit broken the moses build.
2016-01-13 12:53:53 -06:00
Lane Schwartz
4dc2257152
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-01-13 12:39:24 -06:00
Hieu Hoang
31992defad
might have deleted it by accident
2016-01-13 15:14:32 +00:00
Hieu Hoang
38f999fa3f
Merge ../mosesdecoder into perf_moses2
2016-01-13 14:57:20 +00:00
Hieu Hoang
e0fb456dbb
eclipse
2016-01-13 14:56:45 +00:00
MosesAdmin
c545b4160c
daily automatic beautifier
2016-01-13 00:00:52 +00:00
Matthias Huck
3d051db850
TargetPreferencesFeature
2016-01-12 23:09:07 +00:00
Lane Schwartz
6089017cd8
Factored out code in Ken.cpp
2016-01-12 16:05:00 -06:00
Lane Schwartz
f964385a3b
ReloadingLM now runs, reloading model before each sentence is translated
2016-01-12 15:54:21 -06:00
Lane Schwartz
b8e5ca51cb
No more double LM scores
2016-01-12 15:19:07 -06:00
Lane Schwartz
d58db287c3
ReloadingLM compiles and runs, but gives double the LM score it should
2016-01-12 14:36:14 -06:00
Matthias Huck
020492b9da
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-01-12 18:49:44 +00:00
Lane Schwartz
70b20909b1
Merge branch 'master' of github.com:moses-smt/mosesdecoder into lane_multisrc
2016-01-12 12:49:05 -06:00
Lane Schwartz
f645511e5c
Starting work on reloading LM
2016-01-12 12:44:39 -06:00
Matthias Huck
005d5506a1
SoftSourceSyntacticConstraintsFeature log output
2016-01-12 18:04:11 +00:00
Ulrich Germann
8d7dc4b446
Bug fix related to --report-all-factors.
2016-01-12 17:20:29 +00:00
Hieu Hoang
d0a48e71ad
Merge ../mosesdecoder into perf_moses2
2016-01-12 09:23:07 +00:00
Ulrich Germann
256d57369a
Bug fix in server as suggested by Martin Baumgärtner.
2016-01-11 15:48:36 -06:00
Ulrich Germann
074614974c
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-01-11 21:44:23 +00:00
Ulrich Germann
fdc8e05984
Bug fix in server as suggested by Martin Baumgärtner.
2016-01-11 21:43:58 +00:00
Matthias Huck
a5a4401fe9
TargetPreferencesPhraseProperty
2016-01-11 20:14:28 +00:00
Hieu Hoang
b4e1176c5a
Merge ../mosesdecoder into perf_moses2
2016-01-08 11:32:57 +00:00
Matthias Huck
8750c71ef4
PhraseOrientationFeature configuration parameters
2016-01-07 21:52:22 +00:00
Matthias Huck
97e786de12
PhraseOrientationFeature: ignore-boundary configuration parameter
2016-01-07 19:28:08 +00:00
Hieu Hoang
7577a6f84f
Merge ../mosesdecoder into perf_moses2
2016-01-07 18:20:27 +00:00
Matthias Huck
fdb4abb778
PhraseOrientationFeature: default config parameter values
2016-01-07 17:36:43 +00:00
Hieu Hoang
79a642bc0e
Merge ../mosesdecoder into perf_moses2
2016-01-07 13:01:02 +00:00
Hieu Hoang
5d1bc4b406
log prob
2016-01-07 12:06:49 +00:00
Hieu Hoang
859705431a
use program_options to parse command line args
2016-01-07 11:11:31 +00:00
MosesAdmin
f6eaa5daa7
daily automatic beautifier
2016-01-07 00:00:37 +00:00
Hieu Hoang
bf19d71780
Merge ../mosesdecoder into perf_moses2
2016-01-06 21:03:33 +00:00
Matthias Huck
dda3f1867c
Hiero phrase orientation
2016-01-06 18:52:14 +00:00
Matthias Huck
f6b0d988d9
eliminate compiler warnings
2016-01-06 17:35:19 +00:00
MosesAdmin
a2431ce62a
daily automatic beautifier
2016-01-06 00:00:41 +00:00
Hieu Hoang
05236daf69
Merge ../mosesdecoder into perf_moses2
2016-01-05 10:58:15 +00:00
Ulrich Germann
9caeda5751
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2016-01-04 22:58:48 +00:00
Ulrich Germann
e594211e25
Fix bug in reporting of word alignment info in batch mode.
2016-01-04 22:53:38 +00:00
Ulrich Germann
b32d7754cd
Code cleanup.
2016-01-04 22:51:43 +00:00
MosesAdmin
6e39865213
daily automatic beautifier
2015-12-30 00:00:41 +00:00
Hieu Hoang
f2c4bb53b2
Merge ../mosesdecoder into perf_moses2
2015-12-29 20:05:16 +00:00
Hieu Hoang
11809630ea
add PhraseDictionaryMemoryPerSentence
2015-12-29 20:02:25 +00:00
Hieu Hoang
c093bf206e
increment probing pt version
2015-12-28 21:15:43 +00:00
Hieu Hoang
94db0753bb
exclude LexRO from property column
2015-12-28 16:16:23 +00:00
Hieu Hoang
73516a34c2
append lex probs to pt probs
2015-12-28 15:50:42 +00:00
Hieu Hoang
06cd3b977b
append lex probs to pt probs
2015-12-28 13:00:26 +00:00
michaelhutt
cf5d093c4f
fixes parameter mismatch in LM::Load
2015-12-23 13:31:49 -05:00
Hieu Hoang
50a75aef1e
apply Nikolay's changes to moses2 fork
2015-12-23 13:31:23 +00:00
Nikolay Bogoychev
2951d3496e
Change API version and finish up support for additional PT features
2015-12-22 21:06:07 +00:00
Nikolay Bogoychev
6c0ca3fad7
Work to support extra features in the PT
2015-12-22 20:37:06 +00:00
Hieu Hoang
139ee7e0c8
fix tokenization
2015-12-22 18:15:00 +00:00
Hieu Hoang
f3cdad40da
correct phrase-table column description and number
2015-12-22 10:55:02 +00:00
Hieu Hoang
24d3e0b326
Merge ../mosesdecoder into perf_moses2
2015-12-22 10:52:37 +00:00
Hieu Hoang
ade0cb6a2f
create probing pt without word alignment
2015-12-21 21:46:22 +00:00
Hieu Hoang
dc44436481
integrate compact lex RO
2015-12-20 00:10:28 +00:00
Michael Denkowski
5de46d6ae9
Utility to look up phrase table entries for a corpus
...
(specifically for dynamic phrase tables like Mmsapt and PhraseDictionaryGroup)
2015-12-18 15:08:40 -05:00
Matthias Huck
0a39efb6c8
Hiero phrase orientation: modify some parameters
2015-12-18 17:24:42 +00:00
Hieu Hoang
b836ab24fb
Merge ../mosesdecoder into perf_moses2
2015-12-18 10:26:09 +00:00
Hieu Hoang
b27310d367
always compile with probing pt
2015-12-18 00:26:25 +00:00
Ulrich Germann
e84afbfc1c
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-12-17 00:22:19 +00:00
Ulrich Germann
1cd6478415
Updated minor Mmsapt-related utilities to catch up with refactoring of Moses.
2015-12-17 00:21:25 +00:00
Hieu Hoang
4f0dff6a6e
Merge ../mosesdecoder into perf_moses2
2015-12-15 18:15:06 +00:00
Hieu Hoang
8b00dbec2e
scoring now done in the state class
2015-12-15 13:12:24 -05:00
Hieu Hoang
ffaf24419d
Merge ../mosesdecoder into perf_moses2
2015-12-14 13:18:15 +00:00
MosesAdmin
dfcdb43c28
daily automatic beautifier
2015-12-13 23:07:15 +00:00
Ulrich Germann
8b2f1ba529
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-12-13 22:31:58 +00:00
Ulrich Germann
bb6e0157aa
Code cleanup and refactoring.
2015-12-13 22:31:43 +00:00
Hieu Hoang
18337d2a22
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-12-13 21:36:29 +00:00
Hieu Hoang
4858875289
compile error with compact pt reported by Shaimaa Marzouk
2015-12-13 21:36:18 +00:00
Hieu Hoang
1ba9af09fe
Merge ../mosesdecoder into perf_moses2
2015-12-12 18:04:54 +00:00
MosesAdmin
b0d8c397bb
daily automatic beautifier
2015-12-12 18:04:13 +00:00
Hieu Hoang
d21f62b8a8
SRI minor compile error
2015-12-12 18:02:52 +00:00
Hieu Hoang
8908fdb9bd
Merge ../mosesdecoder into perf_moses2
2015-12-12 17:44:49 +00:00
Ulrich Germann
b899ab8175
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-12-12 15:31:42 +00:00
Ulrich Germann
9196cd1461
Changes to PhraseDictionaryCompact and LexicalReorderingtableCompact:
...
- minphr-memory and minlexr-memory are now static members of the respective classes,
not global variables; they are interpreted by class-specific option interpretation
functions that are called from StaticData.cpp.
- m_weight has been removed from PhraseDictionaryCompact and PhraseDecoder,
as it was never used.
2015-12-12 15:28:22 +00:00
MosesAdmin
10531d5f02
daily automatic beautifier
2015-12-12 00:00:41 +00:00
Hieu Hoang
ca80646157
Merge ../mosesdecoder into perf_moses2
2015-12-11 22:30:06 +00:00
Hieu Hoang
4604cc96ba
eclipse
2015-12-11 22:29:24 +00:00
Hieu Hoang
b813f893da
Merge ../mosesdecoder into perf_moses2
2015-12-11 20:39:21 +00:00
Hieu Hoang
d17fa2ea80
change DALM::Load() - minor compile error. Update eclipse project
2015-12-11 20:39:03 +00:00
Hieu Hoang
e5d3306519
Merge ../mosesdecoder into perf_moses2
2015-12-11 17:29:10 +00:00
Hieu Hoang
51d21b09c0
Merge ../mosesdecoder into perf_moses2
2015-12-11 17:28:31 +00:00
Ulrich Germann
65f4f1f92a
Code cleanup and refactoring.
2015-12-11 13:52:48 +00:00
Ulrich Germann
40ed3df9cb
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/ChartParser.cpp
moses/ChartParser.h
moses/ConfusionNet.h
moses/FF/CountNonTerms.cpp
moses/FF/CountNonTerms.h
moses/FF/SoftSourceSyntacticConstraintsFeature.cpp
moses/FF/SoftSourceSyntacticConstraintsFeature.h
moses/FF/SourceGHKMTreeInputMatchFeature.cpp
moses/FF/SourceGHKMTreeInputMatchFeature.h
moses/ForestInput.cpp
moses/InputType.h
moses/MockHypothesis.cpp
moses/Sentence.cpp
moses/Sentence.h
moses/StaticData.cpp
moses/StaticData.h
moses/Syntax/F2S/GlueRuleSynthesizer.h
moses/Syntax/T2S/GlueRuleSynthesizer.cpp
moses/Syntax/T2S/GlueRuleSynthesizer.h
moses/TreeInput.cpp
moses/XmlOption.cpp
moses/XmlOption.h
2015-12-11 01:59:26 +00:00
Ulrich Germann
29694af6e4
Code cleanup and refactoring.
2015-12-11 01:09:22 +00:00
MosesAdmin
739165c2b0
daily automatic beautifier
2015-12-11 00:00:33 +00:00
Matthias Huck
bd3f573452
Hiero phrase orientation
2015-12-10 12:56:37 +00:00
Ulrich Germann
831dc83778
Code cleanup and refactoring.
2015-12-10 03:17:36 +00:00
Ulrich Germann
240b88c683
Passing around AllOptions or references thereto everywhere,
...
strong them locally where appropriate, so that compontents can
become independent of StaticData once instantiated.
2015-12-09 23:05:00 +00:00
Ulrich Germann
ad5e27ae56
Implemented more options in AllOptions and option groups therein.
2015-12-09 17:59:14 +00:00
Ales Tamchyna
c71aca8311
reflect recent changes in VW code
2015-12-09 17:34:08 +01:00
MosesAdmin
59365f2bd3
daily automatic beautifier
2015-12-09 00:00:35 +00:00
Ulrich Germann
fdb5d9b282
Code refactoring: All FF now get access to AllOptions at load time, so they don't have to rely on StaticData.
2015-12-08 12:56:55 +00:00
Ulrich Germann
9528b56242
Set defaults in option group constructors.
2015-12-08 12:43:20 +00:00
Ulrich Germann
c1a008bf6d
Reduce dependence on StaticData.
2015-12-07 23:50:56 +00:00
Ulrich Germann
c4e45fb128
Code cleanup.
2015-12-07 16:07:11 +00:00
Ulrich Germann
2be2481feb
Added switch --daemon: fork and run moses server in background. The parent won't exit until the child is ready to serve.
2015-12-07 16:01:12 +00:00
Ulrich Germann
d56d900d6a
Code cleanup.
2015-12-06 01:43:17 +00:00
Ulrich Germann
69e5a1cc15
Code cleanup.
2015-12-06 00:12:01 +00:00
Philipp Koehn
b6a212b9ce
bug fix: server mode did not report full search graph
2015-12-05 19:21:32 +00:00
Hieu Hoang
042f304afc
Merge ../mosesdecoder into perf_moses2
2015-12-04 23:41:52 +00:00
Ulrich Germann
889a33dcd6
XmlOptions are now const within Sentence.
2015-12-04 19:43:37 +00:00
Ulrich Germann
4983aa0980
Cleanup.
2015-12-04 19:32:37 +00:00
Ulrich Germann
9e1503bf63
Added variant lrfunc (in addition to lr-func) as a Mmsapt parameter to accommodate a typo in my 2015 PBML paper.
2015-12-03 16:21:11 +00:00
MosesAdmin
157be7cc51
daily automatic beautifier
2015-12-03 00:01:07 +00:00
Ulrich Germann
97d6ccec98
Merge branch 'master' of https://github.com/modernmt/mosesdecoder
2015-12-02 20:51:45 +00:00
Ulrich Germann
5a63286447
Code cleanup and bug fix in (Base)Manager::OutputSurface:
...
Mark-up of unkown words in output.
2015-12-02 20:43:56 +00:00
Ulrich Germann
0f9cca4ae4
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-11-30 01:29:28 +00:00
Ulrich Germann
11262b0a62
Added switch --version to have Moses print out the code versions it was compiled with.
2015-11-30 01:29:13 +00:00
Ulrich Germann
9a321a0ce4
Bug fix: typo prevented compilation.
2015-11-30 01:12:04 +00:00
Ulrich Germann
c165e80e48
Changes to Mmsapt.
...
- added phrase table features: pfwd / pbwd weighted by each sample's
weight (when used with biased sampling)
- a few minor internal changes ({p|j}stats.add(...) reports back
current joint count (intended for early stopping of sampling when
evidence is sufficient; yet to be explored experimentally).
2015-11-29 18:39:38 +00:00
Ulrich Germann
93df2b2f19
Initialization order of members.
2015-11-29 17:57:04 +00:00
Ulrich Germann
48999749ec
Unused variable.
2015-11-29 17:56:27 +00:00
Ulrich Germann
37ea003f02
Avoid compiler warning.
2015-11-28 14:54:48 +00:00
Phil Williams
7375d81e16
Fix a few compiler warnings (clang)
2015-11-27 12:20:38 +00:00
Hieu Hoang
533aff9d53
Merge ../mosesdecoder into perf_moses2
2015-11-26 20:52:02 +00:00
Ulrich Germann
c11c4cbeed
Bug fix related to commit 220d82041a
,
...
which replaced boost::intrusive_ptr<bitext> with shared_ptr<bitext>.
2015-11-25 19:51:54 +00:00
Ulrich Germann
ee5edc421c
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-11-25 02:18:00 +00:00
MosesAdmin
57a291421a
daily automatic beautifier
2015-11-25 00:00:39 +00:00
Ulrich Germann
bb135f6a64
Cosmetic fix for having the server reporting word alignments left-to-right.
2015-11-24 20:42:53 +00:00
Ulrich Germann
ca038c5e4c
Fix suggested by Martin Baumgärtner to keep server from crashing when packing word alignments.
2015-11-24 19:24:09 +00:00
Ulrich Germann
c8b859de67
Merge remote-tracking branch 'legacy/master'
...
Conflicts:
moses/server/TranslationRequest.cpp
2015-11-24 19:22:37 +00:00
Ulrich Germann
bcb0212b5b
FF registration is now in FeatureFactory::DefaultSetup, ...
...
... not in the FF constructor any more.
This is related to a bug fix in Base.cpp, related to moving the
LM OOV feature specification from the global space into the setup
of individual LMs (to eliminate the dependence on StaticData in the
LM constructors).
2015-11-24 18:28:38 +00:00
Hieu Hoang
ad377a53b6
Merge branch 'master' into perf_moses2
2015-11-24 15:12:10 +00:00
Ulrich Germann
a074efc7cc
Change parameters only when specified during parameter updates in server mode.
2015-11-23 16:59:39 +00:00
Ulrich Germann
6f1e39d64e
Adaptation to renamed functions in Bitext class.
2015-11-23 16:57:44 +00:00
Ulrich Germann
9a7356bbed
Adaptation to renamed functions in Bitext class.
2015-11-23 16:57:35 +00:00
Barry Haddow
87ec9f56c7
bugfix: options refactor broke (l)mbr
2015-11-23 12:37:11 +00:00
Barry Haddow
10df006eed
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-11-23 12:16:46 +00:00
Ulrich Germann
894644d615
Merge ../master into sync-with-mmt
2015-11-20 17:43:05 +00:00
Ulrich Germann
3f09aa40aa
Additional functions for determining doc ids and document names from mapped bitexts.
2015-11-20 17:10:47 +00:00
Ulrich Germann
a767608804
Bug fix in keeping track of doc ids with uniform random sampling.
2015-11-20 17:09:18 +00:00
Ulrich Germann
1fa81806c1
Work in progress.
2015-11-20 17:07:17 +00:00
Ulrich Germann
752ac68d08
Merge branch 'moses-server-placeholder-patch' of https://github.com/ebay-hlt/mosesdecoder into ebay-hlt-moses-server-placeholder-patch
...
Conflicts:
regression-testing/Jamfile
run-regtests.sh
2015-11-20 14:47:59 +00:00
MosesAdmin
bf209a35a3
daily automatic beautifier
2015-11-20 00:00:42 +00:00
Evgeny Matusov
42c57d077b
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into moses-server-placeholder-patch
...
Conflict in TranslationRequest solved.
Conflicts:
moses/server/TranslationRequest.cpp
moses/server/TranslationRequest.h
2015-11-19 09:59:15 -07:00
Ulrich Germann
c610d0a6e7
Code decluttering.
...
The class StatefuleFeatureFunction now provides an empty dummy implementation
of various (virtual) Evaluate... functions. The corresponding empty
implementations on derived classes have been removed.
2015-11-19 13:54:24 +00:00
Evgeny Matusov
f346dcd37f
another fix to debug output for moses server
2015-11-19 12:42:07 +01:00
Evgeny Matusov
aa7ef1738b
another update in Debug output for Moses server
2015-11-19 12:20:48 +01:00
Evgeny Matusov
d3fb16d39f
changed debug output for moses server
2015-11-19 12:03:19 +01:00
Ulrich Germann
edacfbb9fd
Bug fix in server: Moses server now handles the placeholder mechanism for translations provided with the input.
2015-11-18 17:09:52 +00:00
Evgeny Matusov
4e8396744c
added first version of regression testing for moses server
2015-11-18 16:21:50 +01:00
Hieu Hoang
91bd99e649
Merge ../mosesdecoder into perf_moses2
2015-11-18 12:11:16 +00:00
Ulrich Germann
220d82041a
gcc-4.4.7 was struggling with boost::intrusive_ptr. Switched to shared_ptr.
2015-11-18 10:35:17 +00:00
Barry Haddow
21d8111287
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-11-18 09:50:29 +00:00
David Madl
060a5f1b47
forward declare SHyperedge in StatefulFeatureFunction, StatelessFeatureFunction
2015-11-17 16:17:09 +00:00
Hieu Hoang
86e1af8631
delete g_mosesDebug
2015-11-17 16:16:17 +00:00
David Madl
8729a2d47d
Measure TimeOtherScore in Search instead of in Hypothesis
2015-11-17 16:15:13 +00:00
David Madl
5fea16a9a6
move options out of Hypothesis
2015-11-17 16:15:13 +00:00
David Madl
73ab44c126
Hypothesis: get rid of calls into Manager from constructor
2015-11-17 16:15:13 +00:00
David Madl
b1ea3d624b
Dump two ugly, old overrides of Hypothesis::EvaluateWhenApplied()
...
A Brief History of Time:
65ddbf3
7/2/12 Wilson, "Implement batched LM requests."
776da79
8/6/15 Hoang, "delete old unused code"
2015-11-17 16:15:13 +00:00
David Madl
e5a8438149
document @param lhs in Phrase::CreateFromString()
2015-11-17 16:15:13 +00:00
David Madl
e36fb96557
LanguageModel, KenLM: avoid StaticData usage
...
* drop global lmodel-oov-feature option, and add it to LM FF config line instead
use oov-feature=1 (bool) option instead
* drop LanguageModel::GetWeight()
* KenLM: use m_verbosity of FF instead of IFVERBOSE macro which uses StaticData
* train-model.perl: move language model OOV feature onto LM feature spec line
2015-11-17 16:15:13 +00:00
David Madl
3b63930943
move global Timer to Timer.h
...
Move ResetUserTime(), PrintUserTime(), GetUserTime() to Timer.h
Do not reset timer in StaticData.
2015-11-17 16:15:13 +00:00
David Madl
0dd6c31f63
FeatureFunction: enable construction without registering
2015-11-17 16:15:13 +00:00
David Madl
3288eb5f50
remove IOWrapper.cpp unused includes such as Incremental.h (and others)
2015-11-17 16:15:13 +00:00
Hieu Hoang
6432fefd3b
Merge ../mosesdecoder into perf_moses2
2015-11-17 15:51:29 +00:00
Evgeny Matusov
5e1340cf63
fixed moses server placehoders ; correctly implemented the boolean parameter check function for mosesserver request parameters
2015-11-17 15:16:39 +01:00
Evgeny Matusov
66928f682f
second commit of moses server placeholder fix
2015-11-17 15:06:48 +01:00
Evgeny Matusov
7c088c9a95
first commit of placeholder changes to moses server
2015-11-17 14:19:36 +01:00
MosesAdmin
fef50536d6
daily automatic beautifier
2015-11-17 00:00:49 +00:00
Phil Williams
d317fdc373
Store SHyperedge feature scores as deltas instead of totals
...
This mirrors the change made for the chart decoder in commit 465b4756...
2015-11-16 19:23:27 +00:00
Michael Denkowski
07001f7645
Model support bitmap features in PhraseDictionaryGroup
2015-11-16 11:23:18 -05:00
Michael Denkowski
9df2336d45
Per-model phrase and word counts in PhraseDictionaryGroup
2015-11-13 17:22:27 -05:00
Michael Denkowski
e3cca68ed7
mmsapt-lr-func option for PhraseDictionaryGroup
...
Support also filling in gaps via averaging for LR functions of member
Mmsapt models
2015-11-13 13:56:26 -05:00
Michael Denkowski
49f4eeca47
default-average-others option for PhraseDictionaryGroup
...
Average scores of other models to fill in gaps for unseen phrases
2015-11-12 16:33:52 -05:00
Ulrich Germann
7b8a875efb
Merge branch 'master' of http://github.com/moses-smt/mosesdecoder
2015-11-12 14:02:16 +00:00
Hieu Hoang
28eee66d6e
Merge ../mosesdecoder into perf_moses2
2015-11-12 13:12:25 +00:00
MosesAdmin
dad1bd6127
daily automatic beautifier
2015-11-12 00:00:40 +00:00
Ulrich Germann
b01eb7cbd0
Bug fix: m_reportAllFactors was never initialized or set.
...
Removed altogether, now using m_options.output.ReportAllFactors.
2015-11-11 19:56:43 +00:00
Ulrich Germann
e357a75972
Merge branch 'master' of ../legacy
2015-11-11 17:28:20 +00:00
Ulrich Germann
858a509d53
Added missing files.
2015-11-11 17:27:53 +00:00
Ulrich Germann
37b63f2d79
Merge branch 'master' of ../legacy into mmt-dev
...
Conflicts:
moses/FF/LexicalReordering/LexicalReordering.cpp
2015-11-11 17:19:49 +00:00
Ulrich Germann
f247e26fed
More options refactoring (OOV Handling this time).
2015-11-11 17:07:45 +00:00
Hieu Hoang
28dee22e0a
Revert "move printFF out of Parameter class"
...
This reverts commit 4b5466bcfe
.
2015-11-11 14:04:53 +00:00
Hieu Hoang
4b5466bcfe
move printFF out of Parameter class
2015-11-11 13:52:42 +00:00
Ulrich Germann
2ab6b8f16d
Merge branch 'master' of http://github.com/moses-smt/mosesdecoder
2015-11-11 01:08:22 +00:00
Ulrich Germann
9826599cb0
Enforce const-ness of command line arguments; bug fix in mosesserver.cpp.
2015-11-11 01:08:05 +00:00
Ulrich Germann
d727829387
Merge branch 'master' of https://github.com/modernmt/mosesdecoder
...
Conflicts:
moses/parameters/InputOptions.cpp
moses/parameters/InputOptions.h
2015-11-10 23:05:13 +00:00
Ulrich Germann
806f888c10
Moved placeholder factor variable from StaticData to InputOptions.
2015-11-10 21:44:48 +00:00
Barry Haddow
1996502fcb
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-11-10 21:35:59 +00:00
Barry Haddow
ccfe8ba018
remove unused method, and misleading comment
2015-11-10 21:35:08 +00:00
Michael Denkowski
652283c538
Consistent naming: zeros -> default-scores
...
(Matches LexicalReordering)
2015-11-10 15:48:41 -05:00