Hieu Hoang
ff880ec6f1
delete references to LMList
2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd
move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number
2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9
make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it
2013-05-20 17:01:19 +01:00
Rico Sennrich
5fa1752018
multimodel(counts): allow different features to have separate interpolation weights.
2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba
restore support for multimodel(counts) in moses server:
...
set sentence-level weights and optimize weights
2013-05-16 13:40:17 +02:00
Hieu Hoang
3876c47d1d
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 14:34:31 +01:00
Hieu Hoang
81ffe84dbc
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-14 17:35:22 +01:00
Hieu Hoang
66ad7c3c18
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 15:16:09 +01:00
Hieu Hoang
0c3fa9942b
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 13:11:55 +01:00
Hieu Hoang
34df0011a9
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-14 12:19:55 +01:00
Hieu Hoang
d5ebe61791
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:40:12 +01:00
Hieu Hoang
b8efef6667
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:39:06 +01:00
Hieu Hoang
dcafe74892
port PhraseDictionaryMultiModelCount to new format
2013-05-13 17:20:14 +01:00
Hieu Hoang
499487fb98
get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly
2013-05-13 15:36:09 +01:00
Hieu Hoang
a8cf5c3472
port PhraseDictionaryMultiModel to new format
2013-05-13 13:19:25 +01:00
Hieu Hoang
3a10197edb
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-13 10:37:08 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
72c9e7813d
port PhraseDictionaryMultiModel to new format
2013-05-10 18:01:52 +01:00
Hieu Hoang
cb8b303f10
changes for cruise control
2013-05-10 15:51:07 +01:00
Hieu Hoang
7e398d3bca
port PhraseDictionaryMultiModel to new format
2013-05-10 15:33:46 +01:00
Hieu Hoang
805c5c5be9
port PhraseDictionaryMultiModel to new format
2013-05-10 15:13:03 +01:00
Hieu Hoang
f0bf197695
port PhraseDictionaryMultiModel to new format
2013-05-10 14:48:06 +01:00
Hieu Hoang
ed7ab8146f
port PhraseDictionaryMultiModel to new format
2013-05-10 12:30:01 +01:00
Hieu Hoang
187e09a5d2
delete last TargetPhrase::SetScore()
2013-05-02 18:36:34 +01:00
Hieu Hoang
fdcfe95574
start framework for evaluating target phrase score
2013-05-02 17:19:45 +01:00
Hieu Hoang
46b70fe89a
start framework for evaluating target phrase score
2013-05-02 17:07:03 +01:00
Hieu Hoang
47465f8afb
start framework for evaluating target phrase score
2013-05-02 14:55:26 +01:00
Hieu Hoang
ce80626c9a
remove SparsePhraseDictionaryFeature
2013-05-01 13:17:09 +01:00
Hieu Hoang
2b93917a80
delete argument report-sparse-features
2013-05-01 12:40:59 +01:00
Hieu Hoang
3e64d4b341
enum StatelessFeatureType
2013-04-30 19:27:49 +01:00
Hieu Hoang
26a4aa8d18
enable sparse feature in phrase table
2013-04-30 17:27:35 +01:00
Hieu Hoang
ce95c117f6
merge
2013-04-29 18:46:48 +01:00
Hieu Hoang
83494418e2
delete PhraseDictionaryMemory. Fix word penalty in compact phrase table
2013-04-26 15:55:32 +01:00
Hieu Hoang
b448c6285a
make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors
2013-04-26 12:20:49 +01:00
Kenneth Heafield
2437ed441d
Accept cmph with lib64 too
2013-04-25 21:50:05 +01:00
Hieu Hoang
4b4aba3d81
log probabilities. /Abby
2013-04-25 16:54:45 +01:00
Rico Sennrich
908c006e32
online combination of multiple phrase tables
...
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
- linear interpolation or instance weighting
- two possible component model types supported so far: 0 (in-memory) or 12 (compact)
- weights can be set in config, and overriden on a sentence-level through mosesserver API
- online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Barry Haddow
9d42c7f6f7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-12 16:07:26 +01:00
Hieu Hoang
e1dc4131f6
merge
2013-03-27 08:45:16 +00:00
Hieu Hoang
f8afc73569
get rid of locking altogether. PDTimp already has separated source & target vocab variable. Use those instead
2013-03-26 14:05:50 +00:00
Hieu Hoang
e2b18c5337
no leak message due to static variable in binary phrase table. Doesn't actually solve the mem leak though
2013-03-26 13:29:59 +00:00
Hieu Hoang
51a59b881e
move RedVoc() as method in PDTimp class. Ready for getting rid of static variable
2013-03-26 12:45:27 +00:00
Hieu Hoang
9c91eda308
Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new
2013-03-16 23:25:40 +00:00
Hieu Hoang
2c26ad133e
error parsing factors. And eclipse project files
2013-03-16 16:41:38 +00:00
Hieu Hoang
db049e0fa0
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-16 13:35:05 +00:00
Hieu Hoang
9f4824b2be
single threaded compile error
2013-03-16 13:25:31 +00:00
Hieu Hoang
8523a27768
fix single-threaded
2013-03-15 20:38:26 +00:00
Hieu Hoang
51d34f2f96
delete Phrase::CreateFromStringNewFormat()
2013-03-08 22:04:28 +00:00
Hieu Hoang
9298402dcf
merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat()
2013-03-08 19:10:28 +00:00
