Rico Sennrich
29cde2a204
allow overriding table filtering in config (required for multimodelcounts)
2013-07-30 16:46:23 +02:00
Rico Sennrich
7b6239b663
multimodelcounts: use Word objects instead of strings in map (avoid costly conversion and string comparison)
2013-07-30 15:03:25 +02:00
Rico Sennrich
ccdcecc86f
multimodel and mosesserver: instead of optimizing first model, select model by name.
2013-07-30 13:54:50 +02:00
Ulrich Germann
cb1c06d502
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
moses/Jamfile
2013-07-28 16:51:13 +01:00
Ulrich Germann
56bb485dd5
Fixed missing #include.
2013-07-28 16:39:13 +01:00
Ulrich Germann
b3ed0d56d7
Fixed missing #include.
2013-07-28 16:38:33 +01:00
Ulrich Germann
a47b6cfafa
Added call to tp->Evaluate(src) before adding a phrase table entry to the TargetPhraseCollection during lookup.
2013-07-28 16:37:20 +01:00
Ulrich Germann
1b1771dcc9
Items under 'generic' now included in libmoses'
2013-07-28 16:30:41 +01:00
Ulrich Germann
a0c13837e0
Fixed computation of lexical scores.
2013-07-28 16:28:41 +01:00
Hieu Hoang
76a9730ca8
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-25 15:23:12 +01:00
Barry Haddow
7081f06413
Fixes to the shared build
2013-07-25 15:24:34 +01:00
Hieu Hoang
e2c2bc59f1
beautify
2013-07-25 15:23:05 +01:00
Hieu Hoang
c0aba71c79
bug processing unknown word with digits
2013-07-25 08:41:59 +01:00
Kenneth Heafield
71ae8c9d19
LM/Factory.cpp -> FF/Factory.cpp oops
2013-07-24 12:13:11 +01:00
Hieu Hoang
e6a3df7e97
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-23 13:12:30 +01:00
Hieu Hoang
206b165d14
randlm compile with refactored code. No regression tests yet
2013-07-23 12:56:35 +01:00
Hieu Hoang
1e906bea73
add ControlRecombination feature function
2013-07-23 01:38:08 +01:00
Hieu Hoang
42c1c908a5
add ControlRecombination feature function
2013-07-23 01:32:25 +01:00
Hieu Hoang
2590601708
add ControlRecombination feature function
2013-07-20 23:41:49 +01:00
Hieu Hoang
a098227abe
add ControlRecombination feature function
2013-07-20 23:10:50 +01:00
Hieu Hoang
96da822861
Don't deprecate lmodel-oov-feature
2013-07-20 17:20:12 +01:00
Hieu Hoang
b6f8e3c383
Don't mix old and new ini file format
2013-07-20 17:08:03 +01:00
Hieu Hoang
5b7a9af588
refactor RandLM. Compiles with eclipse but not with bjam
2013-07-20 00:19:04 +01:00
Hieu Hoang
11666a8359
RandLM is currently broken
2013-07-19 22:39:20 +01:00
Hieu Hoang
4a4b1a168d
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-19 18:52:54 +01:00
Kenneth Heafield
2f6e669fb9
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-19 18:50:29 +01:00
Kenneth Heafield
e1a2b2f0c9
Reduce scope of lm dependency
2013-07-19 18:50:12 +01:00
Hieu Hoang
c77ec1b904
beautfiy
2013-07-19 13:56:02 +01:00
Hieu Hoang
a95127b972
add default weights for feature functions that aren't tuneable, eg. OOV feature
2013-07-19 13:24:05 +01:00
Hieu Hoang
8a28178339
add default weights for feature functions that aren't tuneable, eg. OOV feature
2013-07-19 11:35:50 +01:00
Kenneth Heafield
b5e6b9c959
Factory
2013-07-18 22:54:52 +01:00
Hieu Hoang
cb46bd3c00
beautify
2013-07-18 17:00:44 +01:00
Hieu Hoang
f81d7a446f
starting placeholder
2013-07-18 17:00:07 +01:00
Hieu Hoang
415c5ab693
tokenize only first occurence of = char for key=value. Allow paths with = chars
2013-07-18 14:01:08 +01:00
Hieu Hoang
f3e0fd2dd4
finished converting TargetPhraseCollection* to TargetPhraseCollection
2013-07-16 16:55:56 +01:00
Hieu Hoang
e1a86bd9c9
sometimes target phrase collection can have 0 phrases
2013-07-16 16:30:54 +01:00
Kenneth Heafield
789039fa2e
In-line PhraseDictionaryNodeMemory with the hash table data structure
...
Before:
Name:moses_chart VmPeak:11988700 kB VmRSS:10112684 kB
real 2m58.393s
user 2m39.673s
sys 0m12.171s
After:
Name:moses_chart VmPeak:11952688 kB VmRSS:10077304 kB
real 2m42.329s
user 2m31.219s
sys 0m10.261s
2013-07-12 07:13:19 -07:00
Kenneth Heafield
1b3f769c5c
Always have a TargetPhraseCollection.
...
Before:
Name:moses_chart VmPeak:12027904 kB VmRSS:10151884 kB real:173.000
real 2m53.608s
user 2m44.003s
sys 0m8.401s
After:
Name:moses_chart VmPeak:11988700 kB VmRSS:10112684 kB real:177.500
real 2m58.393s
user 2m39.673s
sys 0m12.171s
2013-07-12 07:01:33 -07:00
Kenneth Heafield
23c2530617
PhraseDictionaryNodeMemory doesn't need to be virtual. Slight reduction in CPU/RAM.
2013-07-12 06:32:33 -07:00
Hieu Hoang
a88096f669
debug message for overriding feature function arguments
2013-07-11 20:41:42 +01:00
Hieu Hoang
175b540509
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-11 15:42:17 +01:00
Hieu Hoang
ddffe5e01b
minor debug tweak
2013-07-11 15:42:01 +01:00
Hieu Hoang
7eb5e41ea1
Merge pull request #41 from neubig/check-processphrasetable-width
...
Prevented segfault on print non-existant alignment string
2013-07-09 04:28:57 -07:00
Nadir Durrani
418abf42fa
Merge branch 'nadir_osm'
2013-07-09 11:44:14 +01:00
Hieu Hoang
310b26f989
beautify
2013-07-08 20:52:14 +01:00
Hieu Hoang
3eba5782c2
beautify
2013-07-08 20:25:47 +01:00
Marcin Junczys-Dowmunt
d3b4c11be2
Fixed queryPhraseTableMin, added warnings for compacting phrase tables qithout alignment
2013-07-08 09:58:02 +02:00
Graham Neubig
0cde047e6e
Merge branch 'master' of github.com:neubig/mosesdecoder into check-processphrasetable-width
2013-07-05 12:38:31 +09:00
Graham Neubig
6c25048d20
Prevented segfault on print non-existant alignment
...
In processPhraseTable, there is an option to print alignments.
When this is selected, processPhraseTable will print the 4th
column in the phrase table, but the check for the phrase table
width only currently goes to the 3rd column. This patch makes
sure that the phrase table must have 4 columns when alignments
are being printed, and 3 otherwise.
2013-07-05 12:21:01 +09:00
Marcin Junczys-Dowmunt
bc904ff61f
Deleted stray "cerr << .."
2013-07-05 00:15:27 +02:00
