Commit Graph

2696 Commits

Author SHA1 Message Date
Hieu Hoang
8a28178339 add default weights for feature functions that aren't tuneable, eg. OOV feature 2013-07-19 11:35:50 +01:00
Kenneth Heafield
b5e6b9c959 Factory 2013-07-18 22:54:52 +01:00
Hieu Hoang
cb46bd3c00 beautify 2013-07-18 17:00:44 +01:00
Hieu Hoang
f81d7a446f starting placeholder 2013-07-18 17:00:07 +01:00
Hieu Hoang
415c5ab693 tokenize only first occurence of = char for key=value. Allow paths with = chars 2013-07-18 14:01:08 +01:00
Hieu Hoang
f3e0fd2dd4 finished converting TargetPhraseCollection* to TargetPhraseCollection 2013-07-16 16:55:56 +01:00
Hieu Hoang
e1a86bd9c9 sometimes target phrase collection can have 0 phrases 2013-07-16 16:30:54 +01:00
Kenneth Heafield
789039fa2e In-line PhraseDictionaryNodeMemory with the hash table data structure
Before:
Name:moses_chart        VmPeak:11988700 kB      VmRSS:10112684 kB
real    2m58.393s
user    2m39.673s
sys     0m12.171s

After:
Name:moses_chart        VmPeak:11952688 kB      VmRSS:10077304 kB
real    2m42.329s
user    2m31.219s
sys     0m10.261s
2013-07-12 07:13:19 -07:00
Kenneth Heafield
1b3f769c5c Always have a TargetPhraseCollection.
Before:
Name:moses_chart        VmPeak:12027904 kB      VmRSS:10151884 kB       real:173.000
real    2m53.608s
user    2m44.003s
sys     0m8.401s

After:
Name:moses_chart        VmPeak:11988700 kB      VmRSS:10112684 kB       real:177.500
real    2m58.393s
user    2m39.673s
sys     0m12.171s
2013-07-12 07:01:33 -07:00
Kenneth Heafield
23c2530617 PhraseDictionaryNodeMemory doesn't need to be virtual. Slight reduction in CPU/RAM. 2013-07-12 06:32:33 -07:00
Hieu Hoang
a88096f669 debug message for overriding feature function arguments 2013-07-11 20:41:42 +01:00
Hieu Hoang
175b540509 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-11 15:42:17 +01:00
Hieu Hoang
ddffe5e01b minor debug tweak 2013-07-11 15:42:01 +01:00
Hieu Hoang
7eb5e41ea1 Merge pull request #41 from neubig/check-processphrasetable-width
Prevented segfault on print non-existant alignment string
2013-07-09 04:28:57 -07:00
Nadir Durrani
418abf42fa Merge branch 'nadir_osm' 2013-07-09 11:44:14 +01:00
Hieu Hoang
310b26f989 beautify 2013-07-08 20:52:14 +01:00
Hieu Hoang
3eba5782c2 beautify 2013-07-08 20:25:47 +01:00
Marcin Junczys-Dowmunt
d3b4c11be2 Fixed queryPhraseTableMin, added warnings for compacting phrase tables qithout alignment 2013-07-08 09:58:02 +02:00
Graham Neubig
0cde047e6e Merge branch 'master' of github.com:neubig/mosesdecoder into check-processphrasetable-width 2013-07-05 12:38:31 +09:00
Graham Neubig
6c25048d20 Prevented segfault on print non-existant alignment
In processPhraseTable, there is an option to print alignments.
When this is selected, processPhraseTable will print the 4th
column in the phrase table, but the check for the phrase table
width only currently goes to the 3rd column. This patch makes
sure that the phrase table must have 4 columns when alignments
are being printed, and 3 otherwise.
2013-07-05 12:21:01 +09:00
Marcin Junczys-Dowmunt
bc904ff61f Deleted stray "cerr << .." 2013-07-05 00:15:27 +02:00
Hieu Hoang
6e56a9aed5 beautify 2013-07-04 20:29:05 +01:00
Hieu Hoang
f35750bc08 beautify 2013-07-04 20:19:51 +01:00
Nadir Durrani
389b7762e8 Merge branch 'nadir_osm' of github.com:moses-smt/mosesdecoder into nadir_osm 2013-07-04 12:05:00 +01:00
Nadir Durrani
e402714d2b Getting Rid of feature-path 2013-07-04 12:04:29 +01:00
Nadir Durrani
33a167ac9d Merge branch 'nadir_osm' 2013-07-02 13:24:21 +01:00
Nadir Durrani
c05317dd82 Future-Cost 2013-07-02 13:19:55 +01:00
Hieu Hoang
d203f2bb6e single threaded build compiles & passes regression 2013-07-01 17:37:24 +01:00
Nadir Durrani
582d31cb16 No SRILM 2013-07-01 13:10:58 +01:00
Nadir Durrani
ba72c70c6e Merge branch 'nadir_osm' of github.com:moses-smt/mosesdecoder into nadir_osm 2013-07-01 11:07:21 +01:00
Nadir Durrani
6a915253e1 Bug Fix 2013-07-01 11:06:55 +01:00
Kenneth Heafield
51c0b6ae43 Unbreak build by disabling OSM without SRI.
TODO(nadir): remove (or make optional) your dependence on SRILM then undo this commit and remove the if statement from the Jamfile.
2013-06-30 13:08:12 +01:00
Hieu Hoang
fa4b92fc0a Merge branch 'master' into nadir_osm 2013-06-28 14:19:30 +01:00
Nadir Durrani
8c19c2ba8a KenLM 2013-06-28 14:16:41 +01:00
Ulrich Germann
c963338476 Feature values are now returned as log probabilities. 2013-06-27 17:55:16 +01:00
Hieu Hoang
efc2c6145e beautify 2013-06-26 17:19:09 +01:00
Hieu Hoang
771e792bb4 Merge branch 'master' into dynamic-phrase-tables 2013-06-26 17:13:36 +01:00
Hieu Hoang
3833d67ec0 merge with master 2013-06-26 17:12:22 +01:00
Hieu Hoang
352e36334a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-06-26 11:54:12 +01:00
Ulrich Germann
2f6ca0c0b8 Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	moses/Hypothesis.cpp
	moses/StaticData.cpp
	moses/TargetPhrase.cpp
	moses/TranslationModel/BilingualDynSuffixArray.cpp
	moses/TranslationModel/BilingualDynSuffixArray.h
	moses/TranslationModel/PhraseDictionary.h
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.cpp
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.h
2013-06-26 03:00:27 +01:00
Nadir Durrani
4335587698 Merge branch 'nadir_osm' of github.com:moses-smt/mosesdecoder into nadir_osm 2013-06-25 17:09:15 +01:00
Nadir Durrani
7aecb78d76 merge 2013-06-25 17:09:06 +01:00
Hieu Hoang
eefd94edb1 don't pollute namespace 2013-06-25 17:08:15 +01:00
Nadir Durrani
f66bbdd1f1 merge 2013-06-25 17:00:28 +01:00
Nadir Durrani
4f7a55e247 KenLM 2013-06-25 16:54:41 +01:00
Hieu Hoang
546d0add94 merge 2013-06-25 16:53:41 +01:00
Hieu Hoang
4b881dd74f don't pollute namespace 2013-06-25 16:51:56 +01:00
Nadir Durrani
537210b010 KenLM 2013-06-25 16:27:41 +01:00
Hieu Hoang
493d713075 Merge branch 'nadir_osm' of github.com:moses-smt/mosesdecoder into nadir_osm 2013-06-25 10:52:00 +01:00
Hieu Hoang
d43c174dcd merge 2013-06-25 10:50:26 +01:00