moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 13:23:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,525 Commits 136 Branches 26 Tags 147 MiB
febb2afc4d
Commit Graph

412 Commits

Author SHA1 Message Date
Hieu Hoang
8d857fa26e OnDisk pt passes regression 2013-07-08 19:01:28 +01:00
Hieu Hoang
b03ac10a2d error processing OOV when using OnDisk pt 2013-07-08 17:58:22 +01:00
Marcin Junczys-Dowmunt
d3b4c11be2 Fixed queryPhraseTableMin, added warnings for compacting phrase tables qithout alignment 2013-07-08 09:58:02 +02:00
Hieu Hoang
29b895a97a InputLatticeNode to InputPath 2013-07-07 02:14:51 +01:00
Hieu Hoang
ecef376aed rename InputLatticeNode.h to InputPath.h 2013-07-06 22:42:52 +01:00
Hieu Hoang
6a060abe74 a little bit more towards using prefix subphrase to optimize translation rule lookup 2013-07-05 11:24:27 +01:00
Hieu Hoang
7114b164c7 cleanup of OnDiskPt methods 2013-07-05 11:10:10 +01:00
Hieu Hoang
ee0d29f56b prefix subphrase optimization 2013-07-05 10:57:45 +01:00
Hieu Hoang
e073d22301 prefix subphrase optimization 2013-07-05 10:52:12 +01:00
Hieu Hoang
a60da7d4b7 prefix subphrase optimization 2013-07-05 09:59:50 +01:00
Graham Neubig
0cde047e6e Merge branch 'master' of github.com:neubig/mosesdecoder into check-processphrasetable-width 2013-07-05 12:38:31 +09:00
Graham Neubig
6c25048d20 Prevented segfault on print non-existant alignment 
In processPhraseTable, there is an option to print alignments.
When this is selected, processPhraseTable will print the 4th
column in the phrase table, but the check for the phrase table
width only currently goes to the 3rd column. This patch makes
sure that the phrase table must have 4 columns when alignments
are being printed, and 3 otherwise.
 2013-07-05 12:21:01 +09:00
Hieu Hoang
574d186708 beautify 2013-07-04 23:38:18 +01:00
Hieu Hoang
0efcf64c28 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input2 2013-07-04 23:37:21 +01:00
Hieu Hoang
f4d77aae38 start prefix subphrase optimization with OnDisk pt 2013-07-04 23:36:17 +01:00
Marcin Junczys-Dowmunt
bc904ff61f Deleted stray "cerr << .." 2013-07-05 00:15:27 +02:00
Hieu Hoang
f0dc30f25a prefix subphrase optimization done for in-memory pt. Need to delete objects also 2013-07-04 15:13:29 +01:00
Hieu Hoang
934e24718e a little bit more towards using prefix subphrase to optimize translation rule lookup 2013-07-04 09:24:13 +01:00
Hieu Hoang
5e355c1595 move lookup of all subphrases into PhraseDictionary class 2013-07-03 19:07:36 +01:00
Hieu Hoang
ac8d10af38 move lookup of all subphrases into PhraseDictionary class 2013-07-03 16:57:23 +01:00
Hieu Hoang
d203f2bb6e single threaded build compiles & passes regression 2013-07-01 17:37:24 +01:00
Ulrich Germann
c963338476 Feature values are now returned as log probabilities. 2013-06-27 17:55:16 +01:00
Hieu Hoang
efc2c6145e beautify 2013-06-26 17:19:09 +01:00
Hieu Hoang
771e792bb4 Merge branch 'master' into dynamic-phrase-tables 2013-06-26 17:13:36 +01:00
Hieu Hoang
3833d67ec0 merge with master 2013-06-26 17:12:22 +01:00
Hieu Hoang
352e36334a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-06-26 11:54:12 +01:00
Ulrich Germann
2f6ca0c0b8 Merge branch 'master' into dynamic-phrase-tables 
Conflicts:
	moses/Hypothesis.cpp
	moses/StaticData.cpp
	moses/TargetPhrase.cpp
	moses/TranslationModel/BilingualDynSuffixArray.cpp
	moses/TranslationModel/BilingualDynSuffixArray.h
	moses/TranslationModel/PhraseDictionary.h
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.cpp
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.h
 2013-06-26 03:00:27 +01:00
Hieu Hoang
ea0c7b63e7 fix argument parsing in PhraseDictionaryALSuffixArray 2013-06-24 16:10:22 +01:00
Kenneth Heafield
718e90d006 Missing header 2013-06-21 09:38:45 -04:00
Hieu Hoang
a69ad79e9c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-06-21 14:38:14 +01:00
Kenneth Heafield
217c8ea38f Missing header / Mehndi Bhargava 2013-06-21 09:37:05 -04:00
Hieu Hoang
3d790b7226 minor cleanup 2013-06-20 17:15:54 +01:00
Hieu Hoang
d68277d369 redo parsing of feature function parameters 2013-06-20 13:25:02 +01:00
Hieu Hoang
24d2edd790 redo parsing of feature function parameters 2013-06-20 13:06:03 +01:00
Hieu Hoang
dc33fa3d3d redo parsing of feature function parameters 2013-06-20 12:50:41 +01:00
Hieu Hoang
c2f4c48758 clean up SetParameter() 2013-06-19 00:24:21 +01:00
Hieu Hoang
acb4baacaf delete 2 unused legacy functions 2013-06-17 18:46:40 +01:00
Hieu Hoang
e51c4feb6b push calling of OnlyTheseFactors() to individual PT implementations, as needed 2013-06-17 18:31:06 +01:00
Hieu Hoang
f7371cf53d calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract 2013-06-14 18:34:47 +01:00
Rico Sennrich
b1b70e802d use read-write lock in multimodel 2013-06-12 15:25:53 +02:00
Rico Sennrich
9e9cbbc13b refactoring multimodel code out of StaticData; locking. 2013-06-12 14:47:40 +02:00
Hieu Hoang
5becd868a9 delete misc unused variables from PhraseDictionary 2013-06-11 16:31:43 +01:00
Hieu Hoang
61e2b7a24f refactor parsing of feature functiona args 2013-06-11 01:46:04 +01:00
Hieu Hoang
b4ad093334 refactor parsing of feature functiona args 2013-06-11 00:05:12 +01:00
Hieu Hoang
efa42b451c refactor parsing of feature functiona args 2013-06-10 21:24:31 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
96d116dba0 refactor parsing of feature functiona args 2013-06-10 16:29:07 +01:00
Hieu Hoang
e291c5f4a4 implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far 2013-06-07 17:32:01 +01:00
Hieu Hoang
23fba08ded minor 2013-06-06 21:49:38 +01:00
Hieu Hoang
df4b8e5828 m_numInputScores deleted from PhraseDictionary. 2013-06-06 18:54:44 +01:00
Ulrich Germann
7ecfb88a29 Alpha version of phrase tables based on dynamic suffix arrays. 2013-06-05 10:46:42 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Ulrich Germann
570b7c6aa5 Fixed bug in ComparePosition::operator()(...). 2013-06-03 12:22:05 +01:00
Hieu Hoang
3b76143072 refactor loading in class PhraseDictionaryFuzzyMatch 2013-05-31 23:39:19 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
Hieu Hoang
173cfffaac Reapply Abby Levenberg's log change @4b4aba3 2013-05-31 15:06:36 +01:00
Hieu Hoang
0db5504629 port PhraseDictionaryDynSuffixArray to new ini format. Scores aren't the same. Probably something to do with Abby Levenberg's log change 2013-05-31 15:02:34 +01:00
Hieu Hoang
65d2d68bc5 beautify 2013-05-31 00:00:21 +01:00
Hieu Hoang
117eb76b0a figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 18:34:10 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
66afd6611b parse scores correctly. Assume dense features, always in the same order 2013-05-28 15:54:11 +01:00
Hieu Hoang
ed220e91a9 debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do 2013-05-28 15:38:36 +01:00
Hieu Hoang
0580e2bd11 delete create-ini 2013-05-28 13:11:37 +01:00
Hieu Hoang
036ea4ee29 delete sourcePhrase variable in TargetPhrase class 2013-05-28 11:38:18 +01:00
Hieu Hoang
ae82d02a05 delete sourcePhrase variable in TargetPhrase class 2013-05-28 00:41:25 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
6c322ba05e move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:33:30 +01:00
Hieu Hoang
4a280c8ca7 move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:23:31 +01:00
Hieu Hoang
d273812231 delete enum StatelessFeatureType. Features can be multiple types at once. Just overload the Evaluate() function you need 2013-05-24 16:04:38 +01:00
Hieu Hoang
ca8007be12 leak 2013-05-23 15:29:25 +01:00
Hieu Hoang
b10ecf2b44 make each node in trie a pointer. No possibility that the node is delete during build of the trie 2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635 technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 17:32:06 +01:00
Hieu Hoang
bfe321a068 change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie 2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b Make Phrase::CreateFromString() more efficient 2013-05-22 14:41:28 +01:00
Hieu Hoang
bce3b36170 Make Phrase::CreateFromString() more efficient 2013-05-22 12:28:32 +01:00
Hieu Hoang
112bcdc925 Make Phrase::CreateFromString() more efficient 2013-05-22 12:03:00 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Ulrich Germann
7996378ffb Made InitDictionary() a pure virtual function to force explicit initialization in derived classes. 2013-05-21 19:06:39 +01:00
Hieu Hoang
2f38746f6a delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function 2013-05-21 14:00:28 +01:00
Hieu Hoang
7dc177514d delete references to WordPenaltyProducer 2013-05-21 13:50:18 +01:00
Hieu Hoang
81003b9464 delete references to WordPenaltyProducer 2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
f4cf5f152b delete references to LMList 2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4 delete references to LMList 2013-05-21 12:47:26 +01:00
Hieu Hoang
70873c3b8d delete references to LMList 2013-05-21 12:33:51 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number 2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9 make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it 2013-05-20 17:01:19 +01:00
Rico Sennrich
5fa1752018 multimodel(counts): allow different features to have separate interpolation weights. 2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba restore support for multimodel(counts) in moses server: 
set sentence-level weights and optimize weights
 2013-05-16 13:40:17 +02:00
Hieu Hoang
3876c47d1d port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3 port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 14:34:31 +01:00
Hieu Hoang
81ffe84dbc port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-14 17:35:22 +01:00
Hieu Hoang
66ad7c3c18 port PhraseDictionaryMultiModelCounts to new format 2013-05-14 15:16:09 +01:00
Hieu Hoang
0c3fa9942b port PhraseDictionaryMultiModelCounts to new format 2013-05-14 13:11:55 +01:00
Hieu Hoang
34df0011a9 change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary 2013-05-14 12:19:55 +01:00
Hieu Hoang
d5ebe61791 port PhraseDictionaryMultiModelCount to new format 2013-05-13 18:40:12 +01:00
Hieu Hoang
b8efef6667 port PhraseDictionaryMultiModelCount to new format 2013-05-13 18:39:06 +01:00
Hieu Hoang
dcafe74892 port PhraseDictionaryMultiModelCount to new format 2013-05-13 17:20:14 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
a8cf5c3472 port PhraseDictionaryMultiModel to new format 2013-05-13 13:19:25 +01:00
Hieu Hoang
3a10197edb Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-13 10:37:08 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
72c9e7813d port PhraseDictionaryMultiModel to new format 2013-05-10 18:01:52 +01:00
Hieu Hoang
cb8b303f10 changes for cruise control 2013-05-10 15:51:07 +01:00
Hieu Hoang
7e398d3bca port PhraseDictionaryMultiModel to new format 2013-05-10 15:33:46 +01:00
Hieu Hoang
805c5c5be9 port PhraseDictionaryMultiModel to new format 2013-05-10 15:13:03 +01:00
Hieu Hoang
f0bf197695 port PhraseDictionaryMultiModel to new format 2013-05-10 14:48:06 +01:00
Hieu Hoang
ed7ab8146f port PhraseDictionaryMultiModel to new format 2013-05-10 12:30:01 +01:00
Hieu Hoang
187e09a5d2 delete last TargetPhrase::SetScore() 2013-05-02 18:36:34 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
46b70fe89a start framework for evaluating target phrase score 2013-05-02 17:07:03 +01:00
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
ce80626c9a remove SparsePhraseDictionaryFeature 2013-05-01 13:17:09 +01:00
Hieu Hoang
2b93917a80 delete argument report-sparse-features 2013-05-01 12:40:59 +01:00
Hieu Hoang
3e64d4b341 enum StatelessFeatureType 2013-04-30 19:27:49 +01:00
Hieu Hoang
26a4aa8d18 enable sparse feature in phrase table 2013-04-30 17:27:35 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Hieu Hoang
83494418e2 delete PhraseDictionaryMemory. Fix word penalty in compact phrase table 2013-04-26 15:55:32 +01:00
Hieu Hoang
b448c6285a make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors 2013-04-26 12:20:49 +01:00
Kenneth Heafield
2437ed441d Accept cmph with lib64 too 2013-04-25 21:50:05 +01:00
Hieu Hoang
4b4aba3d81 log probabilities. /Abby 2013-04-25 16:54:45 +01:00
Rico Sennrich
908c006e32 online combination of multiple phrase tables 
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
  - linear interpolation or instance weighting
  - two possible component model types supported so far: 0 (in-memory) or 12 (compact)
  - weights can be set in config, and overriden on a sentence-level through mosesserver API
  - online optimization (perplexity minimization) using dlib and xmlrpc-c call
 2013-04-22 13:21:59 +02:00
Barry Haddow
9d42c7f6f7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-12 16:07:26 +01:00
Hieu Hoang
e1dc4131f6 merge 2013-03-27 08:45:16 +00:00
Hieu Hoang
f8afc73569 get rid of locking altogether. PDTimp already has separated source & target vocab variable. Use those instead 2013-03-26 14:05:50 +00:00
Hieu Hoang
e2b18c5337 no leak message due to static variable in binary phrase table. Doesn't actually solve the mem leak though 2013-03-26 13:29:59 +00:00
Hieu Hoang
51a59b881e move RedVoc() as method in PDTimp class. Ready for getting rid of static variable 2013-03-26 12:45:27 +00:00
Hieu Hoang
9c91eda308 Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-03-16 23:25:40 +00:00
Hieu Hoang
2c26ad133e error parsing factors. And eclipse project files 2013-03-16 16:41:38 +00:00
Hieu Hoang
db049e0fa0 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-03-16 13:35:05 +00:00
Hieu Hoang
9f4824b2be single threaded compile error 2013-03-16 13:25:31 +00:00
Hieu Hoang
8523a27768 fix single-threaded 2013-03-15 20:38:26 +00:00
Hieu Hoang
51d34f2f96 delete Phrase::CreateFromStringNewFormat() 2013-03-08 22:04:28 +00:00
Hieu Hoang
9298402dcf merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 19:10:28 +00:00
Hieu Hoang
d015ef2e62 merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 17:56:39 +00:00
Hieu Hoang
d0e2e417aa merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same 2013-03-08 16:33:36 +00:00
Hieu Hoang
66ad6f32ce start merging PhraseDictionaryMemory and PhraseDictionarySCFG 2013-03-07 19:12:49 +00:00
Hieu Hoang
1f6592aaa9 eclipse 2013-03-07 17:40:45 +00:00
Hieu Hoang
45f30766d4 return reference from function instead of pointer 2013-03-05 14:16:37 +00:00
Hieu Hoang
ce1d50723a make on-disk pt threadable 2013-03-05 14:02:55 +00:00
Hieu Hoang
cc2ec9bc3e make binary pt threadable 2013-03-04 18:15:05 +00:00
Hieu Hoang
991ea4f9c1 minor tidy up 2013-03-04 16:01:25 +00:00
Barry Haddow
3805d8825e remove debug 2013-02-28 22:51:52 +00:00
Barry Haddow
ef87461d07 Interpolated phrase feature 2013-02-28 22:48:41 +00:00
Hieu Hoang
1483f35b71 Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-25 20:32:18 +00:00
Hieu Hoang
63be801652 compressed pt works with new pt format 2013-02-25 18:52:58 +00:00
Hieu Hoang
30ef335226 sparse pt features works with new pt format 2013-02-25 16:52:02 +00:00
Hieu Hoang
5344cc1a63 load PhraseDictionarySCFG 2013-02-25 14:50:33 +00:00
Hieu Hoang
c90eec946f load scfg on-disk pt 2013-02-25 14:24:34 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
c789ce81e6 load binary pt 2013-02-25 11:49:34 +00:00
Hieu Hoang
682aaf4c6f load pt memory 2013-02-25 11:03:34 +00:00
Hieu Hoang
0fb8f2b08e Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-24 22:51:33 +00:00
Hieu Hoang
24aac70a69 new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 16:01:50 +00:00
Hieu Hoang
7d4ca4f21e new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 15:38:29 +00:00
Hieu Hoang
bcecfe55db merge with Lane's search graph output 2013-02-24 00:31:29 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
86b848ef24 set m_useThreadSafePhraseDictionary 2013-02-21 18:06:03 +00:00
Hieu Hoang
ebd7b85aa6 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-20 10:11:21 +00:00
marcinj
10c1785226 Added missing function call to for sort order check 2013-02-20 11:03:57 +01:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
67976401dd Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-14 14:18:49 +00:00
marcinj
10012fac15 Fixed missing last source phrase and added workaround for single key cmph hash functions 2013-02-14 13:22:19 +01:00
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
4d8de1e51d PhraseDictionary doesn't inherit from Dictionary 2013-02-05 19:13:26 +00:00
Hieu Hoang
4417f254a2 delete GetDecodeType(). Thinking of getting rid of class Dictionary altogther 2013-02-05 18:47:25 +00:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b use new constructor for PhraseDictionaryFeature 2013-02-04 12:07:21 +00:00
Hieu Hoang
a02cc4b691 don't use new constructor yet, some regresssion tests fails 2013-02-04 01:57:50 +00:00
Hieu Hoang
95c602fb11 use new constructor 2013-02-04 01:09:15 +00:00
Hieu Hoang
63cd5d4faf use new constructor 2013-02-03 23:55:05 +00:00
Hieu Hoang
ed4921c0c9 delete variable weight 2013-02-03 23:30:36 +00:00
Hieu Hoang
55dd8f1fcf delete variable m_dictIndex 2013-02-03 23:04:52 +00:00
Hieu Hoang
530e859697 tokenize line now moved into base class ScoreProducer 2013-02-01 20:23:36 +00:00
Hieu Hoang
6ed71fc73c separate out PhraseDictionaryFeature from SparsePhraseDictionaryFeature 2013-02-01 16:59:30 +00:00
Hieu Hoang
551d97344c refactor PhraseDictionaryFeature 2013-02-01 15:50:57 +00:00
Hieu Hoang
f95e66c067 Merge branch 'master' into weight-new 2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Hieu Hoang
4d32d8b64b merge 2013-01-19 18:47:04 +00:00
Hieu Hoang
10d7f3654e compile error when single threading 2013-01-18 16:31:55 +00:00
hieu
01243e415a Merge branch 'master' into weight-new 2013-01-03 17:17:35 +00:00
hieu
15c776eda4 delete check and exit of Suffix Array phrase table implementation erroneously checked in 2013-01-03 14:35:39 +00:00
Hieu Hoang
8a8825d740 delete PhraseDictionary::InitDictionary() 2012-12-27 12:26:27 +00:00
Hieu Hoang
bf58eac8bc clean up InitializeBeforeSentenceProcessing() 2012-12-24 18:52:04 +00:00
Hieu Hoang
0df397065d clean up InitializeBeforeSentenceProcessing() 2012-12-24 16:52:40 +00:00
Hieu Hoang
6dd4259258 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:56:29 +00:00
Hieu Hoang
50f666f397 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:37:11 +00:00
Hieu Hoang
c3fe79564c clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:17:13 +00:00
Hieu Hoang
961cc53ae5 clean up CleanUpAfterSentenceProcessing() 2012-12-24 14:34:34 +00:00
Hieu Hoang
8799e721ac move phrase tables and generation tables to staticData 2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4 move language model from TranslationSystem back to StaticData 2012-12-20 16:38:15 +00:00
Hieu Hoang
5d9980af91 move WordPenalty to staticData 2012-12-19 15:38:57 +00:00
Hieu Hoang
f9e21799ed get rid of all occurance of GetNumInputScores() from feature functions. 2012-12-07 16:25:55 +00:00
Hieu Hoang
f212927368 get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not 2012-12-07 16:05:50 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Marcin Junczys-Dowmunt
205cea8644 Allow .minlexr suffix and bugfix 2012-12-01 00:38:20 +01:00
Hieu Hoang
a07f71d095 race condition on letter sed cache. Requires locking 2012-11-30 17:15:32 +00:00
Hieu Hoang
7abb3c878a remove locking. Make wordIndex variable local 2012-11-30 13:50:59 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
bc1e96730d move CKY+Parser to TranslationModel/ 2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18 move the rest of DynSA to TranslationModel/ 2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Hieu Hoang
0b54d32038 move fuzzy-match to TranslationModel/ 2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00