Commit Graph

395 Commits

Author SHA1 Message Date
Hieu Hoang
934e24718e a little bit more towards using prefix subphrase to optimize translation rule lookup 2013-07-04 09:24:13 +01:00
Hieu Hoang
5e355c1595 move lookup of all subphrases into PhraseDictionary class 2013-07-03 19:07:36 +01:00
Hieu Hoang
ac8d10af38 move lookup of all subphrases into PhraseDictionary class 2013-07-03 16:57:23 +01:00
Hieu Hoang
d203f2bb6e single threaded build compiles & passes regression 2013-07-01 17:37:24 +01:00
Ulrich Germann
c963338476 Feature values are now returned as log probabilities. 2013-06-27 17:55:16 +01:00
Hieu Hoang
efc2c6145e beautify 2013-06-26 17:19:09 +01:00
Hieu Hoang
771e792bb4 Merge branch 'master' into dynamic-phrase-tables 2013-06-26 17:13:36 +01:00
Hieu Hoang
3833d67ec0 merge with master 2013-06-26 17:12:22 +01:00
Hieu Hoang
352e36334a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-06-26 11:54:12 +01:00
Ulrich Germann
2f6ca0c0b8 Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	moses/Hypothesis.cpp
	moses/StaticData.cpp
	moses/TargetPhrase.cpp
	moses/TranslationModel/BilingualDynSuffixArray.cpp
	moses/TranslationModel/BilingualDynSuffixArray.h
	moses/TranslationModel/PhraseDictionary.h
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.cpp
	moses/TranslationModel/PhraseDictionaryDynSuffixArray.h
2013-06-26 03:00:27 +01:00
Hieu Hoang
ea0c7b63e7 fix argument parsing in PhraseDictionaryALSuffixArray 2013-06-24 16:10:22 +01:00
Kenneth Heafield
718e90d006 Missing header 2013-06-21 09:38:45 -04:00
Hieu Hoang
a69ad79e9c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-06-21 14:38:14 +01:00
Kenneth Heafield
217c8ea38f Missing header / Mehndi Bhargava 2013-06-21 09:37:05 -04:00
Hieu Hoang
3d790b7226 minor cleanup 2013-06-20 17:15:54 +01:00
Hieu Hoang
d68277d369 redo parsing of feature function parameters 2013-06-20 13:25:02 +01:00
Hieu Hoang
24d2edd790 redo parsing of feature function parameters 2013-06-20 13:06:03 +01:00
Hieu Hoang
dc33fa3d3d redo parsing of feature function parameters 2013-06-20 12:50:41 +01:00
Hieu Hoang
c2f4c48758 clean up SetParameter() 2013-06-19 00:24:21 +01:00
Hieu Hoang
acb4baacaf delete 2 unused legacy functions 2013-06-17 18:46:40 +01:00
Hieu Hoang
e51c4feb6b push calling of OnlyTheseFactors() to individual PT implementations, as needed 2013-06-17 18:31:06 +01:00
Hieu Hoang
f7371cf53d calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract 2013-06-14 18:34:47 +01:00
Rico Sennrich
b1b70e802d use read-write lock in multimodel 2013-06-12 15:25:53 +02:00
Rico Sennrich
9e9cbbc13b refactoring multimodel code out of StaticData; locking. 2013-06-12 14:47:40 +02:00
Hieu Hoang
5becd868a9 delete misc unused variables from PhraseDictionary 2013-06-11 16:31:43 +01:00
Hieu Hoang
61e2b7a24f refactor parsing of feature functiona args 2013-06-11 01:46:04 +01:00
Hieu Hoang
b4ad093334 refactor parsing of feature functiona args 2013-06-11 00:05:12 +01:00
Hieu Hoang
efa42b451c refactor parsing of feature functiona args 2013-06-10 21:24:31 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
96d116dba0 refactor parsing of feature functiona args 2013-06-10 16:29:07 +01:00
Hieu Hoang
e291c5f4a4 implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far 2013-06-07 17:32:01 +01:00
Hieu Hoang
23fba08ded minor 2013-06-06 21:49:38 +01:00
Hieu Hoang
df4b8e5828 m_numInputScores deleted from PhraseDictionary. 2013-06-06 18:54:44 +01:00
Ulrich Germann
7ecfb88a29 Alpha version of phrase tables based on dynamic suffix arrays. 2013-06-05 10:46:42 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Ulrich Germann
570b7c6aa5 Fixed bug in ComparePosition::operator()(...). 2013-06-03 12:22:05 +01:00
Hieu Hoang
3b76143072 refactor loading in class PhraseDictionaryFuzzyMatch 2013-05-31 23:39:19 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
Hieu Hoang
173cfffaac Reapply Abby Levenberg's log change @4b4aba3 2013-05-31 15:06:36 +01:00
Hieu Hoang
0db5504629 port PhraseDictionaryDynSuffixArray to new ini format. Scores aren't the same. Probably something to do with Abby Levenberg's log change 2013-05-31 15:02:34 +01:00
Hieu Hoang
65d2d68bc5 beautify 2013-05-31 00:00:21 +01:00
Hieu Hoang
117eb76b0a figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 18:34:10 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
66afd6611b parse scores correctly. Assume dense features, always in the same order 2013-05-28 15:54:11 +01:00
Hieu Hoang
ed220e91a9 debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do 2013-05-28 15:38:36 +01:00
Hieu Hoang
0580e2bd11 delete create-ini 2013-05-28 13:11:37 +01:00
Hieu Hoang
036ea4ee29 delete sourcePhrase variable in TargetPhrase class 2013-05-28 11:38:18 +01:00
Hieu Hoang
ae82d02a05 delete sourcePhrase variable in TargetPhrase class 2013-05-28 00:41:25 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
6c322ba05e move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:33:30 +01:00
Hieu Hoang
4a280c8ca7 move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:23:31 +01:00
Hieu Hoang
d273812231 delete enum StatelessFeatureType. Features can be multiple types at once. Just overload the Evaluate() function you need 2013-05-24 16:04:38 +01:00
Hieu Hoang
ca8007be12 leak 2013-05-23 15:29:25 +01:00
Hieu Hoang
b10ecf2b44 make each node in trie a pointer. No possibility that the node is delete during build of the trie 2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635 technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 17:32:06 +01:00
Hieu Hoang
bfe321a068 change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie 2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b Make Phrase::CreateFromString() more efficient 2013-05-22 14:41:28 +01:00
Hieu Hoang
bce3b36170 Make Phrase::CreateFromString() more efficient 2013-05-22 12:28:32 +01:00
Hieu Hoang
112bcdc925 Make Phrase::CreateFromString() more efficient 2013-05-22 12:03:00 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Ulrich Germann
7996378ffb Made InitDictionary() a pure virtual function to force explicit initialization in derived classes. 2013-05-21 19:06:39 +01:00
Hieu Hoang
2f38746f6a delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function 2013-05-21 14:00:28 +01:00
Hieu Hoang
7dc177514d delete references to WordPenaltyProducer 2013-05-21 13:50:18 +01:00
Hieu Hoang
81003b9464 delete references to WordPenaltyProducer 2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
f4cf5f152b delete references to LMList 2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4 delete references to LMList 2013-05-21 12:47:26 +01:00
Hieu Hoang
70873c3b8d delete references to LMList 2013-05-21 12:33:51 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number 2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9 make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it 2013-05-20 17:01:19 +01:00
Rico Sennrich
5fa1752018 multimodel(counts): allow different features to have separate interpolation weights. 2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba restore support for multimodel(counts) in moses server:
set sentence-level weights and optimize weights
2013-05-16 13:40:17 +02:00
Hieu Hoang
3876c47d1d port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3 port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 14:34:31 +01:00
Hieu Hoang
81ffe84dbc port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-14 17:35:22 +01:00
Hieu Hoang
66ad7c3c18 port PhraseDictionaryMultiModelCounts to new format 2013-05-14 15:16:09 +01:00
Hieu Hoang
0c3fa9942b port PhraseDictionaryMultiModelCounts to new format 2013-05-14 13:11:55 +01:00
Hieu Hoang
34df0011a9 change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary 2013-05-14 12:19:55 +01:00
Hieu Hoang
d5ebe61791 port PhraseDictionaryMultiModelCount to new format 2013-05-13 18:40:12 +01:00
Hieu Hoang
b8efef6667 port PhraseDictionaryMultiModelCount to new format 2013-05-13 18:39:06 +01:00
Hieu Hoang
dcafe74892 port PhraseDictionaryMultiModelCount to new format 2013-05-13 17:20:14 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
a8cf5c3472 port PhraseDictionaryMultiModel to new format 2013-05-13 13:19:25 +01:00
Hieu Hoang
3a10197edb Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-13 10:37:08 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
72c9e7813d port PhraseDictionaryMultiModel to new format 2013-05-10 18:01:52 +01:00
Hieu Hoang
cb8b303f10 changes for cruise control 2013-05-10 15:51:07 +01:00
Hieu Hoang
7e398d3bca port PhraseDictionaryMultiModel to new format 2013-05-10 15:33:46 +01:00
Hieu Hoang
805c5c5be9 port PhraseDictionaryMultiModel to new format 2013-05-10 15:13:03 +01:00
Hieu Hoang
f0bf197695 port PhraseDictionaryMultiModel to new format 2013-05-10 14:48:06 +01:00
Hieu Hoang
ed7ab8146f port PhraseDictionaryMultiModel to new format 2013-05-10 12:30:01 +01:00
Hieu Hoang
187e09a5d2 delete last TargetPhrase::SetScore() 2013-05-02 18:36:34 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
46b70fe89a start framework for evaluating target phrase score 2013-05-02 17:07:03 +01:00
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
ce80626c9a remove SparsePhraseDictionaryFeature 2013-05-01 13:17:09 +01:00
Hieu Hoang
2b93917a80 delete argument report-sparse-features 2013-05-01 12:40:59 +01:00
Hieu Hoang
3e64d4b341 enum StatelessFeatureType 2013-04-30 19:27:49 +01:00
Hieu Hoang
26a4aa8d18 enable sparse feature in phrase table 2013-04-30 17:27:35 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Hieu Hoang
83494418e2 delete PhraseDictionaryMemory. Fix word penalty in compact phrase table 2013-04-26 15:55:32 +01:00
Hieu Hoang
b448c6285a make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors 2013-04-26 12:20:49 +01:00
Kenneth Heafield
2437ed441d Accept cmph with lib64 too 2013-04-25 21:50:05 +01:00
Hieu Hoang
4b4aba3d81 log probabilities. /Abby 2013-04-25 16:54:45 +01:00
Rico Sennrich
908c006e32 online combination of multiple phrase tables
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
  - linear interpolation or instance weighting
  - two possible component model types supported so far: 0 (in-memory) or 12 (compact)
  - weights can be set in config, and overriden on a sentence-level through mosesserver API
  - online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Barry Haddow
9d42c7f6f7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-12 16:07:26 +01:00
Hieu Hoang
e1dc4131f6 merge 2013-03-27 08:45:16 +00:00
Hieu Hoang
f8afc73569 get rid of locking altogether. PDTimp already has separated source & target vocab variable. Use those instead 2013-03-26 14:05:50 +00:00
Hieu Hoang
e2b18c5337 no leak message due to static variable in binary phrase table. Doesn't actually solve the mem leak though 2013-03-26 13:29:59 +00:00
Hieu Hoang
51a59b881e move RedVoc() as method in PDTimp class. Ready for getting rid of static variable 2013-03-26 12:45:27 +00:00
Hieu Hoang
9c91eda308 Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-03-16 23:25:40 +00:00
Hieu Hoang
2c26ad133e error parsing factors. And eclipse project files 2013-03-16 16:41:38 +00:00
Hieu Hoang
db049e0fa0 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-03-16 13:35:05 +00:00
Hieu Hoang
9f4824b2be single threaded compile error 2013-03-16 13:25:31 +00:00
Hieu Hoang
8523a27768 fix single-threaded 2013-03-15 20:38:26 +00:00
Hieu Hoang
51d34f2f96 delete Phrase::CreateFromStringNewFormat() 2013-03-08 22:04:28 +00:00
Hieu Hoang
9298402dcf merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 19:10:28 +00:00
Hieu Hoang
d015ef2e62 merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 17:56:39 +00:00
Hieu Hoang
d0e2e417aa merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same 2013-03-08 16:33:36 +00:00
Hieu Hoang
66ad6f32ce start merging PhraseDictionaryMemory and PhraseDictionarySCFG 2013-03-07 19:12:49 +00:00
Hieu Hoang
1f6592aaa9 eclipse 2013-03-07 17:40:45 +00:00
Hieu Hoang
45f30766d4 return reference from function instead of pointer 2013-03-05 14:16:37 +00:00
Hieu Hoang
ce1d50723a make on-disk pt threadable 2013-03-05 14:02:55 +00:00
Hieu Hoang
cc2ec9bc3e make binary pt threadable 2013-03-04 18:15:05 +00:00
Hieu Hoang
991ea4f9c1 minor tidy up 2013-03-04 16:01:25 +00:00
Barry Haddow
3805d8825e remove debug 2013-02-28 22:51:52 +00:00
Barry Haddow
ef87461d07 Interpolated phrase feature 2013-02-28 22:48:41 +00:00
Hieu Hoang
1483f35b71 Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-25 20:32:18 +00:00
Hieu Hoang
63be801652 compressed pt works with new pt format 2013-02-25 18:52:58 +00:00
Hieu Hoang
30ef335226 sparse pt features works with new pt format 2013-02-25 16:52:02 +00:00
Hieu Hoang
5344cc1a63 load PhraseDictionarySCFG 2013-02-25 14:50:33 +00:00
Hieu Hoang
c90eec946f load scfg on-disk pt 2013-02-25 14:24:34 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
c789ce81e6 load binary pt 2013-02-25 11:49:34 +00:00
Hieu Hoang
682aaf4c6f load pt memory 2013-02-25 11:03:34 +00:00
Hieu Hoang
0fb8f2b08e Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-24 22:51:33 +00:00
Hieu Hoang
24aac70a69 new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 16:01:50 +00:00
Hieu Hoang
7d4ca4f21e new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 15:38:29 +00:00
Hieu Hoang
bcecfe55db merge with Lane's search graph output 2013-02-24 00:31:29 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
86b848ef24 set m_useThreadSafePhraseDictionary 2013-02-21 18:06:03 +00:00
Hieu Hoang
ebd7b85aa6 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-20 10:11:21 +00:00
marcinj
10c1785226 Added missing function call to for sort order check 2013-02-20 11:03:57 +01:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
67976401dd Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-14 14:18:49 +00:00
marcinj
10012fac15 Fixed missing last source phrase and added workaround for single key cmph hash functions 2013-02-14 13:22:19 +01:00
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
4d8de1e51d PhraseDictionary doesn't inherit from Dictionary 2013-02-05 19:13:26 +00:00
Hieu Hoang
4417f254a2 delete GetDecodeType(). Thinking of getting rid of class Dictionary altogther 2013-02-05 18:47:25 +00:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b use new constructor for PhraseDictionaryFeature 2013-02-04 12:07:21 +00:00
Hieu Hoang
a02cc4b691 don't use new constructor yet, some regresssion tests fails 2013-02-04 01:57:50 +00:00
Hieu Hoang
95c602fb11 use new constructor 2013-02-04 01:09:15 +00:00
Hieu Hoang
63cd5d4faf use new constructor 2013-02-03 23:55:05 +00:00
Hieu Hoang
ed4921c0c9 delete variable weight 2013-02-03 23:30:36 +00:00
Hieu Hoang
55dd8f1fcf delete variable m_dictIndex 2013-02-03 23:04:52 +00:00
Hieu Hoang
530e859697 tokenize line now moved into base class ScoreProducer 2013-02-01 20:23:36 +00:00
Hieu Hoang
6ed71fc73c separate out PhraseDictionaryFeature from SparsePhraseDictionaryFeature 2013-02-01 16:59:30 +00:00
Hieu Hoang
551d97344c refactor PhraseDictionaryFeature 2013-02-01 15:50:57 +00:00
Hieu Hoang
f95e66c067 Merge branch 'master' into weight-new 2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Hieu Hoang
4d32d8b64b merge 2013-01-19 18:47:04 +00:00
Hieu Hoang
10d7f3654e compile error when single threading 2013-01-18 16:31:55 +00:00
hieu
01243e415a Merge branch 'master' into weight-new 2013-01-03 17:17:35 +00:00
hieu
15c776eda4 delete check and exit of Suffix Array phrase table implementation erroneously checked in 2013-01-03 14:35:39 +00:00
Hieu Hoang
8a8825d740 delete PhraseDictionary::InitDictionary() 2012-12-27 12:26:27 +00:00
Hieu Hoang
bf58eac8bc clean up InitializeBeforeSentenceProcessing() 2012-12-24 18:52:04 +00:00
Hieu Hoang
0df397065d clean up InitializeBeforeSentenceProcessing() 2012-12-24 16:52:40 +00:00
Hieu Hoang
6dd4259258 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:56:29 +00:00
Hieu Hoang
50f666f397 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:37:11 +00:00
Hieu Hoang
c3fe79564c clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:17:13 +00:00
Hieu Hoang
961cc53ae5 clean up CleanUpAfterSentenceProcessing() 2012-12-24 14:34:34 +00:00
Hieu Hoang
8799e721ac move phrase tables and generation tables to staticData 2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4 move language model from TranslationSystem back to StaticData 2012-12-20 16:38:15 +00:00
Hieu Hoang
5d9980af91 move WordPenalty to staticData 2012-12-19 15:38:57 +00:00
Hieu Hoang
f9e21799ed get rid of all occurance of GetNumInputScores() from feature functions. 2012-12-07 16:25:55 +00:00
Hieu Hoang
f212927368 get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not 2012-12-07 16:05:50 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Marcin Junczys-Dowmunt
205cea8644 Allow .minlexr suffix and bugfix 2012-12-01 00:38:20 +01:00
Hieu Hoang
a07f71d095 race condition on letter sed cache. Requires locking 2012-11-30 17:15:32 +00:00
Hieu Hoang
7abb3c878a remove locking. Make wordIndex variable local 2012-11-30 13:50:59 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
bc1e96730d move CKY+Parser to TranslationModel/ 2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18 move the rest of DynSA to TranslationModel/ 2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Hieu Hoang
0b54d32038 move fuzzy-match to TranslationModel/ 2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00