Commit Graph

281 Commits

Author SHA1 Message Date
Hieu Hoang
2c26ad133e error parsing factors. And eclipse project files 2013-03-16 16:41:38 +00:00
Hieu Hoang
db049e0fa0 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-03-16 13:35:05 +00:00
Hieu Hoang
9f4824b2be single threaded compile error 2013-03-16 13:25:31 +00:00
Hieu Hoang
8523a27768 fix single-threaded 2013-03-15 20:38:26 +00:00
Hieu Hoang
51d34f2f96 delete Phrase::CreateFromStringNewFormat() 2013-03-08 22:04:28 +00:00
Hieu Hoang
9298402dcf merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 19:10:28 +00:00
Hieu Hoang
d015ef2e62 merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 17:56:39 +00:00
Hieu Hoang
d0e2e417aa merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same 2013-03-08 16:33:36 +00:00
Hieu Hoang
66ad6f32ce start merging PhraseDictionaryMemory and PhraseDictionarySCFG 2013-03-07 19:12:49 +00:00
Hieu Hoang
1f6592aaa9 eclipse 2013-03-07 17:40:45 +00:00
Hieu Hoang
45f30766d4 return reference from function instead of pointer 2013-03-05 14:16:37 +00:00
Hieu Hoang
ce1d50723a make on-disk pt threadable 2013-03-05 14:02:55 +00:00
Hieu Hoang
cc2ec9bc3e make binary pt threadable 2013-03-04 18:15:05 +00:00
Hieu Hoang
991ea4f9c1 minor tidy up 2013-03-04 16:01:25 +00:00
Barry Haddow
3805d8825e remove debug 2013-02-28 22:51:52 +00:00
Barry Haddow
ef87461d07 Interpolated phrase feature 2013-02-28 22:48:41 +00:00
Hieu Hoang
1483f35b71 Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-25 20:32:18 +00:00
Hieu Hoang
63be801652 compressed pt works with new pt format 2013-02-25 18:52:58 +00:00
Hieu Hoang
30ef335226 sparse pt features works with new pt format 2013-02-25 16:52:02 +00:00
Hieu Hoang
5344cc1a63 load PhraseDictionarySCFG 2013-02-25 14:50:33 +00:00
Hieu Hoang
c90eec946f load scfg on-disk pt 2013-02-25 14:24:34 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
c789ce81e6 load binary pt 2013-02-25 11:49:34 +00:00
Hieu Hoang
682aaf4c6f load pt memory 2013-02-25 11:03:34 +00:00
Hieu Hoang
0fb8f2b08e Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new 2013-02-24 22:51:33 +00:00
Hieu Hoang
24aac70a69 new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 16:01:50 +00:00
Hieu Hoang
7d4ca4f21e new pt format compiles. Doesn't run probably, doesn't load 2013-02-24 15:38:29 +00:00
Hieu Hoang
bcecfe55db merge with Lane's search graph output 2013-02-24 00:31:29 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
86b848ef24 set m_useThreadSafePhraseDictionary 2013-02-21 18:06:03 +00:00
Hieu Hoang
ebd7b85aa6 Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-20 10:11:21 +00:00
marcinj
10c1785226 Added missing function call to for sort order check 2013-02-20 11:03:57 +01:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
67976401dd Merge github.com:moses-smt/mosesdecoder into weight-new 2013-02-14 14:18:49 +00:00
marcinj
10012fac15 Fixed missing last source phrase and added workaround for single key cmph hash functions 2013-02-14 13:22:19 +01:00
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
4d8de1e51d PhraseDictionary doesn't inherit from Dictionary 2013-02-05 19:13:26 +00:00
Hieu Hoang
4417f254a2 delete GetDecodeType(). Thinking of getting rid of class Dictionary altogther 2013-02-05 18:47:25 +00:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b use new constructor for PhraseDictionaryFeature 2013-02-04 12:07:21 +00:00
Hieu Hoang
a02cc4b691 don't use new constructor yet, some regresssion tests fails 2013-02-04 01:57:50 +00:00
Hieu Hoang
95c602fb11 use new constructor 2013-02-04 01:09:15 +00:00
Hieu Hoang
63cd5d4faf use new constructor 2013-02-03 23:55:05 +00:00
Hieu Hoang
ed4921c0c9 delete variable weight 2013-02-03 23:30:36 +00:00
Hieu Hoang
55dd8f1fcf delete variable m_dictIndex 2013-02-03 23:04:52 +00:00
Hieu Hoang
530e859697 tokenize line now moved into base class ScoreProducer 2013-02-01 20:23:36 +00:00
Hieu Hoang
6ed71fc73c separate out PhraseDictionaryFeature from SparsePhraseDictionaryFeature 2013-02-01 16:59:30 +00:00
Hieu Hoang
551d97344c refactor PhraseDictionaryFeature 2013-02-01 15:50:57 +00:00
Hieu Hoang
f95e66c067 Merge branch 'master' into weight-new 2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Hieu Hoang
4d32d8b64b merge 2013-01-19 18:47:04 +00:00
Hieu Hoang
10d7f3654e compile error when single threading 2013-01-18 16:31:55 +00:00
hieu
01243e415a Merge branch 'master' into weight-new 2013-01-03 17:17:35 +00:00
hieu
15c776eda4 delete check and exit of Suffix Array phrase table implementation erroneously checked in 2013-01-03 14:35:39 +00:00
Hieu Hoang
8a8825d740 delete PhraseDictionary::InitDictionary() 2012-12-27 12:26:27 +00:00
Hieu Hoang
bf58eac8bc clean up InitializeBeforeSentenceProcessing() 2012-12-24 18:52:04 +00:00
Hieu Hoang
0df397065d clean up InitializeBeforeSentenceProcessing() 2012-12-24 16:52:40 +00:00
Hieu Hoang
6dd4259258 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:56:29 +00:00
Hieu Hoang
50f666f397 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:37:11 +00:00
Hieu Hoang
c3fe79564c clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:17:13 +00:00
Hieu Hoang
961cc53ae5 clean up CleanUpAfterSentenceProcessing() 2012-12-24 14:34:34 +00:00
Hieu Hoang
8799e721ac move phrase tables and generation tables to staticData 2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4 move language model from TranslationSystem back to StaticData 2012-12-20 16:38:15 +00:00
Hieu Hoang
5d9980af91 move WordPenalty to staticData 2012-12-19 15:38:57 +00:00
Hieu Hoang
f9e21799ed get rid of all occurance of GetNumInputScores() from feature functions. 2012-12-07 16:25:55 +00:00
Hieu Hoang
f212927368 get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not 2012-12-07 16:05:50 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Marcin Junczys-Dowmunt
205cea8644 Allow .minlexr suffix and bugfix 2012-12-01 00:38:20 +01:00
Hieu Hoang
a07f71d095 race condition on letter sed cache. Requires locking 2012-11-30 17:15:32 +00:00
Hieu Hoang
7abb3c878a remove locking. Make wordIndex variable local 2012-11-30 13:50:59 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
bc1e96730d move CKY+Parser to TranslationModel/ 2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18 move the rest of DynSA to TranslationModel/ 2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Hieu Hoang
0b54d32038 move fuzzy-match to TranslationModel/ 2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00