Hieu Hoang
e073d22301
prefix subphrase optimization
2013-07-05 10:52:12 +01:00
Hieu Hoang
a60da7d4b7
prefix subphrase optimization
2013-07-05 09:59:50 +01:00
Graham Neubig
0cde047e6e
Merge branch 'master' of github.com:neubig/mosesdecoder into check-processphrasetable-width
2013-07-05 12:38:31 +09:00
Graham Neubig
6c25048d20
Prevented segfault on print non-existant alignment
...
In processPhraseTable, there is an option to print alignments.
When this is selected, processPhraseTable will print the 4th
column in the phrase table, but the check for the phrase table
width only currently goes to the 3rd column. This patch makes
sure that the phrase table must have 4 columns when alignments
are being printed, and 3 otherwise.
2013-07-05 12:21:01 +09:00
Hieu Hoang
574d186708
beautify
2013-07-04 23:38:18 +01:00
Hieu Hoang
0efcf64c28
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input2
2013-07-04 23:37:21 +01:00
Hieu Hoang
f4d77aae38
start prefix subphrase optimization with OnDisk pt
2013-07-04 23:36:17 +01:00
Marcin Junczys-Dowmunt
bc904ff61f
Deleted stray "cerr << .."
2013-07-05 00:15:27 +02:00
Hieu Hoang
f0dc30f25a
prefix subphrase optimization done for in-memory pt. Need to delete objects also
2013-07-04 15:13:29 +01:00
Hieu Hoang
934e24718e
a little bit more towards using prefix subphrase to optimize translation rule lookup
2013-07-04 09:24:13 +01:00
Hieu Hoang
5e355c1595
move lookup of all subphrases into PhraseDictionary class
2013-07-03 19:07:36 +01:00
Hieu Hoang
ac8d10af38
move lookup of all subphrases into PhraseDictionary class
2013-07-03 16:57:23 +01:00
Hieu Hoang
d203f2bb6e
single threaded build compiles & passes regression
2013-07-01 17:37:24 +01:00
Ulrich Germann
c963338476
Feature values are now returned as log probabilities.
2013-06-27 17:55:16 +01:00
Hieu Hoang
efc2c6145e
beautify
2013-06-26 17:19:09 +01:00
Hieu Hoang
771e792bb4
Merge branch 'master' into dynamic-phrase-tables
2013-06-26 17:13:36 +01:00
Hieu Hoang
3833d67ec0
merge with master
2013-06-26 17:12:22 +01:00
Hieu Hoang
352e36334a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-06-26 11:54:12 +01:00
Ulrich Germann
2f6ca0c0b8
Merge branch 'master' into dynamic-phrase-tables
...
Conflicts:
moses/Hypothesis.cpp
moses/StaticData.cpp
moses/TargetPhrase.cpp
moses/TranslationModel/BilingualDynSuffixArray.cpp
moses/TranslationModel/BilingualDynSuffixArray.h
moses/TranslationModel/PhraseDictionary.h
moses/TranslationModel/PhraseDictionaryDynSuffixArray.cpp
moses/TranslationModel/PhraseDictionaryDynSuffixArray.h
2013-06-26 03:00:27 +01:00
Hieu Hoang
ea0c7b63e7
fix argument parsing in PhraseDictionaryALSuffixArray
2013-06-24 16:10:22 +01:00
Kenneth Heafield
718e90d006
Missing header
2013-06-21 09:38:45 -04:00
Hieu Hoang
a69ad79e9c
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-06-21 14:38:14 +01:00
Kenneth Heafield
217c8ea38f
Missing header / Mehndi Bhargava
2013-06-21 09:37:05 -04:00
Hieu Hoang
3d790b7226
minor cleanup
2013-06-20 17:15:54 +01:00
Hieu Hoang
d68277d369
redo parsing of feature function parameters
2013-06-20 13:25:02 +01:00
Hieu Hoang
24d2edd790
redo parsing of feature function parameters
2013-06-20 13:06:03 +01:00
Hieu Hoang
dc33fa3d3d
redo parsing of feature function parameters
2013-06-20 12:50:41 +01:00
Hieu Hoang
c2f4c48758
clean up SetParameter()
2013-06-19 00:24:21 +01:00
Hieu Hoang
acb4baacaf
delete 2 unused legacy functions
2013-06-17 18:46:40 +01:00
Hieu Hoang
e51c4feb6b
push calling of OnlyTheseFactors() to individual PT implementations, as needed
2013-06-17 18:31:06 +01:00
Hieu Hoang
f7371cf53d
calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract
2013-06-14 18:34:47 +01:00
Rico Sennrich
b1b70e802d
use read-write lock in multimodel
2013-06-12 15:25:53 +02:00
Rico Sennrich
9e9cbbc13b
refactoring multimodel code out of StaticData; locking.
2013-06-12 14:47:40 +02:00
Hieu Hoang
5becd868a9
delete misc unused variables from PhraseDictionary
2013-06-11 16:31:43 +01:00
Hieu Hoang
61e2b7a24f
refactor parsing of feature functiona args
2013-06-11 01:46:04 +01:00
Hieu Hoang
b4ad093334
refactor parsing of feature functiona args
2013-06-11 00:05:12 +01:00
Hieu Hoang
efa42b451c
refactor parsing of feature functiona args
2013-06-10 21:24:31 +01:00
Hieu Hoang
abe6bb7c22
refactor parsing of feature functiona args
2013-06-10 18:11:55 +01:00
Hieu Hoang
96d116dba0
refactor parsing of feature functiona args
2013-06-10 16:29:07 +01:00
Hieu Hoang
e291c5f4a4
implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far
2013-06-07 17:32:01 +01:00
Hieu Hoang
23fba08ded
minor
2013-06-06 21:49:38 +01:00
Hieu Hoang
df4b8e5828
m_numInputScores deleted from PhraseDictionary.
2013-06-06 18:54:44 +01:00
Ulrich Germann
7ecfb88a29
Alpha version of phrase tables based on dynamic suffix arrays.
2013-06-05 10:46:42 +01:00
Hieu Hoang
21ff6d4831
beautify
2013-06-03 12:33:18 +01:00
Ulrich Germann
570b7c6aa5
Fixed bug in ComparePosition::operator()(...).
2013-06-03 12:22:05 +01:00
Hieu Hoang
3b76143072
refactor loading in class PhraseDictionaryFuzzyMatch
2013-05-31 23:39:19 +01:00
Hieu Hoang
eaf53769ad
consistent Load() for all feature functions. Can be used not to load if doing --show-weights
2013-05-31 20:21:02 +01:00
Hieu Hoang
173cfffaac
Reapply Abby Levenberg's log change @4b4aba3
2013-05-31 15:06:36 +01:00
Hieu Hoang
0db5504629
port PhraseDictionaryDynSuffixArray to new ini format. Scores aren't the same. Probably something to do with Abby Levenberg's log change
2013-05-31 15:02:34 +01:00
Hieu Hoang
65d2d68bc5
beautify
2013-05-31 00:00:21 +01:00
Hieu Hoang
117eb76b0a
figure out which feature function to apply at which decode step. Book-keeping
2013-05-30 18:34:10 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
66afd6611b
parse scores correctly. Assume dense features, always in the same order
2013-05-28 15:54:11 +01:00
Hieu Hoang
ed220e91a9
debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do
2013-05-28 15:38:36 +01:00
Hieu Hoang
0580e2bd11
delete create-ini
2013-05-28 13:11:37 +01:00
Hieu Hoang
036ea4ee29
delete sourcePhrase variable in TargetPhrase class
2013-05-28 11:38:18 +01:00
Hieu Hoang
ae82d02a05
delete sourcePhrase variable in TargetPhrase class
2013-05-28 00:41:25 +01:00
Hieu Hoang
e8dadb58ce
split classes in DummyScoreProducers into separate files
2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f
move feature functions into moses/FF
2013-05-24 18:02:49 +01:00
Hieu Hoang
6c322ba05e
move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory
2013-05-24 16:33:30 +01:00
Hieu Hoang
4a280c8ca7
move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory
2013-05-24 16:23:31 +01:00
Hieu Hoang
d273812231
delete enum StatelessFeatureType. Features can be multiple types at once. Just overload the Evaluate() function you need
2013-05-24 16:04:38 +01:00
Hieu Hoang
ca8007be12
leak
2013-05-23 15:29:25 +01:00
Hieu Hoang
b10ecf2b44
make each node in trie a pointer. No possibility that the node is delete during build of the trie
2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635
technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind
2013-05-22 17:32:06 +01:00
Hieu Hoang
bfe321a068
change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie
2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b
Make Phrase::CreateFromString() more efficient
2013-05-22 14:41:28 +01:00
Hieu Hoang
bce3b36170
Make Phrase::CreateFromString() more efficient
2013-05-22 12:28:32 +01:00
Hieu Hoang
112bcdc925
Make Phrase::CreateFromString() more efficient
2013-05-22 12:03:00 +01:00
Hieu Hoang
f4a75b30f7
Make lhsTarget a pointer
2013-05-22 11:22:17 +01:00
Ulrich Germann
7996378ffb
Made InitDictionary() a pure virtual function to force explicit initialization in derived classes.
2013-05-21 19:06:39 +01:00
Hieu Hoang
2f38746f6a
delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function
2013-05-21 14:00:28 +01:00
Hieu Hoang
7dc177514d
delete references to WordPenaltyProducer
2013-05-21 13:50:18 +01:00
Hieu Hoang
81003b9464
delete references to WordPenaltyProducer
2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335
delete references to WordPenaltyProducer
2013-05-21 13:39:31 +01:00
Hieu Hoang
0e1c246010
delete references to WordPenaltyProducer
2013-05-21 13:22:04 +01:00
Hieu Hoang
f4cf5f152b
delete references to LMList
2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4
delete references to LMList
2013-05-21 12:47:26 +01:00
Hieu Hoang
70873c3b8d
delete references to LMList
2013-05-21 12:33:51 +01:00
Hieu Hoang
ff880ec6f1
delete references to LMList
2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd
move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number
2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9
make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it
2013-05-20 17:01:19 +01:00
Rico Sennrich
5fa1752018
multimodel(counts): allow different features to have separate interpolation weights.
2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba
restore support for multimodel(counts) in moses server:
...
set sentence-level weights and optimize weights
2013-05-16 13:40:17 +02:00
Hieu Hoang
3876c47d1d
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 14:34:31 +01:00
Hieu Hoang
81ffe84dbc
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-14 17:35:22 +01:00
Hieu Hoang
66ad7c3c18
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 15:16:09 +01:00
Hieu Hoang
0c3fa9942b
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 13:11:55 +01:00
Hieu Hoang
34df0011a9
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-14 12:19:55 +01:00
Hieu Hoang
d5ebe61791
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:40:12 +01:00
Hieu Hoang
b8efef6667
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:39:06 +01:00
Hieu Hoang
dcafe74892
port PhraseDictionaryMultiModelCount to new format
2013-05-13 17:20:14 +01:00
Hieu Hoang
499487fb98
get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly
2013-05-13 15:36:09 +01:00
Hieu Hoang
a8cf5c3472
port PhraseDictionaryMultiModel to new format
2013-05-13 13:19:25 +01:00
Hieu Hoang
3a10197edb
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-13 10:37:08 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
72c9e7813d
port PhraseDictionaryMultiModel to new format
2013-05-10 18:01:52 +01:00
Hieu Hoang
cb8b303f10
changes for cruise control
2013-05-10 15:51:07 +01:00
Hieu Hoang
7e398d3bca
port PhraseDictionaryMultiModel to new format
2013-05-10 15:33:46 +01:00
Hieu Hoang
805c5c5be9
port PhraseDictionaryMultiModel to new format
2013-05-10 15:13:03 +01:00
Hieu Hoang
f0bf197695
port PhraseDictionaryMultiModel to new format
2013-05-10 14:48:06 +01:00
Hieu Hoang
ed7ab8146f
port PhraseDictionaryMultiModel to new format
2013-05-10 12:30:01 +01:00
Hieu Hoang
187e09a5d2
delete last TargetPhrase::SetScore()
2013-05-02 18:36:34 +01:00
Hieu Hoang
fdcfe95574
start framework for evaluating target phrase score
2013-05-02 17:19:45 +01:00
Hieu Hoang
46b70fe89a
start framework for evaluating target phrase score
2013-05-02 17:07:03 +01:00
Hieu Hoang
47465f8afb
start framework for evaluating target phrase score
2013-05-02 14:55:26 +01:00
Hieu Hoang
ce80626c9a
remove SparsePhraseDictionaryFeature
2013-05-01 13:17:09 +01:00
Hieu Hoang
2b93917a80
delete argument report-sparse-features
2013-05-01 12:40:59 +01:00
Hieu Hoang
3e64d4b341
enum StatelessFeatureType
2013-04-30 19:27:49 +01:00
Hieu Hoang
26a4aa8d18
enable sparse feature in phrase table
2013-04-30 17:27:35 +01:00
Hieu Hoang
ce95c117f6
merge
2013-04-29 18:46:48 +01:00
Hieu Hoang
83494418e2
delete PhraseDictionaryMemory. Fix word penalty in compact phrase table
2013-04-26 15:55:32 +01:00
Hieu Hoang
b448c6285a
make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors
2013-04-26 12:20:49 +01:00
Kenneth Heafield
2437ed441d
Accept cmph with lib64 too
2013-04-25 21:50:05 +01:00
Hieu Hoang
4b4aba3d81
log probabilities. /Abby
2013-04-25 16:54:45 +01:00
Rico Sennrich
908c006e32
online combination of multiple phrase tables
...
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
- linear interpolation or instance weighting
- two possible component model types supported so far: 0 (in-memory) or 12 (compact)
- weights can be set in config, and overriden on a sentence-level through mosesserver API
- online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Barry Haddow
9d42c7f6f7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-12 16:07:26 +01:00
Hieu Hoang
e1dc4131f6
merge
2013-03-27 08:45:16 +00:00
Hieu Hoang
f8afc73569
get rid of locking altogether. PDTimp already has separated source & target vocab variable. Use those instead
2013-03-26 14:05:50 +00:00
Hieu Hoang
e2b18c5337
no leak message due to static variable in binary phrase table. Doesn't actually solve the mem leak though
2013-03-26 13:29:59 +00:00
Hieu Hoang
51a59b881e
move RedVoc() as method in PDTimp class. Ready for getting rid of static variable
2013-03-26 12:45:27 +00:00
Hieu Hoang
9c91eda308
Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new
2013-03-16 23:25:40 +00:00
Hieu Hoang
2c26ad133e
error parsing factors. And eclipse project files
2013-03-16 16:41:38 +00:00
Hieu Hoang
db049e0fa0
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-16 13:35:05 +00:00
Hieu Hoang
9f4824b2be
single threaded compile error
2013-03-16 13:25:31 +00:00
Hieu Hoang
8523a27768
fix single-threaded
2013-03-15 20:38:26 +00:00
Hieu Hoang
51d34f2f96
delete Phrase::CreateFromStringNewFormat()
2013-03-08 22:04:28 +00:00
Hieu Hoang
9298402dcf
merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat()
2013-03-08 19:10:28 +00:00
Hieu Hoang
d015ef2e62
merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat()
2013-03-08 17:56:39 +00:00
Hieu Hoang
d0e2e417aa
merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same
2013-03-08 16:33:36 +00:00
Hieu Hoang
66ad6f32ce
start merging PhraseDictionaryMemory and PhraseDictionarySCFG
2013-03-07 19:12:49 +00:00
Hieu Hoang
1f6592aaa9
eclipse
2013-03-07 17:40:45 +00:00
Hieu Hoang
45f30766d4
return reference from function instead of pointer
2013-03-05 14:16:37 +00:00
Hieu Hoang
ce1d50723a
make on-disk pt threadable
2013-03-05 14:02:55 +00:00
Hieu Hoang
cc2ec9bc3e
make binary pt threadable
2013-03-04 18:15:05 +00:00
Hieu Hoang
991ea4f9c1
minor tidy up
2013-03-04 16:01:25 +00:00
Barry Haddow
3805d8825e
remove debug
2013-02-28 22:51:52 +00:00
Barry Haddow
ef87461d07
Interpolated phrase feature
2013-02-28 22:48:41 +00:00
Hieu Hoang
1483f35b71
Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new
2013-02-25 20:32:18 +00:00
Hieu Hoang
63be801652
compressed pt works with new pt format
2013-02-25 18:52:58 +00:00
Hieu Hoang
30ef335226
sparse pt features works with new pt format
2013-02-25 16:52:02 +00:00
Hieu Hoang
5344cc1a63
load PhraseDictionarySCFG
2013-02-25 14:50:33 +00:00
Hieu Hoang
c90eec946f
load scfg on-disk pt
2013-02-25 14:24:34 +00:00
Hieu Hoang
9f33f5ba7e
load scfg on-disk pt
2013-02-25 14:19:48 +00:00
Hieu Hoang
c789ce81e6
load binary pt
2013-02-25 11:49:34 +00:00
Hieu Hoang
682aaf4c6f
load pt memory
2013-02-25 11:03:34 +00:00
Hieu Hoang
0fb8f2b08e
Merge branch 'weight-new' of github.com:hieuhoang/mosesdecoder into weight-new
2013-02-24 22:51:33 +00:00
Hieu Hoang
24aac70a69
new pt format compiles. Doesn't run probably, doesn't load
2013-02-24 16:01:50 +00:00
Hieu Hoang
7d4ca4f21e
new pt format compiles. Doesn't run probably, doesn't load
2013-02-24 15:38:29 +00:00
Hieu Hoang
bcecfe55db
merge with Lane's search graph output
2013-02-24 00:31:29 +00:00
Hieu Hoang
194adf8130
change format for phrase model
2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22
delete PTLOAD_TIME
2013-02-21 22:55:41 +00:00
Hieu Hoang
86b848ef24
set m_useThreadSafePhraseDictionary
2013-02-21 18:06:03 +00:00
Hieu Hoang
ebd7b85aa6
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-02-20 10:11:21 +00:00
marcinj
10c1785226
Added missing function call to for sort order check
2013-02-20 11:03:57 +01:00
Hieu Hoang
e0746cd525
throw exception if unknown argument
2013-02-19 17:31:11 +00:00
Hieu Hoang
67976401dd
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-02-14 14:18:49 +00:00
marcinj
10012fac15
Fixed missing last source phrase and added workaround for single key cmph hash functions
2013-02-14 13:22:19 +01:00
Hieu Hoang
5a26a4c84f
delete class Dictionary
2013-02-06 11:29:54 +00:00
Hieu Hoang
4d8de1e51d
PhraseDictionary doesn't inherit from Dictionary
2013-02-05 19:13:26 +00:00
Hieu Hoang
4417f254a2
delete GetDecodeType(). Thinking of getting rid of class Dictionary altogther
2013-02-05 18:47:25 +00:00
Hieu Hoang
9d0c4801d5
name-value pairs for LM arguments
2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b
use new constructor for PhraseDictionaryFeature
2013-02-04 12:07:21 +00:00
Hieu Hoang
a02cc4b691
don't use new constructor yet, some regresssion tests fails
2013-02-04 01:57:50 +00:00
Hieu Hoang
95c602fb11
use new constructor
2013-02-04 01:09:15 +00:00
Hieu Hoang
63cd5d4faf
use new constructor
2013-02-03 23:55:05 +00:00
Hieu Hoang
ed4921c0c9
delete variable weight
2013-02-03 23:30:36 +00:00
Hieu Hoang
55dd8f1fcf
delete variable m_dictIndex
2013-02-03 23:04:52 +00:00
Hieu Hoang
530e859697
tokenize line now moved into base class ScoreProducer
2013-02-01 20:23:36 +00:00
Hieu Hoang
6ed71fc73c
separate out PhraseDictionaryFeature from SparsePhraseDictionaryFeature
2013-02-01 16:59:30 +00:00
Hieu Hoang
551d97344c
refactor PhraseDictionaryFeature
2013-02-01 15:50:57 +00:00
Hieu Hoang
f95e66c067
Merge branch 'master' into weight-new
2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
fcf75fae18
Added option to specify directory or prefix for temporary files created during phrase table compacting
2013-01-22 21:11:02 +01:00
Hieu Hoang
4d32d8b64b
merge
2013-01-19 18:47:04 +00:00
Hieu Hoang
10d7f3654e
compile error when single threading
2013-01-18 16:31:55 +00:00
hieu
01243e415a
Merge branch 'master' into weight-new
2013-01-03 17:17:35 +00:00
hieu
15c776eda4
delete check and exit of Suffix Array phrase table implementation erroneously checked in
2013-01-03 14:35:39 +00:00
Hieu Hoang
8a8825d740
delete PhraseDictionary::InitDictionary()
2012-12-27 12:26:27 +00:00
Hieu Hoang
bf58eac8bc
clean up InitializeBeforeSentenceProcessing()
2012-12-24 18:52:04 +00:00
Hieu Hoang
0df397065d
clean up InitializeBeforeSentenceProcessing()
2012-12-24 16:52:40 +00:00
Hieu Hoang
6dd4259258
clean up CleanUpAfterSentenceProcessing()
2012-12-24 15:56:29 +00:00
Hieu Hoang
50f666f397
clean up CleanUpAfterSentenceProcessing()
2012-12-24 15:37:11 +00:00
Hieu Hoang
c3fe79564c
clean up CleanUpAfterSentenceProcessing()
2012-12-24 15:17:13 +00:00
Hieu Hoang
961cc53ae5
clean up CleanUpAfterSentenceProcessing()
2012-12-24 14:34:34 +00:00
Hieu Hoang
8799e721ac
move phrase tables and generation tables to staticData
2012-12-21 14:54:43 +00:00
Hieu Hoang
efbc8bb6c4
move language model from TranslationSystem back to StaticData
2012-12-20 16:38:15 +00:00
Hieu Hoang
5d9980af91
move WordPenalty to staticData
2012-12-19 15:38:57 +00:00
Hieu Hoang
f9e21799ed
get rid of all occurance of GetNumInputScores() from feature functions.
2012-12-07 16:25:55 +00:00
Hieu Hoang
f212927368
get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not
2012-12-07 16:05:50 +00:00
Hieu Hoang
9fe742ce52
get rid function GetScoreProducerWeightShortName(). Fails 1 regression test
2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7
get rid of int argument from GetScoreProducerWeightShortName()
2012-12-04 13:08:00 +00:00
Marcin Junczys-Dowmunt
205cea8644
Allow .minlexr suffix and bugfix
2012-12-01 00:38:20 +01:00
Hieu Hoang
a07f71d095
race condition on letter sed cache. Requires locking
2012-11-30 17:15:32 +00:00
Hieu Hoang
7abb3c878a
remove locking. Make wordIndex variable local
2012-11-30 13:50:59 +00:00
Hieu Hoang
d4ead15066
fuzzy match phrase-table is multi-threaded
2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9
move CompactPt to TranslationModel/
2012-11-27 18:04:01 +00:00
Hieu Hoang
bc1e96730d
move CKY+Parser to TranslationModel/
2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022
move Score3Parser to TranslationModel/
2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c
move RuleTable to TranslationModel/
2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18
move the rest of DynSA to TranslationModel/
2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8
move DynSAInclude to TranslationModel/
2012-11-27 16:16:30 +00:00
Hieu Hoang
0b54d32038
move fuzzy-match to TranslationModel/
2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925
make TranslationModel subdirectory and move files from moses/ into it
2012-11-27 15:08:31 +00:00