moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
10,930 Commits 136 Branches 26 Tags 147 MiB
31ccd6c5b7
Commit Graph

81 Commits

Author SHA1 Message Date
Hieu Hoang
03fd06b38b convert Evaluate() methods into abstract, rather than empty functions. Every FF must implement them all 2013-08-30 15:49:00 +01:00
Lane Schwartz
c0fe9bb4ea Updating XCode project 2013-08-29 12:56:25 -04:00
Lane Schwartz
7675825eb7 Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-08-28 13:27:12 -04:00
Lane Schwartz
8a726a9de4 Changes to allow SRILM on Mac OS X. 
By default, SRILM defines a function called zopen.

However, on Mac OS X (and possibly other BSDs),
<stdio.h> already defines a zopen function.

To resolve this conflict, SRILM checks to see if HAVE_ZOPEN is defined.
If it is, SRILM will rename its zopen function as my_zopen.

So, before importing any SRILM headers,
it is important to define HAVE_ZOPEN if we are on an Apple OS.
 2013-08-28 12:39:47 -04:00
Hieu Hoang
d79d97c0e6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-28 11:06:44 +01:00
Hieu Hoang
1848946cb3 beautify 2013-08-28 11:06:27 +01:00
Hieu Hoang
89f88fdb6b refactor parsing of args for language models 2013-08-28 11:05:47 +01:00
Lane Schwartz
08225d8e57 Re-enable backward LM code. 
This commit updates that code to take into account Hieu's major refactoring.

Additionally, this commit re-instates changes from
commit 8459a86 (moses/LM/Jamfile, moses/LM/Ken.h, moses/LM/Ken.cpp),
commit d340218 (moses/LM/Ken.h),
commit 95e3a37 (moses/LM/Ken.h, moses/LM/Ken.cpp), and
commit aacc936 (moses/LM/Jamfile, moses/LM/Ken.cpp)

The above changes appear to have been improperly discarded
during the merge in commit 4894df6 and then again in commit 3ed17bb.
 2013-08-27 15:55:07 -04:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
206b165d14 randlm compile with refactored code. No regression tests yet 2013-07-23 12:56:35 +01:00
Hieu Hoang
5b7a9af588 refactor RandLM. Compiles with eclipse but not with bjam 2013-07-20 00:19:04 +01:00
Kenneth Heafield
e1a2b2f0c9 Reduce scope of lm dependency 2013-07-19 18:50:12 +01:00
Kenneth Heafield
b5e6b9c959 Factory 2013-07-18 22:54:52 +01:00
Hieu Hoang
f35750bc08 beautify 2013-07-04 20:19:51 +01:00
Nadir Durrani
6a915253e1 Bug Fix 2013-07-01 11:06:55 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
7f1a6041ba explicitly declare how many scores there are in language model features 2013-06-04 21:49:37 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Hieu Hoang
695617d930 consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:50:13 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
Hieu Hoang
bc0fdfbd79 delete LM:Useable(). Superseded by IsUseable() for all feature functions 2013-05-31 00:11:38 +01:00
Hieu Hoang
83c4477841 figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 12:41:08 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
b5bb500773 move GetFirstLM() as static method of LanguageModel 2013-05-28 17:35:06 +01:00
Hieu Hoang
537e9373f8 minor warnings 2013-05-28 11:57:13 +01:00
Hieu Hoang
d647dd8aa3 delete sourcePhrase variable in TargetPhrase class 2013-05-28 10:51:28 +01:00
Hieu Hoang
75a1849bcf split classes in FeatureFunction files 2013-05-24 19:11:15 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
41da563645 port SRILM to new weights format 2013-05-19 12:44:45 +01:00
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
c99e9f8c90 start framework for evaluating target phrase score 2013-05-02 12:15:26 +01:00
Hieu Hoang
4894df6494 merge 2013-04-29 19:04:00 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Lane Schwartz
62e1bf05d6 Added slightly more unit test coverage for backward LM. 2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6 Initial unit test for BackwardLanguageModel Evaluate method 2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917 Checking in changes. 
This currently doesn't compile.

Need to debug why.
 2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b Work on BackwardLM unit testing 2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204 Adding unit tests to Backward LM 2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469 Added CalcScore to BackwardLanguageModel 2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4 BackwardLM now can calculate its empty state 2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137 Refactoring code from Ken.cpp into Ken.h 
in preparation for implemenation of backward language model
from Xiong et al (2011)
 2013-04-29 09:18:45 -04:00
Hieu Hoang
f5d3f16fab rescale LM score for chart decoding by KenLM. All regression tests passes 2013-04-29 13:01:26 +01:00
Hieu Hoang
aa9689d12b rescale LM score for chart decoding 2013-04-26 19:39:29 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
68b64974c4 runtime error using name args with language models 2013-03-19 12:19:39 +00:00
Hieu Hoang
b4ab054453 merge error 2013-03-16 16:18:51 +00:00
Hieu Hoang
7888c7ba23 eclipse project files 2013-03-15 22:02:00 +00:00
Hieu Hoang
974bdd979b memory leak 2013-03-15 14:19:36 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00