moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 07:42:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits 136 Branches 26 Tags 147 MiB
aff577748f
Commit Graph

165 Commits

Author SHA1 Message Date
Paul Baltescu
d75c4e1ae5 OxLM integration. 2014-08-08 01:18:05 +01:00
Rico Sennrich
b0fbf80dc0 remove unnecessary code, and floor NPLM scores 2014-07-18 14:39:54 +01:00
Rico Sennrich
eb5336ad9c thread-safety, precomputation and caching for NeuralLMWrapper 
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
 2014-07-17 16:50:08 +01:00
Hieu Hoang
69c27a3020 name change 2014-07-16 13:21:51 +01:00
Hieu Hoang
ce014e0b35 cleanup 2014-07-15 17:47:36 +01:00
Hieu Hoang
3b0ab6e6de scores matches. State info from hash 2014-07-15 17:14:32 +01:00
Hieu Hoang
7cb8ef5933 scores matches for 1st best, but not nbest 2014-07-15 16:46:19 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00
Hieu Hoang
08be3b6b4f new LBLLM based on LanguageModel class 2014-07-15 00:13:35 +01:00
Hieu Hoang
dc1cf603de new LBLLM based on LanguageModel class 2014-07-14 21:33:38 +01:00
Hieu Hoang
7dfe943fb0 new LBLLM based on LanguageModel class 2014-07-14 20:40:33 +01:00
Hieu Hoang
f340ede6b5 new LBLLM based on LanguageModel class 2014-07-14 19:15:20 +01:00
Hieu Hoang
a402523ef5 calculate baseline score without optimisation 2014-07-11 16:26:48 +01:00
Hieu Hoang
8f5dc2b9e7 state info 2014-07-11 12:53:03 +01:00
Hieu Hoang
da825e844b 1st rough sketch. compiles with eclipse 2014-07-11 11:15:06 +01:00
Hieu Hoang
a209d0ed18 compiles with eclipse 2014-07-10 18:48:51 +01:00
Hieu Hoang
3c9e397132 compiles with eclipse 2014-07-10 16:14:22 +01:00
Hieu Hoang
5b2bafde76 compiles with eclipse 2014-07-10 12:16:38 +01:00
Hieu Hoang
e197b110fc rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:54:16 +01:00
Hieu Hoang
12a14221e2 rename Evaluate() to EvaluateWhenApplied() 2014-07-09 23:41:08 +01:00
Hieu Hoang
587b5fd716 rename Evaluate() to EvaluateWithSourceContext() 2014-07-09 23:06:54 +01:00
Hieu Hoang
c9bd98fb0f rename Evaluate() to EvaluateInIsolation() 2014-07-09 22:35:59 +01:00
Jun-ya NORIMATSU
cc71e0ee54 bugfix. 2014-06-05 19:26:27 +09:00
Jun-ya NORIMATSU
0659c31c05 Merge remote-tracking branch 'origin/master' 2014-06-05 14:24:44 +09:00
Jun-ya NORIMATSU
1180f5dd70 bug fix. 2014-06-05 14:24:10 +09:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
 2014-06-03 18:55:53 +01:00
Jun-ya NORIMATSU
65bf623228 tuning. 2014-06-03 16:13:32 +09:00
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of 
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
 2014-05-31 14:33:31 +01:00
Hieu Hoang
15566f7fc5 extend FF framework by add StackVec* argument to 2nd Evaluate(). NULL if phrase-based 2014-05-08 17:51:45 +01:00
Kenneth Heafield
c61231fad9 Fix BackwardTest failure which was just compiler-drive differences in floating point precision. 
BOOST_CHECK_CLOSE's tolerance is proportional to the value on the left, so 0.0 has zero tolerance.  Changed to an explicit range.
 2014-04-09 10:01:19 -07:00
Jun-ya NORIMATSU
19bc1c317d improve DALMwrapper again. 2014-02-28 13:38:35 +09:00
Jun-ya NORIMATSU
007799eb07 modify DALMwrapper. 2014-02-19 17:49:42 +09:00
Jun-ya NORIMATSU
ba63f1eb97 improve DALMwrapper. 2014-02-18 00:00:28 +09:00
Jun-ya NORIMATSU
4488d97629 tune DALMWrapper. 2014-02-14 20:22:53 +09:00
Jun-ya NORIMATSU
d78778d1fc prepare for the next version of DALM. 2014-02-07 15:04:35 +09:00
Hieu Hoang
fccf2ea43a get rid of all aborts from decoder 2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
Hieu Hoang
372359ba81 minor memleak 2014-01-12 18:56:43 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Hieu Hoang
02b78d72d9 update sample query to read ini file with relative file paths 2013-12-31 16:52:47 +00:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM. 
The test is compiling and running with no errors.
 2013-12-20 15:49:55 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Lane Schwartz
83f89ac2b2 Updated Jamfile for compiling and linking against NPLM 2013-12-20 13:49:56 -05:00
Hieu Hoang
dea1fe995f default factor to 0 for language models that don't specify what factor type 2013-12-18 20:54:53 +00:00
Jun-ya NORIMATSU
da4e2719b2 modify DALMState to use the DALM compare function. 2013-12-17 14:36:19 +09:00
Jun-ya NORIMATSU
dbf90ce8e8 more efficient state for DALM. 2013-12-16 23:17:56 +09:00
Ales Tamchyna
cd63f30f15 modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00