moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 05:55:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,361 Commits 136 Branches 26 Tags 147 MiB
39858ce1ff
Commit Graph

133 Commits

Author SHA1 Message Date
jiejiang
ead60c4c89 exclude all changes for bjam on mingw, which is buggy on linux 2014-01-16 00:00:33 +08:00
jiejiang
5f1217d793 merged upstream with origin for mingw 2014-01-15 18:16:56 +00:00
Hieu Hoang
fccf2ea43a get rid of all aborts from decoder 2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
Hieu Hoang
372359ba81 minor memleak 2014-01-12 18:56:43 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Hieu Hoang
02b78d72d9 update sample query to read ini file with relative file paths 2013-12-31 16:52:47 +00:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM. 
The test is compiling and running with no errors.
 2013-12-20 15:49:55 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Lane Schwartz
83f89ac2b2 Updated Jamfile for compiling and linking against NPLM 2013-12-20 13:49:56 -05:00
Hieu Hoang
dea1fe995f default factor to 0 for language models that don't specify what factor type 2013-12-18 20:54:53 +00:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Jun-ya NORIMATSU
da4e2719b2 modify DALMState to use the DALM compare function. 2013-12-17 14:36:19 +09:00
Jun-ya NORIMATSU
dbf90ce8e8 more efficient state for DALM. 2013-12-16 23:17:56 +09:00
Ales Tamchyna
cd63f30f15 modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
c2ffc022ea replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 18:52:15 +00:00
Hieu Hoang
22864c2b4b replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 17:23:19 +00:00
Hieu Hoang
1accc75d14 Add vocab mapping back to DALM 2013-11-18 13:54:40 +00:00
Jun-ya NORIMATSU
01f10fa3a3 modify DALM.cpp for better recombination. 2013-11-17 14:42:13 +09:00
Hieu Hoang
c9d09a7168 correct hashing of contextFactor for state. /Ken 2013-11-15 17:30:37 +00:00
Hieu Hoang
dfbad35abd minor compile errors on gcc now 2013-11-14 18:59:36 +00:00
Hieu Hoang
cd8388c213 oops. little errors in DALM 2013-11-14 18:31:46 +00:00
Hieu Hoang
58a73676d8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-14 18:04:14 +00:00
Hieu Hoang
0b1bb6a443 mert compiles under Mac OSX Mavericks. #ifdef PreProcessFilter.cpp and accomplices 2013-11-14 17:58:59 +00:00
Hieu Hoang
c226e35c5e typo 2013-11-14 17:26:27 +00:00
Hieu Hoang
bbb6f0b145 tested DALM 2013-11-14 16:05:27 +00:00
Hieu Hoang
5dc13dbe91 bjam with dalm 2013-11-14 14:37:23 +00:00
Hieu Hoang
ca1c62c652 eclipse 2013-11-11 23:17:56 +00:00
Hieu Hoang
d2868bda5d 1st stab @ evaluating LM with DALM 2013-11-11 19:49:00 +00:00
Hieu Hoang
42e22d4216 compiled DALM with bjam 2013-11-11 18:27:15 +00:00
Hieu Hoang
8c9c81a14e compiled DALM with eclipse. bjam problems still 2013-11-11 17:19:44 +00:00
Hieu Hoang
d5cde1d874 DALM load 2013-11-11 14:39:53 +00:00
Kenneth Heafield
fe01a02fcb Initialize variables... 2013-11-06 19:30:32 -08:00
Hieu Hoang
08d888382d add DALM. Just a skeleton so far 2013-11-05 14:37:56 +00:00
Hieu Hoang
88569e2e0a rand lm compiles 2013-11-04 20:09:15 +00:00
Hieu Hoang
a5f391e3f3 remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
Hieu Hoang
518a766ed2 add NeuralLM 2013-10-28 23:34:50 +00:00
Hieu Hoang
37896ed854 add NeuralLM 2013-10-28 23:21:02 +00:00
Hieu Hoang
0af1df9f8b add NeuralLM 2013-10-28 22:11:37 +00:00
phikoehn
ecc30bcfe2 also report lm scores, and matched n-gram length (thanks Ken!) 2013-10-13 22:05:07 +01:00
phikoehn
30c8c294e0 ooops 2013-10-13 07:08:50 +01:00
phikoehn
8e23a3f2c1 more enriched trace 2013-10-13 06:59:05 +01:00
Hieu Hoang
72981abf20 defer BackwardTest 2013-10-01 13:57:47 +01:00
Hieu Hoang
5472311e5f defer BackwardTest 2013-09-30 17:39:09 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
Hieu Hoang
deafd5922d skeleton PT 2013-09-25 16:57:01 +01:00
Hieu Hoang
cff36b6638 skeleton LM 2013-09-24 22:26:51 +01:00