moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-11-10 10:59:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
Moses, the machine translation system
11,293 Commits 136 Branches 26 Tags 147 MiB
C++ 59.3%
C 13.8%
Perl 10.5%
Python 4.6%
Shell 2.9%
Other 8.5%
f40e1ac8f8
Go to file
Lane Schwartz f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
2013-12-20 15:04:09 -05:00
biconcor Checking in examples of CMake files. 2013-09-06 13:39:46 -04:00
contrib Fixed mistake in README 2013-12-16 13:21:19 +00:00
cruise-control changes for cruise control 2013-05-10 16:34:57 +01:00
defer defer BackwardTest 2013-09-30 17:39:09 +01:00
jam-files update bjam source code. Copied from boost 1.54 2013-10-04 16:08:14 +01:00
lm KenLM 6f7913cc7ca0f7672c6d899358365f047a742bbb 2013-09-09 10:43:20 +01:00
mert return default even if compiling with non-gcc 2013-11-25 16:38:19 +00:00
mira move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
misc Transliteration Mining 2013-12-16 18:19:44 +00:00
moses Added support for hierarchical maximum entropy LM through SRILM. 2013-12-20 15:04:09 -05:00
moses-chart-cmd UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
moses-cmd UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
OnDiskPt UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
phrase-extract minor verbose in consolidate-main.cpp 2013-12-06 11:46:19 +00:00
regression-testing re-enable some score regressions tests. Was failing due to rounding errors 2013-01-08 13:54:35 +00:00
scripts Post-decoding Transliteration Script 2013-12-18 16:10:57 +00:00
search replace nth_element() with macro that execute sort() instead for gcc 4.8.1 & 4.8.2 2013-11-15 10:55:38 +00:00
symal beautify 2013-07-08 20:52:14 +01:00
util replace CHECK with UTIL_THROW_IF. It's gonna be a fun week 2013-11-15 20:14:10 +00:00
.gitignore Added *.d 2013-09-25 00:52:38 +01:00
.gitmodules Arrow pipeline submodules now use https protocol. 2013-07-24 11:52:14 +01:00
bjam Fix cd error when running bjam from non-top 2013-03-19 11:17:17 +00:00
BUILD-INSTRUCTIONS.txt finesse instruction for building Boost 2013-12-05 16:24:54 +00:00
Jamroot Added support for hierarchical maximum entropy LM through SRILM. 2013-12-20 15:04:09 -05:00
NOTICE testing commit emails function. 9 2013-03-15 11:19:15 +00:00