Commit Graph

45 Commits

Author SHA1 Message Date
Hieu Hoang
80791d1767 rename Skeleton... to Example... 2017-04-26 13:10:32 +01:00
Lane Schwartz
578e65298f Add InMemoryPerSentenceOnDemandLM 2017-01-02 12:57:52 -06:00
Rico Sennrich
12439215d0 compile NPLM objects with single precision
(for compatibility with nplm commit 9dea3fe)
2015-08-27 14:15:49 +01:00
Ulrich Germann
e8f010b9af Removed ORLM. 2015-08-17 18:11:04 +01:00
Ulrich Germann
1b654743c3 added switch -fopenmp to compilation of BiLM_NPML.o 2015-07-21 15:30:16 +01:00
Rico Sennrich
eab513b635 relational dependency language model 2015-03-18 17:39:45 +00:00
Hieu Hoang
afe8b4162e link with openmp for srilm 2015-03-08 21:25:24 +00:00
Hieu Hoang
c08ebc9dae link with openmp for srilm 2015-03-08 21:23:13 +00:00
Hieu Hoang
b223256040 park Joint LM. Doesn't work anymore 2015-02-18 15:11:03 +00:00
Nicola Bertoldi
fa00c99aa3 fixings to the IRSTLM interface for textual input; code cleanup 2015-01-26 18:24:12 +01:00
Nicola Bertoldi
dfd6cd2dd7 changes to make Moses compliant with the most recent version (5.80.06) of IRSTLM 2014-12-15 12:25:10 +01:00
Rico Sennrich
6748f4106f compatibility with NPLM 0.3 (breaks earlier versions of NPLM) 2014-11-17 18:08:42 +00:00
Paul Baltescu
248aa4bf8a Convert moses words to oxlm word ids. 2014-11-13 16:10:40 +00:00
Paul Baltescu
7588c4b8e3 Skeleton for source conditioned OxLM feature. 2014-11-13 16:08:10 +00:00
Paul Baltescu
5f87cf94d8 Move BilingualLM under LM. 2014-11-13 15:51:48 +00:00
XapaJIaMnu
c2f0419089 Fix compilation 2014-11-13 15:51:47 +00:00
XapaJIaMnu
0271b451b7 Some file renaming and fixes 2014-11-13 15:51:47 +00:00
XapaJIaMnu
bceff44fcb Abstract BilingualLM to Binlm_NPLM. Doesn't compile 2014-11-13 15:51:47 +00:00
Hieu Hoang
41b207e623 fix Jamfile 2014-11-13 15:51:46 +00:00
Paul Baltescu
8f74ecd8f3 Fix OxLM. 2014-10-08 22:08:42 +01:00
Hieu Hoang
87afd853e5 warn against using SRILM 1.7.1 2014-09-30 10:06:52 +01:00
Paul Baltescu
d75c4e1ae5 OxLM integration. 2014-08-08 01:18:05 +01:00
Rico Sennrich
eb5336ad9c thread-safety, precomputation and caching for NeuralLMWrapper
doesn't work with default nplm, but with the fork at https://github.com/rsennrich/nplm
2014-07-17 16:50:08 +01:00
Hieu Hoang
69c27a3020 name change 2014-07-16 13:21:51 +01:00
Hieu Hoang
ce014e0b35 cleanup 2014-07-15 17:47:36 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00
Hieu Hoang
8f5dc2b9e7 state info 2014-07-11 12:53:03 +01:00
Hieu Hoang
3c9e397132 compiles with eclipse 2014-07-10 16:14:22 +01:00
Jun-ya NORIMATSU
d78778d1fc prepare for the next version of DALM. 2014-02-07 15:04:35 +09:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM.
The test is compiling and running with no errors.
2013-12-20 15:49:55 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM.
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
2013-12-20 15:04:09 -05:00
Lane Schwartz
83f89ac2b2 Updated Jamfile for compiling and linking against NPLM 2013-12-20 13:49:56 -05:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
5dc13dbe91 bjam with dalm 2013-11-14 14:37:23 +00:00
Hieu Hoang
42e22d4216 compiled DALM with bjam 2013-11-11 18:27:15 +00:00
Hieu Hoang
d5cde1d874 DALM load 2013-11-11 14:39:53 +00:00
Hieu Hoang
37896ed854 add NeuralLM 2013-10-28 23:21:02 +00:00
Hieu Hoang
72981abf20 defer BackwardTest 2013-10-01 13:57:47 +01:00
Hieu Hoang
cff36b6638 skeleton LM 2013-09-24 22:26:51 +01:00
Lane Schwartz
08225d8e57 Re-enable backward LM code.
This commit updates that code to take into account Hieu's major refactoring.

Additionally, this commit re-instates changes from
commit 8459a86 (moses/LM/Jamfile, moses/LM/Ken.h, moses/LM/Ken.cpp),
commit d340218 (moses/LM/Ken.h),
commit 95e3a37 (moses/LM/Ken.h, moses/LM/Ken.cpp), and
commit aacc936 (moses/LM/Jamfile, moses/LM/Ken.cpp)

The above changes appear to have been improperly discarded
during the merge in commit 4894df6 and then again in commit 3ed17bb.
2013-08-27 15:55:07 -04:00
Kenneth Heafield
e1a2b2f0c9 Reduce scope of lm dependency 2013-07-19 18:50:12 +01:00
Kenneth Heafield
b5e6b9c959 Factory 2013-07-18 22:54:52 +01:00
Hieu Hoang
2573d0a122 delete LM/Factory.* 2013-02-01 21:01:44 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00