moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 22:14:57 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,482 Commits 136 Branches 26 Tags 147 MiB
f7ee316e12
Commit Graph

11482 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hieu Hoang
584af0d015 add support for --MinPhraseLength 2014-01-06 18:03:38 +00:00
Hieu Hoang
35faa887e8 add support for --MinPhraseLength 2014-01-06 17:34:04 +00:00
Hieu Hoang
abe0155f81 ordering extract in same format as my own 2014-01-06 17:21:39 +00:00
Hieu Hoang
ac5d6676f2 ordering extract in same format as my own 2014-01-06 17:04:10 +00:00
Hieu Hoang
d4d4e27511 only output ordering extract 2014-01-06 16:31:21 +00:00
Hieu Hoang
2fb99f07bb only output ordering extract 2014-01-06 13:31:47 +00:00
Hieu Hoang
63f6ea8fa7 eclipse 2014-01-06 11:55:22 +00:00
Hieu Hoang
ca42b9b01f tcmalloc /buhomecanico 2014-01-06 11:52:21 +00:00
Hieu Hoang
ab88d4dbe7 Merge branch 'master' into hieu 2014-01-06 11:22:50 +00:00
Hieu Hoang
a102bbb33c delete cache object. Shows up as memleak in valgrind 2014-01-06 11:10:57 +00:00
phikoehn
9ea0f5dd0e reporting on init (pretty slow for binary phrase table!) and bug fix in experiment.perl with setting filter settings 2014-01-05 22:39:47 +00:00
phikoehn
e8f00eb420 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-05 22:38:51 +00:00
Hieu Hoang
1431cc5688 delete check.hh 2014-01-05 18:19:51 +00:00
Hieu Hoang
eb5112f09e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-01-05 14:12:53 +00:00
Hieu Hoang
a8cb0f7f13 Tamil tokenization /P.Arththika 2014-01-05 14:07:28 +00:00
phikoehn
6c34ff207f additional time reporting and stardardization 2014-01-05 02:26:47 +00:00
phikoehn
6846089089 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-03 18:45:45 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Kenneth Heafield
9af5c12aa2 Eradicating CHECK 2014-01-02 11:34:04 -05:00
Kenneth Heafield
c4ec78b817 Remove a CHECK 2014-01-02 11:24:49 -05:00
Rico Sennrich
155e10b05a mosesserver and multimodel: identify multimodel phrase table by name (instead of assuming it's first table in config) 2014-01-02 13:38:39 +01:00
Rico Sennrich
58ed19ce6a remove hacks for phrase penalty from MultiModel phrase type. 2014-01-02 12:29:38 +01:00
phikoehn
14a499d9aa Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-01 21:50:31 +00:00
Kenneth Heafield
732a1b0744 KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
phikoehn
0c6e73f40f Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-01 19:10:52 +00:00
Hieu Hoang
18aaf4750a destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
phikoehn
c8b5cc4f0e avoid warning; 2013-12-31 19:21:28 +00:00
Hieu Hoang
02b78d72d9 update sample query to read ini file with relative file paths 2013-12-31 16:52:47 +00:00
Hieu Hoang
a9c81857c1 minor addition of non-const method 2013-12-29 23:33:46 +00:00
Hieu Hoang
ad617e0c86 minor change from UINT32 to UINT64 2013-12-29 23:18:16 +00:00
Hieu Hoang
ad0eda5c18 minor change from UINT32 to UINT64 2013-12-29 23:14:08 +00:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM. 
The test is compiling and running with no errors.
 2013-12-20 15:49:55 -05:00
Lane Schwartz
f57ac23be9 Added comment in Jamroot on how to compile against NPLM 2013-12-20 15:06:49 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Lane Schwartz
83f89ac2b2 Updated Jamfile for compiling and linking against NPLM 2013-12-20 13:49:56 -05:00
Hieu Hoang
dea1fe995f default factor to 0 for language models that don't specify what factor type 2013-12-18 20:54:53 +00:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Hieu Hoang
b3a712baa0 output reordering only 2013-12-18 18:40:23 +00:00
Nadir Durrani
a92a46a66a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-12-18 16:11:28 +00:00
Nadir Durrani
7f75018349 Post-decoding Transliteration Script 2013-12-18 16:10:57 +00:00
Hieu Hoang
1555bf3b9e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-17 15:55:44 +00:00
Hieu Hoang
e8b2d2a269 bug - should get score for translation rule from the translation option, not the target phrase. 2013-12-17 14:54:12 +00:00
Hieu Hoang
f7cff6d692 Merge pull request #55 from jnory/master 
DALMWrapper using more efficient state class in DALM.
 2013-12-17 03:28:40 -08:00
Jun-ya NORIMATSU
da4e2719b2 modify DALMState to use the DALM compare function. 2013-12-17 14:36:19 +09:00
Nadir Durrani
c291f859a0 Transliteration Mining 2013-12-16 18:19:44 +00:00
Jun-ya NORIMATSU
dbf90ce8e8 more efficient state for DALM. 2013-12-16 23:17:56 +09:00
Ian Johnson
c74d85f58b Fixed mistake in README 2013-12-16 13:21:19 +00:00
Ian Johnson
513e0f1081 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-16 13:17:43 +00:00
Ian Johnson
fb5545ed2c Updated PCL to v1.1.0-beta 2013-12-16 13:17:34 +00:00
Hieu Hoang
597cb4a20f added negate=true. Only create translation which DON'T match reference 2013-12-15 01:42:22 +00:00