moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 14:05:29 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,368 Commits 136 Branches 26 Tags 147 MiB
2387f3123c
Commit Graph

3235 Commits

Author SHA1 Message Date
Hieu Hoang
1aad3dfdce moved 2014-01-23 13:07:33 +00:00
Hieu Hoang
6c3b8587ba bjam 2014-01-23 00:51:03 +00:00
Hieu Hoang
5800ff848c bjam 2014-01-22 20:57:06 +00:00
Hieu Hoang
52ab05a154 set scores and alignments (almost) 2014-01-22 18:41:58 +00:00
Hieu Hoang
e505a462a7 probing hash pt compiles. Need to hook up vocab 2014-01-22 18:24:51 +00:00
Hieu Hoang
63b9eac201 integration of Nikolay's probing pt into Moses 2014-01-22 13:06:10 +00:00
Hieu Hoang
39858ce1ff leak 2014-01-21 18:07:12 +00:00
Hieu Hoang
fcadf4511a leak 2014-01-21 17:11:16 +00:00
Hieu Hoang
8fe07d1c9c oops. Minor compile error 2014-01-20 17:01:53 +00:00
Hieu Hoang
839d1c6978 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-01-20 16:26:45 +00:00
Hieu Hoang
b448e77639 register feature function HyperParameterAsWeight 2014-01-20 16:12:46 +00:00
Rico Sennrich
c8108ca71d some sparse feature functions couldn't be set to be non-tuneable in moses.ini 2014-01-20 15:56:36 +00:00
Rico Sennrich
5d2b4d8efc sparse feature weights can now be set in moses.ini; overrides weights in weight-file. 2014-01-20 15:54:17 +00:00
Hieu Hoang
20e7d078a6 add feature function HyperParameterAsWeight 2014-01-17 17:59:36 +00:00
Rico Sennrich
742e59f1e0 minor optimization (minimize performance impact of SoftMatchingFeature code if disabled) 2014-01-17 11:57:52 +00:00
Rico Sennrich
9e177cb472 SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments) 2014-01-16 18:45:26 +00:00
Rico Sennrich
ed25bb2b99 soft matching of target-side nonterminals 2014-01-16 18:34:33 +00:00
jiejiang
c55161dff4 merge c11 revert with mingw changes 2014-01-16 01:08:01 +00:00
jiejiang
8486d30d74 Merge remote-tracking branch 'origin/master' 2014-01-16 00:08:41 +00:00
jiejiang
3c11a72c93 c11 macro 2014-01-16 00:06:58 +00:00
jiejiang
5f1217d793 merged upstream with origin for mingw 2014-01-15 18:16:56 +00:00
Rico Sennrich
6d6fca340c Revert "C++11 test; put in the middle of things to make sure people complain if their compiler doesn't support it" 
This reverts commit 32ccbef3b9.
 2014-01-15 16:16:03 +00:00
jiejiang
ead60c4c89 exclude all changes for bjam on mingw, which is buggy on linux 2014-01-16 00:00:33 +08:00
Rico Sennrich
df30085bbe pass regtest with C++11 and gcc 4.7 2014-01-15 09:27:20 +00:00
Rico Sennrich
32ccbef3b9 C++11 test; put in the middle of things to make sure people complain if their compiler doesn't support it 2014-01-14 17:15:25 +00:00
Hieu Hoang
fbe1332bc7 SkeletonPT uses phrase-table cache to store trarget phrases, instead of it's own collection 2014-01-14 11:08:57 +00:00
Hieu Hoang
fccf2ea43a get rid of all aborts from decoder 2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
Hieu Hoang
07902ca550 minor memleak 2014-01-12 20:42:46 +00:00
Hieu Hoang
372359ba81 minor memleak 2014-01-12 18:56:43 +00:00
phikoehn
25553079d9 bug fix with sparse feature handling depending on word alignment in compact phrase table 2014-01-10 18:34:47 +00:00
Hieu Hoang
493f5d6817 minor error in option to override feature name /Maria Nadejde 2014-01-09 18:47:34 +00:00
phikoehn
071ba6ca44 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-07 14:46:42 +00:00
Hieu Hoang
a102bbb33c delete cache object. Shows up as memleak in valgrind 2014-01-06 11:10:57 +00:00
phikoehn
e8f00eb420 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-05 22:38:51 +00:00
Hieu Hoang
1431cc5688 delete check.hh 2014-01-05 18:19:51 +00:00
phikoehn
6c34ff207f additional time reporting and stardardization 2014-01-05 02:26:47 +00:00
phikoehn
6846089089 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-03 18:45:45 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Rico Sennrich
58ed19ce6a remove hacks for phrase penalty from MultiModel phrase type. 2014-01-02 12:29:38 +01:00
Kenneth Heafield
732a1b0744 KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
Hieu Hoang
18aaf4750a destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
Hieu Hoang
02b78d72d9 update sample query to read ini file with relative file paths 2013-12-31 16:52:47 +00:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM. 
The test is compiling and running with no errors.
 2013-12-20 15:49:55 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Lane Schwartz
83f89ac2b2 Updated Jamfile for compiling and linking against NPLM 2013-12-20 13:49:56 -05:00
Hieu Hoang
dea1fe995f default factor to 0 for language models that don't specify what factor type 2013-12-18 20:54:53 +00:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Hieu Hoang
1555bf3b9e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-17 15:55:44 +00:00
Hieu Hoang
e8b2d2a269 bug - should get score for translation rule from the translation option, not the target phrase. 2013-12-17 14:54:12 +00:00