moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-30 23:42:30 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,493 Commits 136 Branches 26 Tags 147 MiB
c4dd3c5a99
Commit Graph

3240 Commits

Author SHA1 Message Date
Hieu Hoang
5155fa26ce Merge branch 'master' into hieu 2014-02-17 22:36:24 +00:00
Jun-ya NORIMATSU
ba63f1eb97 improve DALMwrapper. 2014-02-18 00:00:28 +09:00
Jun-ya NORIMATSU
4488d97629 tune DALMWrapper. 2014-02-14 20:22:53 +09:00
Hieu Hoang
50cadc754f use boost::unordered_map for CacheColl. Marginally faster 2014-02-11 03:43:58 +00:00
Jun-ya NORIMATSU
d78778d1fc prepare for the next version of DALM. 2014-02-07 15:04:35 +09:00
Hieu Hoang
0efd37e147 Merge branch 'master' of github.com:moses-smt/mosesdecoder into hieu 2014-02-04 09:01:56 +00:00
Matthias Huck
86ee3e15a4 new version of the score tool 
which is now capable of dealing with additional properties in an appropriate manner
 2014-01-29 18:37:42 +00:00
Hieu Hoang
b34b4b978f different max-spans depending on whether source non-term is X or syntactic 2014-01-27 17:53:53 +00:00
Hieu Hoang
cb2805151b delete -adjacent-only. Rubbish 2014-01-27 12:25:02 +00:00
Hieu Hoang
b68a906fdd output list of available feature functions, separated by space, rather than lines 2014-01-25 10:58:00 +00:00
Hieu Hoang
9745924937 output list of available feature functions, separated by space, rather than lines 2014-01-25 10:39:47 +00:00
Hieu Hoang
39858ce1ff leak 2014-01-21 18:07:12 +00:00
Hieu Hoang
fcadf4511a leak 2014-01-21 17:11:16 +00:00
Hieu Hoang
8fe07d1c9c oops. Minor compile error 2014-01-20 17:01:53 +00:00
Hieu Hoang
839d1c6978 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-01-20 16:26:45 +00:00
Hieu Hoang
b448e77639 register feature function HyperParameterAsWeight 2014-01-20 16:12:46 +00:00
Rico Sennrich
c8108ca71d some sparse feature functions couldn't be set to be non-tuneable in moses.ini 2014-01-20 15:56:36 +00:00
Rico Sennrich
5d2b4d8efc sparse feature weights can now be set in moses.ini; overrides weights in weight-file. 2014-01-20 15:54:17 +00:00
Hieu Hoang
20e7d078a6 add feature function HyperParameterAsWeight 2014-01-17 17:59:36 +00:00
Rico Sennrich
742e59f1e0 minor optimization (minimize performance impact of SoftMatchingFeature code if disabled) 2014-01-17 11:57:52 +00:00
Rico Sennrich
9e177cb472 SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments) 2014-01-16 18:45:26 +00:00
Rico Sennrich
ed25bb2b99 soft matching of target-side nonterminals 2014-01-16 18:34:33 +00:00
jiejiang
c55161dff4 merge c11 revert with mingw changes 2014-01-16 01:08:01 +00:00
jiejiang
8486d30d74 Merge remote-tracking branch 'origin/master' 2014-01-16 00:08:41 +00:00
jiejiang
3c11a72c93 c11 macro 2014-01-16 00:06:58 +00:00
jiejiang
5f1217d793 merged upstream with origin for mingw 2014-01-15 18:16:56 +00:00
Rico Sennrich
6d6fca340c Revert "C++11 test; put in the middle of things to make sure people complain if their compiler doesn't support it" 
This reverts commit 32ccbef3b9.
 2014-01-15 16:16:03 +00:00
jiejiang
ead60c4c89 exclude all changes for bjam on mingw, which is buggy on linux 2014-01-16 00:00:33 +08:00
Rico Sennrich
df30085bbe pass regtest with C++11 and gcc 4.7 2014-01-15 09:27:20 +00:00
Rico Sennrich
32ccbef3b9 C++11 test; put in the middle of things to make sure people complain if their compiler doesn't support it 2014-01-14 17:15:25 +00:00
Hieu Hoang
fbe1332bc7 SkeletonPT uses phrase-table cache to store trarget phrases, instead of it's own collection 2014-01-14 11:08:57 +00:00
Hieu Hoang
fccf2ea43a get rid of all aborts from decoder 2014-01-13 18:32:22 +00:00
Hieu Hoang
b5558c36b8 get rid of all aborts 2014-01-13 14:37:05 +00:00
Hieu Hoang
07902ca550 minor memleak 2014-01-12 20:42:46 +00:00
Hieu Hoang
372359ba81 minor memleak 2014-01-12 18:56:43 +00:00
phikoehn
25553079d9 bug fix with sparse feature handling depending on word alignment in compact phrase table 2014-01-10 18:34:47 +00:00
Hieu Hoang
493f5d6817 minor error in option to override feature name /Maria Nadejde 2014-01-09 18:47:34 +00:00
phikoehn
071ba6ca44 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-07 14:46:42 +00:00
Hieu Hoang
a102bbb33c delete cache object. Shows up as memleak in valgrind 2014-01-06 11:10:57 +00:00
phikoehn
e8f00eb420 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-05 22:38:51 +00:00
Hieu Hoang
1431cc5688 delete check.hh 2014-01-05 18:19:51 +00:00
phikoehn
6c34ff207f additional time reporting and stardardization 2014-01-05 02:26:47 +00:00
phikoehn
6846089089 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-01-03 18:45:45 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Rico Sennrich
58ed19ce6a remove hacks for phrase penalty from MultiModel phrase type. 2014-01-02 12:29:38 +01:00
Kenneth Heafield
732a1b0744 KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
Hieu Hoang
18aaf4750a destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
Hieu Hoang
02b78d72d9 update sample query to read ini file with relative file paths 2013-12-31 16:52:47 +00:00
Lane Schwartz
867eabd699 Re-enabled unit test for backward LM. 
The test is compiling and running with no errors.
 2013-12-20 15:49:55 -05:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00