moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,301 Commits 136 Branches 26 Tags 147 MiB
58ed19ce6a
Commit Graph

214 Commits

Author SHA1 Message Date
Hieu Hoang
18aaf4750a destroy feature functions at end. Otherwise it shows up on valgrind as memory leak 2013-12-31 20:15:43 +00:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Hieu Hoang
597cb4a20f added negate=true. Only create translation which DON'T match reference 2013-12-15 01:42:22 +00:00
Hieu Hoang
295c07e884 bug in constrained decoding 2013-12-10 18:47:13 +00:00
Hieu Hoang
ba209202ef move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
Hieu Hoang
09d50f87b1 move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
Hieu Hoang
78eba93a6b minor change in argument key for consistency 2013-12-06 13:09:34 +00:00
Hieu Hoang
fc8f8ba657 minor change in argument key for consistency 2013-12-06 13:07:33 +00:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
b33cf30bc1 transliteration pt obery backoff argument. Probably not threadable yet 2013-12-05 13:06:35 +00:00
Ales Tamchyna
64b629803d fixed a bug in CoveredRerefenceFeature 2013-12-04 10:21:01 +01:00
Ales Tamchyna
81ad92cc3f minor 2013-12-03 17:29:50 +01:00
Ales Tamchyna
fea32c7182 debugged CoveredReferenceFeature 2013-12-03 17:25:42 +01:00
Ales Tamchyna
8c0b5ffa6f early evaluation of CoveredReferenceFeature 2013-12-03 17:03:41 +01:00
Ales Tamchyna
cd63f30f15 modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Ales Tamchyna
fec97d2073 minor, added a check in CoveredReferenceFeature 2013-12-03 14:30:19 +01:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Ales Tamchyna
86a0dc337a adding CoveredReferenceFeature 2013-11-29 09:27:43 +01:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
c4dfc60f95 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-22 15:26:23 +00:00
Hieu Hoang
5c6d88a463 add new phrase table for Scope-3 parsing. Doesn't quite work... 2013-11-22 15:26:14 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
c3bd825d23 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 12:51:27 +00:00
Hieu Hoang
c2ffc022ea replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 18:52:15 +00:00
Hieu Hoang
22864c2b4b replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 17:23:19 +00:00
Hieu Hoang
2f00ae936b move collection of phrase-table from Staticdata to PhraseDictionary 2013-11-15 17:26:26 +00:00
Hieu Hoang
79fb8a1df4 provide mira program with BLEU Feature. Delete assert statement. 2013-11-15 16:43:39 +00:00
Hieu Hoang
2d8f9bc515 bug fixes for TargetNGramFeature 2013-11-11 15:32:58 +00:00
Hieu Hoang
ada80e6720 convert class TargetNgramFeature to new feature framework 2013-11-11 01:53:53 +00:00
Hieu Hoang
b8f67b51f3 convert class TargetNgramFeature to new feature framework 2013-11-11 01:50:40 +00:00
Hieu Hoang
08d888382d add DALM. Just a skeleton so far 2013-11-05 14:37:56 +00:00
Hieu Hoang
4b004b26d3 output list of available feature functions 2013-11-01 15:17:24 +00:00
Hieu Hoang
d51702f387 output list of available feature functions 2013-11-01 15:16:47 +00:00
Hieu Hoang
b926346bfe compiles with eclipse under OSX Mavericks 2013-10-30 21:23:16 +00:00
Hieu Hoang
a5f391e3f3 remove description argument from feature function constructor. Redundant 2013-10-29 18:59:53 +00:00
Hieu Hoang
bd82b7355b remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
Hieu Hoang
d21e99e444 remove description argument from feature function constructor. Redundant 2013-10-29 17:46:03 +00:00
Hieu Hoang
37896ed854 add NeuralLM 2013-10-28 23:21:02 +00:00
Hieu Hoang
0af1df9f8b add NeuralLM 2013-10-28 22:11:37 +00:00
Phil Williams
69f5e4bec3 Merge branch 'master' into GHKMStruct 2013-10-09 16:21:49 +01:00
Hieu Hoang
6ccc17b804 speed up compiling by removing headers from StaticData.h 2013-10-03 11:05:53 +01:00
Phil Williams
841bf4b0a4 Fix merge error. 2013-09-29 17:07:48 +01:00
Phil Williams
4565d63995 Update InternalStructStatelessFF after merge. 2013-09-29 16:01:03 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
 2013-09-29 15:27:09 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
Nadir Durrani
13e1adf000 Astetic Changes 2013-09-26 17:55:20 +01:00
Hieu Hoang
650f5150f8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-09-26 12:15:17 +01:00
Hieu Hoang
4285a6c7df move Uli's new pt into it's own folder. Comment out bjam compile. Doesn't work on MacOSX yet 2013-09-26 10:10:12 +01:00
Hieu Hoang
01c0708854 input feature score error when using anything other than bin pt 2013-09-26 00:05:52 +01:00