moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-11-10 10:59:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,729 Commits 136 Branches 26 Tags 147 MiB
10e26ef00d
Commit Graph

59 Commits

Author SHA1 Message Date
Barry Haddow
c1be2d47e5 Merge remote-tracking branch 'origin/master' into sparse-reordering 
Conflicts:
	moses/FF/Factory.cpp
 2014-05-26 11:48:51 +01:00
Hieu Hoang
b60ac0321f rename DuplicateWord -> NieceTerminal 2014-05-20 20:02:49 +01:00
Hieu Hoang
e31ce4d3be add FF DuplicateWord 2014-05-20 19:51:46 +01:00
Hieu Hoang
1e96ffcf3d rename FF RuleAmbiguity to RuleScope 2014-05-16 12:47:43 +01:00
Hieu Hoang
3ef5d76860 add MaxSpanFreeNonTermSource. Need to change FF framework to take in derivation 2014-05-08 16:34:04 +01:00
Hieu Hoang
9644a30858 add FF RuleAmbiguity 2014-04-11 10:22:03 +01:00
Hieu Hoang
91d6bfe0d5 start on FF ReferenceComparison 2014-04-10 21:34:34 +01:00
Hieu Hoang
4c634023ce add FF CountNonTerms 2014-04-08 17:19:26 +01:00
Hieu Hoang
09dc0e9913 add FF/SetSourcePhrase 2014-04-06 16:57:54 +01:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables 
Conflicts:
	phrase-extract/score-main.cpp
 2014-03-10 14:25:45 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature 
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
 2014-03-03 13:56:19 +00:00
Ulrich Germann
ef2ef881a4 Merge branch 'dynamic-phrase-tables' of file:///home/germann/git/mosesdecoder into dynamic-phrase-tables 2014-02-21 01:04:02 +00:00
Ulrich Germann
6d2818fa57 Fixed include path for msapt.h 2014-02-08 18:22:33 +00:00
Hieu Hoang
9745924937 output list of available feature functions, separated by space, rather than lines 2014-01-25 10:39:47 +00:00
Hieu Hoang
839d1c6978 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-01-20 16:26:45 +00:00
Hieu Hoang
b448e77639 register feature function HyperParameterAsWeight 2014-01-20 16:12:46 +00:00
Rico Sennrich
c8108ca71d some sparse feature functions couldn't be set to be non-tuneable in moses.ini 2014-01-20 15:56:36 +00:00
Rico Sennrich
9e177cb472 SyntaxConstraintFeature (without any actual constraints; useful to build/output syntax tree from GHKM tree fragments) 2014-01-16 18:45:26 +00:00
Rico Sennrich
ed25bb2b99 soft matching of target-side nonterminals 2014-01-16 18:34:33 +00:00
Lane Schwartz
f40e1ac8f8 Added support for hierarchical maximum entropy LM through SRILM. 
Currently, the code compiles, but has not been run or tested.

    Steps to compile with maxent LM are below:

    - Download SRILM 1.6.0

    - Download the maxent patch from
      http://www.phon.ioc.ee/~tanela/srilm-me/srilm-1.6.0-me.patch

    - Download the required libLBFGS library from
      http://www.chokkan.org/software/liblbfgs

    - Edit SRILM's sbin/machine-type script
      to return MACHINE_TYPE=i686-m64 for case x86_64

    - Compile libLBFGS and install it in the /tools/SRILM/SRILM-1.7.0 directory.
      Make sure that the liblbfgs.* library files are in /tools/SRILM/SRILM-1.7.0/lib//

    - In the /tools/SRILM/SRILM-1.7.0 dir, apply the maxent patch to SRILM:
      patch -p1 < srilm-1.6.0-me.patch

    - Point the appropriate SRILM makefile
      to see libLBFGS's include and lib dirs, following the instructions at:
      http://www.phon.ioc.ee/dokuwiki/doku.php?id=people:tanel:srilm-me.en

    - Compile SRILM

    - Compile Moses using --with-srilm and --with-maxent-srilm:
      ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true

    NOTE: The above steps were for my original integration.
          Current versions of SRILM (such as 1.7.1) include the maxent patch.
          As such, it should be sufficient to compile a current version of SRILM
          with support form maxent enabled,
          and then compile Moses using --with-srilm and --with-maxent-srilm:
          ./bjam --with-srilm=/tools/SRILM/SRILM-1.7.0 --with-maxent-srilm=true
 2013-12-20 15:04:09 -05:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Ales Tamchyna
86a0dc337a adding CoveredReferenceFeature 2013-11-29 09:27:43 +01:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
c4dfc60f95 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-22 15:26:23 +00:00
Hieu Hoang
5c6d88a463 add new phrase table for Scope-3 parsing. Doesn't quite work... 2013-11-22 15:26:14 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
2d8f9bc515 bug fixes for TargetNGramFeature 2013-11-11 15:32:58 +00:00
Hieu Hoang
08d888382d add DALM. Just a skeleton so far 2013-11-05 14:37:56 +00:00
Hieu Hoang
4b004b26d3 output list of available feature functions 2013-11-01 15:17:24 +00:00
Hieu Hoang
d51702f387 output list of available feature functions 2013-11-01 15:16:47 +00:00
Hieu Hoang
b926346bfe compiles with eclipse under OSX Mavericks 2013-10-30 21:23:16 +00:00
Hieu Hoang
37896ed854 add NeuralLM 2013-10-28 23:21:02 +00:00
Hieu Hoang
0af1df9f8b add NeuralLM 2013-10-28 22:11:37 +00:00
Phil Williams
841bf4b0a4 Fix merge error. 2013-09-29 17:07:48 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
 2013-09-29 15:27:09 +01:00
Hieu Hoang
4285a6c7df move Uli's new pt into it's own folder. Comment out bjam compile. Doesn't work on MacOSX yet 2013-09-26 10:10:12 +01:00
Ulrich Germann
050b089ea0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/TranslationModel/SkeletonPT.cpp
 2013-09-25 22:33:27 +01:00
Hieu Hoang
deafd5922d skeleton PT 2013-09-25 16:57:01 +01:00
Ulrich Germann
82274ffda7 Merge branch 'dynamic-phrase-tables' 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/Phrase.cpp
 2013-09-25 13:52:05 +01:00
=
8545b4d15e Added Mmsapt as a feature function. 2013-09-25 00:14:57 +01:00
Hieu Hoang
cff36b6638 skeleton LM 2013-09-24 22:26:51 +01:00
Hieu Hoang
5ebb81a17a constrained decoding FF works for both pb and hiero 2013-09-17 15:06:17 +02:00
Hieu Hoang
3b13068ce4 oops. forgot to check in new FF 2013-09-16 11:00:11 +01:00
Hieu Hoang
0d94d7067e update convert-moses-ini-to-v2.perl with memory pt for SCFFG decoding. Start on constrained ff 2013-09-16 07:46:45 +02:00
Barry Haddow
d737a352b3 Renamed 2013-09-14 17:22:43 +01:00
maria nadejde
7077a04c3b Stateless Feature InternalStructStatelessFF 2013-09-13 18:21:23 +02:00
Barry Haddow
a6e6660497 Merge branch 'master' into sparse-reordering 
Conflicts:
	moses/FF/Factory.cpp
 2013-09-12 18:57:10 +01:00
Hieu Hoang
c36d8d048f ExternalFeature /cdec & phil blumson 2013-09-12 09:48:17 +02:00
Barry Haddow
565b4ea1ae Skeleton sparse reordering feature 2013-09-10 08:58:45 +01:00