Commit Graph

1441 Commits

Author SHA1 Message Date
phkoehn
7507373b84 enable use of both edt and sd; reduction of translation option cache
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1966 1f5c12ca-751b-0410-a591-d2e778427230
2009-01-01 18:16:54 +00:00
nicolabertoldi
2075f9dda1 modification to mert script to allow the use of fewer nbest lists; features and scores are no more gzipped
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1965 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-30 17:33:16 +00:00
phkoehn
5e66cd48f0 faster early discarding, code cleanup and documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1964 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-20 20:22:35 +00:00
jdschroeder
83cc7f6476 added SquareMatrix to Makefile.am
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1963 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-17 16:33:59 +00:00
hieuhoang1972
beaf1856cd vs build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1962 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-17 14:07:17 +00:00
phkoehn
813fb5cf81 big fix in early discarding, requiring moving CalcFutureCost into
SquareMatrix


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1961 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-17 12:32:52 +00:00
phkoehn
a360b71426 initial version of reordering zones and walls, may work
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1960 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-15 12:52:38 +00:00
phkoehn
e13e45dc63 improved early discarding, ifverbose(2) time tracking
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1959 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-14 13:23:33 +00:00
jdschroeder
3aadf33bef Fixed XML bug where TranslationOptions generated by XML had null for source phrases. TODO: drop <linked> XML tags feature?
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1958 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-13 13:12:54 +00:00
phkoehn
8caf6053da ooops
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1957 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-13 12:18:45 +00:00
phkoehn
11139a364d improvements to pruning, working version passed regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1956 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-13 12:08:55 +00:00
abarun
3cc8305efa Modified xcode project to make it work with both sri and irst lms
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1955 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-11 19:27:59 +00:00
hieuhoang1972
69b2dc441d eclipse files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-10 14:20:10 +00:00
bojar
091c9ece28 raising line_max_length
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1953 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-05 10:01:05 +00:00
bojar
586d7e2f84 minor fix when handling gzipped corpora
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1952 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-04 17:49:59 +00:00
bojar
2c900c8bd7 uncompress input files for phrase extract, if needed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1951 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-27 10:39:28 +00:00
xandfraser
7268b31292 Added include so ReorderingConstraint.h compiles
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1950 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-26 19:07:39 +00:00
hieuhoang1972
8ef9fcc9f8 allow no LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1949 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-25 20:20:40 +00:00
phkoehn
94d18dd219 needed for -monotone-at-punctuation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1948 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-25 19:29:47 +00:00
bhaddow
1e13f6d2d6 Weights can sometimes be in exponential format.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1947 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-25 09:54:45 +00:00
phkoehn
b2818633f4 that one was missing
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1946 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-24 17:31:26 +00:00
phkoehn
a0edbf1522 added -monotone-at-punctuation option
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1945 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-24 17:30:37 +00:00
hieuhoang1972
2807bc48ad absolute file name check, provided by Eric Kow
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1944 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-20 13:03:59 +00:00
hieuhoang1972
254284e57e patch to fix fiddly env variable and directory stuff, provided by Eric Kow@
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1943 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-20 13:01:49 +00:00
nicolabertoldi
32029561da mert can now load more data files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1942 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-18 18:51:02 +00:00
jdschroeder
6eab281ce6 CreateAlignmentInfo is now only called when UseAlignmentInfo is true. Shrinks phrase table memory size when extra data is not needed.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1941 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-13 17:43:15 +00:00
hieuhoang1972
102856bf84 init m_sourceStartPosMattersForRecombination
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1940 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-12 20:26:02 +00:00
hieuhoang1972
d342a5e6d8 add interal language model into makefile build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1939 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-12 19:57:28 +00:00
phkoehn
abb2fc37b1 proper binarization of lexicalized reordering model
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1938 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-10 16:03:16 +00:00
bhaddow
ec68b5235f Fix minor bugs in randlm and irstlm config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1937 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-05 18:06:14 +00:00
hieuhoang1972
789d6d96d1 intergrate randlm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-04 18:03:03 +00:00
hieuhoang1972
5539e81209 configure for randlm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1934 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-04 18:01:30 +00:00
hieuhoang1972
a670ddddd9 configure for randlm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1933 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-04 17:49:44 +00:00
hieuhoang1972
c59b532df1 eclipse proj
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-31 18:44:44 +00:00
hieuhoang1972
8d6d739a6a eclipse proj
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1925 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-30 19:44:54 +00:00
hieuhoang1972
8b64fb3df0 wrap trans opt list
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1924 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-30 18:43:17 +00:00
hieuhoang1972
ece61581a0 make build instructions. can build with both sri & irst @ same time
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1919 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-28 17:17:01 +00:00
phkoehn
bfbbefd710 bug fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1917 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-26 03:32:29 +00:00
mphi
8a4c6a2c63 pus significance test into proper location
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1915 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-23 09:16:33 +00:00
mphi
88d3b775ce altered the bootstrap significance script algorithm according to (Riezler and Maxwell 2005 @ MTSE'05)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1914 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-23 09:03:41 +00:00
phkoehn
a09242ad16 bug fix with phrase table name in moses.ini, when using hmm alignment
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1913 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-20 21:37:57 +00:00
mphi
f033e32979 Added implementation of Koehn's 2004 EMNLP paired bootsrap resampling
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1911 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-20 11:55:12 +00:00
phkoehn
1c7b305152 bug fix
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1910 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-19 07:32:48 +00:00
phkoehn
1b5d99ad26 added headers for standard compliance (gcc 4.3 on 64 bit linux)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1905 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-16 21:14:38 +00:00
phkoehn
3a5981ce9d major improvements, see email to moses-support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1904 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-15 23:25:14 +00:00
phkoehn
614876771d extended extract/score, to allow for one big file, not just parts
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1903 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-15 22:12:56 +00:00
hieuhoang1972
d9d1b8f748 fix caching bug.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1902 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-14 19:25:18 +00:00
hieuhoang1972
a88239c5c0 unix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1901 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-10 18:31:07 +00:00
hieuhoang1972
254005bcee unix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1900 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-10 18:30:59 +00:00
hieuhoang1972
6a61ffa9bd unix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1899 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-10 18:30:51 +00:00