Commit Graph

197 Commits

Author SHA1 Message Date
Phil Williams
b9a382aa78 Add filter-rule-table
This will eventually replace filter-rule-table.py.  At the moment
it can only filter rule tables where the source-side is a STSG
fragment and when the test sentences have parse trees.
2014-12-07 14:56:48 +00:00
Phil Williams
60e56efc6b phrase-extract: add syntax-common sub-library
And remove some (near-)duplicate code from pcfg-common and score-stsg.
2014-12-07 14:27:51 +00:00
Hieu Hoang
5bbd30ec12 comment out running script. Need to get git version to insert into exec 2014-12-02 19:25:47 +00:00
Phil Williams
f84f159247 Add score-stsg, a program for scoring STSG extract files 2014-12-02 17:10:20 +00:00
Hieu Hoang
46e7aebce4 move SetBooleanParameter to Parameter class. Make it a specialized version of template SetParameter 2014-11-30 20:15:15 +00:00
Ulrich Germann
7aa4d5d8d5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses-cmd/simulate-pe.cc
2014-11-20 17:55:51 +00:00
XapaJIaMnu
52c520c042 Resolve merge conflicts 2014-11-20 15:50:32 +00:00
Ulrich Germann
f8f96f146e Removed sim-pe from the list of programs to be compiled and installed. Use simulate-pe from moses-cmd instead. 2014-11-16 16:29:00 +00:00
Hieu Hoang
1c27e05a06 softlink for moses_chart 2014-11-14 13:56:56 +00:00
XapaJIaMnu
06fa9b5916 Add option to build with Og for newer versions of gcc 2014-11-13 16:14:16 +00:00
Hieu Hoang
ad1d5ade7a softlink moses -> moses_chart for backward compatibility 2014-11-08 19:31:38 +00:00
Hieu Hoang
4687c1cc2b softlink moses -> moses_chart for backward compatibility 2014-11-08 17:16:22 +00:00
Hieu Hoang
e1092c0dad merge 2014-11-07 14:35:36 +00:00
Ulrich Germann
07202c544c Added ptable-describe-features to list features used by PhraseDictionaryBitextSampling. 2014-10-25 12:06:38 -07:00
Ulrich Germann
53ef6c5c38 Added demo program for use of suffix arrays. 2014-10-23 11:11:28 -07:00
Barry Haddow
562cf7e007 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-10-21 15:11:22 +01:00
Barry Haddow
b4f26e9f5e rephraser 2014-10-21 15:10:50 +01:00
Hieu Hoang
93d11e3626 merge moses_chart and moses 2014-10-10 15:09:56 +01:00
Paul Baltescu
8f74ecd8f3 Fix OxLM. 2014-10-08 22:08:42 +01:00
Hieu Hoang
cbf85cc1f7 add back server compile, with warning about xmlrpc-c version 1.25.29 2014-09-17 19:29:45 +02:00
Hieu Hoang
2158ba270d don't compile moses server by default 2014-09-09 17:09:36 +02:00
Ulrich Germann
db6e5de641 Added initial code for utility to count features of PhraseDictionaryBitextSampling. 2014-09-08 11:03:05 +01:00
Ulrich Germann
4941314a48 Branch biased bitext sampling: Initial check-in. 2014-09-08 09:26:09 +01:00
Ulrich Germann
a86d49fc88 Added bias to bitext sampling. 2014-09-08 09:26:08 +01:00
Ulrich Germann
015d690b6f Added try-align2 to --with-mm and new switch --with-icu. 2014-09-08 09:26:08 +01:00
Hieu Hoang
b51062672f Roll out mixed syntax 2014-08-29 15:55:48 +01:00
Ulrich Germann
215041dfff Bug fix in Jamroot with respect to compiling without --with-cmph. 2014-08-05 02:19:43 +01:00
Barry Haddow
2826ccc001 Boost version update, specify filesystem v3
Shout if it breaks your favourite platform!
2014-07-23 17:22:14 +01:00
Ulrich Germann
5915e2b1cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 15:53:07 +01:00
Hieu Hoang
53073726d6 compiles with bjam 2014-07-15 15:26:50 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Ulrich Germann
73081786bc Name change: lookup_mmsapt -> ptable-lookup 2014-06-28 20:08:41 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Ulrich Germann
ce853731ae Added mmsapt lookup utility. 2014-06-05 01:38:55 +01:00
Ulrich Germann
21f141ce0d Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	moses/InputPath.cpp
	moses/Word.cpp
2014-04-08 14:58:29 +01:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory.
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Ulrich Germann
c91fb5cc84 Added mmlex-lookup utility program. 2014-03-19 20:41:29 +00:00
Ulrich Germann
394a40b934 Added program calc-coverage. 2014-03-18 12:17:07 +00:00
Ulrich Germann
9025ac065f Added utilities:
- mam2symal converts memory-mapped word alignments to symal format
- mam_verify performs a sanity check on memory-mapped word alignments
2014-03-12 08:06:55 +00:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Kenneth Heafield
952bb76b77 We weren't linking against tcmalloc... 2014-03-01 07:42:32 +00:00
Ulrich Germann
4b95c3a906 Merge branch 'dynamic-phrase-tables' of ssh://thor//home/germann/git/mosesdecoder into dynamic-phrase-tables
due to resetting the location of the remote repository.
2014-02-21 01:09:38 +00:00
Ulrich Germann
b410026804 Added test program try-align. 2014-02-20 23:56:45 +00:00
Ulrich Germann
af007c4cf0 Minor fixes related to mm. 2014-02-08 18:18:45 +00:00
Hieu Hoang
2387f3123c bjam 2014-01-23 13:14:59 +00:00
Hieu Hoang
5800ff848c bjam 2014-01-22 20:57:06 +00:00
Rico Sennrich
c1d8f6e267 Revert "testing the waters for C++11 adoption"
This reverts commit d2d508184e.

there's problems with gcc 4.5, and apparently different problems with new boost versions; sticking with C++03 for the time being.
2014-01-15 16:16:11 +00:00
Rico Sennrich
d2d508184e testing the waters for C++11 adoption 2014-01-14 17:01:46 +00:00
Hieu Hoang
ca42b9b01f tcmalloc /buhomecanico 2014-01-06 11:52:21 +00:00