Commit Graph

13500 Commits

Author SHA1 Message Date
Phil Williams
e1d60211a4 filter-rule-table: comments + minor clean-up. 2015-02-11 12:03:27 +00:00
Kenneth Heafield
8fcf00869d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-02-10 10:44:59 -05:00
Kenneth Heafield
ee39fdbaa5 Relative path 2015-02-10 10:43:10 -05:00
Phil Williams
02f5ada680 filter-rule-table: support for "hierarchical" and "s2t" model types
Output should match filter-rule-table.py, but filtering is faster.  Some rough
timings:

             That        This
  System A    0h 13m     0h 04m
  System B   18h 03m     0h 51m

System A is WMT14, en-de, string-to-tree (32M rules, 3,000 test sentences)
System B is WMT14, cs-en, string-to-tree (293M rules, 13,071 test sentences)
2015-02-10 15:11:10 +00:00
Matthias Huck
0de206f359 fixing a bug from commit 70e8eb5 2015-02-10 03:12:02 +00:00
Charley C
e40606d08f default path update in train-recaser 2015-02-09 18:36:31 -05:00
Hieu Hoang
ce80e53b30 set scores for lattice path 2015-02-09 11:43:44 +00:00
Hieu Hoang
066a681b43 fix word lattice input feature for non-binary pt 2015-02-08 00:50:23 +00:00
Hieu Hoang
755bd609f5 Using boost for prefix/suffix checks /Jeroen Vermeulen 2015-02-06 15:52:25 +00:00
Hieu Hoang
4145999e33 virtual destructor for KenOSMBase /Jeroen Vermeulen 2015-02-06 15:37:47 +00:00
Hieu Hoang
65f94e615b check args for KENLM 2015-02-06 11:53:25 +00:00
James Zhang
8b61f396a7 Simple structure change to make moses main() function available in libmoses.a 2015-02-05 14:43:45 -05:00
Hieu Hoang
70e8eb54ce Using boost for prefix/suffix checks /Jeroen Vermeulen 2015-02-05 16:23:47 +00:00
Hieu Hoang
53afe08da7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-04 11:33:29 +00:00
Hieu Hoang
3e14401a2b KenLM wrapper fix 2015-02-04 11:30:34 +00:00
Ales Tamchyna
fd61d2f810 vw bugfix 2015-02-04 11:33:10 +01:00
Ales Tamchyna
e932e96db7 avoid duplicate generation of source-side features when training VW 2015-02-04 11:07:07 +01:00
Philipp Koehn
f69c1dab02 more efficient default recaser training 2015-02-04 09:18:09 +00:00
Phil Williams
6b9da6c585 filter-rule-table: merge changes from t2s branch (still WIP) 2015-02-03 11:33:10 +00:00
Hieu Hoang
78f79632b9 script to convert moses.ini v2 to v1 /Tom Hoar 2015-02-03 10:59:38 +00:00
Hieu Hoang
6bfdddfe49 eclipse 2015-02-03 10:26:51 +00:00
Kenneth Heafield
081fb5e181 Fix argument parser: ignore lead 2015-02-02 17:34:57 -05:00
Hieu Hoang
464686e242 Merge pull request #94 from aminorex/master
remove spurious endl
2015-02-02 21:01:27 +00:00
akimbal1
362e6a9374 remove spurious endl 2015-02-02 15:57:04 -05:00
Hieu Hoang
80b2128a59 Merge pull request #93 from aminorex/master
alignment for hieu
2015-02-02 20:18:26 +00:00
akimbal1
8ea1c9fd40 alignment for hieu 2015-02-02 12:55:21 -05:00
Phil Williams
ac8f01bc3d Partial merge of t2s branch (implements t2s and f2s algorithms)
Implements search algorithms 7, 8, and 9:

-search-algorithm 7
  tree-to-string (STSG-based, currently a special-case of forest-to-string)

-search-algorithm 8
  tree-to-string (SCFG-based)

-search-algorithm 9
  forest-to-string (STSG-based)
2015-02-02 17:07:54 +00:00
Phil Williams
c8ad84fa55 New input type, ForestInput, for weighted forests.
* Uses Egret format (https://sites.google.com/site/zhangh1982/egret)
 * Used by forest-to-string search algorithm (-search-algorithm 9)
2015-02-02 16:34:17 +00:00
Phil Williams
984936f05f Placeholders for new syntax-based search algorithms 2015-02-02 15:39:00 +00:00
Phil Williams
e177131a22 Remove -s2t option (use -search-algorithm=6 instead) 2015-02-02 15:01:59 +00:00
Kenneth Heafield
e542986ed5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-02-02 09:26:08 -05:00
Kenneth Heafield
ee881734fe Rewrite KenLM argument parser to consume one = 2015-02-02 09:25:02 -05:00
Hieu Hoang
884a0b1c90 forgot to add Parameters.cpp. Change c++11 to c++0x to support older compilers (on Ubuntu 12.04 etc). 2015-01-30 17:45:20 +00:00
Phil Williams
2975e7a0d3 Minor refactoring in moses/Syntax 2015-01-30 11:56:08 +00:00
Kenneth Heafield
925565a0b9 "just put it in. I'll verify it if i can be bovvered" --Hieu /usr/bin/env 2015-01-29 18:37:05 -05:00
Matthias Huck
449d9b294b Revert "env perl shebang"
This reverts commit 34f2801f8a.

Caused problems because /bin/env doesn't exist on Ubuntu 12.04.
/usr/bin/env does, though.
2015-01-29 21:15:20 +00:00
Matthias Huck
a2efb9afc7 PhraseOrientationFeature: more sparse scores 2015-01-29 20:23:41 +00:00
Ales Tamchyna
c33e9e81da vw verbose 2015-01-29 17:40:22 +01:00
Ales Tamchyna
2b0aa56677 VW verbose outputs 2015-01-29 17:33:35 +01:00
Ales Tamchyna
79f7e7bd16 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-01-29 16:52:27 +01:00
Ales Tamchyna
bef4795ad9 optionally leave one out in VW training 2015-01-29 16:52:21 +01:00
Matthias Huck
7a7d12b038 PhraseOrientationFeature: can produce some sparse scores 2015-01-28 20:50:24 +00:00
Matthias Huck
91dfd36c8b use FEATUREVERBOSE 2015-01-28 20:49:04 +00:00
Kenneth Heafield
34f2801f8a env perl shebang 2015-01-27 18:35:54 -05:00
Matthias Huck
4cc5c677b3 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-27 18:53:13 +00:00
Hieu Hoang
7691657c35 Merge branch 'RC-3.1' 2015-01-27 18:24:36 +00:00
Hieu Hoang
5244a7b607 shut up 2015-01-27 18:24:15 +00:00
Matthias Huck
afb6ac903b Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-27 18:16:14 +00:00
Matthias Huck
9f562e0fd4 SoftSourceSyntacticConstraintsFeature: better config parameter names 2015-01-27 18:15:51 +00:00
Hieu Hoang
646d3bd055 Merge branch 'RC-3.1' 2015-01-27 16:49:01 +00:00