Phil Williams
e1d60211a4
filter-rule-table: comments + minor clean-up.
2015-02-11 12:03:27 +00:00
Kenneth Heafield
8fcf00869d
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-02-10 10:44:59 -05:00
Kenneth Heafield
ee39fdbaa5
Relative path
2015-02-10 10:43:10 -05:00
Phil Williams
02f5ada680
filter-rule-table: support for "hierarchical" and "s2t" model types
...
Output should match filter-rule-table.py, but filtering is faster. Some rough
timings:
That This
System A 0h 13m 0h 04m
System B 18h 03m 0h 51m
System A is WMT14, en-de, string-to-tree (32M rules, 3,000 test sentences)
System B is WMT14, cs-en, string-to-tree (293M rules, 13,071 test sentences)
2015-02-10 15:11:10 +00:00
Matthias Huck
0de206f359
fixing a bug from commit 70e8eb5
2015-02-10 03:12:02 +00:00
Charley C
e40606d08f
default path update in train-recaser
2015-02-09 18:36:31 -05:00
Hieu Hoang
ce80e53b30
set scores for lattice path
2015-02-09 11:43:44 +00:00
Hieu Hoang
066a681b43
fix word lattice input feature for non-binary pt
2015-02-08 00:50:23 +00:00
Hieu Hoang
755bd609f5
Using boost for prefix/suffix checks /Jeroen Vermeulen
2015-02-06 15:52:25 +00:00
Hieu Hoang
4145999e33
virtual destructor for KenOSMBase /Jeroen Vermeulen
2015-02-06 15:37:47 +00:00
Hieu Hoang
65f94e615b
check args for KENLM
2015-02-06 11:53:25 +00:00
James Zhang
8b61f396a7
Simple structure change to make moses main() function available in libmoses.a
2015-02-05 14:43:45 -05:00
Hieu Hoang
70e8eb54ce
Using boost for prefix/suffix checks /Jeroen Vermeulen
2015-02-05 16:23:47 +00:00
Hieu Hoang
53afe08da7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-04 11:33:29 +00:00
Hieu Hoang
3e14401a2b
KenLM wrapper fix
2015-02-04 11:30:34 +00:00
Ales Tamchyna
fd61d2f810
vw bugfix
2015-02-04 11:33:10 +01:00
Ales Tamchyna
e932e96db7
avoid duplicate generation of source-side features when training VW
2015-02-04 11:07:07 +01:00
Philipp Koehn
f69c1dab02
more efficient default recaser training
2015-02-04 09:18:09 +00:00
Phil Williams
6b9da6c585
filter-rule-table: merge changes from t2s branch (still WIP)
2015-02-03 11:33:10 +00:00
Hieu Hoang
78f79632b9
script to convert moses.ini v2 to v1 /Tom Hoar
2015-02-03 10:59:38 +00:00
Hieu Hoang
6bfdddfe49
eclipse
2015-02-03 10:26:51 +00:00
Kenneth Heafield
081fb5e181
Fix argument parser: ignore lead
2015-02-02 17:34:57 -05:00
Hieu Hoang
464686e242
Merge pull request #94 from aminorex/master
...
remove spurious endl
2015-02-02 21:01:27 +00:00
akimbal1
362e6a9374
remove spurious endl
2015-02-02 15:57:04 -05:00
Hieu Hoang
80b2128a59
Merge pull request #93 from aminorex/master
...
alignment for hieu
2015-02-02 20:18:26 +00:00
akimbal1
8ea1c9fd40
alignment for hieu
2015-02-02 12:55:21 -05:00
Phil Williams
ac8f01bc3d
Partial merge of t2s branch (implements t2s and f2s algorithms)
...
Implements search algorithms 7, 8, and 9:
-search-algorithm 7
tree-to-string (STSG-based, currently a special-case of forest-to-string)
-search-algorithm 8
tree-to-string (SCFG-based)
-search-algorithm 9
forest-to-string (STSG-based)
2015-02-02 17:07:54 +00:00
Phil Williams
c8ad84fa55
New input type, ForestInput, for weighted forests.
...
* Uses Egret format (https://sites.google.com/site/zhangh1982/egret )
* Used by forest-to-string search algorithm (-search-algorithm 9)
2015-02-02 16:34:17 +00:00
Phil Williams
984936f05f
Placeholders for new syntax-based search algorithms
2015-02-02 15:39:00 +00:00
Phil Williams
e177131a22
Remove -s2t option (use -search-algorithm=6 instead)
2015-02-02 15:01:59 +00:00
Kenneth Heafield
e542986ed5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-02-02 09:26:08 -05:00
Kenneth Heafield
ee881734fe
Rewrite KenLM argument parser to consume one =
2015-02-02 09:25:02 -05:00
Hieu Hoang
884a0b1c90
forgot to add Parameters.cpp. Change c++11 to c++0x to support older compilers (on Ubuntu 12.04 etc).
2015-01-30 17:45:20 +00:00
Phil Williams
2975e7a0d3
Minor refactoring in moses/Syntax
2015-01-30 11:56:08 +00:00
Kenneth Heafield
925565a0b9
"just put it in. I'll verify it if i can be bovvered" --Hieu /usr/bin/env
2015-01-29 18:37:05 -05:00
Matthias Huck
449d9b294b
Revert "env perl shebang"
...
This reverts commit 34f2801f8a
.
Caused problems because /bin/env doesn't exist on Ubuntu 12.04.
/usr/bin/env does, though.
2015-01-29 21:15:20 +00:00
Matthias Huck
a2efb9afc7
PhraseOrientationFeature: more sparse scores
2015-01-29 20:23:41 +00:00
Ales Tamchyna
c33e9e81da
vw verbose
2015-01-29 17:40:22 +01:00
Ales Tamchyna
2b0aa56677
VW verbose outputs
2015-01-29 17:33:35 +01:00
Ales Tamchyna
79f7e7bd16
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2015-01-29 16:52:27 +01:00
Ales Tamchyna
bef4795ad9
optionally leave one out in VW training
2015-01-29 16:52:21 +01:00
Matthias Huck
7a7d12b038
PhraseOrientationFeature: can produce some sparse scores
2015-01-28 20:50:24 +00:00
Matthias Huck
91dfd36c8b
use FEATUREVERBOSE
2015-01-28 20:49:04 +00:00
Kenneth Heafield
34f2801f8a
env perl shebang
2015-01-27 18:35:54 -05:00
Matthias Huck
4cc5c677b3
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-01-27 18:53:13 +00:00
Hieu Hoang
7691657c35
Merge branch 'RC-3.1'
2015-01-27 18:24:36 +00:00
Hieu Hoang
5244a7b607
shut up
2015-01-27 18:24:15 +00:00
Matthias Huck
afb6ac903b
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2015-01-27 18:16:14 +00:00
Matthias Huck
9f562e0fd4
SoftSourceSyntacticConstraintsFeature: better config parameter names
2015-01-27 18:15:51 +00:00
Hieu Hoang
646d3bd055
Merge branch 'RC-3.1'
2015-01-27 16:49:01 +00:00