Hieu Hoang
3b3496d92a
output sentence as is if unparseable. -unparseable
2014-03-16 00:19:52 +00:00
Phil Williams
b2b9751227
parse-de-bitpar.perl: fix special char handling
...
Unescape special characters in input to BitPar and then re-escape
in output.
2012-10-06 16:27:33 +01:00
Hieu Hoang
debe090426
Change Bin to RealBin. Thanks to Tom Hoar
2012-06-26 11:57:23 -04:00
Phil Williams
e70cafa1d7
The current version of BitPar's German grammar is encoded using UTF-8, so
...
disable the conversion to and from ISO-8859-1 in the parse-de-bitpar.perl
wrapper script. For compatibility with older versions of BitPar, the old
behaviour is available using the --old-bitpar command-line option.
2011-11-08 15:05:02 +00:00
hieuhoang1972
57e3a92836
rollback. argument not supported by all iconv
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3712 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-15 12:50:11 +00:00
hieuhoang1972
ff339e56e3
don't drop unknown char. replace it with improbable string. avoid misalignment
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3709 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-14 20:50:15 +00:00
hieuhoang1972
a79a6bbaec
add scripts to exclude unparseable sentences
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3700 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-11 18:04:16 +00:00
hieuhoang1972
f1f04daa0a
add empty line if input is empty line
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3699 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-10 12:11:55 +00:00
phkoehn
2ed6804f12
official release of experiment.perl
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3224 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-04 23:04:10 +00:00
pjwilliams
2edfc16912
Merge remaining script support for tree-based models from mt3_chart.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3137 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-16 09:45:51 +00:00
