Hieu Hoang
cbee7096bc
bump again
2018-10-26 18:52:27 +02:00
Hieu Hoang
ab161b6f7f
Merge pull request #203 from maxthomas/contrib-modular-boost
...
contrib: make boost variable modular; update version to 1.68.0
2018-10-26 18:49:27 +02:00
Hieu Hoang
4180b932b1
bump
2018-10-26 18:46:26 +02:00
max thomas
c43a84516c
contrib: make boost variable modular; update version to 1.68.0
2018-10-24 21:51:48 -05:00
Hieu Hoang
4dd747e5db
Merge pull request #202 from thuvh/python3_compatible
...
fix print to compatible with python2 and python3
2018-09-27 11:30:54 +01:00
Hoai-Thu Vuong
90c8464c53
fix print to compatible with python2 and python3
2018-09-26 23:17:19 +07:00
Rico Sennrich
411f45f249
multi-bleu-detok should take raw reference
2018-09-26 12:24:07 +01:00
Hieu Hoang
48fa6e92a9
grammar
2018-09-16 14:58:39 +01:00
Hieu Hoang
fd1758ba74
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2018-09-10 18:30:46 +01:00
Hieu Hoang
e760db2d17
unused script
2018-09-10 18:30:36 +01:00
Barry Haddow
06f519d4e2
Handle glottal stops in Somalian
2018-09-06 16:09:36 +01:00
Hieu Hoang
3545225c0b
Merge pull request #201 from louismartin/bleu-fix-newline
...
[BLEU] Fix multi-bleu.perl bug (no newline at end of file)
2018-07-05 14:02:10 +01:00
Louis MARTIN
53da5f4dbe
Fix multi-bleu.perl bug when file does not end with newline
...
When reading hypothesis and reference files, multi-bleu.perl uses the
chop function to remove the trailing newline character.
If one of these files happens to not end with a newline, then chop will
remove the last character of the last line (instead of the newline).
This causes the BLEU score to be slightly off from its theoretical
value.
Using the safest chomp function solves this problem, i.e. it only
removes newlines when present.
2018-07-03 04:06:09 -06:00
Hieu Hoang
8c5eaa1a12
Merge branch 'RELEASE-4.0' of github.com:jowagner/mosesdecoder
2018-06-25 09:21:50 +01:00
Joachim Wagner
5bbd5ca160
fix syntax error; credit https://www.mail-archive.com/moses-support@mit.edu/msg15226.html
2018-06-23 08:19:36 +01:00
Joachim Wagner
2aa5cd2152
fix syntax error in regular expression
2018-06-22 18:16:11 +01:00
Joachim Wagner
1d675ba956
fix syntax error; credit: https://patchwork.ozlabs.org/patch/735705/
2018-06-22 16:28:06 +01:00
Hieu Hoang
03578921cc
Merge pull request #198 from tofula/master
...
EMS: Added missing step for the "TRAINING:build-generation-custom".
2018-05-22 15:08:59 +01:00
Prashant Mathur
b56d97dee0
Merge pull request #199 from mtresearcher/dev-chrf-tuning
...
Tuning with character FScore
2018-05-21 21:06:06 +02:00
Prashant Mathur
c817980025
Update email
2018-05-18 16:20:47 +02:00
Prashant Mathur
e315438bea
Make CHRFscorer compile
2018-05-18 16:18:47 +02:00
Prashant Mathur
fb478bf1db
Include chrf as a metric
2018-05-18 16:18:19 +02:00
Prashant Mathur
8b59644945
Adding chrf scorers
2018-05-18 16:16:22 +02:00
Tomas Fulajtar
3a2a63b9dc
* Added missing step for the "TRAINING:build-generation-custom".
...
* Fixed the $cmd parameter - should be "-corpus" instead of "-generation-corpus".
2018-05-18 14:18:11 +02:00
Hieu Hoang
999e83d128
Merge pull request #196 from astronautguo/master
...
fix bug when copying to cache
2018-05-04 14:42:35 +01:00
Kenneth Heafield
ae47469919
Don't drop last character if file does not end with newline
2018-05-03 10:28:11 +01:00
astro
f47e670f20
fix bug when copying to cache
2018-04-27 19:52:20 -04:00
Hieu Hoang
5a7c31e5d1
Merge pull request #195 from moses-smt/alvations-python-tokenizer
...
Contributing MosesTokenizer from NLTK to Moses
2018-04-11 16:47:39 +01:00
alvations
686034488a
Contributing MosesTokenizer from NLTK to Moses
2018-04-11 00:27:37 +08:00
Hieu Hoang
ae7aa6a9d2
Merge pull request #192 from yvesscherrer/master
...
fix symlink path in Jamroot when using --prefix
2018-02-20 12:18:24 +00:00
Scherrer Yves
d1aaf52289
Merge remote-tracking branch 'upstream/master'
2018-02-20 13:29:51 +02:00
Scherrer Yves
cc6d6a14a2
fix symlink path in Jamroot when using --prefix
2018-02-20 12:09:32 +02:00
Hieu Hoang
b1ccbe92f9
Merge pull request #191 from yvesscherrer/master
...
add fi/sv-specific colon handling in tokenizer.perl
2018-02-16 12:54:20 +00:00
Scherrer Yves
4a7f16b366
add fi/sv-specific colon handling in tokenizer.perl
2018-02-14 10:27:46 +02:00
Hieu Hoang
5be48ce9db
Merge pull request #190 from moses-smt/patch-detokenizer-ko
...
Korean sentences have spaces =)
2018-01-19 10:54:50 +00:00
alvations
194964c017
Korean words has spaces =)
2018-01-19 13:29:53 +08:00
Hieu Hoang
3a0631a05b
better default
2017-12-12 15:30:56 +00:00
Hieu Hoang
79f021e29b
Merge pull request #187 from tofula/master
...
filter-model-given input.pl - update for OnDiskPT and ProbingPT
2017-12-11 23:44:09 +00:00
Tomas Fulajtar
5b9a6da9a4
The .gz extension should be also added for 'On Disk' and 'Probing' Phrase tables.
2017-11-28 10:29:58 +01:00
Rico Sennrich
7e9108dd29
multi-bleu-detok.perl - a plain text alternative to mteval-v13a.perl
2017-10-20 10:08:22 +01:00
Hieu Hoang
05a37d218e
wording change
2017-10-19 23:31:56 +01:00
Kenneth Heafield
545eee7e75
Attempt to stop people from publishing non-comparable BLEU scores, as discussed in statmt meeting
2017-10-19 22:57:36 +01:00
hieu
eced95d694
Revert "use std::unordered_set instead of boost::unordered_set. Segfault on boost 1.65.1"
...
This reverts commit d3c2c0bda5
2017-09-26 12:54:09 +01:00
hieu
c276ffbe01
Revert "use std::unordered_set instead of boost::unordered_set for all instances in moses2. To avoid confusion"
...
This reverts commit 65c75ff073
2017-09-26 12:53:49 +01:00
Hieu Hoang
65c75ff073
use std::unordered_set instead of boost::unordered_set for all instances in moses2. To avoid confusion
2017-09-26 10:54:39 +01:00
Hieu Hoang
d3c2c0bda5
use std::unordered_set instead of boost::unordered_set. Segfault on boost 1.65.1
2017-09-26 10:43:17 +01:00
Hieu Hoang
cc15f070dd
eclipse for CreateProbingPt
2017-09-26 10:31:31 +01:00
Hieu Hoang
a551c965ba
eclipse
2017-09-26 10:27:45 +01:00
Hieu Hoang
0838c831d8
bump
2017-09-02 02:29:52 +01:00
Hieu Hoang
df87045493
don't create shared boost libraries. Unit test can't link to them without setting other env variables
2017-08-26 10:26:50 +01:00
