Ulrich Germann
9cda39f802
Major bug fix in setting ug_bitext::jstats.my_cnt2.
2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be
Added phrase feature function for log counts.
2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3
TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values.
2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3
Added more phrase table features and configuration options to Mmsapt.
2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e
Added some code to Word.cpp to allow factor-less decoding.
...
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Ulrich Germann
ce435d22bf
Mmsapt now adds the phrase penalty only if num_features specified
...
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Ulrich Germann
d1e5a544f1
Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none).
2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74
Eliminated factor delimiter from the parameters of
...
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Ulrich Germann
c452875343
Mmsapt/ug_bitext:
...
- Sampling now uses a static seed for consistency between runs.
- (In order to have consistency guarantees, specify workers=1 in the
- Mmsapt line in moses.ini; otherwise the randomness of thread scheduling may
cause inconsistencies between runs.
- Denominator for fwd phrase probabilities can now be chosen via an
external argument.
2014-05-31 14:29:44 +01:00
Ulrich Germann
0efea15dbe
mira/MiraOptimizer.cpp: Fixed signed/unsigned integer mismatch in comparisons.
2014-05-31 14:26:43 +01:00
Ulrich Germann
339f9fb780
Commented out unused variables.
2014-05-31 14:25:43 +01:00
Ulrich Germann
0b6a0e42d6
scripts/generic/bsbleu.py: Bug fix.
2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b
scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument.
2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211
Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling.
2014-05-30 13:12:07 +01:00
Ulrich Germann
365a2ae95d
Bug fix in scripts/server/sim-pe.py.
2014-05-19 23:58:54 +01:00
Ulrich Germann
59ddfdfaa0
Added server port number as a command line option to sim-pe.py.
...
This is important to allow running independent servers on the same machine.
Moses server (in moses.py) will not look for a free port any more if the
port specified is not available.
2014-05-19 21:41:32 +01:00
Ulrich Germann
380b2da2d0
Bug fix in and in connection with Mmsapt::combine_pstats().
2014-05-19 21:34:58 +01:00
Ulrich Germann
9cda90afdf
Major revision of m4m. May not be backwards-compatible.
2014-05-18 21:53:19 +01:00
Ulrich Germann
ff6a27b56e
Tried to get merge-sorted to compile under bjam. Didn't work.
2014-05-18 21:49:22 +01:00
Ulrich Germann
a79ba985e9
Code refactoring of scripts/server/sim-pe.py.
2014-05-18 21:48:17 +01:00
Ulrich Germann
5c90a09d5a
Initial check-in of moses.py
2014-05-18 21:45:42 +01:00
Ulrich Germann
b136e292af
Put libraries in the right order for things to work.
2014-05-18 15:51:56 +01:00
Ulrich Germann
16b95c08ce
Initial check-in.
2014-05-18 15:44:33 +01:00
Ulrich Germann
05e7de7f99
Fixed file path for ug_stream.h in merge-sorted.cc.
2014-05-18 15:44:04 +01:00
Ulrich Germann
ae4ab9aae0
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-04-29 15:50:39 +01:00
Hieu Hoang
4c74a5d638
bug in lattice decoding. Some arcs can span more than 1 node
2014-04-29 14:41:20 +01:00
Ulrich Germann
07d8b66366
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-04-29 11:01:46 +01:00
Hieu Hoang
6182750b70
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-04-28 14:29:49 +01:00
Hieu Hoang
9e33f37fb4
bug in lattice decoding. Some target phrase collection can have 0 size. Should execute OOV processing
2014-04-28 14:29:39 +01:00
Ulrich Germann
00aecc27d5
Merge branch 'dynamic-phrase-tables'
2014-04-28 10:46:04 +01:00
Ulrich Germann
3d4ab5a0d9
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into dynamic-phrase-tables
2014-04-28 10:22:12 +01:00
Ulrich Germann
6c8a732fc0
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-04-28 10:01:51 +01:00
Ulrich Germann
7c145d045b
Merge branch 'master' into dynamic-phrase-tables
...
Conflicts:
contrib/server/Jamfile
contrib/server/mosesserver.cpp
2014-04-28 10:00:07 +01:00
Philipp Koehn
fa85d15e31
relative links to javascript sub directory in ems web interface
2014-04-23 16:56:10 -04:00
Ulrich Germann
e5b739946f
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-04-23 18:29:39 +01:00
Hieu Hoang
d7380d6d9e
don't add label to m_targetLabelSet if no hypotheses. Assert error in parsing
2014-04-23 17:11:25 +01:00
Hieu Hoang
2c14b506b4
merge problem
2014-04-23 16:11:09 +01:00
Hieu Hoang
6a9eb6c848
minor leak showing for lex reordering. Just refactor
2014-04-23 15:12:27 +01:00
phikoehn
4ee4e07c1b
minor ems fixes
2014-04-23 13:50:08 +01:00
Hieu Hoang
3f32e48f97
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-04-23 12:11:50 +01:00
Hieu Hoang
00505ba048
minor leak
2014-04-23 11:36:25 +01:00
Phil Williams
ff8ac92be1
moses_chart: oops, don't output more distinct translations than requested
2014-04-21 14:46:22 +01:00
Phil Williams
b308bd5657
moses_chart: enable ChartKBestExtractor.
2014-04-21 10:19:00 +01:00
Hieu Hoang
76a4609cff
add script to creat pt with only certain scores
2014-04-20 23:30:09 +01:00
Phil Williams
568685cb66
ChartKBestExtractor: fix memory leak, clean-up code
2014-04-19 10:29:41 +01:00
Barry Haddow
00a2bd395a
word alignment from server, thanks to Jyotesh Choudhari
2014-04-17 21:22:30 +01:00
Barry Haddow
7681cd4a15
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-04-17 20:50:27 +01:00
Hieu Hoang
e22b68e2fd
roll back change in mosesserver. Doesn't work with xmlrpc-c v. 1.16.33 - ie very old lib on Ubuntu 12.04
2014-04-17 20:15:06 +01:00
Hieu Hoang
a4d32a2b09
minor compile errors in ChartKBestExtractor
2014-04-17 20:04:02 +01:00
Barry Haddow
b9c25afd45
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-04-17 19:02:57 +01:00