Commit Graph

11677 Commits

Author SHA1 Message Date
Ulrich Germann
9cda39f802 Major bug fix in setting ug_bitext::jstats.my_cnt2. 2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be Added phrase feature function for log counts. 2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3 TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values. 2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3 Added more phrase table features and configuration options to Mmsapt. 2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e Added some code to Word.cpp to allow factor-less decoding.
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Ulrich Germann
ce435d22bf Mmsapt now adds the phrase penalty only if num_features specified
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Ulrich Germann
d1e5a544f1 Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none). 2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Ulrich Germann
c452875343 Mmsapt/ug_bitext:
- Sampling now uses a static seed for consistency between runs.
- (In order to have consistency guarantees, specify workers=1 in the
- Mmsapt line in moses.ini; otherwise the randomness of thread scheduling may
  cause inconsistencies between runs.
- Denominator for fwd phrase probabilities can now be chosen via an
  external argument.
2014-05-31 14:29:44 +01:00
Ulrich Germann
0efea15dbe mira/MiraOptimizer.cpp: Fixed signed/unsigned integer mismatch in comparisons. 2014-05-31 14:26:43 +01:00
Ulrich Germann
339f9fb780 Commented out unused variables. 2014-05-31 14:25:43 +01:00
Ulrich Germann
0b6a0e42d6 scripts/generic/bsbleu.py: Bug fix. 2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument. 2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211 Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling. 2014-05-30 13:12:07 +01:00
Ulrich Germann
365a2ae95d Bug fix in scripts/server/sim-pe.py. 2014-05-19 23:58:54 +01:00
Ulrich Germann
59ddfdfaa0 Added server port number as a command line option to sim-pe.py.
This is important to allow running independent servers on the same machine.
Moses server (in moses.py) will not look for a free port any more if the
port specified is not available.
2014-05-19 21:41:32 +01:00
Ulrich Germann
380b2da2d0 Bug fix in and in connection with Mmsapt::combine_pstats(). 2014-05-19 21:34:58 +01:00
Ulrich Germann
9cda90afdf Major revision of m4m. May not be backwards-compatible. 2014-05-18 21:53:19 +01:00
Ulrich Germann
ff6a27b56e Tried to get merge-sorted to compile under bjam. Didn't work. 2014-05-18 21:49:22 +01:00
Ulrich Germann
a79ba985e9 Code refactoring of scripts/server/sim-pe.py. 2014-05-18 21:48:17 +01:00
Ulrich Germann
5c90a09d5a Initial check-in of moses.py 2014-05-18 21:45:42 +01:00
Ulrich Germann
b136e292af Put libraries in the right order for things to work. 2014-05-18 15:51:56 +01:00
Ulrich Germann
16b95c08ce Initial check-in. 2014-05-18 15:44:33 +01:00
Ulrich Germann
05e7de7f99 Fixed file path for ug_stream.h in merge-sorted.cc. 2014-05-18 15:44:04 +01:00
Ulrich Germann
ae4ab9aae0 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-04-29 15:50:39 +01:00
Hieu Hoang
4c74a5d638 bug in lattice decoding. Some arcs can span more than 1 node 2014-04-29 14:41:20 +01:00
Ulrich Germann
07d8b66366 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-04-29 11:01:46 +01:00
Hieu Hoang
6182750b70 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-28 14:29:49 +01:00
Hieu Hoang
9e33f37fb4 bug in lattice decoding. Some target phrase collection can have 0 size. Should execute OOV processing 2014-04-28 14:29:39 +01:00
Ulrich Germann
00aecc27d5 Merge branch 'dynamic-phrase-tables' 2014-04-28 10:46:04 +01:00
Ulrich Germann
3d4ab5a0d9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into dynamic-phrase-tables 2014-04-28 10:22:12 +01:00
Ulrich Germann
6c8a732fc0 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-04-28 10:01:51 +01:00
Ulrich Germann
7c145d045b Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	contrib/server/Jamfile
	contrib/server/mosesserver.cpp
2014-04-28 10:00:07 +01:00
Philipp Koehn
fa85d15e31 relative links to javascript sub directory in ems web interface 2014-04-23 16:56:10 -04:00
Ulrich Germann
e5b739946f Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-04-23 18:29:39 +01:00
Hieu Hoang
d7380d6d9e don't add label to m_targetLabelSet if no hypotheses. Assert error in parsing 2014-04-23 17:11:25 +01:00
Hieu Hoang
2c14b506b4 merge problem 2014-04-23 16:11:09 +01:00
Hieu Hoang
6a9eb6c848 minor leak showing for lex reordering. Just refactor 2014-04-23 15:12:27 +01:00
phikoehn
4ee4e07c1b minor ems fixes 2014-04-23 13:50:08 +01:00
Hieu Hoang
3f32e48f97 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-23 12:11:50 +01:00
Hieu Hoang
00505ba048 minor leak 2014-04-23 11:36:25 +01:00
Phil Williams
ff8ac92be1 moses_chart: oops, don't output more distinct translations than requested 2014-04-21 14:46:22 +01:00
Phil Williams
b308bd5657 moses_chart: enable ChartKBestExtractor. 2014-04-21 10:19:00 +01:00
Hieu Hoang
76a4609cff add script to creat pt with only certain scores 2014-04-20 23:30:09 +01:00
Phil Williams
568685cb66 ChartKBestExtractor: fix memory leak, clean-up code 2014-04-19 10:29:41 +01:00
Barry Haddow
00a2bd395a word alignment from server, thanks to Jyotesh Choudhari 2014-04-17 21:22:30 +01:00
Barry Haddow
7681cd4a15 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-17 20:50:27 +01:00
Hieu Hoang
e22b68e2fd roll back change in mosesserver. Doesn't work with xmlrpc-c v. 1.16.33 - ie very old lib on Ubuntu 12.04 2014-04-17 20:15:06 +01:00
Hieu Hoang
a4d32a2b09 minor compile errors in ChartKBestExtractor 2014-04-17 20:04:02 +01:00
Barry Haddow
b9c25afd45 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-17 19:02:57 +01:00