Commit Graph

495 Commits

Author SHA1 Message Date
phkoehn
4e57c9c4e4 added pruning for partial translation option lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@580 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:36:21 +00:00
phkoehn
b403c8c784 code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@579 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:35:13 +00:00
phkoehn
099ed1b113 added pruning of partial translation option lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@578 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:33:31 +00:00
phkoehn
dfadc16043 added parameter that limits the number of partial translation options per span
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@577 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:32:33 +00:00
phkoehn
adef9d0f25 added global feature that limits number of partial translations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@576 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:31:25 +00:00
phkoehn
e9176b97e1 added check for LM scoring, if factors are not present
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@575 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:29:54 +00:00
redpony
032178eda2 comments
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@574 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 21:21:46 +00:00
redpony
523527fa17 get rid of profiling
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@573 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 20:16:06 +00:00
redpony
db5a6bd11e fix bug that prevents | and _ from being tokenized properly.
fix bug in --parallel


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@572 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 20:13:57 +00:00
phkoehn
96b889d35b added constant for partial translation option pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@571 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 19:54:54 +00:00
phkoehn
8305539a50 removed redundant line (code cleanup)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@570 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 19:53:57 +00:00
bojar
81ddb0e4f9 added train-factored... to releases, added dependency on our copy of phrase-extract
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@569 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 19:22:53 +00:00
bojar
303f411387 simplified Makefile, removed duplicit implementation of tokenize()
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@568 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 19:04:59 +00:00
phkoehn
b83fc72dd2 initial version of phrase-extract and phrase-score used by training script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@567 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:54:28 +00:00
redpony
7f8914c6d5 fix to allow new hypothesis debugging format
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@566 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:50:28 +00:00
redpony
56d9fcc7a2 fix hypothesis debug output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@565 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:49:28 +00:00
redpony
d4128a7f8c N_BEST cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f delete nbest config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1 delete n-best config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:16:01 +00:00
redpony
233c610cd8 get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:49:07 +00:00
redpony
9570f74181 test
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@560 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:47:46 +00:00
redpony
4a871d944f gcc 4.1 compilation error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@559 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 16:13:52 +00:00
zens
817b666d42 make some functions protected (instead of public)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@558 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 16:04:31 +00:00
redpony
e9fd44ef13 check in regression tests to CVS
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@557 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 15:54:30 +00:00
bojar
264f045a6b fixing ensure_absolute
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@556 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 03:41:50 +00:00
bojar
0541ce3689 just cleanup of variable initialization
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@555 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 01:54:50 +00:00
bojar
5290653a4d Added reduce_combine to release
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@554 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 01:26:08 +00:00
hieuhoang1972
f0dc2ffcf7 create data for chunking LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@553 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 00:19:40 +00:00
eherbst
384f8ccb07 adding sentence-by-sentence.pl: display all sentences in a corpus, system output vs. reference
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@552 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 00:09:40 +00:00
bojar
64ec2e5ca4 checking in multi-bleu.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@551 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:35 +00:00
redpony
f83c8abd66 add detailed logging of 1-best translation output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:32 +00:00
redpony
5d7a766aae enable optional logging of the details of the 1-best translation hypothesis, including dropped words, alignment, scores
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@549 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:43:48 +00:00
phkoehn
28764255a0 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@548 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:14:47 +00:00
bojar
ab5bb31797 allowing to override default paths
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@547 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:04:33 +00:00
phkoehn
d020dbae28 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@546 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:02:31 +00:00
phkoehn
9d36c5097e added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@545 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:49:55 +00:00
phkoehn
91c0f728cf added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@544 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:40:08 +00:00
phkoehn
fe01840f4b added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@543 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:22:31 +00:00
hieuhoang1972
ce408f05f4 bug in shallow parsing class
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@542 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:19:09 +00:00
bojar
26ce21f29b fixed unintended structure-sharing bug
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@541 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:17:02 +00:00
phkoehn
60ade3d041 changed documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@540 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:13:20 +00:00
phkoehn
1c3a397ec8 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@539 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 22:10:36 +00:00
bojar
a41a4e95d6 now expects 3 numbers on [generation-file] lines before the pathname
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@538 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:55:06 +00:00
ccorbett
92fdc3e9f1 infrastructure now supports multiple reordering models; this functionality cannot be read from the configuration file yet, that's upnext.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@537 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:43:09 +00:00
phkoehn
5c29431ff3 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@536 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:29:52 +00:00
zens
6cfe732bff - add some source files in Makefile.am
- bug fix: source / Manager get deleted in right order


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:18:13 +00:00
zens
8bf9742655 move CreateTranslationOptionCollection call into Manager
some code cleaning


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:29:35 +00:00
hieuhoang1972
33b3fc67e4 factored lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@533 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:21:05 +00:00
ccorbett
4a88275261 lexical reordering is now functional, Forward, Backward and Bidirectional
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@532 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:18:26 +00:00
phkoehn
0d10ce8433 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@531 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 17:55:31 +00:00