Commit Graph

446 Commits

Author SHA1 Message Date
phkoehn
0d10ce8433 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@531 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 17:55:31 +00:00
eherbst
0d91864621 adding scripts to extract POSs from LOPAR output and to extract arbitrary sets of factors from a corpus
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@530 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 17:35:16 +00:00
eherbst
8420ecf516 added statistical testing, both to compare different outputs and to get a confidence measure for a single output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@529 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 17:22:39 +00:00
hieuhoang1972
ac34c07dc0 factored lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@528 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 14:21:07 +00:00
hieuhoang1972
d5b0cdb73a deleted Phrase default constructor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@527 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 14:08:46 +00:00
hieuhoang1972
f304d8ae29 factored lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@526 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 03:18:57 +00:00
hieuhoang1972
283c44a95a factored lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@525 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 02:48:16 +00:00
hieuhoang1972
ad5e23440b factored lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@524 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 02:01:59 +00:00
hieuhoang1972
557d7186da chunking lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@523 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 01:42:04 +00:00
hieuhoang1972
20efbe08ac parse tree filtering
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@522 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-06 04:52:15 +00:00
hieuhoang1972
4a41245196 cvs headers
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf enable IRST LM in eclipse
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 02:31:25 +00:00
hieuhoang1972
0d51cac0f9 rationalising LM constants
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@519 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 01:52:17 +00:00
hieuhoang1972
124b71dbfc rationalising LM constants
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@518 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 01:45:42 +00:00
hieuhoang1972
0488f48234 bug in IRST LM calling
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@517 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 01:36:56 +00:00
hieuhoang1972
7b023dfdb8 chunking lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@516 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 01:01:46 +00:00
hieuhoang1972
d0490f8836 got rid of billions of spurious warnings
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@515 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 01:00:43 +00:00
bojar
2d7cf749a6 Allowing scores in 'scientific' float format from moses.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@514 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 00:53:48 +00:00
hieuhoang1972
cd814426fc visual studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@513 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 00:50:27 +00:00
hieuhoang1972
4dc00ba5c9 chunking lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@512 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 00:36:37 +00:00
hieuhoang1972
f6d65fb38c chunking lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@511 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 00:28:38 +00:00
bojar
10a0e23801 checking in reduce_combine
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@510 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 00:11:57 +00:00
hieuhoang1972
548ab61d9c chunking lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@509 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 23:24:01 +00:00
mfederico
40301b1212 Changed include names of ngram.[ch] to n_gram.[ch] as they clash with Ngram.[ch] of SRI LM in Mac OX filesystem, which is case insensitive.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@508 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 22:38:50 +00:00
mfederico
c9396688ae Changed names of ngram.[ch] to n_gram.[ch] as they clash with Ngram.[ch] of SRI LM in Mac OX filesystem, which is case insensitive.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@507 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 22:38:16 +00:00
mfederico
c78ce9ced7 Changed names of ngram.[ch] to n_gram.[ch] as they clash with Ngram.[ch] of SRI LM in Mac OX filesystem, which is case insensitive.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@506 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 22:30:22 +00:00
bojar
a5c122dfc8 added mert to list of released files, make rules to release moses (personally or publicly)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@505 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 22:25:38 +00:00
phkoehn
8faed6af82 added documentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@504 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 21:58:18 +00:00
phkoehn
9abc1e8d15 added documentation compatible to Doxygen
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@503 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 21:55:39 +00:00
hieuhoang1972
286c79bc23 visual studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@502 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 21:55:18 +00:00
hieuhoang1972
64cf12a0b7 stupid visual studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@501 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 21:49:02 +00:00
hieuhoang1972
2092797167 added java utils in misc project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@500 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 21:02:48 +00:00
hieuhoang1972
0db0be9287 added java utils in misc project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@499 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:55:34 +00:00
hieuhoang1972
7dc7261bc3 added chunking language model
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@498 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:45:19 +00:00
hieuhoang1972
21e44ec6c4 delete mysql support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792 add code for printing out information about a translation (ie, distortion, dropped words, etc)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6 - print path statistics for CN and Text input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:46:58 +00:00
hieuhoang1972
82a0b5c4bf visual studio project for misc
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@494 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:13:57 +00:00
hieuhoang1972
95ad2a1609 comment out phrase dictionary filtering
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@493 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:08:06 +00:00
bojar
12f50a5f26 Added labelling of scores in nbestlist and fixed mert to understand that.
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 04:45:48 +00:00
redpony
7d0e0f5698 fix
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@491 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 21:10:18 +00:00
redpony
7b11b66b6d enable --parallel in tfpm.perl
add a script to build a generation table from a monolingual corpus.
add a script to post-process the german morpho tagger output


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@490 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 21:05:55 +00:00
bojar
18dac34fe2 checking in the current version of cmert we're using
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@489 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 20:00:00 +00:00
bojar
232727e0e4 removed the dependence on external lowercaser, lowercasing internally
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@488 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 18:07:10 +00:00
bojar
c2fdfae2c1 modifying Makefile and released-files so that clean-n-corpus is properly released
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@487 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 17:55:56 +00:00
bojar
4d49e12bc4 checking the latest version from /export/bin to cvs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@486 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 17:53:13 +00:00
ccorbett
4e09d09551 lexical reordering should be functional. baseline charts coming soon.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@485 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 17:21:16 +00:00
hieuhoang1972
37b1123b19 fallback to another LM if what we have isn't compiled into lib
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@484 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 16:18:13 +00:00
ccorbett
649150440e minor changes. regression tests passed.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@483 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 15:24:33 +00:00
hieuhoang1972
f0957d6fbe minor cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@482 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 14:57:32 +00:00