moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
569 Commits 136 Branches 26 Tags 147 MiB
8e4128beef
Commit Graph

104 Commits

Author SHA1 Message Date
redpony
8e4128beef add dropped word analysis, fix potential out of memory crash 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21 visual studio proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:21:27 +00:00
redpony
eff4b3447e FactorTypeSet->FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 22:41:26 +00:00
redpony
5a0787310b FactorTypeSet -> FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 20:42:34 +00:00
phkoehn
525a181f12 re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 04:20:06 +00:00
zens
b2041149f2 early pruning of path during confusion net exploration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@594 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-09 19:14:43 +00:00
redpony
d4128a7f8c N_BEST cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f delete nbest config 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1 delete n-best config 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:16:01 +00:00
redpony
233c610cd8 get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 17:49:07 +00:00
redpony
f83c8abd66 add detailed logging of 1-best translation output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 23:44:32 +00:00
zens
6cfe732bff - add some source files in Makefile.am 
- bug fix: source / Manager get deleted in right order


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 21:18:13 +00:00
zens
8bf9742655 move CreateTranslationOptionCollection call into Manager 
some code cleaning


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196 cvs headers 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf enable IRST LM in eclipse 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4 delete mysql support 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792 add code for printing out information about a translation (ie, distortion, dropped words, etc) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6 - print path statistics for CN and Text input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 15:46:58 +00:00
bojar
12f50a5f26 Added labelling of scores in nbestlist and fixed mert to understand that. 
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 04:45:48 +00:00
redpony
b84426d1af change message 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1 eclipse project file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d took out FactorType 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03 took out FactorType 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 20:02:39 +00:00
zens
ff15ed0732 - remove some obsolete code 
- optional future costs for distortion model


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18 memory pool cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97 using mem pool. needs to be more finely tweaked to give good results 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6 getting ready to use mempool for Phrase 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120 Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f make mysql code work with new scxoring collection 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 16:28:56 +00:00
zens
dd124448c1 - bug fix and further cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7 major score refactoring 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 01:11:45 +00:00
zens
dec0f5f703 print confusion net posterior in nbest list (if input is confusion net) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0 add score logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75 deleted Arc & LatticeEdge classes 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:11:20 +00:00
zens
0e6517b428 - fixing already fixed bugs that have been re-introduced by someone 
- moving some stuff from PhraseDictionaryTree to GenerateTuples
 - removing some obsolete code


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5 turned off profiling 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 03:18:18 +00:00
redpony
b48c33f1da use new score bookkeeping for nbest lists 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9 cvs ignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d cvs ignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 15:26:10 +00:00
redpony
14d342508e preparation for new ScoreComponentCollection, which will be much more efficient 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 13:47:43 +00:00
zens
4022ae95bc - print statistics for confusion nets 
- small bug fixes


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c perf profiling turned on in eclipse in debug conf 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 20:24:37 +00:00
redpony
b7b03f9ff2 rename function 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@302 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 14:29:45 +00:00
bojar
b0f7cb32cb Added -report-all-factors, so that stdout is more verbose. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@300 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 00:01:05 +00:00
phkoehn
f89ba84fdc reset sentence counter after reading phrases from input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@293 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 21:53:50 +00:00
hieuhoang1972
c99e2c1786 Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@289 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 21:41:04 +00:00
bojar
88f4bced55 reimplemented future score matrix calculation, should be faster. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@288 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 21:17:12 +00:00
ccorbett
ee3e1e1576 Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 15:52:09 +00:00