Commit Graph

96 Commits

Author SHA1 Message Date
hieuhoang1972
ebc4b6bfb1 delete n-best config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:16:01 +00:00
redpony
233c610cd8 get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:49:07 +00:00
redpony
f83c8abd66 add detailed logging of 1-best translation output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:32 +00:00
zens
6cfe732bff - add some source files in Makefile.am
- bug fix: source / Manager get deleted in right order


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:18:13 +00:00
zens
8bf9742655 move CreateTranslationOptionCollection call into Manager
some code cleaning


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196 cvs headers
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf enable IRST LM in eclipse
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4 delete mysql support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792 add code for printing out information about a translation (ie, distortion, dropped words, etc)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6 - print path statistics for CN and Text input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:46:58 +00:00
bojar
12f50a5f26 Added labelling of scores in nbestlist and fixed mert to understand that.
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 04:45:48 +00:00
redpony
b84426d1af change message
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1 eclipse project file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d took out FactorType
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03 took out FactorType
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:02:39 +00:00
zens
ff15ed0732 - remove some obsolete code
- optional future costs for distortion model


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18 memory pool cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97 using mem pool. needs to be more finely tweaked to give good results
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6 getting ready to use mempool for Phrase
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120 Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f make mysql code work with new scxoring collection
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 16:28:56 +00:00
zens
dd124448c1 - bug fix and further cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7 major score refactoring
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 01:11:45 +00:00
zens
dec0f5f703 print confusion net posterior in nbest list (if input is confusion net)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0 add score logging
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75 deleted Arc & LatticeEdge classes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:11:20 +00:00
zens
0e6517b428 - fixing already fixed bugs that have been re-introduced by someone
- moving some stuff from PhraseDictionaryTree to GenerateTuples
 - removing some obsolete code


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5 turned off profiling
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 03:18:18 +00:00
redpony
b48c33f1da use new score bookkeeping for nbest lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9 cvs ignore
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d cvs ignore
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 15:26:10 +00:00
redpony
14d342508e preparation for new ScoreComponentCollection, which will be much more efficient
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 13:47:43 +00:00
zens
4022ae95bc - print statistics for confusion nets
- small bug fixes


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c perf profiling turned on in eclipse in debug conf
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:24:37 +00:00
redpony
b7b03f9ff2 rename function
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@302 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 14:29:45 +00:00
bojar
b0f7cb32cb Added -report-all-factors, so that stdout is more verbose.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@300 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 00:01:05 +00:00
phkoehn
f89ba84fdc reset sentence counter after reading phrases from input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@293 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:53:50 +00:00
hieuhoang1972
c99e2c1786 Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@289 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:41:04 +00:00
bojar
88f4bced55 reimplemented future score matrix calculation, should be faster.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@288 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:17:12 +00:00
ccorbett
ee3e1e1576 Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 15:52:09 +00:00
redpony
c2be12bcd4 add irstlm support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@273 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:42:49 +00:00
zens
a28dc42dd0 - fixed confusion net stuff (translations are identical, scores still different)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@270 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:08:21 +00:00
zens
162c8583c6 - TranslationOptionCollection...
* moved generic functions to base class
   * todo: implement ProcessInitialTranslation and ProcessUnknownWord
           for confusion nets


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@269 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 13:35:42 +00:00
hieuhoang1972
dd8a983149 merged up of chaching algorithm. lot6s of changed made to manager.cpp, TranslationOptColl.cpp, amongst other.
other code may be broken as a result


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@267 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 04:53:29 +00:00
zens
287d01fab1 - weight for confusion net scores
- bug fix in ranking of target phrases for confusion nets
 - code cleanup


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@266 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 00:24:18 +00:00
bojar
2e83536ef1 Moses accepts -report-source-span 1 for a mose verbose output.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@265 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-24 23:48:18 +00:00
bojar
90124bd403 (useless) optimization flag added
+ reporting number od hypotheses


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@259 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-24 17:59:35 +00:00
zens
81a63989fa - do no read input phraes for confusion net input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@257 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 22:19:02 +00:00