moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
207 Commits 136 Branches 26 Tags 147 MiB
ee3e1e1576
Commit Graph

55 Commits

Author SHA1 Message Date
ccorbett
ee3e1e1576 Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 15:52:09 +00:00
redpony
c2be12bcd4 add irstlm support 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@273 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 14:42:49 +00:00
zens
a28dc42dd0 - fixed confusion net stuff (translations are identical, scores still different) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@270 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 14:08:21 +00:00
zens
162c8583c6 - TranslationOptionCollection... 
* moved generic functions to base class
   * todo: implement ProcessInitialTranslation and ProcessUnknownWord
           for confusion nets


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@269 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 13:35:42 +00:00
hieuhoang1972
dd8a983149 merged up of chaching algorithm. lot6s of changed made to manager.cpp, TranslationOptColl.cpp, amongst other. 
other code may be broken as a result


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@267 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 04:53:29 +00:00
zens
287d01fab1 - weight for confusion net scores 
- bug fix in ranking of target phrases for confusion nets
 - code cleanup


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@266 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-25 00:24:18 +00:00
bojar
2e83536ef1 Moses accepts -report-source-span 1 for a mose verbose output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@265 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-24 23:48:18 +00:00
bojar
90124bd403 (useless) optimization flag added 
+ reporting number od hypotheses


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@259 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-24 17:59:35 +00:00
zens
81a63989fa - do no read input phraes for confusion net input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@257 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 22:19:02 +00:00
zens
47edc0599d - removed some obsolete parts 
- avoided some code duplication
 - binary ttable is no longer a compiler switch:
   use binary ttable if exists, otherwise use standard ttable


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@253 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 22:03:03 +00:00
zens
98ef97e803 - translation of confusion nets integrated (works only with binary phrase table) 
- removed some obsolete stuff


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@250 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 21:09:23 +00:00
hieuhoang1972
a857773715 don't output if not surface factor 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@248 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 17:57:37 +00:00
zens
70682b48a1 - prepare I/O for Confusion Nets 
- remove some of the dynamic casting stuff


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@245 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 17:43:42 +00:00
zens
c220c86501 - binary phrase table now fully supported 
-> define preprocessor variable USEBINTTABLE
      e.g. uncommenting the line in StaticData.cpp
           or on the make  command line
 - some clean up


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@241 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 13:50:41 +00:00
zens
4c03fc1de8 - removed processPhraseTable stuff 
- explicit dependency on moses library
   -> automatically relink moses if libmoses.a changed


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@240 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 13:34:45 +00:00
zens
325353b0f4 - support for binary ttable in moses almost completed 
- moved common part of CreateTranslationOptionCollection() for text and confusion net input
   to base class


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@237 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-21 13:22:00 +00:00
eherbst
7a6600617e minor cleaning-up 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@196 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-19 22:05:52 +00:00
zens
648bd1dfcd - prepared confusion net input 
-> new base class InputType is used throughout the decoder
      instead of Sentence
      Sentence and ConfusionNet derive from this class
   -> Manager etc. do not know if the input is a sentence or a
      confusion net (but could check if REALLY needed)
 - two separate classes derived from TranslationOptionCollection:
   one for text input and one for confusion net input
 - score computation in PhraseDictionaryTree.cpp and some optimizations


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@183 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-19 00:16:29 +00:00
eherbst
7beabbd9ed adding source-word deletion (currently commented out) and unknown-word handling (also currently commented out) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@175 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-18 18:11:09 +00:00
hieuhoang1972
b6e9b01155 checking eclipse project files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@172 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-18 17:27:47 +00:00
alex_const
bcb49a09c6 fixed bug in hypothesis backtracking 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@151 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-17 15:05:00 +00:00
redpony
bf423cb0d3 temporary "fix" (break fewer people) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@149 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-17 14:31:34 +00:00
hieuhoang1972
d655816734 for miscellaneous scripts and programs stuff 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@136 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-15 03:19:07 +00:00
zens
27dc2bfb7a *** empty log message *** 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@131 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-15 00:13:27 +00:00
zens
34b6f1d349 prefix tree phrase table: 
- access to tree structure
  - tool for conversion
  - some code cleaning / reformatting


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@129 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 23:50:58 +00:00
hieuhoang1972
78e1a8830d commented out BackTrack 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@128 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 23:11:08 +00:00
hieuhoang1972
365460dff9 bug fixes & starting on translation option caching 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@125 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 22:21:54 +00:00
alex_const
2c0bfddfc2 Added hypothesis backtracking for the best hypothesis for verbose option 3. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@123 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 21:51:05 +00:00
hieuhoang1972
afd1e85498 bug fixes & starting on translation option caching 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@115 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 18:13:50 +00:00
redpony
a08575e264 fix makefile stuff for moses-cmd 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@114 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 16:19:29 +00:00
eherbst
1bd381c35c removing various junk I and a couple others CVSed accidentally 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@108 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 15:17:59 +00:00
eherbst
1ec33be9d6 modularized unknown-source-word handling (see UnknownWordHandler) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@107 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 14:36:51 +00:00
hieuhoang1972
edc5548cfe recommit config.in 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@103 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 14:01:52 +00:00
redpony
d7e5db0856 unify logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@102 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-14 13:31:06 +00:00
bojar
02a83cbc28 Never add a hypo with score worse than the worst in the (at least once pruned) stack, as it would get pruned anyway. 
Renamed Add(hypo, beamthreshold) to AddPrune(hypo)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@97 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-13 21:23:42 +00:00
bojar
572f3a2dbe --enable-profiling option for ./configure 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@90 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-13 17:59:27 +00:00
redpony
d3f951ea85 add logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@86 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-13 12:09:23 +00:00
hieuhoang1972
e338a6dbc0 variable number of score components for phrase trans 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@79 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 10:16:21 +00:00
hieuhoang1972
038ef552b0 ScoreComponentCollection to be map ! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@77 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 09:44:11 +00:00
hieuhoang1972
38e4001a75 ScoreComponentCollection o be set instead of map 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@72 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 06:51:28 +00:00
hieuhoang1972
3e0e05ecde rolled back variable number of translation component scores 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@69 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 06:38:12 +00:00
hieuhoang1972
563094e3f8 visual studio proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@64 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 01:37:33 +00:00
hieuhoang1972
abd7a65b26 visual studio proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@63 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 01:30:26 +00:00
hieuhoang1972
90b5dadfe0 visual studio proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@62 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-12 00:59:55 +00:00
hieuhoang1972
007dca2a99 ScoreType namespace 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@45 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-11 00:22:21 +00:00
hieuhoang1972
9d4778441d Debugging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@40 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-10 21:27:24 +00:00
redpony
37456ad0f4 allow static linking 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@38 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-10 20:52:20 +00:00
redpony
9278b06622 fixes for automake 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@35 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-10 19:54:11 +00:00
hieuhoang1972
79ec2cf2a8 Debugging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@27 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-09 23:56:40 +00:00
hieuhoang1972
822963842b variable number of translation component scores 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@24 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-09 21:37:49 +00:00