moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 14:05:29 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,821 Commits 136 Branches 26 Tags 147 MiB
bb2431331c
Commit Graph

266 Commits

Author SHA1 Message Date
bhaddow
bb2431331c Fix to consensus decoding to stop it discarding hypos with zero score. 
Move hypothesis id management into Manager to make it thread-safe.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-14 09:33:03 +00:00
hieuhoang1972
f36759478b don't spew out param list if there's a genuine error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089 m_detailedTranslationReportingStream=NULL if not outputting trans opt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310 Add consensus decoding to mosesmt. Really need to get the mainlines merged! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 14:55:59 +00:00
phkoehn
f52a2cc55d code cleanup & enable trace ("-t") for MBR decoding ("-mbr") 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-10 21:18:47 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-08 15:51:59 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used 
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-05 16:53:41 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-26 13:38:56 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available). 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-23 15:01:06 +00:00
hieuhoang1972
45ecd333f9 delete std namespace in .h files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3116 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-12 10:04:35 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63 Implementation of consensus decoding - first cut. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-07 15:47:58 +00:00
hieuhoang1972
202bcf2911 eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 20:03:54 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised 
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 17:52:51 +00:00
bhaddow
22b74b56f7 Output of nbest from lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-16 11:34:50 +00:00
abarun
86ef292af1 Writing out sentence number when printing all derivations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 08:28:16 +00:00
abarun
3434d15cda Lattice MBR pruning based on target length of MAP hypothesis 
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 07:57:48 +00:00
bhaddow
ef54ec3699 Fix mosesmt compile 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2942 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 13:30:40 +00:00
jfouet
242846f07c Use portable include guard instead of pragma once 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 11:15:44 +00:00
jfouet
087b2021c5 Link libmoses with boost-thread 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:34:00 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432 Fix lattice mbr grid search so that the full lattice is created and pruned correctly. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 23:42:35 +00:00
bhaddow
0e16a9c3c5 deubg to cerr not cout 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2928 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 19:20:28 +00:00
bhaddow
b2201e765d Grid search for lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 14:15:34 +00:00
bojar
cce14523ab added -report-all-factors-in-n-best 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 10:54:33 +00:00
bhaddow
11cb44ba5b Refactoring of lattice mbr code so that it can be used with mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2907 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 17:25:56 +00:00
bhaddow
7f45cd12f9 reduce memory usage in lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2906 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 14:14:44 +00:00
bhaddow
b3a8411ae1 Fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2901 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-15 19:27:17 +00:00
hieuhoang1972
6b1b505089 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2897 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-14 00:26:34 +00:00
abarun
6aff4f1afd Floor probability for unknown ngrams in Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2896 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 18:04:17 +00:00
abarun
0b04e54234 Only outputting surface form for LatticeMBR argmax 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2893 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 15:56:37 +00:00
bhaddow
2396f6d9e9 Fix moses mt compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2886 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-11 10:44:11 +00:00
abarun
4ac95fb82a Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46 Set appropriate verbose level for Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:30:07 +00:00
abarun
904a982e05 Fixed bug in nbest MBR - now outputting correct MBR solution 
Fixed bug in lattice MBR - now outputting correct MBR solution 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2853 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:04:05 +00:00
abarun
117f5ef329 Lattice MBR now uses nbest list as default hypothesis set during reranking. 
To use lattice instead as hypothesis set, run with -lattice-hypo-set option


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 11:20:20 +00:00
abarun
6d7a710beb Added LatticeMBR to moses-cmd/Makefile.am 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2842 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:30:35 +00:00
abarun
32a58a3ec9 Implemented Lattice MBR for Moses. 
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:23:32 +00:00
phkoehn
d606f541e4 die fast 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2784 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 17:44:28 +00:00
phkoehn
cccab3d22b extended search graph output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2717 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 15:32:04 +00:00
nicolabertoldi
558ff92c33 if the output file for nbest is /dev/stdout, the output of best translation is suppressed; this simulates the behavior of '-' shortcut 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2702 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 13:09:10 +00:00
chardmeier
a3e9af21c3 Commented out unused variable. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2698 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 12:11:09 +00:00
hieuhoang1972
42b69fe20f leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2649 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-09 18:53:14 +00:00
bhaddow
b8789dfd97 Fix MosesMT.cpp to work with new mbr interface 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2641 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-17 15:00:11 +00:00
nicolabertoldi
c30d135f93 enabling output of recovering path for MBR both in the best translation and in the nbest list 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2639 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 17:27:07 +00:00
nicolabertoldi
d17f9dfd8e enabling output of nbest with MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2637 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 14:24:14 +00:00
bhaddow
499bf77ebc output feature weights debug in mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2636 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-04 15:24:22 +00:00
bhaddow
c7dea2e497 make sure it builds on platforms without pthreads 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2618 1f5c12ca-751b-0410-a591-d2e778427230
 2009-11-13 10:13:55 +00:00
hieuhoang1972
a042aad7f2 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
 2009-10-02 09:54:10 +00:00