moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 23:12:41 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,475 Commits 136 Branches 26 Tags 147 MiB
3f678fa689
Commit Graph

510 Commits

Author SHA1 Message Date
bhaddow
5b7c5ebdb5 Merge branch 'master' into miramerge 
Conflicts:
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/Main.cpp
	moses/src/DummyScoreProducers.cpp
	moses/src/DummyScoreProducers.h
	moses/src/GenerationDictionary.cpp
	moses/src/GenerationDictionary.h
	moses/src/GlobalLexicalModel.h
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelImplementation.h
	moses/src/LanguageModelKen.h
	moses/src/LanguageModelMultiFactor.cpp
	moses/src/LanguageModelMultiFactor.h
	moses/src/LanguageModelSingleFactor.cpp
	moses/src/LanguageModelSingleFactor.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionary.cpp
	moses/src/PhraseDictionary.h
	moses/src/ScoreIndexManager.cpp
	moses/src/ScoreProducer.h
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TranslationSystem.cpp
 2011-09-20 11:23:38 +01:00
arianna_b
633b80f515 recovered missing blank in n-best-list output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4170 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-02 11:40:32 +00:00
nicolabertoldi
75edc2eddd change to print the corrett name of the features with InputScores 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4168 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-30 12:25:50 +00:00
hieuhoang1972
5449839d75 option to sort word alignment info, as suggested by arianna bisazza 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4164 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-26 02:37:52 +00:00
bhaddow
1f3c11b441 Merge branch 'master' into miramerge 
Passes all regression except for the score tests, as I still have to merge
in the missing files for these tests.

Conflicts:
	.gitignore
	Makefile.am
	configure.in
	moses-chart/moses-chart.xcodeproj/project.pbxproj
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTrellisPath.cpp
	moses/src/DotChart.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelFactory.cpp
	moses/src/LanguageModelRemote.h
	moses/src/LexicalReordering.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/Parameter.cpp
	moses/src/RuleCubeQueue.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
	moses/src/TranslationOptionCollection.cpp
 2011-08-22 14:52:02 +01:00
bhaddow
de26a207d6 Merge commit '67dd80fb7bf71f36f2b29b4ba7a39e3ad35e5f81' into miramerge 
Conflicts:
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses-cmd/src/TranslationAnalysis.cpp
 2011-08-19 14:55:32 +01:00
bhaddow
cf81f9188f Merged up to 3895 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3934 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
pkoehn
42e10d010b added reporting of sparse features in n-best list 
git-svn-id: http://svn.statmt.org/repository/mira@3926 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
hieuhoang1972
b0ec298ce2 vs.net build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4088 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-23 23:52:34 +00:00
hieuhoang1972
9c0d725cde visual studio 2010 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-19 03:07:15 +00:00
naditomeh
83d02c11c6 Fix a segmentation fault produced when both 'constraint' and 
'translation-details' are used, and no hypothesis that matches the
reference translation is found.
The problem resulted from a missing check if a vector is empty before
incrementing its iterator.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3950 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-17 19:46:46 +00:00
phkoehn
4ee7e5f673 added some comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3911 1f5c12ca-751b-0410-a591-d2e778427230
 2011-03-02 19:02:07 +00:00
pjwilliams
75709a6c87 Memory efficiency: make the reserveSize argument non-optional in 
Moses::Phrase's constructor.  The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases.  Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR 
otherwise.  If you know the code involved, it's probably worth reviewing.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-28 11:41:08 +00:00
hieuhoang1972
67dd80fb7b run beautify.perl. Consistent formatting for .h & .cpp files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3897 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-24 12:39:29 +00:00
phkoehn
4c11bcd617 extensions to phrase table scoring options 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3893 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-23 10:27:54 +00:00
bhaddow
6b8415bffb Write alignment info through OutputCollector so it gets ordered 
correctly when run with multiple threads.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3882 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-16 16:50:55 +00:00
ales-t
83e2406f42 Word alignment output also works with MBR decoding. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3875 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-08 17:15:50 +00:00
bojar
0bc0ece594 Ales Tamchyna's printing of alignments (-print-alignment-info did nothing) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3867 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-03 09:08:42 +00:00
pjwilliams
8051c5ad35 Use TranslationTask objects to perform sentence decoding in moses-chart. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3846 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-25 17:15:30 +00:00
pjwilliams
99bbfe938b Use OutputCollector to write moses-chart output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3843 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-25 15:17:17 +00:00
bhaddow
a2bde7a16e Make sure internal libraries and paths go before boost. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-11 19:32:59 +00:00
bhaddow
a2730c445d Merge up to 3791 from trunk. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-05 13:49:44 +00:00
hieuhoang1972
41c5b3a1c2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3769 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-10 13:04:06 +00:00
bhaddow
50f0e6c07d Add a show-weights option. It prints out the moses features and exits. May 
load tables as a side-effect.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3744 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-29 16:44:28 +00:00
xandfraser
c0c617a8c4 Added print word alignment in nbest 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3726 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-22 15:34:53 +00:00
hieuhoang1972
735d5b682f xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3673 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-27 18:54:50 +00:00
hieuhoang1972
34e7c43114 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3664 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-27 03:14:11 +00:00
hieuhoang1972
5f6baa9021 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3627 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-18 05:47:07 +00:00
bhaddow
7e72ceea22 Goodbye ScoreIndexManager. 
Compiles ok, but haven't dared to run regression yet.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-06 22:06:49 +00:00
hieuhoang1972
e504b797b2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 22:29:01 +00:00
hieuhoang1972
bdfa2beab8 delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:16:50 +00:00
redpony
570183461c plf checker 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3407 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-16 01:03:39 +00:00
bhaddow
904133fcb7 Merge in the multiple models branch. These changes allow the moses server 
to support multiple translation, language and generation models within the
same process. The main design change is the introduction of a TranslationSystem
object to manage the models, which have been moved out of StaticData.
The changes should have no effect on existing systems.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3394 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-10 13:12:00 +00:00
hieuhoang1972
31930eb6fc alignment info in pt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3358 1f5c12ca-751b-0410-a591-d2e778427230
 2010-07-17 22:29:06 +00:00
hieuhoang1972
65194ba505 drop unknown option for chart decoding, xcode, minor adjustments to regression test formatting 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3312 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-09 12:56:31 +00:00
hieuhoang1972
c9eb463fe6 vs.net 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-05 13:10:26 +00:00
bhaddow
649bf24f62 One moses main 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3274 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-27 08:37:25 +00:00
bhaddow
f58f8397f4 Correct bug in use of scale factor 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3268 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-25 08:55:13 +00:00
bhaddow
c9baabe2ea Merging of moses mains. mosesmt now does single and multi-threeaded 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3264 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-19 16:42:18 +00:00
dowobeha
9fec69ce31 Merged fix (r3001-3260) for problem where multi-threaded moses would fail during linking if boost was compiled for 64 bit. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3261 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-17 01:41:58 +00:00
bhaddow
bb2431331c Fix to consensus decoding to stop it discarding hypos with zero score. 
Move hypothesis id management into Manager to make it thread-safe.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-14 09:33:03 +00:00
hieuhoang1972
f36759478b don't spew out param list if there's a genuine error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089 m_detailedTranslationReportingStream=NULL if not outputting trans opt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310 Add consensus decoding to mosesmt. Really need to get the mainlines merged! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 14:55:59 +00:00
phkoehn
f52a2cc55d code cleanup & enable trace ("-t") for MBR decoding ("-mbr") 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-10 21:18:47 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-08 15:51:59 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used 
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-05 16:53:41 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-26 13:38:56 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available). 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-23 15:01:06 +00:00
hieuhoang1972
45ecd333f9 delete std namespace in .h files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3116 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-12 10:04:35 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63 Implementation of consensus decoding - first cut. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-07 15:47:58 +00:00
hieuhoang1972
202bcf2911 eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 20:03:54 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised 
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 17:52:51 +00:00
bhaddow
22b74b56f7 Output of nbest from lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-16 11:34:50 +00:00
abarun
86ef292af1 Writing out sentence number when printing all derivations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 08:28:16 +00:00
abarun
3434d15cda Lattice MBR pruning based on target length of MAP hypothesis 
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 07:57:48 +00:00
bhaddow
ef54ec3699 Fix mosesmt compile 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2942 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 13:30:40 +00:00
jfouet
242846f07c Use portable include guard instead of pragma once 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 11:15:44 +00:00
jfouet
087b2021c5 Link libmoses with boost-thread 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:34:00 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432 Fix lattice mbr grid search so that the full lattice is created and pruned correctly. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 23:42:35 +00:00
bhaddow
0e16a9c3c5 deubg to cerr not cout 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2928 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 19:20:28 +00:00
bhaddow
b2201e765d Grid search for lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 14:15:34 +00:00
bojar
cce14523ab added -report-all-factors-in-n-best 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 10:54:33 +00:00
bhaddow
11cb44ba5b Refactoring of lattice mbr code so that it can be used with mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2907 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 17:25:56 +00:00
bhaddow
7f45cd12f9 reduce memory usage in lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2906 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 14:14:44 +00:00
bhaddow
b3a8411ae1 Fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2901 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-15 19:27:17 +00:00
hieuhoang1972
6b1b505089 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2897 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-14 00:26:34 +00:00
abarun
6aff4f1afd Floor probability for unknown ngrams in Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2896 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 18:04:17 +00:00
abarun
0b04e54234 Only outputting surface form for LatticeMBR argmax 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2893 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 15:56:37 +00:00
bhaddow
2396f6d9e9 Fix moses mt compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2886 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-11 10:44:11 +00:00
abarun
4ac95fb82a Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46 Set appropriate verbose level for Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:30:07 +00:00
abarun
904a982e05 Fixed bug in nbest MBR - now outputting correct MBR solution 
Fixed bug in lattice MBR - now outputting correct MBR solution 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2853 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:04:05 +00:00
abarun
117f5ef329 Lattice MBR now uses nbest list as default hypothesis set during reranking. 
To use lattice instead as hypothesis set, run with -lattice-hypo-set option


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 11:20:20 +00:00
abarun
6d7a710beb Added LatticeMBR to moses-cmd/Makefile.am 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2842 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:30:35 +00:00
abarun
32a58a3ec9 Implemented Lattice MBR for Moses. 
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:23:32 +00:00
phkoehn
d606f541e4 die fast 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2784 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 17:44:28 +00:00
phkoehn
cccab3d22b extended search graph output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2717 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 15:32:04 +00:00
nicolabertoldi
558ff92c33 if the output file for nbest is /dev/stdout, the output of best translation is suppressed; this simulates the behavior of '-' shortcut 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2702 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 13:09:10 +00:00
chardmeier
a3e9af21c3 Commented out unused variable. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2698 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 12:11:09 +00:00
hieuhoang1972
42b69fe20f leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2649 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-09 18:53:14 +00:00
bhaddow
b8789dfd97 Fix MosesMT.cpp to work with new mbr interface 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2641 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-17 15:00:11 +00:00
nicolabertoldi
c30d135f93 enabling output of recovering path for MBR both in the best translation and in the nbest list 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2639 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 17:27:07 +00:00
nicolabertoldi
d17f9dfd8e enabling output of nbest with MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2637 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 14:24:14 +00:00
bhaddow
499bf77ebc output feature weights debug in mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2636 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-04 15:24:22 +00:00
bhaddow
c7dea2e497 make sure it builds on platforms without pthreads 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2618 1f5c12ca-751b-0410-a591-d2e778427230
 2009-11-13 10:13:55 +00:00
hieuhoang1972
a042aad7f2 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
 2009-10-02 09:54:10 +00:00
bhaddow
beaf123b5f Output of nbest from multi-threaded moses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2535 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-31 12:55:33 +00:00
bhaddow
c5d39f039f Merge moses-server branch (includes mt moses) into trunk. 
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-07 16:47:54 +00:00
hieuhoang1972
7d17d823ae xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2351 1f5c12ca-751b-0410-a591-d2e778427230
 2009-05-31 15:56:45 +00:00
phkoehn
8833098925 generalized n-best list reporting for feature functions, added experimental version of global lexical model 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2343 1f5c12ca-751b-0410-a591-d2e778427230
 2009-05-26 19:30:35 +00:00
abarun
3cc8305efa Modified xcode project to make it work with both sri and irst lms 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1955 1f5c12ca-751b-0410-a591-d2e778427230
 2008-12-11 19:27:59 +00:00
hieuhoang1972
69b2dc441d eclipse files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
 2008-12-10 14:20:10 +00:00
hieuhoang1972
789d6d96d1 intergrate randlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
 2008-11-04 18:03:03 +00:00
hieuhoang1972
c59b532df1 eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-31 18:44:44 +00:00
hieuhoang1972
8d6d739a6a eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1925 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-30 19:44:54 +00:00
hieuhoang1972
6a61ffa9bd unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1899 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-10 18:30:51 +00:00
hieuhoang1972
868428fe66 unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1898 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-09 00:20:39 +00:00
hieuhoang1972
928d771085 create namespace 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1897 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-08 23:51:26 +00:00
redpony
232dc9889c enable moses to accept a file that lists feature name and weight pairs. 
enable moses to export its search graph as a phrase lattice encoded serialized in a Google protocol buffer. This requires protoc (http://code.google.com/p/protobuf/) to function, disabled by default.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1890 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-24 16:48:23 +00:00
nicolabertoldi
dd6c36640b Support for printing out word-to-word alignments (besides phrase-to-phrase alignments) 
as contained in the phrase table.
If PT contains word-to-word alignments between source and target phrases,
Moses can optionally output them in the nbest and in the log file (if verbose).
W2w alignments from source to target and from target to source can differ,
if they differ in the PT.

Detailed documentation will be added in the Moses webpages very soon.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1886 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-12 18:09:06 +00:00
hieuhoang1972
5dee5d04aa rename IOStream to IOWrapper. 
move vs.net solution file to root folder

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
 2008-08-05 00:24:45 +00:00
hieuhoang1972
47e4803f97 move cube pruning moses lib to trunk 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1849 1f5c12ca-751b-0410-a591-d2e778427230
 2008-06-11 13:22:26 +00:00
hieuhoang1972
1792e14945 eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1810 1f5c12ca-751b-0410-a591-d2e778427230
 2008-06-02 21:23:33 +00:00
hieuhoang1972
9997b7fd7e alignment output fix 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1604 1f5c12ca-751b-0410-a591-d2e778427230
 2008-05-04 13:13:12 +00:00
hieuhoang1972
3fc0b8ddb4 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1603 1f5c12ca-751b-0410-a591-d2e778427230 2008-05-04 12:52:52 +00:00
hieuhoang1972
24a5a24c8b changed eclipse project for irstlm changes 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1595 1f5c12ca-751b-0410-a591-d2e778427230
 2008-04-15 14:22:42 +00:00
nicolabertoldi
43ae535165 added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
 2008-04-02 17:08:54 +00:00
phkoehn
4ee468dc03 output search graph 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1588 1f5c12ca-751b-0410-a591-d2e778427230
 2008-03-17 21:34:19 +00:00
hieuhoang1972
2d95df359e code clean - move creating wordgraph file to iostream class 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1581 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-29 23:08:58 +00:00
hieuhoang1972
e2f4d64608 output wordgraph for german 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1574 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-27 13:31:37 +00:00
hieuhoang1972
4964c45489 output wordgraph for german 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1573 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-27 12:43:04 +00:00
hieuhoang1972
76606d3823 minor - 
add svn properties for XmlOption.
make vs & eclipse build use return, rather than exit, when closing down

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1555 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-09 17:08:09 +00:00
hieuhoang1972
fd60fe93b9 roll back last change. seg fault in release build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1549 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-29 19:28:13 +00:00
phkoehn
0faf1a83c0 bug fix for distinct n-best list generation, resolved memory blowup issue 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1542 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-18 19:00:07 +00:00
phkoehn
1044b16522 bug fixes to distinct n-best list, mbr decoding; also changed switches for mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1540 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-16 20:25:01 +00:00
abarun
aa6f605a2d Updated xcode project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1518 1f5c12ca-751b-0410-a591-d2e778427230
 2007-11-26 15:32:05 +00:00
hieuhoang1972
dee505b823 don't use hypo pool until delayed destructor is sorted out 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1513 1f5c12ca-751b-0410-a591-d2e778427230
 2007-11-16 00:09:21 +00:00
redpony
7dbcef925d Implemented -r (-recover-input-path) to recover the actual path through the CN/word lattice that was used in the best translation. Also cleaned up handling of source Phrases in the context of a particular hypothesis, which may improve performance translating with lexicalized reordering models. 
Removed PhraseReference since the concept was broken for CN/lattice inputs.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1468 1f5c12ca-751b-0410-a591-d2e778427230
 2007-09-28 16:43:33 +00:00
jdschroeder
6eaf3db0f5 updated xcode projects to include new source files. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1457 1f5c12ca-751b-0410-a591-d2e778427230
 2007-09-05 10:46:18 +00:00
hieuhoang1972
4a2982cd34 build with SRILM in windows under different configuration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
 2007-07-17 20:45:51 +00:00
jdschroeder
0bfb92cfe1 Deleted old xcode files. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 13:49:52 +00:00
hieuhoang1972
9aac5e70de update eclipse project file for irstlm change 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 09:03:00 +00:00
hieuhoang1972
8525279d7d rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e code tidy up 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7 Code for MBR decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c visual studio compile errors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 21:37:25 +00:00
abarun
5c0f6d0415 Code for MBR decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1383 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 20:54:39 +00:00
hieuhoang1972
d2ebe33f9e visual studio project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1364 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-18 18:10:24 +00:00
redpony
c80d8b8d47 Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-18 14:08:46 +00:00
hieuhoang1972
cd697c28ae re-introduce konrad lexicalized reordering but fix bugs with help from philipp. 
speed improvements by caching probabilities in Trans Opt

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1338 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-06 00:24:25 +00:00
hieuhoang1972
8566962ecc output empty line even if no best hypothesis found 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1305 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-14 19:47:51 +00:00
hieuhoang1972
075681d6fc visual studio proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1267 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-04 09:01:50 +00:00
hieuhoang1972
5f22fb13d3 make output of decimal places consistent by not format anywhere but in Main.cpp 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1266 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-04 00:43:45 +00:00
hieuhoang1972
2c9f1a13fe make output of decimal places consistent by not format anywhere but in Main.cpp 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1265 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-04 00:17:54 +00:00
phkoehn
f1d2bd0eb5 added option -include-alignment-in-n-best to include the word alignment for each sentence in the n-best list file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1246 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-26 20:59:41 +00:00
hieuhoang1972
62b4741de0 move calling InitializeBeforeSentenceProcessing() & CleanUpAfterSentenceProcessing() in Manager class 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1241 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-24 20:32:32 +00:00
hieuhoang1972
bef38f4006 code cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1234 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-23 00:00:09 +00:00
hieuhoang1972
c58393a4b4 verbose=0 nothing goes to stderr except for real, aborting errors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1232 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-22 23:44:38 +00:00
hieuhoang1972
7ecb0ce66e change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1227 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-21 19:48:53 +00:00
hieuhoang1972
f3cbacba3e code cleanup - make FactorCollection and StaticData totally accessible only globally 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1218 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-16 18:08:37 +00:00
hieuhoang1972
e247f1da6f fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1209 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-13 19:15:34 +00:00
hieuhoang1972
6b4dfc4db2 added #def to use hypo pool 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1206 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-12 11:05:13 +00:00
hieuhoang1972
006e2724e0 take out irstlm on VS build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1195 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-09 17:36:07 +00:00
hieuhoang1972
9cf7257d27 don't skip empty lines 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1169 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-05 10:24:01 +00:00
hieuhoang1972
e7838339bb exit/return from main() 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1141 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 16:21:28 +00:00
nicolabertoldi
be039bf84a Reduced time to die!!! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1139 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 14:47:13 +00:00
hieuhoang1972
e1823a52ac prune arcList & LatticePathCollection (contenders for n-best paths) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f fixed mem leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-21 13:38:03 +00:00
redpony
0f3ee4b814 If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-08 14:46:48 +00:00
hieuhoang1972
dd721e1b4f Mac xcode proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e dismantle IODevoce framework 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 23:06:30 +00:00
hieuhoang1972
c49a2e31bf eclipse preferences. not sure if need to go into svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7 lots of small changes and code clean up: 
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241 Modified output of feature scores. 
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48 updated eclispe project file to work with calipso version 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949 statically zlib on WIN32 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac eclipse project file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80 added internal, x-platform LM which exactly mimics SRILM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f changes to make LMs work in Windows 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927 solved bug in n-best list creation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2 rename InputOutput to IODevice 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a visual studio project files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59 code cleanup and commenting brought about when documenting for jhu report 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4 xcode proj files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc taken boost out of eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90 delete zlib-win32 proj. library should be in default path 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e put back Visual Leak Detector for Win32 build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386 cleanup... renamed --report-source-word-span into --report-segmentation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c cleanup of verbose logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:03:27 +00:00
swadey
0ffbcca545 - Added necessary zlib-win32 implementation for winbloze 
- update project files for vc++ and fixed minor code issues

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9 make building moses/moses-cmd a single make command rather than two 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-23 15:18:53 +00:00
redpony
1700da00bf remove .cvsignore files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:39:02 +00:00
redpony
1022363f39 remove acsite 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:06:24 +00:00
redpony
fe74de6b44 Remove files that are autogenerated 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:50:36 +00:00
redpony
75796cb419 remove misleading file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:34:50 +00:00
redpony
6eaba82546 remove references to boost, fix formatting, fix make-release-tarball to work with svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:24:09 +00:00
redpony
2e8001f428 prepare for public releases 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 16:24:39 +00:00
redpony
cc97567b2b remove references to JHU fs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:26:27 +00:00
redpony
b116321fd9 remove references to Mysql 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:20:23 +00:00
redpony
3fb417f914 remove references to boost 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3 remove mysql dependency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85 eclipse proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:39:59 +00:00
mfederico
2a3037692b Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 18:31:16 +00:00
eherbst
54166381c9 *** empty log message *** 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881 fixed check for n_gram.h in irstlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:32:01 +00:00
redpony
da207d0016 add optional LM statistics reporting. enable with '-L true' on command line 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 22:44:01 +00:00
ccorbett
4e3631e1b0 IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 19:51:17 +00:00
hieuhoang1972
2a7179a8fa choice of not labelling n-best output for wade shen's mert script 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 19:08:39 +00:00
ccorbett
7019abf652 reordering scores are now implemented for n-best lists 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 18:11:52 +00:00
hieuhoang1972
dfe2e58187 output trans & gen scores in order they were created 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@687 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 03:03:18 +00:00
zens
61294d90ad - generate distinct nbest surface strings (if 3rd token of n-best-list is 'distinct') 
- some sanity checks


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@674 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-12 00:06:55 +00:00
eherbst
5cb683cd7e moved class InputType to InputType.h; 
added more detailed statistics-keeping to SentenceStats;
added custom malloc/realloc (see Util.h);
some commenting


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@666 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 21:04:38 +00:00
redpony
8e986774e1 print input line number in logs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@663 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 20:16:27 +00:00
redpony
8e4128beef add dropped word analysis, fix potential out of memory crash 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21 visual studio proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:21:27 +00:00
redpony
eff4b3447e FactorTypeSet->FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 22:41:26 +00:00
redpony
5a0787310b FactorTypeSet -> FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 20:42:34 +00:00
phkoehn
525a181f12 re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 04:20:06 +00:00
zens
b2041149f2 early pruning of path during confusion net exploration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@594 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-09 19:14:43 +00:00
redpony
d4128a7f8c N_BEST cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f delete nbest config 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1 delete n-best config 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 18:16:01 +00:00
redpony
233c610cd8 get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-08 17:49:07 +00:00
redpony
f83c8abd66 add detailed logging of 1-best translation output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 23:44:32 +00:00
zens
6cfe732bff - add some source files in Makefile.am 
- bug fix: source / Manager get deleted in right order


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 21:18:13 +00:00
zens
8bf9742655 move CreateTranslationOptionCollection call into Manager 
some code cleaning


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196 cvs headers 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf enable IRST LM in eclipse 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4 delete mysql support 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792 add code for printing out information about a translation (ie, distortion, dropped words, etc) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6 - print path statistics for CN and Text input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 15:46:58 +00:00
bojar
12f50a5f26 Added labelling of scores in nbestlist and fixed mert to understand that. 
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-04 04:45:48 +00:00
redpony
b84426d1af change message 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1 eclipse project file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d took out FactorType 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03 took out FactorType 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 20:02:39 +00:00
zens
ff15ed0732 - remove some obsolete code 
- optional future costs for distortion model


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18 memory pool cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97 using mem pool. needs to be more finely tweaked to give good results 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6 getting ready to use mempool for Phrase 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120 Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f make mysql code work with new scxoring collection 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 16:28:56 +00:00
zens
dd124448c1 - bug fix and further cleanup 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7 major score refactoring 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-29 01:11:45 +00:00
zens
dec0f5f703 print confusion net posterior in nbest list (if input is confusion net) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0 add score logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75 deleted Arc & LatticeEdge classes 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 22:11:20 +00:00
zens
0e6517b428 - fixing already fixed bugs that have been re-introduced by someone 
- moving some stuff from PhraseDictionaryTree to GenerateTuples
 - removing some obsolete code


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5 turned off profiling 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 03:18:18 +00:00
redpony
b48c33f1da use new score bookkeeping for nbest lists 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9 cvs ignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d cvs ignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de Visual Studio issues 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 15:26:10 +00:00
redpony
14d342508e preparation for new ScoreComponentCollection, which will be much more efficient 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-27 13:47:43 +00:00
zens
4022ae95bc - print statistics for confusion nets 
- small bug fixes


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c perf profiling turned on in eclipse in debug conf 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
 2006-07-26 20:24:37 +00:00