moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-19 07:07:24 +03:00
Code Issues Packages Projects Releases Wiki Activity
9,500 Commits 136 Branches 26 Tags 147 MiB
667b8a495f
Commit Graph

418 Commits

Author SHA1 Message Date
Barry Haddow
90820ad0c5 Merge branch 'master' into miramerge. 
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.

Conflicts:
	.gitignore
	configure.in
	ltmain.sh
	moses/src/LM/Factory.cpp
	moses/src/LMList.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelKen.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/PhraseDictionaryMemory.cpp
	moses/src/PhraseDictionaryTree.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.h
 2011-10-28 15:54:23 +01:00
Hieu Hoang
a93f4691f6 win32 2011-10-23 09:37:47 +07:00
hieuhoang1972
897fe0f88b visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4356 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-14 10:50:08 +00:00
Barry Haddow
c83166087e Merge branch 'master' into miramerge 
Conflicts:
	moses/src/LanguageModel.cpp
	moses/src/TargetPhrase.h
	moses/src/TrellisPath.h
	moses/src/Util.h
	scripts/training/train-model.perl
 2011-10-12 17:14:23 +01:00
bhaddow
84d73700af Implementation of Lattice sampling (Chatterjee and Cancedda, emnlp 2010) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4295 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-04 15:46:24 +00:00
nicolabertoldi
23d9a9b55e normalization of output spaces before and after field separator 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4293 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-03 16:11:39 +00:00
hieuhoang1972
9762a65bd8 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4264 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-25 10:44:47 +00:00
heafield
19879a8b1e -threads all option 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4252 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-22 22:29:56 +00:00
bhaddow
5b7c5ebdb5 Merge branch 'master' into miramerge 
Conflicts:
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/Main.cpp
	moses/src/DummyScoreProducers.cpp
	moses/src/DummyScoreProducers.h
	moses/src/GenerationDictionary.cpp
	moses/src/GenerationDictionary.h
	moses/src/GlobalLexicalModel.h
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelImplementation.h
	moses/src/LanguageModelKen.h
	moses/src/LanguageModelMultiFactor.cpp
	moses/src/LanguageModelMultiFactor.h
	moses/src/LanguageModelSingleFactor.cpp
	moses/src/LanguageModelSingleFactor.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionary.cpp
	moses/src/PhraseDictionary.h
	moses/src/ScoreIndexManager.cpp
	moses/src/ScoreProducer.h
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TranslationSystem.cpp
 2011-09-20 11:23:38 +01:00
arianna_b
633b80f515 recovered missing blank in n-best-list output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4170 1f5c12ca-751b-0410-a591-d2e778427230
 2011-09-02 11:40:32 +00:00
nicolabertoldi
75edc2eddd change to print the corrett name of the features with InputScores 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4168 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-30 12:25:50 +00:00
hieuhoang1972
5449839d75 option to sort word alignment info, as suggested by arianna bisazza 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4164 1f5c12ca-751b-0410-a591-d2e778427230
 2011-08-26 02:37:52 +00:00
bhaddow
1f3c11b441 Merge branch 'master' into miramerge 
Passes all regression except for the score tests, as I still have to merge
in the missing files for these tests.

Conflicts:
	.gitignore
	Makefile.am
	configure.in
	moses-chart/moses-chart.xcodeproj/project.pbxproj
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTrellisPath.cpp
	moses/src/DotChart.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelFactory.cpp
	moses/src/LanguageModelRemote.h
	moses/src/LexicalReordering.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/Parameter.cpp
	moses/src/RuleCubeQueue.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
	moses/src/TranslationOptionCollection.cpp
 2011-08-22 14:52:02 +01:00
bhaddow
de26a207d6 Merge commit '67dd80fb7bf71f36f2b29b4ba7a39e3ad35e5f81' into miramerge 
Conflicts:
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses-cmd/src/TranslationAnalysis.cpp
 2011-08-19 14:55:32 +01:00
bhaddow
cf81f9188f Merged up to 3895 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3934 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
pkoehn
42e10d010b added reporting of sparse features in n-best list 
git-svn-id: http://svn.statmt.org/repository/mira@3926 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
hieuhoang1972
b0ec298ce2 vs.net build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4088 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-23 23:52:34 +00:00
hieuhoang1972
9c0d725cde visual studio 2010 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-19 03:07:15 +00:00
naditomeh
83d02c11c6 Fix a segmentation fault produced when both 'constraint' and 
'translation-details' are used, and no hypothesis that matches the
reference translation is found.
The problem resulted from a missing check if a vector is empty before
incrementing its iterator.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3950 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-17 19:46:46 +00:00
phkoehn
4ee7e5f673 added some comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3911 1f5c12ca-751b-0410-a591-d2e778427230
 2011-03-02 19:02:07 +00:00
pjwilliams
75709a6c87 Memory efficiency: make the reserveSize argument non-optional in 
Moses::Phrase's constructor.  The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases.  Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR 
otherwise.  If you know the code involved, it's probably worth reviewing.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-28 11:41:08 +00:00
hieuhoang1972
67dd80fb7b run beautify.perl. Consistent formatting for .h & .cpp files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3897 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-24 12:39:29 +00:00
phkoehn
4c11bcd617 extensions to phrase table scoring options 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3893 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-23 10:27:54 +00:00
bhaddow
6b8415bffb Write alignment info through OutputCollector so it gets ordered 
correctly when run with multiple threads.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3882 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-16 16:50:55 +00:00
ales-t
83e2406f42 Word alignment output also works with MBR decoding. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3875 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-08 17:15:50 +00:00
bojar
0bc0ece594 Ales Tamchyna's printing of alignments (-print-alignment-info did nothing) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3867 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-03 09:08:42 +00:00
pjwilliams
8051c5ad35 Use TranslationTask objects to perform sentence decoding in moses-chart. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3846 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-25 17:15:30 +00:00
pjwilliams
99bbfe938b Use OutputCollector to write moses-chart output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3843 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-25 15:17:17 +00:00
bhaddow
a2bde7a16e Make sure internal libraries and paths go before boost. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-11 19:32:59 +00:00
bhaddow
a2730c445d Merge up to 3791 from trunk. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-05 13:49:44 +00:00
hieuhoang1972
41c5b3a1c2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3769 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-10 13:04:06 +00:00
bhaddow
50f0e6c07d Add a show-weights option. It prints out the moses features and exits. May 
load tables as a side-effect.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3744 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-29 16:44:28 +00:00
xandfraser
c0c617a8c4 Added print word alignment in nbest 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3726 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-22 15:34:53 +00:00
hieuhoang1972
735d5b682f xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3673 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-27 18:54:50 +00:00
hieuhoang1972
34e7c43114 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3664 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-27 03:14:11 +00:00
hieuhoang1972
5f6baa9021 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3627 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-18 05:47:07 +00:00
bhaddow
7e72ceea22 Goodbye ScoreIndexManager. 
Compiles ok, but haven't dared to run regression yet.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-06 22:06:49 +00:00
hieuhoang1972
e504b797b2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 22:29:01 +00:00
hieuhoang1972
bdfa2beab8 delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:16:50 +00:00
redpony
570183461c plf checker 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3407 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-16 01:03:39 +00:00
bhaddow
904133fcb7 Merge in the multiple models branch. These changes allow the moses server 
to support multiple translation, language and generation models within the
same process. The main design change is the introduction of a TranslationSystem
object to manage the models, which have been moved out of StaticData.
The changes should have no effect on existing systems.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3394 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-10 13:12:00 +00:00
hieuhoang1972
31930eb6fc alignment info in pt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3358 1f5c12ca-751b-0410-a591-d2e778427230
 2010-07-17 22:29:06 +00:00
hieuhoang1972
65194ba505 drop unknown option for chart decoding, xcode, minor adjustments to regression test formatting 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3312 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-09 12:56:31 +00:00
hieuhoang1972
c9eb463fe6 vs.net 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-05 13:10:26 +00:00
bhaddow
649bf24f62 One moses main 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3274 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-27 08:37:25 +00:00
bhaddow
f58f8397f4 Correct bug in use of scale factor 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3268 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-25 08:55:13 +00:00
bhaddow
c9baabe2ea Merging of moses mains. mosesmt now does single and multi-threeaded 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3264 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-19 16:42:18 +00:00
dowobeha
9fec69ce31 Merged fix (r3001-3260) for problem where multi-threaded moses would fail during linking if boost was compiled for 64 bit. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3261 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-17 01:41:58 +00:00
bhaddow
bb2431331c Fix to consensus decoding to stop it discarding hypos with zero score. 
Move hypothesis id management into Manager to make it thread-safe.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-14 09:33:03 +00:00
hieuhoang1972
f36759478b don't spew out param list if there's a genuine error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089 m_detailedTranslationReportingStream=NULL if not outputting trans opt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310 Add consensus decoding to mosesmt. Really need to get the mainlines merged! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-11 14:55:59 +00:00
phkoehn
f52a2cc55d code cleanup & enable trace ("-t") for MBR decoding ("-mbr") 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-10 21:18:47 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-08 15:51:59 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used 
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-05 16:53:41 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-26 13:38:56 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available). 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-23 15:01:06 +00:00
hieuhoang1972
45ecd333f9 delete std namespace in .h files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3116 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-12 10:04:35 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63 Implementation of consensus decoding - first cut. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-07 15:47:58 +00:00
hieuhoang1972
202bcf2911 eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 20:03:54 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised 
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 17:52:51 +00:00
bhaddow
22b74b56f7 Output of nbest from lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-16 11:34:50 +00:00
abarun
86ef292af1 Writing out sentence number when printing all derivations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 08:28:16 +00:00
abarun
3434d15cda Lattice MBR pruning based on target length of MAP hypothesis 
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 07:57:48 +00:00
bhaddow
ef54ec3699 Fix mosesmt compile 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2942 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 13:30:40 +00:00
jfouet
242846f07c Use portable include guard instead of pragma once 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 11:15:44 +00:00
jfouet
087b2021c5 Link libmoses with boost-thread 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:34:00 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432 Fix lattice mbr grid search so that the full lattice is created and pruned correctly. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 23:42:35 +00:00
bhaddow
0e16a9c3c5 deubg to cerr not cout 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2928 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 19:20:28 +00:00
bhaddow
b2201e765d Grid search for lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 14:15:34 +00:00
bojar
cce14523ab added -report-all-factors-in-n-best 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 10:54:33 +00:00
bhaddow
11cb44ba5b Refactoring of lattice mbr code so that it can be used with mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2907 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 17:25:56 +00:00
bhaddow
7f45cd12f9 reduce memory usage in lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2906 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 14:14:44 +00:00
bhaddow
b3a8411ae1 Fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2901 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-15 19:27:17 +00:00
hieuhoang1972
6b1b505089 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2897 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-14 00:26:34 +00:00
abarun
6aff4f1afd Floor probability for unknown ngrams in Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2896 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 18:04:17 +00:00
abarun
0b04e54234 Only outputting surface form for LatticeMBR argmax 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2893 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 15:56:37 +00:00
bhaddow
2396f6d9e9 Fix moses mt compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2886 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-11 10:44:11 +00:00
abarun
4ac95fb82a Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46 Set appropriate verbose level for Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:30:07 +00:00
abarun
904a982e05 Fixed bug in nbest MBR - now outputting correct MBR solution 
Fixed bug in lattice MBR - now outputting correct MBR solution 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2853 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:04:05 +00:00
abarun
117f5ef329 Lattice MBR now uses nbest list as default hypothesis set during reranking. 
To use lattice instead as hypothesis set, run with -lattice-hypo-set option


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 11:20:20 +00:00
abarun
6d7a710beb Added LatticeMBR to moses-cmd/Makefile.am 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2842 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:30:35 +00:00
abarun
32a58a3ec9 Implemented Lattice MBR for Moses. 
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:23:32 +00:00
phkoehn
d606f541e4 die fast 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2784 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 17:44:28 +00:00
phkoehn
cccab3d22b extended search graph output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2717 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 15:32:04 +00:00
nicolabertoldi
558ff92c33 if the output file for nbest is /dev/stdout, the output of best translation is suppressed; this simulates the behavior of '-' shortcut 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2702 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 13:09:10 +00:00
chardmeier
a3e9af21c3 Commented out unused variable. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2698 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 12:11:09 +00:00
hieuhoang1972
42b69fe20f leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2649 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-09 18:53:14 +00:00
bhaddow
b8789dfd97 Fix MosesMT.cpp to work with new mbr interface 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2641 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-17 15:00:11 +00:00
nicolabertoldi
c30d135f93 enabling output of recovering path for MBR both in the best translation and in the nbest list 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2639 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 17:27:07 +00:00
nicolabertoldi
d17f9dfd8e enabling output of nbest with MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2637 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-14 14:24:14 +00:00
bhaddow
499bf77ebc output feature weights debug in mosesmt 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2636 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-04 15:24:22 +00:00
bhaddow
c7dea2e497 make sure it builds on platforms without pthreads 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2618 1f5c12ca-751b-0410-a591-d2e778427230
 2009-11-13 10:13:55 +00:00
hieuhoang1972
a042aad7f2 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
 2009-10-02 09:54:10 +00:00
bhaddow
beaf123b5f Output of nbest from multi-threaded moses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2535 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-31 12:55:33 +00:00
bhaddow
c5d39f039f Merge moses-server branch (includes mt moses) into trunk. 
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-07 16:47:54 +00:00
hieuhoang1972
7d17d823ae xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2351 1f5c12ca-751b-0410-a591-d2e778427230
 2009-05-31 15:56:45 +00:00
phkoehn
8833098925 generalized n-best list reporting for feature functions, added experimental version of global lexical model 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2343 1f5c12ca-751b-0410-a591-d2e778427230
 2009-05-26 19:30:35 +00:00
abarun
3cc8305efa Modified xcode project to make it work with both sri and irst lms 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1955 1f5c12ca-751b-0410-a591-d2e778427230
 2008-12-11 19:27:59 +00:00
hieuhoang1972
69b2dc441d eclipse files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
 2008-12-10 14:20:10 +00:00
hieuhoang1972
789d6d96d1 intergrate randlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
 2008-11-04 18:03:03 +00:00
hieuhoang1972
c59b532df1 eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-31 18:44:44 +00:00
hieuhoang1972
8d6d739a6a eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1925 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-30 19:44:54 +00:00
hieuhoang1972
6a61ffa9bd unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1899 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-10 18:30:51 +00:00
hieuhoang1972
868428fe66 unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1898 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-09 00:20:39 +00:00
hieuhoang1972
928d771085 create namespace 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1897 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-08 23:51:26 +00:00
redpony
232dc9889c enable moses to accept a file that lists feature name and weight pairs. 
enable moses to export its search graph as a phrase lattice encoded serialized in a Google protocol buffer. This requires protoc (http://code.google.com/p/protobuf/) to function, disabled by default.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1890 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-24 16:48:23 +00:00
nicolabertoldi
dd6c36640b Support for printing out word-to-word alignments (besides phrase-to-phrase alignments) 
as contained in the phrase table.
If PT contains word-to-word alignments between source and target phrases,
Moses can optionally output them in the nbest and in the log file (if verbose).
W2w alignments from source to target and from target to source can differ,
if they differ in the PT.

Detailed documentation will be added in the Moses webpages very soon.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1886 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-12 18:09:06 +00:00
hieuhoang1972
5dee5d04aa rename IOStream to IOWrapper. 
move vs.net solution file to root folder

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
 2008-08-05 00:24:45 +00:00
hieuhoang1972
47e4803f97 move cube pruning moses lib to trunk 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1849 1f5c12ca-751b-0410-a591-d2e778427230
 2008-06-11 13:22:26 +00:00
hieuhoang1972
1792e14945 eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1810 1f5c12ca-751b-0410-a591-d2e778427230
 2008-06-02 21:23:33 +00:00
hieuhoang1972
9997b7fd7e alignment output fix 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1604 1f5c12ca-751b-0410-a591-d2e778427230
 2008-05-04 13:13:12 +00:00
hieuhoang1972
3fc0b8ddb4 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1603 1f5c12ca-751b-0410-a591-d2e778427230 2008-05-04 12:52:52 +00:00
hieuhoang1972
24a5a24c8b changed eclipse project for irstlm changes 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1595 1f5c12ca-751b-0410-a591-d2e778427230
 2008-04-15 14:22:42 +00:00
nicolabertoldi
43ae535165 added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
 2008-04-02 17:08:54 +00:00
phkoehn
4ee468dc03 output search graph 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1588 1f5c12ca-751b-0410-a591-d2e778427230
 2008-03-17 21:34:19 +00:00
hieuhoang1972
2d95df359e code clean - move creating wordgraph file to iostream class 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1581 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-29 23:08:58 +00:00
hieuhoang1972
e2f4d64608 output wordgraph for german 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1574 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-27 13:31:37 +00:00
hieuhoang1972
4964c45489 output wordgraph for german 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1573 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-27 12:43:04 +00:00
hieuhoang1972
76606d3823 minor - 
add svn properties for XmlOption.
make vs & eclipse build use return, rather than exit, when closing down

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1555 1f5c12ca-751b-0410-a591-d2e778427230
 2008-02-09 17:08:09 +00:00
hieuhoang1972
fd60fe93b9 roll back last change. seg fault in release build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1549 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-29 19:28:13 +00:00
phkoehn
0faf1a83c0 bug fix for distinct n-best list generation, resolved memory blowup issue 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1542 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-18 19:00:07 +00:00
phkoehn
1044b16522 bug fixes to distinct n-best list, mbr decoding; also changed switches for mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1540 1f5c12ca-751b-0410-a591-d2e778427230
 2008-01-16 20:25:01 +00:00
abarun
aa6f605a2d Updated xcode project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1518 1f5c12ca-751b-0410-a591-d2e778427230
 2007-11-26 15:32:05 +00:00
hieuhoang1972
dee505b823 don't use hypo pool until delayed destructor is sorted out 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1513 1f5c12ca-751b-0410-a591-d2e778427230
 2007-11-16 00:09:21 +00:00
redpony
7dbcef925d Implemented -r (-recover-input-path) to recover the actual path through the CN/word lattice that was used in the best translation. Also cleaned up handling of source Phrases in the context of a particular hypothesis, which may improve performance translating with lexicalized reordering models. 
Removed PhraseReference since the concept was broken for CN/lattice inputs.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1468 1f5c12ca-751b-0410-a591-d2e778427230
 2007-09-28 16:43:33 +00:00
jdschroeder
6eaf3db0f5 updated xcode projects to include new source files. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1457 1f5c12ca-751b-0410-a591-d2e778427230
 2007-09-05 10:46:18 +00:00
hieuhoang1972
4a2982cd34 build with SRILM in windows under different configuration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
 2007-07-17 20:45:51 +00:00
jdschroeder
0bfb92cfe1 Deleted old xcode files. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 13:49:52 +00:00
hieuhoang1972
9aac5e70de update eclipse project file for irstlm change 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-29 09:03:00 +00:00
hieuhoang1972
8525279d7d rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e code tidy up 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7 Code for MBR decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c visual studio compile errors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 21:37:25 +00:00
abarun
5c0f6d0415 Code for MBR decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1383 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-15 20:54:39 +00:00
hieuhoang1972
d2ebe33f9e visual studio project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1364 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-18 18:10:24 +00:00
redpony
c80d8b8d47 Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-18 14:08:46 +00:00
hieuhoang1972
cd697c28ae re-introduce konrad lexicalized reordering but fix bugs with help from philipp. 
speed improvements by caching probabilities in Trans Opt

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1338 1f5c12ca-751b-0410-a591-d2e778427230
 2007-04-06 00:24:25 +00:00
hieuhoang1972
8566962ecc output empty line even if no best hypothesis found 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1305 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-14 19:47:51 +00:00
hieuhoang1972
075681d6fc visual studio proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1267 1f5c12ca-751b-0410-a591-d2e778427230
 2007-03-04 09:01:50 +00:00