Commit Graph

602 Commits

Author SHA1 Message Date
Kenneth Heafield
868255af03 Surround mains in try-catch blocks. 2012-01-13 10:20:42 -05:00
Eva Hasler
50d3a62bda change order of -show-weights output to match nbest list order 2011-12-14 10:51:35 +00:00
Eva Hasler
85ce6547fd -show-weights: output sparseProducerWeight if != 1, otherwise 'sparse' 2011-12-13 19:13:13 +00:00
Barry Haddow
072848a4df Merge branch 'master' into bjam. Doesn't compile.
Conflicts:
	.gitignore
	Makefile.am
	config.h.in
	configure.in
	m4/boost.m4
	moses/src/LM/Factory.cpp
	moses/src/LM/ParallelBackoff.h
	moses/src/LM/RandLM.h
	moses/src/Makefile.am
	moses/src/PDTAimp.h
	moses/src/Phrase.h
	moses/src/PhraseDictionaryTree.cpp
	moses/src/ScoreComponentCollection.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TranslationOptionCollection.cpp
	moses/src/TranslationSystem.cpp
	scripts/Makefile
	scripts/released-files
2011-12-08 23:17:30 +00:00
Hieu Hoang
71c78ef0ce move vs and xcode project files into separate contrib folder 2011-12-02 08:33:39 +07:00
Hieu Hoang
39db162cc0 move vs and xcode project files into separate contrib folder 2011-12-02 08:33:39 +07:00
Kenneth Heafield
9fe831c60c Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
a0d79781e5 Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
42975b0635 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Eva Hasler
9084db96c4 add parameter weight-dlm as additional dense weight 2011-11-24 19:27:12 +00:00
Barry Haddow
9c952b586f move checkplf 2011-11-23 15:48:48 +00:00
Barry Haddow
21f3f19aaa move checkplf 2011-11-23 15:48:48 +00:00
Kenneth Heafield
a65ed7e587 Jam: install executables in legacy paths and stop leaving a.out files everywhere 2011-11-21 13:20:52 -05:00
Barry Haddow
7fd0e6ca7f Remove GetTargetPhrase() (already have GetCurrTargetPhrase()) 2011-11-21 12:35:58 +00:00
Barry Haddow
5baa595a91 Further direction removal 2011-11-21 11:14:05 +00:00
Barry Haddow
3dc30fd51a Remove direction from Phrase 2011-11-21 10:49:26 +00:00
Hieu Hoang
ce0065ff2a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a xcode 2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a Introducing Jamfiles
Currently supports kenlm, irstlm, and srilm options.

bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
caac64a33b xcode 2011-11-18 21:33:58 +07:00
Kenneth Heafield
024b411e85 One more assert 2011-11-18 13:41:24 +00:00
Kenneth Heafield
bf78f7a1ac Replace assert with CHECK until people learn how to use assert properly 2011-11-18 12:07:41 +00:00
Kenneth Heafield
404c4b3a73 Why are these executable? 2011-11-17 18:59:29 -05:00
Barry Haddow
d57d0c0656 Merge branch 'master' into miramerge
Conflicts:
	Makefile.am
	config.h.in
	configure.in
	kenlm
	moses-chart-cmd/src/IOWrapper.cpp
	moses/src/Parameter.cpp
	scripts/Makefile
2011-11-17 17:46:17 +00:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00
Hieu Hoang
253f32a2e5 load hiero format for reading suffix arrays 2011-11-14 00:14:40 +07:00
Hieu Hoang
d97cf2d9a5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-11 22:25:54 +00:00
Hieu Hoang
87500bc93d visual studio 2011-11-11 22:24:25 +00:00
Hieu Hoang
7da1af411c xcode build 2011-11-11 20:55:55 +07:00
Barry Haddow
6890472ba1 Merge branch 'master' into miramerge
Conflicts:
	.gitignore
	config.h.in
	moses/src/ChartTrellisPath.cpp
	moses/src/Makefile.am
2011-11-11 08:25:13 +00:00
Hieu Hoang
aac12ed58f xcode 2011-10-30 12:51:08 +07:00
Hieu Hoang
aff5978be4 Revert "xcode"
This reverts commit c6b333a832.
2011-10-30 12:37:51 +07:00
Hieu Hoang
c6b333a832 xcode 2011-10-29 20:00:45 +07:00
Barry Haddow
90820ad0c5 Merge branch 'master' into miramerge.
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.

Conflicts:
	.gitignore
	configure.in
	ltmain.sh
	moses/src/LM/Factory.cpp
	moses/src/LMList.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelKen.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/PhraseDictionaryMemory.cpp
	moses/src/PhraseDictionaryTree.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.h
2011-10-28 15:54:23 +01:00
Hieu Hoang
a93f4691f6 win32 2011-10-23 09:37:47 +07:00
hieuhoang1972
897fe0f88b visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4356 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-14 10:50:08 +00:00
Barry Haddow
c83166087e Merge branch 'master' into miramerge
Conflicts:
	moses/src/LanguageModel.cpp
	moses/src/TargetPhrase.h
	moses/src/TrellisPath.h
	moses/src/Util.h
	scripts/training/train-model.perl
2011-10-12 17:14:23 +01:00
bhaddow
84d73700af Implementation of Lattice sampling (Chatterjee and Cancedda, emnlp 2010)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4295 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-04 15:46:24 +00:00
nicolabertoldi
23d9a9b55e normalization of output spaces before and after field separator
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4293 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-03 16:11:39 +00:00
hieuhoang1972
9762a65bd8 xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4264 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-25 10:44:47 +00:00
heafield
19879a8b1e -threads all option
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4252 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-22 22:29:56 +00:00
bhaddow
5b7c5ebdb5 Merge branch 'master' into miramerge
Conflicts:
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/Main.cpp
	moses/src/DummyScoreProducers.cpp
	moses/src/DummyScoreProducers.h
	moses/src/GenerationDictionary.cpp
	moses/src/GenerationDictionary.h
	moses/src/GlobalLexicalModel.h
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelImplementation.h
	moses/src/LanguageModelKen.h
	moses/src/LanguageModelMultiFactor.cpp
	moses/src/LanguageModelMultiFactor.h
	moses/src/LanguageModelSingleFactor.cpp
	moses/src/LanguageModelSingleFactor.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionary.cpp
	moses/src/PhraseDictionary.h
	moses/src/ScoreIndexManager.cpp
	moses/src/ScoreProducer.h
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TranslationSystem.cpp
2011-09-20 11:23:38 +01:00
arianna_b
633b80f515 recovered missing blank in n-best-list output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4170 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-02 11:40:32 +00:00
nicolabertoldi
75edc2eddd change to print the corrett name of the features with InputScores
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4168 1f5c12ca-751b-0410-a591-d2e778427230
2011-08-30 12:25:50 +00:00
hieuhoang1972
5449839d75 option to sort word alignment info, as suggested by arianna bisazza
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4164 1f5c12ca-751b-0410-a591-d2e778427230
2011-08-26 02:37:52 +00:00
bhaddow
1f3c11b441 Merge branch 'master' into miramerge
Passes all regression except for the score tests, as I still have to merge
in the missing files for these tests.

Conflicts:
	.gitignore
	Makefile.am
	configure.in
	moses-chart/moses-chart.xcodeproj/project.pbxproj
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTrellisPath.cpp
	moses/src/DotChart.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelFactory.cpp
	moses/src/LanguageModelRemote.h
	moses/src/LexicalReordering.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/Parameter.cpp
	moses/src/RuleCubeQueue.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
	moses/src/TranslationOptionCollection.cpp
2011-08-22 14:52:02 +01:00
bhaddow
de26a207d6 Merge commit '67dd80fb7bf71f36f2b29b4ba7a39e3ad35e5f81' into miramerge
Conflicts:
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses-cmd/src/TranslationAnalysis.cpp
2011-08-19 14:55:32 +01:00
bhaddow
cf81f9188f Merged up to 3895 from trunk
git-svn-id: http://svn.statmt.org/repository/mira@3934 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
pkoehn
42e10d010b added reporting of sparse features in n-best list
git-svn-id: http://svn.statmt.org/repository/mira@3926 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
hieuhoang1972
b0ec298ce2 vs.net build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4088 1f5c12ca-751b-0410-a591-d2e778427230
2011-07-23 23:52:34 +00:00
hieuhoang1972
9c0d725cde visual studio 2010
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
2011-07-19 03:07:15 +00:00
naditomeh
83d02c11c6 Fix a segmentation fault produced when both 'constraint' and
'translation-details' are used, and no hypothesis that matches the
reference translation is found.
The problem resulted from a missing check if a vector is empty before
incrementing its iterator.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3950 1f5c12ca-751b-0410-a591-d2e778427230
2011-04-17 19:46:46 +00:00
phkoehn
4ee7e5f673 added some comments
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3911 1f5c12ca-751b-0410-a591-d2e778427230
2011-03-02 19:02:07 +00:00
pjwilliams
75709a6c87 Memory efficiency: make the reserveSize argument non-optional in
Moses::Phrase's constructor.  The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases.  Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR 
otherwise.  If you know the code involved, it's probably worth reviewing.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-28 11:41:08 +00:00
hieuhoang1972
67dd80fb7b run beautify.perl. Consistent formatting for .h & .cpp files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3897 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-24 12:39:29 +00:00
phkoehn
4c11bcd617 extensions to phrase table scoring options
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3893 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-23 10:27:54 +00:00
bhaddow
6b8415bffb Write alignment info through OutputCollector so it gets ordered
correctly when run with multiple threads.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3882 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-16 16:50:55 +00:00
ales-t
83e2406f42 Word alignment output also works with MBR decoding.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3875 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-08 17:15:50 +00:00
bojar
0bc0ece594 Ales Tamchyna's printing of alignments (-print-alignment-info did nothing)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3867 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-03 09:08:42 +00:00
pjwilliams
8051c5ad35 Use TranslationTask objects to perform sentence decoding in moses-chart.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3846 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-25 17:15:30 +00:00
pjwilliams
99bbfe938b Use OutputCollector to write moses-chart output.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3843 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-25 15:17:17 +00:00
bhaddow
a2bde7a16e Make sure internal libraries and paths go before boost.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-11 19:32:59 +00:00
bhaddow
a2730c445d Merge up to 3791 from trunk.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-05 13:49:44 +00:00
hieuhoang1972
41c5b3a1c2 xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3769 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-10 13:04:06 +00:00
bhaddow
50f0e6c07d Add a show-weights option. It prints out the moses features and exits. May
load tables as a side-effect.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3744 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 16:44:28 +00:00
xandfraser
c0c617a8c4 Added print word alignment in nbest
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3726 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-22 15:34:53 +00:00
hieuhoang1972
735d5b682f xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3673 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-27 18:54:50 +00:00
hieuhoang1972
34e7c43114 xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3664 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-27 03:14:11 +00:00
hieuhoang1972
5f6baa9021 xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3627 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-18 05:47:07 +00:00
bhaddow
7e72ceea22 Goodbye ScoreIndexManager.
Compiles ok, but haven't dared to run regression yet.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-06 22:06:49 +00:00
hieuhoang1972
e504b797b2 xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece ken lm integration
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
2010-09-26 22:29:01 +00:00
hieuhoang1972
bdfa2beab8 delete eclipse build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
2010-09-10 09:16:50 +00:00
redpony
570183461c plf checker
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3407 1f5c12ca-751b-0410-a591-d2e778427230
2010-08-16 01:03:39 +00:00
bhaddow
904133fcb7 Merge in the multiple models branch. These changes allow the moses server
to support multiple translation, language and generation models within the
same process. The main design change is the introduction of a TranslationSystem
object to manage the models, which have been moved out of StaticData.
The changes should have no effect on existing systems.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3394 1f5c12ca-751b-0410-a591-d2e778427230
2010-08-10 13:12:00 +00:00
hieuhoang1972
31930eb6fc alignment info in pt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3358 1f5c12ca-751b-0410-a591-d2e778427230
2010-07-17 22:29:06 +00:00
hieuhoang1972
65194ba505 drop unknown option for chart decoding, xcode, minor adjustments to regression test formatting
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3312 1f5c12ca-751b-0410-a591-d2e778427230
2010-06-09 12:56:31 +00:00
hieuhoang1972
c9eb463fe6 vs.net
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
2010-06-05 13:10:26 +00:00
bhaddow
649bf24f62 One moses main
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3274 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-27 08:37:25 +00:00
bhaddow
f58f8397f4 Correct bug in use of scale factor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3268 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-25 08:55:13 +00:00
bhaddow
c9baabe2ea Merging of moses mains. mosesmt now does single and multi-threeaded
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3264 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-19 16:42:18 +00:00
dowobeha
9fec69ce31 Merged fix (r3001-3260) for problem where multi-threaded moses would fail during linking if boost was compiled for 64 bit.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3261 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-17 01:41:58 +00:00
bhaddow
bb2431331c Fix to consensus decoding to stop it discarding hypos with zero score.
Move hypothesis id management into Manager to make it thread-safe.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-14 09:33:03 +00:00
hieuhoang1972
f36759478b don't spew out param list if there's a genuine error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089 m_detailedTranslationReportingStream=NULL if not outputting trans opt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310 Add consensus decoding to mosesmt. Really need to get the mainlines merged!
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 14:55:59 +00:00
phkoehn
f52a2cc55d code cleanup & enable trace ("-t") for MBR decoding ("-mbr")
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 21:18:47 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-08 15:51:59 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:53:41 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 13:38:56 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-23 15:01:06 +00:00
hieuhoang1972
45ecd333f9 delete std namespace in .h files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3116 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-12 10:04:35 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63 Implementation of consensus decoding - first cut.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-07 15:47:58 +00:00
hieuhoang1972
202bcf2911 eclipse build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-31 20:03:54 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-19 17:52:51 +00:00
bhaddow
22b74b56f7 Output of nbest from lattice mbr
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-16 11:34:50 +00:00
abarun
86ef292af1 Writing out sentence number when printing all derivations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-07 08:28:16 +00:00
abarun
3434d15cda Lattice MBR pruning based on target length of MAP hypothesis
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-07 07:57:48 +00:00
bhaddow
ef54ec3699 Fix mosesmt compile
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2942 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 13:30:40 +00:00
jfouet
242846f07c Use portable include guard instead of pragma once
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 11:15:44 +00:00
jfouet
087b2021c5 Link libmoses with boost-thread
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 10:34:00 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432 Fix lattice mbr grid search so that the full lattice is created and pruned correctly.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-22 23:42:35 +00:00
bhaddow
0e16a9c3c5 deubg to cerr not cout
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2928 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-22 19:20:28 +00:00
bhaddow
b2201e765d Grid search for lattice mbr
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-18 14:15:34 +00:00
bojar
cce14523ab added -report-all-factors-in-n-best
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-18 10:54:33 +00:00
bhaddow
11cb44ba5b Refactoring of lattice mbr code so that it can be used with mosesmt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2907 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-17 17:25:56 +00:00
bhaddow
7f45cd12f9 reduce memory usage in lattice mbr
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2906 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-17 14:14:44 +00:00
bhaddow
b3a8411ae1 Fix compile error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2901 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-15 19:27:17 +00:00
hieuhoang1972
6b1b505089 visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2897 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-14 00:26:34 +00:00
abarun
6aff4f1afd Floor probability for unknown ngrams in Lattice MBR
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2896 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-12 18:04:17 +00:00
abarun
0b04e54234 Only outputting surface form for LatticeMBR argmax
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2893 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-12 15:56:37 +00:00
bhaddow
2396f6d9e9 Fix moses mt compile error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2886 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-11 10:44:11 +00:00
abarun
4ac95fb82a Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46 Set appropriate verbose level for Lattice MBR
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 17:30:07 +00:00
abarun
904a982e05 Fixed bug in nbest MBR - now outputting correct MBR solution
Fixed bug in lattice MBR - now outputting correct MBR solution 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2853 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 17:04:05 +00:00
abarun
117f5ef329 Lattice MBR now uses nbest list as default hypothesis set during reranking.
To use lattice instead as hypothesis set, run with -lattice-hypo-set option


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 11:20:20 +00:00
abarun
6d7a710beb Added LatticeMBR to moses-cmd/Makefile.am
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2842 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 10:30:35 +00:00
abarun
32a58a3ec9 Implemented Lattice MBR for Moses.
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 10:23:32 +00:00
phkoehn
d606f541e4 die fast
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2784 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-29 17:44:28 +00:00
phkoehn
cccab3d22b extended search graph output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2717 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 15:32:04 +00:00
nicolabertoldi
558ff92c33 if the output file for nbest is /dev/stdout, the output of best translation is suppressed; this simulates the behavior of '-' shortcut
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2702 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 13:09:10 +00:00
chardmeier
a3e9af21c3 Commented out unused variable.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2698 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 12:11:09 +00:00
hieuhoang1972
42b69fe20f leak
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2649 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-09 18:53:14 +00:00
bhaddow
b8789dfd97 Fix MosesMT.cpp to work with new mbr interface
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2641 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-17 15:00:11 +00:00
nicolabertoldi
c30d135f93 enabling output of recovering path for MBR both in the best translation and in the nbest list
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2639 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-14 17:27:07 +00:00
nicolabertoldi
d17f9dfd8e enabling output of nbest with MBR
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2637 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-14 14:24:14 +00:00
bhaddow
499bf77ebc output feature weights debug in mosesmt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2636 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-04 15:24:22 +00:00
bhaddow
c7dea2e497 make sure it builds on platforms without pthreads
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2618 1f5c12ca-751b-0410-a591-d2e778427230
2009-11-13 10:13:55 +00:00
hieuhoang1972
a042aad7f2 visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
2009-10-02 09:54:10 +00:00
bhaddow
beaf123b5f Output of nbest from multi-threaded moses
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2535 1f5c12ca-751b-0410-a591-d2e778427230
2009-08-31 12:55:33 +00:00
bhaddow
c5d39f039f Merge moses-server branch (includes mt moses) into trunk.
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
2009-08-07 16:47:54 +00:00
hieuhoang1972
7d17d823ae xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2351 1f5c12ca-751b-0410-a591-d2e778427230
2009-05-31 15:56:45 +00:00
phkoehn
8833098925 generalized n-best list reporting for feature functions, added experimental version of global lexical model
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2343 1f5c12ca-751b-0410-a591-d2e778427230
2009-05-26 19:30:35 +00:00
abarun
3cc8305efa Modified xcode project to make it work with both sri and irst lms
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1955 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-11 19:27:59 +00:00
hieuhoang1972
69b2dc441d eclipse files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-10 14:20:10 +00:00
hieuhoang1972
789d6d96d1 intergrate randlm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-04 18:03:03 +00:00
hieuhoang1972
c59b532df1 eclipse proj
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-31 18:44:44 +00:00
hieuhoang1972
8d6d739a6a eclipse proj
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1925 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-30 19:44:54 +00:00
hieuhoang1972
6a61ffa9bd unix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1899 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-10 18:30:51 +00:00
hieuhoang1972
868428fe66 unix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1898 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-09 00:20:39 +00:00
hieuhoang1972
928d771085 create namespace
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1897 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-08 23:51:26 +00:00
redpony
232dc9889c enable moses to accept a file that lists feature name and weight pairs.
enable moses to export its search graph as a phrase lattice encoded serialized in a Google protocol buffer. This requires protoc (http://code.google.com/p/protobuf/) to function, disabled by default.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1890 1f5c12ca-751b-0410-a591-d2e778427230
2008-09-24 16:48:23 +00:00
nicolabertoldi
dd6c36640b Support for printing out word-to-word alignments (besides phrase-to-phrase alignments)
as contained in the phrase table.
If PT contains word-to-word alignments between source and target phrases,
Moses can optionally output them in the nbest and in the log file (if verbose).
W2w alignments from source to target and from target to source can differ,
if they differ in the PT.

Detailed documentation will be added in the Moses webpages very soon.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1886 1f5c12ca-751b-0410-a591-d2e778427230
2008-09-12 18:09:06 +00:00
hieuhoang1972
5dee5d04aa rename IOStream to IOWrapper.
move vs.net solution file to root folder

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
2008-08-05 00:24:45 +00:00
hieuhoang1972
47e4803f97 move cube pruning moses lib to trunk
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1849 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-11 13:22:26 +00:00
hieuhoang1972
1792e14945 eclipse project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1810 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-02 21:23:33 +00:00
hieuhoang1972
9997b7fd7e alignment output fix
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1604 1f5c12ca-751b-0410-a591-d2e778427230
2008-05-04 13:13:12 +00:00
hieuhoang1972
3fc0b8ddb4 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1603 1f5c12ca-751b-0410-a591-d2e778427230 2008-05-04 12:52:52 +00:00
hieuhoang1972
24a5a24c8b changed eclipse project for irstlm changes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1595 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-15 14:22:42 +00:00
nicolabertoldi
43ae535165 added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-02 17:08:54 +00:00
phkoehn
4ee468dc03 output search graph
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1588 1f5c12ca-751b-0410-a591-d2e778427230
2008-03-17 21:34:19 +00:00
hieuhoang1972
2d95df359e code clean - move creating wordgraph file to iostream class
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1581 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-29 23:08:58 +00:00
hieuhoang1972
e2f4d64608 output wordgraph for german
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1574 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 13:31:37 +00:00
hieuhoang1972
4964c45489 output wordgraph for german
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1573 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 12:43:04 +00:00
hieuhoang1972
76606d3823 minor -
add svn properties for XmlOption.
make vs & eclipse build use return, rather than exit, when closing down

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1555 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-09 17:08:09 +00:00
hieuhoang1972
fd60fe93b9 roll back last change. seg fault in release build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1549 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-29 19:28:13 +00:00
phkoehn
0faf1a83c0 bug fix for distinct n-best list generation, resolved memory blowup issue
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1542 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-18 19:00:07 +00:00
phkoehn
1044b16522 bug fixes to distinct n-best list, mbr decoding; also changed switches for mbr
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1540 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-16 20:25:01 +00:00
abarun
aa6f605a2d Updated xcode project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1518 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-26 15:32:05 +00:00
hieuhoang1972
dee505b823 don't use hypo pool until delayed destructor is sorted out
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1513 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-16 00:09:21 +00:00
redpony
7dbcef925d Implemented -r (-recover-input-path) to recover the actual path through the CN/word lattice that was used in the best translation. Also cleaned up handling of source Phrases in the context of a particular hypothesis, which may improve performance translating with lexicalized reordering models.
Removed PhraseReference since the concept was broken for CN/lattice inputs.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1468 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-28 16:43:33 +00:00
jdschroeder
6eaf3db0f5 updated xcode projects to include new source files.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1457 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-05 10:46:18 +00:00
hieuhoang1972
4a2982cd34 build with SRILM in windows under different configuration
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-17 20:45:51 +00:00
jdschroeder
0bfb92cfe1 Deleted old xcode files.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:49:52 +00:00
hieuhoang1972
9aac5e70de update eclipse project file for irstlm change
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 09:03:00 +00:00
hieuhoang1972
8525279d7d rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e code tidy up
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc fix compile error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7 Code for MBR decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c visual studio compile errors
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 21:37:25 +00:00
abarun
5c0f6d0415 Code for MBR decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1383 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 20:54:39 +00:00
hieuhoang1972
d2ebe33f9e visual studio project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1364 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 18:10:24 +00:00
redpony
c80d8b8d47 Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 14:08:46 +00:00
hieuhoang1972
cd697c28ae re-introduce konrad lexicalized reordering but fix bugs with help from philipp.
speed improvements by caching probabilities in Trans Opt

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1338 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-06 00:24:25 +00:00
hieuhoang1972
8566962ecc output empty line even if no best hypothesis found
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1305 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-14 19:47:51 +00:00
hieuhoang1972
075681d6fc visual studio proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1267 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 09:01:50 +00:00
hieuhoang1972
5f22fb13d3 make output of decimal places consistent by not format anywhere but in Main.cpp
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1266 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:43:45 +00:00
hieuhoang1972
2c9f1a13fe make output of decimal places consistent by not format anywhere but in Main.cpp
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1265 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:17:54 +00:00
phkoehn
f1d2bd0eb5 added option -include-alignment-in-n-best to include the word alignment for each sentence in the n-best list file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1246 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-26 20:59:41 +00:00
hieuhoang1972
62b4741de0 move calling InitializeBeforeSentenceProcessing() & CleanUpAfterSentenceProcessing() in Manager class
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1241 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-24 20:32:32 +00:00
hieuhoang1972
bef38f4006 code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1234 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-23 00:00:09 +00:00
hieuhoang1972
c58393a4b4 verbose=0 nothing goes to stderr except for real, aborting errors
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1232 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-22 23:44:38 +00:00
hieuhoang1972
7ecb0ce66e change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1227 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-21 19:48:53 +00:00
hieuhoang1972
f3cbacba3e code cleanup - make FactorCollection and StaticData totally accessible only globally
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1218 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-16 18:08:37 +00:00
hieuhoang1972
e247f1da6f fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1209 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-13 19:15:34 +00:00
hieuhoang1972
6b4dfc4db2 added #def to use hypo pool
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1206 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-12 11:05:13 +00:00
hieuhoang1972
006e2724e0 take out irstlm on VS build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1195 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-09 17:36:07 +00:00
hieuhoang1972
9cf7257d27 don't skip empty lines
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1169 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-05 10:24:01 +00:00
hieuhoang1972
e7838339bb exit/return from main()
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1141 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 16:21:28 +00:00
nicolabertoldi
be039bf84a Reduced time to die!!!
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1139 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 14:47:13 +00:00
hieuhoang1972
e1823a52ac prune arcList & LatticePathCollection (contenders for n-best paths)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f fixed mem leak
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-21 13:38:03 +00:00
redpony
0f3ee4b814 If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-08 14:46:48 +00:00
hieuhoang1972
dd721e1b4f Mac xcode proj
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e dismantle IODevoce framework
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 23:06:30 +00:00
hieuhoang1972
c49a2e31bf eclipse preferences. not sure if need to go into svn
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7 lots of small changes and code clean up:
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241 Modified output of feature scores.
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48 updated eclispe project file to work with calipso version
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949 statically zlib on WIN32
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac eclipse project file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80 added internal, x-platform LM which exactly mimics SRILM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f changes to make LMs work in Windows
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927 solved bug in n-best list creation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc added comments
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2 rename InputOutput to IODevice
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c added comments
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a visual studio project files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59 code cleanup and commenting brought about when documenting for jhu report
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4 xcode proj files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc taken boost out of eclipse project
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90 delete zlib-win32 proj. library should be in default path
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e put back Visual Leak Detector for Win32 build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386 cleanup... renamed --report-source-word-span into --report-segmentation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c cleanup of verbose logging
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:03:27 +00:00
swadey
0ffbcca545 - Added necessary zlib-win32 implementation for winbloze
- update project files for vc++ and fixed minor code issues

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9 make building moses/moses-cmd a single make command rather than two
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-23 15:18:53 +00:00
redpony
1700da00bf remove .cvsignore files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:39:02 +00:00
redpony
1022363f39 remove acsite
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:06:24 +00:00
redpony
fe74de6b44 Remove files that are autogenerated
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:50:36 +00:00
redpony
75796cb419 remove misleading file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:34:50 +00:00
redpony
6eaba82546 remove references to boost, fix formatting, fix make-release-tarball to work with svn
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:24:09 +00:00
redpony
2e8001f428 prepare for public releases
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 16:24:39 +00:00
redpony
cc97567b2b remove references to JHU fs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:26:27 +00:00
redpony
b116321fd9 remove references to Mysql
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:20:23 +00:00
redpony
3fb417f914 remove references to boost
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3 remove mysql dependency
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85 eclipse proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:39:59 +00:00
mfederico
2a3037692b Added decoding time computation.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c Added decoding time computation.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 18:31:16 +00:00
eherbst
54166381c9 *** empty log message ***
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881 fixed check for n_gram.h in irstlm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:32:01 +00:00
redpony
da207d0016 add optional LM statistics reporting. enable with '-L true' on command line
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 22:44:01 +00:00
ccorbett
4e3631e1b0 IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:51:17 +00:00
hieuhoang1972
2a7179a8fa choice of not labelling n-best output for wade shen's mert script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:08:39 +00:00
ccorbett
7019abf652 reordering scores are now implemented for n-best lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 18:11:52 +00:00
hieuhoang1972
dfe2e58187 output trans & gen scores in order they were created
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@687 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 03:03:18 +00:00
zens
61294d90ad - generate distinct nbest surface strings (if 3rd token of n-best-list is 'distinct')
- some sanity checks


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@674 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-12 00:06:55 +00:00
eherbst
5cb683cd7e moved class InputType to InputType.h;
added more detailed statistics-keeping to SentenceStats;
added custom malloc/realloc (see Util.h);
some commenting


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@666 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 21:04:38 +00:00
redpony
8e986774e1 print input line number in logs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@663 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 20:16:27 +00:00
redpony
8e4128beef add dropped word analysis, fix potential out of memory crash
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21 visual studio proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:21:27 +00:00
redpony
eff4b3447e FactorTypeSet->FactorMask
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 22:41:26 +00:00
redpony
5a0787310b FactorTypeSet -> FactorMask
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 20:42:34 +00:00
phkoehn
525a181f12 re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 04:20:06 +00:00
zens
b2041149f2 early pruning of path during confusion net exploration
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@594 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-09 19:14:43 +00:00
redpony
d4128a7f8c N_BEST cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f delete nbest config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1 delete n-best config
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:16:01 +00:00
redpony
233c610cd8 get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:49:07 +00:00
redpony
f83c8abd66 add detailed logging of 1-best translation output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:32 +00:00
zens
6cfe732bff - add some source files in Makefile.am
- bug fix: source / Manager get deleted in right order


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:18:13 +00:00
zens
8bf9742655 move CreateTranslationOptionCollection call into Manager
some code cleaning


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196 cvs headers
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf enable IRST LM in eclipse
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4 delete mysql support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792 add code for printing out information about a translation (ie, distortion, dropped words, etc)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6 - print path statistics for CN and Text input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:46:58 +00:00
bojar
12f50a5f26 Added labelling of scores in nbestlist and fixed mert to understand that.
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 04:45:48 +00:00
redpony
b84426d1af change message
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1 eclipse project file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d took out FactorType
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03 took out FactorType
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:02:39 +00:00
zens
ff15ed0732 - remove some obsolete code
- optional future costs for distortion model


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18 memory pool cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97 using mem pool. needs to be more finely tweaked to give good results
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6 getting ready to use mempool for Phrase
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120 Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f make mysql code work with new scxoring collection
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 16:28:56 +00:00
zens
dd124448c1 - bug fix and further cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7 major score refactoring
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 01:11:45 +00:00
zens
dec0f5f703 print confusion net posterior in nbest list (if input is confusion net)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0 add score logging
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75 deleted Arc & LatticeEdge classes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:11:20 +00:00
zens
0e6517b428 - fixing already fixed bugs that have been re-introduced by someone
- moving some stuff from PhraseDictionaryTree to GenerateTuples
 - removing some obsolete code


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5 turned off profiling
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 03:18:18 +00:00
redpony
b48c33f1da use new score bookkeeping for nbest lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9 cvs ignore
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d cvs ignore
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 15:26:10 +00:00
redpony
14d342508e preparation for new ScoreComponentCollection, which will be much more efficient
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 13:47:43 +00:00
zens
4022ae95bc - print statistics for confusion nets
- small bug fixes


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c perf profiling turned on in eclipse in debug conf
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:24:37 +00:00
redpony
b7b03f9ff2 rename function
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@302 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 14:29:45 +00:00
bojar
b0f7cb32cb Added -report-all-factors, so that stdout is more verbose.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@300 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 00:01:05 +00:00
phkoehn
f89ba84fdc reset sentence counter after reading phrases from input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@293 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:53:50 +00:00
hieuhoang1972
c99e2c1786 Visual Studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@289 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:41:04 +00:00
bojar
88f4bced55 reimplemented future score matrix calculation, should be faster.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@288 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:17:12 +00:00
ccorbett
ee3e1e1576 Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 15:52:09 +00:00
redpony
c2be12bcd4 add irstlm support
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@273 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:42:49 +00:00
zens
a28dc42dd0 - fixed confusion net stuff (translations are identical, scores still different)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@270 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:08:21 +00:00