Kenneth Heafield
868255af03
Surround mains in try-catch blocks.
2012-01-13 10:20:42 -05:00
Eva Hasler
50d3a62bda
change order of -show-weights output to match nbest list order
2011-12-14 10:51:35 +00:00
Eva Hasler
85ce6547fd
-show-weights: output sparseProducerWeight if != 1, otherwise 'sparse'
2011-12-13 19:13:13 +00:00
Barry Haddow
072848a4df
Merge branch 'master' into bjam. Doesn't compile.
...
Conflicts:
.gitignore
Makefile.am
config.h.in
configure.in
m4/boost.m4
moses/src/LM/Factory.cpp
moses/src/LM/ParallelBackoff.h
moses/src/LM/RandLM.h
moses/src/Makefile.am
moses/src/PDTAimp.h
moses/src/Phrase.h
moses/src/PhraseDictionaryTree.cpp
moses/src/ScoreComponentCollection.h
moses/src/ScoreIndexManager.cpp
moses/src/StaticData.cpp
moses/src/TargetPhrase.cpp
moses/src/TranslationOptionCollection.cpp
moses/src/TranslationSystem.cpp
scripts/Makefile
scripts/released-files
2011-12-08 23:17:30 +00:00
Hieu Hoang
71c78ef0ce
move vs and xcode project files into separate contrib folder
2011-12-02 08:33:39 +07:00
Hieu Hoang
39db162cc0
move vs and xcode project files into separate contrib folder
2011-12-02 08:33:39 +07:00
Kenneth Heafield
9fe831c60c
Merge CreateOnDisk into OnDiskPt, pop out of src
2011-12-01 18:26:05 +00:00
Kenneth Heafield
a0d79781e5
Merge CreateOnDisk into OnDiskPt, pop out of src
2011-12-01 18:26:05 +00:00
Kenneth Heafield
42975b0635
No more autotools (with bhaddow in the room)
2011-12-01 17:17:28 +00:00
Kenneth Heafield
c53453b266
No more autotools (with bhaddow in the room)
2011-12-01 17:17:28 +00:00
Eva Hasler
9084db96c4
add parameter weight-dlm as additional dense weight
2011-11-24 19:27:12 +00:00
Barry Haddow
9c952b586f
move checkplf
2011-11-23 15:48:48 +00:00
Barry Haddow
21f3f19aaa
move checkplf
2011-11-23 15:48:48 +00:00
Kenneth Heafield
a65ed7e587
Jam: install executables in legacy paths and stop leaving a.out files everywhere
2011-11-21 13:20:52 -05:00
Barry Haddow
7fd0e6ca7f
Remove GetTargetPhrase() (already have GetCurrTargetPhrase())
2011-11-21 12:35:58 +00:00
Barry Haddow
5baa595a91
Further direction removal
2011-11-21 11:14:05 +00:00
Barry Haddow
3dc30fd51a
Remove direction from Phrase
2011-11-21 10:49:26 +00:00
Hieu Hoang
ce0065ff2a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a
xcode
2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a
Introducing Jamfiles
...
Currently supports kenlm, irstlm, and srilm options.
bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
caac64a33b
xcode
2011-11-18 21:33:58 +07:00
Kenneth Heafield
024b411e85
One more assert
2011-11-18 13:41:24 +00:00
Kenneth Heafield
bf78f7a1ac
Replace assert with CHECK until people learn how to use assert properly
2011-11-18 12:07:41 +00:00
Kenneth Heafield
404c4b3a73
Why are these executable?
2011-11-17 18:59:29 -05:00
Barry Haddow
d57d0c0656
Merge branch 'master' into miramerge
...
Conflicts:
Makefile.am
config.h.in
configure.in
kenlm
moses-chart-cmd/src/IOWrapper.cpp
moses/src/Parameter.cpp
scripts/Makefile
2011-11-17 17:46:17 +00:00
Kenneth Heafield
72a4c8a0d3
Move kenlm up one level, simplify compilation
2011-11-17 12:49:55 +00:00
Hieu Hoang
253f32a2e5
load hiero format for reading suffix arrays
2011-11-14 00:14:40 +07:00
Hieu Hoang
d97cf2d9a5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-11-11 22:25:54 +00:00
Hieu Hoang
87500bc93d
visual studio
2011-11-11 22:24:25 +00:00
Hieu Hoang
7da1af411c
xcode build
2011-11-11 20:55:55 +07:00
Barry Haddow
6890472ba1
Merge branch 'master' into miramerge
...
Conflicts:
.gitignore
config.h.in
moses/src/ChartTrellisPath.cpp
moses/src/Makefile.am
2011-11-11 08:25:13 +00:00
Hieu Hoang
aac12ed58f
xcode
2011-10-30 12:51:08 +07:00
Hieu Hoang
aff5978be4
Revert "xcode"
...
This reverts commit c6b333a832
.
2011-10-30 12:37:51 +07:00
Hieu Hoang
c6b333a832
xcode
2011-10-29 20:00:45 +07:00
Barry Haddow
90820ad0c5
Merge branch 'master' into miramerge.
...
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.
Conflicts:
.gitignore
configure.in
ltmain.sh
moses/src/LM/Factory.cpp
moses/src/LMList.cpp
moses/src/LMList.h
moses/src/LanguageModel.cpp
moses/src/LanguageModel.h
moses/src/LanguageModelKen.h
moses/src/Makefile.am
moses/src/Manager.cpp
moses/src/PhraseDictionaryMemory.cpp
moses/src/PhraseDictionaryTree.cpp
moses/src/StaticData.cpp
moses/src/TargetPhrase.h
2011-10-28 15:54:23 +01:00
Hieu Hoang
a93f4691f6
win32
2011-10-23 09:37:47 +07:00
hieuhoang1972
897fe0f88b
visual studio
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4356 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-14 10:50:08 +00:00
Barry Haddow
c83166087e
Merge branch 'master' into miramerge
...
Conflicts:
moses/src/LanguageModel.cpp
moses/src/TargetPhrase.h
moses/src/TrellisPath.h
moses/src/Util.h
scripts/training/train-model.perl
2011-10-12 17:14:23 +01:00
bhaddow
84d73700af
Implementation of Lattice sampling (Chatterjee and Cancedda, emnlp 2010)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4295 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-04 15:46:24 +00:00
nicolabertoldi
23d9a9b55e
normalization of output spaces before and after field separator
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4293 1f5c12ca-751b-0410-a591-d2e778427230
2011-10-03 16:11:39 +00:00
hieuhoang1972
9762a65bd8
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4264 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-25 10:44:47 +00:00
heafield
19879a8b1e
-threads all option
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4252 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-22 22:29:56 +00:00
bhaddow
5b7c5ebdb5
Merge branch 'master' into miramerge
...
Conflicts:
moses-chart-cmd/src/Main.cpp
moses-cmd/src/IOWrapper.cpp
moses-cmd/src/Main.cpp
moses/src/DummyScoreProducers.cpp
moses/src/DummyScoreProducers.h
moses/src/GenerationDictionary.cpp
moses/src/GenerationDictionary.h
moses/src/GlobalLexicalModel.h
moses/src/LMList.h
moses/src/LanguageModel.cpp
moses/src/LanguageModel.h
moses/src/LanguageModelImplementation.h
moses/src/LanguageModelKen.h
moses/src/LanguageModelMultiFactor.cpp
moses/src/LanguageModelMultiFactor.h
moses/src/LanguageModelSingleFactor.cpp
moses/src/LanguageModelSingleFactor.h
moses/src/LexicalReordering.h
moses/src/PhraseDictionary.cpp
moses/src/PhraseDictionary.h
moses/src/ScoreIndexManager.cpp
moses/src/ScoreProducer.h
moses/src/StaticData.cpp
moses/src/StaticData.h
moses/src/TranslationSystem.cpp
2011-09-20 11:23:38 +01:00
arianna_b
633b80f515
recovered missing blank in n-best-list output
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4170 1f5c12ca-751b-0410-a591-d2e778427230
2011-09-02 11:40:32 +00:00
nicolabertoldi
75edc2eddd
change to print the corrett name of the features with InputScores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4168 1f5c12ca-751b-0410-a591-d2e778427230
2011-08-30 12:25:50 +00:00
hieuhoang1972
5449839d75
option to sort word alignment info, as suggested by arianna bisazza
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4164 1f5c12ca-751b-0410-a591-d2e778427230
2011-08-26 02:37:52 +00:00
bhaddow
1f3c11b441
Merge branch 'master' into miramerge
...
Passes all regression except for the score tests, as I still have to merge
in the missing files for these tests.
Conflicts:
.gitignore
Makefile.am
configure.in
moses-chart/moses-chart.xcodeproj/project.pbxproj
moses/src/ChartHypothesis.cpp
moses/src/ChartTranslationOptionCollection.cpp
moses/src/ChartTrellisPath.cpp
moses/src/DotChart.cpp
moses/src/LMList.h
moses/src/LanguageModel.cpp
moses/src/LanguageModel.h
moses/src/LanguageModelFactory.cpp
moses/src/LanguageModelRemote.h
moses/src/LexicalReordering.h
moses/src/Makefile.am
moses/src/Manager.cpp
moses/src/Parameter.cpp
moses/src/RuleCubeQueue.h
moses/src/ScoreIndexManager.cpp
moses/src/StaticData.cpp
moses/src/StaticData.h
moses/src/TargetPhrase.cpp
moses/src/TargetPhrase.h
moses/src/TranslationOptionCollection.cpp
2011-08-22 14:52:02 +01:00
bhaddow
de26a207d6
Merge commit '67dd80fb7bf71f36f2b29b4ba7a39e3ad35e5f81' into miramerge
...
Conflicts:
moses-cmd/src/IOWrapper.cpp
moses-cmd/src/IOWrapper.h
moses-cmd/src/Main.cpp
moses-cmd/src/TranslationAnalysis.cpp
2011-08-19 14:55:32 +01:00
bhaddow
cf81f9188f
Merged up to 3895 from trunk
...
git-svn-id: http://svn.statmt.org/repository/mira@3934 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
pkoehn
42e10d010b
added reporting of sparse features in n-best list
...
git-svn-id: http://svn.statmt.org/repository/mira@3926 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
bhaddow
e664b4a4b3
Merge 3791-3842 from trunk
...
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
hieuhoang1972
b0ec298ce2
vs.net build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4088 1f5c12ca-751b-0410-a591-d2e778427230
2011-07-23 23:52:34 +00:00
hieuhoang1972
9c0d725cde
visual studio 2010
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
2011-07-19 03:07:15 +00:00
naditomeh
83d02c11c6
Fix a segmentation fault produced when both 'constraint' and
...
'translation-details' are used, and no hypothesis that matches the
reference translation is found.
The problem resulted from a missing check if a vector is empty before
incrementing its iterator.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3950 1f5c12ca-751b-0410-a591-d2e778427230
2011-04-17 19:46:46 +00:00
phkoehn
4ee7e5f673
added some comments
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3911 1f5c12ca-751b-0410-a591-d2e778427230
2011-03-02 19:02:07 +00:00
pjwilliams
75709a6c87
Memory efficiency: make the reserveSize argument non-optional in
...
Moses::Phrase's constructor. The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases. Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR
otherwise. If you know the code involved, it's probably worth reviewing.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-28 11:41:08 +00:00
hieuhoang1972
67dd80fb7b
run beautify.perl. Consistent formatting for .h & .cpp files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3897 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-24 12:39:29 +00:00
phkoehn
4c11bcd617
extensions to phrase table scoring options
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3893 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-23 10:27:54 +00:00
bhaddow
6b8415bffb
Write alignment info through OutputCollector so it gets ordered
...
correctly when run with multiple threads.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3882 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-16 16:50:55 +00:00
ales-t
83e2406f42
Word alignment output also works with MBR decoding.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3875 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-08 17:15:50 +00:00
bojar
0bc0ece594
Ales Tamchyna's printing of alignments (-print-alignment-info did nothing)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3867 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-03 09:08:42 +00:00
pjwilliams
8051c5ad35
Use TranslationTask objects to perform sentence decoding in moses-chart.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3846 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-25 17:15:30 +00:00
pjwilliams
99bbfe938b
Use OutputCollector to write moses-chart output.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3843 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-25 15:17:17 +00:00
bhaddow
a2bde7a16e
Make sure internal libraries and paths go before boost.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a
Change of boost macros - please make sure you favourite configuration still works
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-13 23:38:48 +00:00
heafield
a596b48971
Fix --enable-shared compilation.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-11 19:32:59 +00:00
bhaddow
a2730c445d
Merge up to 3791 from trunk.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
2011-01-05 13:49:44 +00:00
hieuhoang1972
41c5b3a1c2
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3769 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-10 13:04:06 +00:00
bhaddow
50f0e6c07d
Add a show-weights option. It prints out the moses features and exits. May
...
load tables as a side-effect.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3744 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 16:44:28 +00:00
xandfraser
c0c617a8c4
Added print word alignment in nbest
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3726 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-22 15:34:53 +00:00
hieuhoang1972
735d5b682f
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3673 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-27 18:54:50 +00:00
hieuhoang1972
34e7c43114
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3664 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-27 03:14:11 +00:00
hieuhoang1972
5f6baa9021
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3627 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-18 05:47:07 +00:00
bhaddow
7e72ceea22
Goodbye ScoreIndexManager.
...
Compiles ok, but haven't dared to run regression yet.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-06 22:06:49 +00:00
hieuhoang1972
e504b797b2
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece
ken lm integration
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
2010-09-26 22:29:01 +00:00
hieuhoang1972
bdfa2beab8
delete eclipse build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
2010-09-10 09:16:50 +00:00
redpony
570183461c
plf checker
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3407 1f5c12ca-751b-0410-a591-d2e778427230
2010-08-16 01:03:39 +00:00
bhaddow
904133fcb7
Merge in the multiple models branch. These changes allow the moses server
...
to support multiple translation, language and generation models within the
same process. The main design change is the introduction of a TranslationSystem
object to manage the models, which have been moved out of StaticData.
The changes should have no effect on existing systems.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3394 1f5c12ca-751b-0410-a591-d2e778427230
2010-08-10 13:12:00 +00:00
hieuhoang1972
31930eb6fc
alignment info in pt
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3358 1f5c12ca-751b-0410-a591-d2e778427230
2010-07-17 22:29:06 +00:00
hieuhoang1972
65194ba505
drop unknown option for chart decoding, xcode, minor adjustments to regression test formatting
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3312 1f5c12ca-751b-0410-a591-d2e778427230
2010-06-09 12:56:31 +00:00
hieuhoang1972
c9eb463fe6
vs.net
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
2010-06-05 13:10:26 +00:00
bhaddow
649bf24f62
One moses main
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3274 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-27 08:37:25 +00:00
bhaddow
f58f8397f4
Correct bug in use of scale factor
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3268 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-25 08:55:13 +00:00
bhaddow
c9baabe2ea
Merging of moses mains. mosesmt now does single and multi-threeaded
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3264 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-19 16:42:18 +00:00
dowobeha
9fec69ce31
Merged fix (r3001-3260) for problem where multi-threaded moses would fail during linking if boost was compiled for 64 bit.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3261 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-17 01:41:58 +00:00
bhaddow
bb2431331c
Fix to consensus decoding to stop it discarding hypos with zero score.
...
Move hypothesis id management into Manager to make it thread-safe.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-14 09:33:03 +00:00
hieuhoang1972
f36759478b
don't spew out param list if there's a genuine error
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089
m_detailedTranslationReportingStream=NULL if not outputting trans opt
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310
Add consensus decoding to mosesmt. Really need to get the mainlines merged!
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 14:55:59 +00:00
phkoehn
f52a2cc55d
code cleanup & enable trace ("-t") for MBR decoding ("-mbr")
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 21:18:47 +00:00
pjwilliams
2a5b262503
Write translation details to a named file instead of cerr.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-08 15:51:59 +00:00
bhaddow
ffea53717e
Refactoring of output search graph code to enable it to be used
...
from moses server.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:53:41 +00:00
nicolabertoldi
1c615ea751
re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 13:38:56 +00:00
nicolabertoldi
cf468273bc
Safer way to cleanup LM caches after a given number of processed sentences.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f
I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available).
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-23 15:01:06 +00:00
hieuhoang1972
45ecd333f9
delete std namespace in .h files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3116 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-12 10:04:35 +00:00
hieuhoang1972
c117ef7c17
Copy in changes from the chart_merge branch (doing it manually because the
...
server doesn't seem to support subversion's --reintegrate option).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63
Implementation of consensus decoding - first cut.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-07 15:47:58 +00:00
hieuhoang1972
202bcf2911
eclipse build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-31 20:03:54 +00:00
bhaddow
795224736b
Merge revisions 2670-2988 from track. Passes all regression except lexicalised
...
reordering
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-19 17:52:51 +00:00
bhaddow
22b74b56f7
Output of nbest from lattice mbr
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-16 11:34:50 +00:00
abarun
86ef292af1
Writing out sentence number when printing all derivations
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-07 08:28:16 +00:00
abarun
3434d15cda
Lattice MBR pruning based on target length of MAP hypothesis
...
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
2010-03-07 07:57:48 +00:00
bhaddow
ef54ec3699
Fix mosesmt compile
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2942 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 13:30:40 +00:00
jfouet
242846f07c
Use portable include guard instead of pragma once
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 11:15:44 +00:00
jfouet
087b2021c5
Link libmoses with boost-thread
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 10:34:00 +00:00
jfouet
7c1e287c71
Add configure options to link dynamically with libmoses
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432
Fix lattice mbr grid search so that the full lattice is created and pruned correctly.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-22 23:42:35 +00:00
bhaddow
0e16a9c3c5
deubg to cerr not cout
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2928 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-22 19:20:28 +00:00
bhaddow
b2201e765d
Grid search for lattice mbr
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-18 14:15:34 +00:00
bojar
cce14523ab
added -report-all-factors-in-n-best
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-18 10:54:33 +00:00
bhaddow
11cb44ba5b
Refactoring of lattice mbr code so that it can be used with mosesmt
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2907 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-17 17:25:56 +00:00
bhaddow
7f45cd12f9
reduce memory usage in lattice mbr
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2906 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-17 14:14:44 +00:00
bhaddow
b3a8411ae1
Fix compile error
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2901 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-15 19:27:17 +00:00
hieuhoang1972
6b1b505089
visual studio
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2897 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-14 00:26:34 +00:00
abarun
6aff4f1afd
Floor probability for unknown ngrams in Lattice MBR
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2896 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-12 18:04:17 +00:00
abarun
0b04e54234
Only outputting surface form for LatticeMBR argmax
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2893 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-12 15:56:37 +00:00
bhaddow
2396f6d9e9
Fix moses mt compile error
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2886 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-11 10:44:11 +00:00
abarun
4ac95fb82a
Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46
Set appropriate verbose level for Lattice MBR
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 17:30:07 +00:00
abarun
904a982e05
Fixed bug in nbest MBR - now outputting correct MBR solution
...
Fixed bug in lattice MBR - now outputting correct MBR solution
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2853 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 17:04:05 +00:00
abarun
117f5ef329
Lattice MBR now uses nbest list as default hypothesis set during reranking.
...
To use lattice instead as hypothesis set, run with -lattice-hypo-set option
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 11:20:20 +00:00
abarun
6d7a710beb
Added LatticeMBR to moses-cmd/Makefile.am
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2842 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 10:30:35 +00:00
abarun
32a58a3ec9
Implemented Lattice MBR for Moses.
...
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
2010-02-03 10:23:32 +00:00
phkoehn
d606f541e4
die fast
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2784 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-29 17:44:28 +00:00
phkoehn
cccab3d22b
extended search graph output
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2717 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 15:32:04 +00:00
nicolabertoldi
558ff92c33
if the output file for nbest is /dev/stdout, the output of best translation is suppressed; this simulates the behavior of '-' shortcut
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2702 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 13:09:10 +00:00
chardmeier
a3e9af21c3
Commented out unused variable.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2698 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-28 12:11:09 +00:00
hieuhoang1972
42b69fe20f
leak
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2649 1f5c12ca-751b-0410-a591-d2e778427230
2010-01-09 18:53:14 +00:00
bhaddow
b8789dfd97
Fix MosesMT.cpp to work with new mbr interface
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2641 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-17 15:00:11 +00:00
nicolabertoldi
c30d135f93
enabling output of recovering path for MBR both in the best translation and in the nbest list
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2639 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-14 17:27:07 +00:00
nicolabertoldi
d17f9dfd8e
enabling output of nbest with MBR
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2637 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-14 14:24:14 +00:00
bhaddow
499bf77ebc
output feature weights debug in mosesmt
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2636 1f5c12ca-751b-0410-a591-d2e778427230
2009-12-04 15:24:22 +00:00
bhaddow
c7dea2e497
make sure it builds on platforms without pthreads
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2618 1f5c12ca-751b-0410-a591-d2e778427230
2009-11-13 10:13:55 +00:00
hieuhoang1972
a042aad7f2
visual studio
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
2009-10-02 09:54:10 +00:00
bhaddow
beaf123b5f
Output of nbest from multi-threaded moses
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2535 1f5c12ca-751b-0410-a591-d2e778427230
2009-08-31 12:55:33 +00:00
bhaddow
c5d39f039f
Merge moses-server branch (includes mt moses) into trunk.
...
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
2009-08-07 16:47:54 +00:00
hieuhoang1972
7d17d823ae
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2351 1f5c12ca-751b-0410-a591-d2e778427230
2009-05-31 15:56:45 +00:00
phkoehn
8833098925
generalized n-best list reporting for feature functions, added experimental version of global lexical model
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2343 1f5c12ca-751b-0410-a591-d2e778427230
2009-05-26 19:30:35 +00:00
abarun
3cc8305efa
Modified xcode project to make it work with both sri and irst lms
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1955 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-11 19:27:59 +00:00
hieuhoang1972
69b2dc441d
eclipse files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
2008-12-10 14:20:10 +00:00
hieuhoang1972
789d6d96d1
intergrate randlm
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
2008-11-04 18:03:03 +00:00
hieuhoang1972
c59b532df1
eclipse proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-31 18:44:44 +00:00
hieuhoang1972
8d6d739a6a
eclipse proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1925 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-30 19:44:54 +00:00
hieuhoang1972
6a61ffa9bd
unix build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1899 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-10 18:30:51 +00:00
hieuhoang1972
868428fe66
unix build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1898 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-09 00:20:39 +00:00
hieuhoang1972
928d771085
create namespace
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1897 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-08 23:51:26 +00:00
redpony
232dc9889c
enable moses to accept a file that lists feature name and weight pairs.
...
enable moses to export its search graph as a phrase lattice encoded serialized in a Google protocol buffer. This requires protoc (http://code.google.com/p/protobuf/ ) to function, disabled by default.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1890 1f5c12ca-751b-0410-a591-d2e778427230
2008-09-24 16:48:23 +00:00
nicolabertoldi
dd6c36640b
Support for printing out word-to-word alignments (besides phrase-to-phrase alignments)
...
as contained in the phrase table.
If PT contains word-to-word alignments between source and target phrases,
Moses can optionally output them in the nbest and in the log file (if verbose).
W2w alignments from source to target and from target to source can differ,
if they differ in the PT.
Detailed documentation will be added in the Moses webpages very soon.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1886 1f5c12ca-751b-0410-a591-d2e778427230
2008-09-12 18:09:06 +00:00
hieuhoang1972
5dee5d04aa
rename IOStream to IOWrapper.
...
move vs.net solution file to root folder
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
2008-08-05 00:24:45 +00:00
hieuhoang1972
47e4803f97
move cube pruning moses lib to trunk
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1849 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-11 13:22:26 +00:00
hieuhoang1972
1792e14945
eclipse project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1810 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-02 21:23:33 +00:00
hieuhoang1972
9997b7fd7e
alignment output fix
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1604 1f5c12ca-751b-0410-a591-d2e778427230
2008-05-04 13:13:12 +00:00
hieuhoang1972
3fc0b8ddb4
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1603 1f5c12ca-751b-0410-a591-d2e778427230
2008-05-04 12:52:52 +00:00
hieuhoang1972
24a5a24c8b
changed eclipse project for irstlm changes
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1595 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-15 14:22:42 +00:00
nicolabertoldi
43ae535165
added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-02 17:08:54 +00:00
phkoehn
4ee468dc03
output search graph
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1588 1f5c12ca-751b-0410-a591-d2e778427230
2008-03-17 21:34:19 +00:00
hieuhoang1972
2d95df359e
code clean - move creating wordgraph file to iostream class
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1581 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-29 23:08:58 +00:00
hieuhoang1972
e2f4d64608
output wordgraph for german
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1574 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 13:31:37 +00:00
hieuhoang1972
4964c45489
output wordgraph for german
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1573 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 12:43:04 +00:00
hieuhoang1972
76606d3823
minor -
...
add svn properties for XmlOption.
make vs & eclipse build use return, rather than exit, when closing down
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1555 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-09 17:08:09 +00:00
hieuhoang1972
fd60fe93b9
roll back last change. seg fault in release build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1549 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-29 19:28:13 +00:00
phkoehn
0faf1a83c0
bug fix for distinct n-best list generation, resolved memory blowup issue
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1542 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-18 19:00:07 +00:00
phkoehn
1044b16522
bug fixes to distinct n-best list, mbr decoding; also changed switches for mbr
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1540 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-16 20:25:01 +00:00
abarun
aa6f605a2d
Updated xcode project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1518 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-26 15:32:05 +00:00
hieuhoang1972
dee505b823
don't use hypo pool until delayed destructor is sorted out
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1513 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-16 00:09:21 +00:00
redpony
7dbcef925d
Implemented -r (-recover-input-path) to recover the actual path through the CN/word lattice that was used in the best translation. Also cleaned up handling of source Phrases in the context of a particular hypothesis, which may improve performance translating with lexicalized reordering models.
...
Removed PhraseReference since the concept was broken for CN/lattice inputs.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1468 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-28 16:43:33 +00:00
jdschroeder
6eaf3db0f5
updated xcode projects to include new source files.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1457 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-05 10:46:18 +00:00
hieuhoang1972
4a2982cd34
build with SRILM in windows under different configuration
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-17 20:45:51 +00:00
jdschroeder
0bfb92cfe1
Deleted old xcode files.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:49:52 +00:00
hieuhoang1972
9aac5e70de
update eclipse project file for irstlm change
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a
Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 09:03:00 +00:00
hieuhoang1972
8525279d7d
rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e
code tidy up
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc
fix compile error
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7
Code for MBR decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c
visual studio compile errors
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 21:37:25 +00:00
abarun
5c0f6d0415
Code for MBR decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1383 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 20:54:39 +00:00
hieuhoang1972
d2ebe33f9e
visual studio project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1364 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 18:10:24 +00:00
redpony
c80d8b8d47
Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 14:08:46 +00:00
hieuhoang1972
cd697c28ae
re-introduce konrad lexicalized reordering but fix bugs with help from philipp.
...
speed improvements by caching probabilities in Trans Opt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1338 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-06 00:24:25 +00:00
hieuhoang1972
8566962ecc
output empty line even if no best hypothesis found
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1305 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-14 19:47:51 +00:00
hieuhoang1972
075681d6fc
visual studio proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1267 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 09:01:50 +00:00
hieuhoang1972
5f22fb13d3
make output of decimal places consistent by not format anywhere but in Main.cpp
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1266 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:43:45 +00:00
hieuhoang1972
2c9f1a13fe
make output of decimal places consistent by not format anywhere but in Main.cpp
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1265 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:17:54 +00:00
phkoehn
f1d2bd0eb5
added option -include-alignment-in-n-best to include the word alignment for each sentence in the n-best list file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1246 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-26 20:59:41 +00:00
hieuhoang1972
62b4741de0
move calling InitializeBeforeSentenceProcessing() & CleanUpAfterSentenceProcessing() in Manager class
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1241 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-24 20:32:32 +00:00
hieuhoang1972
bef38f4006
code cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1234 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-23 00:00:09 +00:00
hieuhoang1972
c58393a4b4
verbose=0 nothing goes to stderr except for real, aborting errors
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1232 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-22 23:44:38 +00:00
hieuhoang1972
7ecb0ce66e
change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1227 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-21 19:48:53 +00:00
hieuhoang1972
f3cbacba3e
code cleanup - make FactorCollection and StaticData totally accessible only globally
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1218 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-16 18:08:37 +00:00
hieuhoang1972
e247f1da6f
fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1209 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-13 19:15:34 +00:00
hieuhoang1972
6b4dfc4db2
added #def to use hypo pool
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1206 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-12 11:05:13 +00:00
hieuhoang1972
006e2724e0
take out irstlm on VS build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1195 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-09 17:36:07 +00:00
hieuhoang1972
9cf7257d27
don't skip empty lines
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1169 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-05 10:24:01 +00:00
hieuhoang1972
e7838339bb
exit/return from main()
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1141 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 16:21:28 +00:00
nicolabertoldi
be039bf84a
Reduced time to die!!!
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1139 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 14:47:13 +00:00
hieuhoang1972
e1823a52ac
prune arcList & LatticePathCollection (contenders for n-best paths)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f
fixed mem leak
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-21 13:38:03 +00:00
redpony
0f3ee4b814
If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-08 14:46:48 +00:00
hieuhoang1972
dd721e1b4f
Mac xcode proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e
dismantle IODevoce framework
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 23:06:30 +00:00
hieuhoang1972
c49a2e31bf
eclipse preferences. not sure if need to go into svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7
lots of small changes and code clean up:
...
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241
Modified output of feature scores.
...
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48
updated eclispe project file to work with calipso version
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949
statically zlib on WIN32
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac
eclipse project file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80
added internal, x-platform LM which exactly mimics SRILM
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f
changes to make LMs work in Windows
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927
solved bug in n-best list creation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc
added comments
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2
rename InputOutput to IODevice
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c
added comments
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a
visual studio project files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59
code cleanup and commenting brought about when documenting for jhu report
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4
xcode proj files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc
taken boost out of eclipse project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90
delete zlib-win32 proj. library should be in default path
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e
put back Visual Leak Detector for Win32 build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386
cleanup... renamed --report-source-word-span into --report-segmentation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c
cleanup of verbose logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:03:27 +00:00
swadey
0ffbcca545
- Added necessary zlib-win32 implementation for winbloze
...
- update project files for vc++ and fixed minor code issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9
make building moses/moses-cmd a single make command rather than two
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-23 15:18:53 +00:00
redpony
1700da00bf
remove .cvsignore files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:39:02 +00:00
redpony
1022363f39
remove acsite
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:06:24 +00:00
redpony
fe74de6b44
Remove files that are autogenerated
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:50:36 +00:00
redpony
75796cb419
remove misleading file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:34:50 +00:00
redpony
6eaba82546
remove references to boost, fix formatting, fix make-release-tarball to work with svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:24:09 +00:00
redpony
2e8001f428
prepare for public releases
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 16:24:39 +00:00
redpony
cc97567b2b
remove references to JHU fs
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:26:27 +00:00
redpony
b116321fd9
remove references to Mysql
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:20:23 +00:00
redpony
3fb417f914
remove references to boost
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3
remove mysql dependency
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85
eclipse proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:39:59 +00:00
mfederico
2a3037692b
Added decoding time computation.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c
Added decoding time computation.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 18:31:16 +00:00
eherbst
54166381c9
*** empty log message ***
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881
fixed check for n_gram.h in irstlm
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:32:01 +00:00
redpony
da207d0016
add optional LM statistics reporting. enable with '-L true' on command line
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 22:44:01 +00:00
ccorbett
4e3631e1b0
IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:51:17 +00:00
hieuhoang1972
2a7179a8fa
choice of not labelling n-best output for wade shen's mert script
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:08:39 +00:00
ccorbett
7019abf652
reordering scores are now implemented for n-best lists
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 18:11:52 +00:00
hieuhoang1972
dfe2e58187
output trans & gen scores in order they were created
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@687 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 03:03:18 +00:00
zens
61294d90ad
- generate distinct nbest surface strings (if 3rd token of n-best-list is 'distinct')
...
- some sanity checks
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@674 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-12 00:06:55 +00:00
eherbst
5cb683cd7e
moved class InputType to InputType.h;
...
added more detailed statistics-keeping to SentenceStats;
added custom malloc/realloc (see Util.h);
some commenting
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@666 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 21:04:38 +00:00
redpony
8e986774e1
print input line number in logs
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@663 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 20:16:27 +00:00
redpony
8e4128beef
add dropped word analysis, fix potential out of memory crash
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21
visual studio proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:21:27 +00:00
redpony
eff4b3447e
FactorTypeSet->FactorMask
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 22:41:26 +00:00
redpony
5a0787310b
FactorTypeSet -> FactorMask
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 20:42:34 +00:00
phkoehn
525a181f12
re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 04:20:06 +00:00
zens
b2041149f2
early pruning of path during confusion net exploration
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@594 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-09 19:14:43 +00:00
redpony
d4128a7f8c
N_BEST cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f
delete nbest config
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1
delete n-best config
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:16:01 +00:00
redpony
233c610cd8
get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:49:07 +00:00
redpony
f83c8abd66
add detailed logging of 1-best translation output
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:32 +00:00
zens
6cfe732bff
- add some source files in Makefile.am
...
- bug fix: source / Manager get deleted in right order
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:18:13 +00:00
zens
8bf9742655
move CreateTranslationOptionCollection call into Manager
...
some code cleaning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196
cvs headers
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf
enable IRST LM in eclipse
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4
delete mysql support
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792
add code for printing out information about a translation (ie, distortion, dropped words, etc)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6
- print path statistics for CN and Text input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:46:58 +00:00
bojar
12f50a5f26
Added labelling of scores in nbestlist and fixed mert to understand that.
...
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 04:45:48 +00:00
redpony
b84426d1af
change message
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1
eclipse project file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d
took out FactorType
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03
took out FactorType
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:02:39 +00:00
zens
ff15ed0732
- remove some obsolete code
...
- optional future costs for distortion model
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18
memory pool cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97
using mem pool. needs to be more finely tweaked to give good results
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6
getting ready to use mempool for Phrase
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f
make mysql code work with new scxoring collection
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 16:28:56 +00:00
zens
dd124448c1
- bug fix and further cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7
major score refactoring
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 01:11:45 +00:00
zens
dec0f5f703
print confusion net posterior in nbest list (if input is confusion net)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0
add score logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75
deleted Arc & LatticeEdge classes
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:11:20 +00:00
zens
0e6517b428
- fixing already fixed bugs that have been re-introduced by someone
...
- moving some stuff from PhraseDictionaryTree to GenerateTuples
- removing some obsolete code
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5
turned off profiling
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 03:18:18 +00:00
redpony
b48c33f1da
use new score bookkeeping for nbest lists
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9
cvs ignore
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d
cvs ignore
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 15:26:10 +00:00
redpony
14d342508e
preparation for new ScoreComponentCollection, which will be much more efficient
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 13:47:43 +00:00
zens
4022ae95bc
- print statistics for confusion nets
...
- small bug fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c
perf profiling turned on in eclipse in debug conf
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:24:37 +00:00
redpony
b7b03f9ff2
rename function
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@302 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 14:29:45 +00:00
bojar
b0f7cb32cb
Added -report-all-factors, so that stdout is more verbose.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@300 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 00:01:05 +00:00
phkoehn
f89ba84fdc
reset sentence counter after reading phrases from input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@293 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:53:50 +00:00
hieuhoang1972
c99e2c1786
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@289 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:41:04 +00:00
bojar
88f4bced55
reimplemented future score matrix calculation, should be faster.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@288 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:17:12 +00:00
ccorbett
ee3e1e1576
Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 15:52:09 +00:00
redpony
c2be12bcd4
add irstlm support
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@273 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:42:49 +00:00
zens
a28dc42dd0
- fixed confusion net stuff (translations are identical, scores still different)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@270 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:08:21 +00:00