moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-21 16:17:45 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,512 Commits 136 Branches 26 Tags 147 MiB
9025ac065f
Commit Graph

203 Commits

Author SHA1 Message Date
Hieu Hoang
1a8764aeda cleanup 2013-02-13 21:04:40 +00:00
Hieu Hoang
2e7d4126db add WP 2013-02-13 21:00:51 +00:00
Hieu Hoang
54f7c45f45 create-ini.cpp 2013-02-08 17:57:22 +00:00
Hieu Hoang
e4876599d2 create-ini.cpp 2013-02-08 13:57:59 +00:00
Hieu Hoang
6663732c38 create-ini.cpp 2013-02-08 13:56:31 +00:00
Hieu Hoang
54dd865f91 create-ini.cpp 2013-02-08 12:56:12 +00:00
Hieu Hoang
b2f37dbb6f create-ini.cpp 2013-02-08 11:59:19 +00:00
Hieu Hoang
1a1f0f33f4 create-ini.cpp 2013-02-08 11:53:53 +00:00
Hieu Hoang
87ab883a6e create-ini.cpp 2013-02-08 11:44:20 +00:00
Hieu Hoang
f8783f7e0a create-ini.cpp 2013-02-08 11:35:39 +00:00
Hieu Hoang
40a074093f create-ini.cpp 2013-02-08 11:24:07 +00:00
Hieu Hoang
c0b92c1ddb add program to create ini file. Replace train-model.perl step=9 2013-02-07 19:14:26 +00:00
Hieu Hoang
dd20bbabf7 wtf is arg text-type? 2013-02-07 18:51:03 +00:00
Hieu Hoang
e96cba96ba wtf is arg text-type? 2013-02-07 18:34:27 +00:00
Hieu Hoang
839dff591f wtf is arg text-type? 2013-02-07 18:14:13 +00:00
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
2573d0a122 delete LM/Factory.* 2013-02-01 21:01:44 +00:00
Hieu Hoang
f95e66c067 Merge branch 'master' into weight-new 2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
d87c7c4d34 Added normalization of temporary directory path 2013-01-22 22:12:08 +01:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Hieu Hoang
7ed52368a8 more minor changes in scripts for new format 2012-12-18 12:45:11 +00:00
Hieu Hoang
aa00aebee6 rewrite reuse-weight 2012-12-18 10:23:00 +00:00
hieu
f323416355 delete new program for creating ini file. Hacked current perl script 2012-12-14 16:44:09 +00:00
hieu
6694df6519 mert-moses.perl create ini file in new format 2012-12-14 16:43:12 +00:00
Hieu Hoang
017bbe78e8 forgotten misc programs for Compact pt 2012-11-30 09:49:36 +00:00
Hieu Hoang
b317ac1a34 compile error on misc programs 2012-11-27 17:33:04 +00:00
marcinj
28a962e65e Change -alignment-info to -no-alignment-info 2012-11-17 18:25:30 +01:00
Barry Haddow
a90e1861c0 Alignments on by default for phrase-based 2012-11-15 12:35:43 +00:00
Hieu Hoang
c916206e84 if you don't need word alignments, but the binary phrase table has it anyway. Don't throw a fit 2012-11-14 19:48:08 +00:00
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00
Hieu Hoang
616903ed09 forgot Marcin's compact pt 2012-11-12 21:20:58 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Hieu Hoang
507b49e0f5 fix marcin's querying of compact rule table 2012-10-24 10:37:52 +01:00
Hieu Hoang
fb8eb0d111 fix marcin's querying of compact rule table 2012-10-24 10:34:28 +01:00
Hieu Hoang
6baa3d7e95 converting create_xml.perl to create_xml.cpp 2012-10-23 18:21:54 +01:00
Hieu Hoang
d246e10a1e tp.GetAlignmentInfo() -> tp.GetAlignTerm() 2012-10-22 22:09:52 +01:00
Marcin Junczys-Dowmunt
3a11b0d6fb Temporarily disabling queryPhraseTableMin due to compilation errors 2012-10-22 22:35:53 +02:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
marcinj
ab2e18466f Bugfix in queryPhraseTableMin, works now with target phrase factors 2012-10-04 19:14:42 +02:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Marcin Junczys-Dowmunt
200d1bdc34 Added tool to query compact phrase table 2012-09-13 14:09:32 +00:00
Marcin Junczys-Dowmunt
3f5dcf4d06 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-09-11 16:13:03 +02:00
junczys
bac859c451 Fix locking in AlignmentInfoCollection.* 2012-09-11 16:06:05 +02:00
Marcin Junczys-Dowmunt
0e3edfd8ee Fixes for compact lexical reodering model for other formats than default 2012-08-23 10:26:22 +02:00
Marcin Junczys-Dowmunt
01b9cc36b9 Added -threads all 2012-08-11 01:03:32 +02:00
Marcin Junczys-Dowmunt
ad2d554428 Added -threads all 2012-08-11 01:03:10 +02:00
Marcin Junczys-Dowmunt
ed21d36245 Default number of threads set to 1 2012-08-10 13:22:40 +02:00
Marcin Junczys-Dowmunt
d86d1a042f Added error messages concerning input formats, alignment data, scores 2012-08-07 14:18:07 +02:00
Marcin Junczys-Dowmunt
a78cb959bb Acknowledgements added 2012-08-06 17:25:20 +02:00
Marcin Junczys-Dowmunt
9c905fa6f6 Acknowledgements added 2012-08-06 15:58:13 +02:00
Marcin Junczys-Dowmunt
11f6a3112f Updated link to documentation 2012-08-05 15:38:51 +02:00
Marcin Junczys-Dowmunt
a245e9ea55 Correction of jamfiles etc. 2012-08-04 15:39:30 +02:00
Marcin Junczys-Dowmunt
88a860d776 Warnings, build issues 2012-08-03 19:29:21 +02:00
Marcin Junczys-Dowmunt
20487f9d7f Got rid of warnings 2012-08-03 17:45:00 +02:00
Marcin Junczys-Dowmunt
023bd0c813 Credits added 2012-08-03 17:02:47 +02:00
Marcin Junczys-Dowmunt
a35791893f Updated Jamsfiles, build instructions etc. 2012-08-03 16:38:45 +02:00
Eva Hasler
f592c222fe revert mode changes 2012-07-04 12:25:21 +01:00
Eva Hasler
027a20730e merge Jamfiles 2012-07-04 11:49:07 +01:00
Colin Cherry
07a5c67ebc Merge branch 'master' into miramerge 
Conflicts:
	Jamroot
	misc/queryPhraseTable.cpp
	scripts/training/train-model.perl
 2012-06-14 17:08:16 -04:00
Eva Hasler
e1c1a5343c merge 2012-06-07 11:16:52 +01:00
Barry Haddow
7a78e2d0f7 Add option just to give counts 2012-06-01 13:42:00 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Barry Haddow
c397d2068b Merge branch 'trunk' into miramerge. Still to fix build. 
Conflicts:
	Jamroot
	mert/Data.cpp
	mert/Data.h
	mert/FeatureArray.cpp
	mert/FeatureArray.h
	mert/FeatureData.cpp
	mert/FeatureData.h
	mert/FeatureStats.cpp
	mert/FeatureStats.h
	mert/mert.cpp
	moses-chart-cmd/src/IOWrapper.h
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses/src/GlobalLexicalModel.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/ScoreIndexManager.h
	moses/src/TargetPhrase.h
	regression-testing/tests/phrase.lexicalized-reordering-bin/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering-cn/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering/truth/results.txt
	regression-testing/tests/phrase.multiple-translation-system-lr/truth/results.txt
	regression-testing/tests/phrase.show-weights.lex-reorder/truth/results.txt
	regression-testing/tests/phrase.show-weights/truth/results.txt
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/filter-model-given-input.pl
	scripts/training/mert-moses.pl
 2012-05-24 21:11:35 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Christian Federmann
4ccab95808 Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Christian Federmann
b9b1517e4f Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Hieu Hoang
79c6528a51 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
Hieu Hoang
5ae2a24878 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
Barry Haddow
072848a4df Merge branch 'master' into bjam. Doesn't compile. 
Conflicts:
	.gitignore
	Makefile.am
	config.h.in
	configure.in
	m4/boost.m4
	moses/src/LM/Factory.cpp
	moses/src/LM/ParallelBackoff.h
	moses/src/LM/RandLM.h
	moses/src/Makefile.am
	moses/src/PDTAimp.h
	moses/src/Phrase.h
	moses/src/PhraseDictionaryTree.cpp
	moses/src/ScoreComponentCollection.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TranslationOptionCollection.cpp
	moses/src/TranslationSystem.cpp
	scripts/Makefile
	scripts/released-files
 2011-12-08 23:17:30 +00:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
42975b0635 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
79eecac809 Actually, moses depends on OnDiskPt, not the other way around. 2011-11-25 08:33:16 -05:00
Kenneth Heafield
056b42f171 Actually, moses depends on OnDiskPt, not the other way around. 2011-11-25 08:33:16 -05:00
Barry Haddow
eb4b85e0ed misc jamming 2011-11-23 12:10:45 +00:00
Barry Haddow
f948f32c88 misc jamming 2011-11-23 12:10:45 +00:00
Barry Haddow
3dc30fd51a Remove direction from Phrase 2011-11-21 10:49:26 +00:00
Kenneth Heafield
bf78f7a1ac Replace assert with CHECK until people learn how to use assert properly 2011-11-18 12:07:41 +00:00
Barry Haddow
d57d0c0656 Merge branch 'master' into miramerge 
Conflicts:
	Makefile.am
	config.h.in
	configure.in
	kenlm
	moses-chart-cmd/src/IOWrapper.cpp
	moses/src/Parameter.cpp
	scripts/Makefile
 2011-11-17 17:46:17 +00:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00
Hieu Hoang
87500bc93d visual studio 2011-11-11 22:24:25 +00:00
Barry Haddow
90820ad0c5 Merge branch 'master' into miramerge. 
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.

Conflicts:
	.gitignore
	configure.in
	ltmain.sh
	moses/src/LM/Factory.cpp
	moses/src/LMList.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelKen.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/PhraseDictionaryMemory.cpp
	moses/src/PhraseDictionaryTree.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.h
 2011-10-28 15:54:23 +01:00
Hieu Hoang
a93f4691f6 win32 2011-10-23 09:37:47 +07:00
hieuhoang1972
897fe0f88b visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4356 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-14 10:50:08 +00:00
bhaddow
cfec98197d Update binary phrase table to include sparse. 
It does this by adding a minimum of an  extra uint_32 onto every
source/target record, but I couldn't see where else
to put it.
 2011-09-29 21:35:52 +01:00
hieuhoang1972
9c0d725cde visual studio 2010 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-19 03:07:15 +00:00
jhclark
da6e4935fd Return 0 on success and 1 on fail. Not the other way around. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3954 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-05 00:51:35 +00:00
pjwilliams
75709a6c87 Memory efficiency: make the reserveSize argument non-optional in 
Moses::Phrase's constructor.  The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases.  Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR 
otherwise.  If you know the code involved, it's probably worth reviewing.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-28 11:41:08 +00:00
hieuhoang1972
a3d97584a9 run beautify.perl. Consistent formatting for .h & .cpp files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3902 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-24 13:57:11 +00:00
bhaddow
a2bde7a16e Make sure internal libraries and paths go before boost. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-11 19:32:59 +00:00
hieuhoang1972
564a9ad371 word alignment info in binary pt, code provided by Christof Pintaske 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3637 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-22 10:37:19 +00:00
hieuhoang1972
e504b797b2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 22:29:01 +00:00
hieuhoang1972
c73dddfb5b delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3423 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:34:17 +00:00
hieuhoang1972
bdfa2beab8 delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:16:50 +00:00
hieuhoang1972
888cc09d34 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3411 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-27 10:27:51 +00:00
hieuhoang1972
c9eb463fe6 vs.net 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-05 13:10:26 +00:00
chardmeier
36cfac2eaa Added queryPhraseTable tool. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3259 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-16 20:32:08 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00