moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 15:04:05 +03:00
Code Issues Packages Projects Releases Wiki Activity
10,262 Commits 136 Branches 26 Tags 147 MiB
beaf295741
Commit Graph

188 Commits

Author SHA1 Message Date
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
2573d0a122 delete LM/Factory.* 2013-02-01 21:01:44 +00:00
Hieu Hoang
f95e66c067 Merge branch 'master' into weight-new 2013-01-28 13:37:21 +00:00
Marcin Junczys-Dowmunt
d87c7c4d34 Added normalization of temporary directory path 2013-01-22 22:12:08 +01:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Hieu Hoang
7ed52368a8 more minor changes in scripts for new format 2012-12-18 12:45:11 +00:00
Hieu Hoang
aa00aebee6 rewrite reuse-weight 2012-12-18 10:23:00 +00:00
hieu
f323416355 delete new program for creating ini file. Hacked current perl script 2012-12-14 16:44:09 +00:00
hieu
6694df6519 mert-moses.perl create ini file in new format 2012-12-14 16:43:12 +00:00
Hieu Hoang
017bbe78e8 forgotten misc programs for Compact pt 2012-11-30 09:49:36 +00:00
Hieu Hoang
b317ac1a34 compile error on misc programs 2012-11-27 17:33:04 +00:00
marcinj
28a962e65e Change -alignment-info to -no-alignment-info 2012-11-17 18:25:30 +01:00
Barry Haddow
a90e1861c0 Alignments on by default for phrase-based 2012-11-15 12:35:43 +00:00
Hieu Hoang
c916206e84 if you don't need word alignments, but the binary phrase table has it anyway. Don't throw a fit 2012-11-14 19:48:08 +00:00
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00
Hieu Hoang
616903ed09 forgot Marcin's compact pt 2012-11-12 21:20:58 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Hieu Hoang
507b49e0f5 fix marcin's querying of compact rule table 2012-10-24 10:37:52 +01:00
Hieu Hoang
fb8eb0d111 fix marcin's querying of compact rule table 2012-10-24 10:34:28 +01:00
Hieu Hoang
6baa3d7e95 converting create_xml.perl to create_xml.cpp 2012-10-23 18:21:54 +01:00
Hieu Hoang
d246e10a1e tp.GetAlignmentInfo() -> tp.GetAlignTerm() 2012-10-22 22:09:52 +01:00
Marcin Junczys-Dowmunt
3a11b0d6fb Temporarily disabling queryPhraseTableMin due to compilation errors 2012-10-22 22:35:53 +02:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
marcinj
ab2e18466f Bugfix in queryPhraseTableMin, works now with target phrase factors 2012-10-04 19:14:42 +02:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Marcin Junczys-Dowmunt
200d1bdc34 Added tool to query compact phrase table 2012-09-13 14:09:32 +00:00
Marcin Junczys-Dowmunt
3f5dcf4d06 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-09-11 16:13:03 +02:00
junczys
bac859c451 Fix locking in AlignmentInfoCollection.* 2012-09-11 16:06:05 +02:00
Marcin Junczys-Dowmunt
0e3edfd8ee Fixes for compact lexical reodering model for other formats than default 2012-08-23 10:26:22 +02:00
Marcin Junczys-Dowmunt
01b9cc36b9 Added -threads all 2012-08-11 01:03:32 +02:00
Marcin Junczys-Dowmunt
ad2d554428 Added -threads all 2012-08-11 01:03:10 +02:00
Marcin Junczys-Dowmunt
ed21d36245 Default number of threads set to 1 2012-08-10 13:22:40 +02:00
Marcin Junczys-Dowmunt
d86d1a042f Added error messages concerning input formats, alignment data, scores 2012-08-07 14:18:07 +02:00
Marcin Junczys-Dowmunt
a78cb959bb Acknowledgements added 2012-08-06 17:25:20 +02:00
Marcin Junczys-Dowmunt
9c905fa6f6 Acknowledgements added 2012-08-06 15:58:13 +02:00
Marcin Junczys-Dowmunt
11f6a3112f Updated link to documentation 2012-08-05 15:38:51 +02:00
Marcin Junczys-Dowmunt
a245e9ea55 Correction of jamfiles etc. 2012-08-04 15:39:30 +02:00
Marcin Junczys-Dowmunt
88a860d776 Warnings, build issues 2012-08-03 19:29:21 +02:00
Marcin Junczys-Dowmunt
20487f9d7f Got rid of warnings 2012-08-03 17:45:00 +02:00
Marcin Junczys-Dowmunt
023bd0c813 Credits added 2012-08-03 17:02:47 +02:00
Marcin Junczys-Dowmunt
a35791893f Updated Jamsfiles, build instructions etc. 2012-08-03 16:38:45 +02:00
Eva Hasler
f592c222fe revert mode changes 2012-07-04 12:25:21 +01:00
Eva Hasler
027a20730e merge Jamfiles 2012-07-04 11:49:07 +01:00
Colin Cherry
07a5c67ebc Merge branch 'master' into miramerge 
Conflicts:
	Jamroot
	misc/queryPhraseTable.cpp
	scripts/training/train-model.perl
 2012-06-14 17:08:16 -04:00
Eva Hasler
e1c1a5343c merge 2012-06-07 11:16:52 +01:00
Barry Haddow
7a78e2d0f7 Add option just to give counts 2012-06-01 13:42:00 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Barry Haddow
c397d2068b Merge branch 'trunk' into miramerge. Still to fix build. 
Conflicts:
	Jamroot
	mert/Data.cpp
	mert/Data.h
	mert/FeatureArray.cpp
	mert/FeatureArray.h
	mert/FeatureData.cpp
	mert/FeatureData.h
	mert/FeatureStats.cpp
	mert/FeatureStats.h
	mert/mert.cpp
	moses-chart-cmd/src/IOWrapper.h
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses/src/GlobalLexicalModel.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/ScoreIndexManager.h
	moses/src/TargetPhrase.h
	regression-testing/tests/phrase.lexicalized-reordering-bin/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering-cn/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering/truth/results.txt
	regression-testing/tests/phrase.multiple-translation-system-lr/truth/results.txt
	regression-testing/tests/phrase.show-weights.lex-reorder/truth/results.txt
	regression-testing/tests/phrase.show-weights/truth/results.txt
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/filter-model-given-input.pl
	scripts/training/mert-moses.pl
 2012-05-24 21:11:35 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Christian Federmann
4ccab95808 Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Christian Federmann
b9b1517e4f Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Hieu Hoang
79c6528a51 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
Hieu Hoang
5ae2a24878 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
Barry Haddow
072848a4df Merge branch 'master' into bjam. Doesn't compile. 
Conflicts:
	.gitignore
	Makefile.am
	config.h.in
	configure.in
	m4/boost.m4
	moses/src/LM/Factory.cpp
	moses/src/LM/ParallelBackoff.h
	moses/src/LM/RandLM.h
	moses/src/Makefile.am
	moses/src/PDTAimp.h
	moses/src/Phrase.h
	moses/src/PhraseDictionaryTree.cpp
	moses/src/ScoreComponentCollection.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TranslationOptionCollection.cpp
	moses/src/TranslationSystem.cpp
	scripts/Makefile
	scripts/released-files
 2011-12-08 23:17:30 +00:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
42975b0635 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
79eecac809 Actually, moses depends on OnDiskPt, not the other way around. 2011-11-25 08:33:16 -05:00
Kenneth Heafield
056b42f171 Actually, moses depends on OnDiskPt, not the other way around. 2011-11-25 08:33:16 -05:00
Barry Haddow
eb4b85e0ed misc jamming 2011-11-23 12:10:45 +00:00
Barry Haddow
f948f32c88 misc jamming 2011-11-23 12:10:45 +00:00
Barry Haddow
3dc30fd51a Remove direction from Phrase 2011-11-21 10:49:26 +00:00
Kenneth Heafield
bf78f7a1ac Replace assert with CHECK until people learn how to use assert properly 2011-11-18 12:07:41 +00:00
Barry Haddow
d57d0c0656 Merge branch 'master' into miramerge 
Conflicts:
	Makefile.am
	config.h.in
	configure.in
	kenlm
	moses-chart-cmd/src/IOWrapper.cpp
	moses/src/Parameter.cpp
	scripts/Makefile
 2011-11-17 17:46:17 +00:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00
Hieu Hoang
87500bc93d visual studio 2011-11-11 22:24:25 +00:00
Barry Haddow
90820ad0c5 Merge branch 'master' into miramerge. 
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.

Conflicts:
	.gitignore
	configure.in
	ltmain.sh
	moses/src/LM/Factory.cpp
	moses/src/LMList.cpp
	moses/src/LMList.h
	moses/src/LanguageModel.cpp
	moses/src/LanguageModel.h
	moses/src/LanguageModelKen.h
	moses/src/Makefile.am
	moses/src/Manager.cpp
	moses/src/PhraseDictionaryMemory.cpp
	moses/src/PhraseDictionaryTree.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.h
 2011-10-28 15:54:23 +01:00
Hieu Hoang
a93f4691f6 win32 2011-10-23 09:37:47 +07:00
hieuhoang1972
897fe0f88b visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4356 1f5c12ca-751b-0410-a591-d2e778427230
 2011-10-14 10:50:08 +00:00
bhaddow
cfec98197d Update binary phrase table to include sparse. 
It does this by adding a minimum of an  extra uint_32 onto every
source/target record, but I couldn't see where else
to put it.
 2011-09-29 21:35:52 +01:00
hieuhoang1972
9c0d725cde visual studio 2010 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4079 1f5c12ca-751b-0410-a591-d2e778427230
 2011-07-19 03:07:15 +00:00
jhclark
da6e4935fd Return 0 on success and 1 on fail. Not the other way around. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3954 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-05 00:51:35 +00:00
pjwilliams
75709a6c87 Memory efficiency: make the reserveSize argument non-optional in 
Moses::Phrase's constructor.  The default used to be ARRAY_SIZE_INCR = 10,
which will be excessive in many cases.  Where the default was used, I've
set the exact size where that was obvious and explicitly used ARRAY_SIZE_INCR 
otherwise.  If you know the code involved, it's probably worth reviewing.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3908 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-28 11:41:08 +00:00
hieuhoang1972
a3d97584a9 run beautify.perl. Consistent formatting for .h & .cpp files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3902 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-24 13:57:11 +00:00
bhaddow
a2bde7a16e Make sure internal libraries and paths go before boost. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3800 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-15 22:41:24 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-11 19:32:59 +00:00
hieuhoang1972
564a9ad371 word alignment info in binary pt, code provided by Christof Pintaske 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3637 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-22 10:37:19 +00:00
hieuhoang1972
e504b797b2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 00:21:27 +00:00
hieuhoang1972
559a5e3ece ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 22:29:01 +00:00
hieuhoang1972
c73dddfb5b delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3423 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:34:17 +00:00
hieuhoang1972
bdfa2beab8 delete eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3422 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-10 09:16:50 +00:00
hieuhoang1972
888cc09d34 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3411 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-27 10:27:51 +00:00
hieuhoang1972
c9eb463fe6 vs.net 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3301 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-05 13:10:26 +00:00
chardmeier
36cfac2eaa Added queryPhraseTable tool. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3259 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-16 20:32:08 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
sanmarf
d30212f19d Simple program that illustrates how to access a phrase table on disk from an external program 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3063 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-07 10:25:50 +00:00
hieuhoang1972
202bcf2911 eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 20:03:54 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised 
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 17:52:51 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
sarst
4b40d26e0f updated quearyLexicalTable.cpp to fix compilation error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2715 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 15:29:11 +00:00
hieuhoang1972
a042aad7f2 visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2559 1f5c12ca-751b-0410-a591-d2e778427230
 2009-10-02 09:54:10 +00:00
bhaddow
c5d39f039f Merge moses-server branch (includes mt moses) into trunk. 
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-07 16:47:54 +00:00
hieuhoang1972
69b2dc441d eclipse files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1954 1f5c12ca-751b-0410-a591-d2e778427230
 2008-12-10 14:20:10 +00:00
hieuhoang1972
789d6d96d1 intergrate randlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1935 1f5c12ca-751b-0410-a591-d2e778427230
 2008-11-04 18:03:03 +00:00
hieuhoang1972
c59b532df1 eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1927 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-31 18:44:44 +00:00
hieuhoang1972
254005bcee unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1900 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-10 18:30:59 +00:00
hieuhoang1972
868428fe66 unix build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1898 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-09 00:20:39 +00:00
hieuhoang1972
928d771085 create namespace 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1897 1f5c12ca-751b-0410-a591-d2e778427230
 2008-10-08 23:51:26 +00:00
nicolabertoldi
9cbde412e2 support for creating binary Phrase Tables including word-to-word alignments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1887 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-12 18:19:41 +00:00
hieuhoang1972
5dee5d04aa rename IOStream to IOWrapper. 
move vs.net solution file to root folder

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
 2008-08-05 00:24:45 +00:00