moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-06 03:33:37 +03:00
Code Issues Packages Projects Releases Wiki Activity
12,630 Commits 136 Branches 26 Tags 147 MiB
250e376036
Commit Graph

226 Commits

Author SHA1 Message Date
Hieu Hoang
6885e04b42 move feature function variables into FeatureFunction.h 2012-12-31 00:57:21 +00:00
Hieu Hoang
c2d9d84ba0 move feature function variables from TranslationSystem back to StaticData 2012-12-19 14:37:00 +00:00
Hieu Hoang
667b8a495f decoder -show-weight to output consistent new format 2012-12-17 17:17:44 +00:00
hieu
05045d574c don't display unknown weight penalty when showing weight, don't usually tune. Also, change delimiter in mert extractor from : to = 2012-12-16 18:29:53 +00:00
hieu
afab4de901 don't display unknown weight penalty when showing weight. Don't usually tune 2012-12-15 19:21:40 +00:00
Hieu Hoang
0909da16db fix for regression test chart.nbest-with-alignment 2012-12-07 13:28:11 +00:00
Hieu Hoang
08ca44b34e delete hardcoded if() statements for show weights. Excluded UnknownWordPenalty and made sure PhraseModel & Generation is in particular order 2012-12-06 17:13:00 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Hieu Hoang
55f65c3104 race condition in chart decoding with -T arg 2012-12-03 14:57:33 +00:00
Hieu Hoang
75108c0aaf minor debug messages 2012-11-27 15:39:08 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Hieu Hoang
78031aa65d output alignments for n-best 2012-11-16 18:25:17 +00:00
Hieu Hoang
82ce52e650 eclipse 2012-11-16 17:31:24 +00:00
Hieu Hoang
2c214c7a21 output alignments into file down. Alignments for n-best todo 2012-11-16 17:04:50 +00:00
Hieu Hoang
90b251a50f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-16 16:44:56 +00:00
Hieu Hoang
057793fc60 output alignments into file down. Alignments for n-best todo 2012-11-16 16:44:29 +00:00
Kenneth Heafield
4f3afbf41f Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/Main.cpp
 2012-11-16 16:07:14 +00:00
Kenneth Heafield
2df57b6b09 Expose k-best lists from incremental search 2012-11-16 15:53:43 +00:00
Kenneth Heafield
6a3fdcd8c0 Rename Incremental/Manager.cpp to just Incremental.cpp 2012-11-15 22:10:30 +00:00
Hieu Hoang
f6d3f8592b added plumbing to output alignments from chart decoder. 
Currently outputs to alignment file, output to n-best list still to do.
Haven't adjusted for source and target offset, that's gonna be difficult
 2012-11-15 16:42:19 +00:00
Hieu Hoang
64b324c93f added plumbing to output alignments from chart decoder. 
Currently outputs to alignment file, output to n-best list still to do.
Haven't adjusted for source and target offset, that's gonna be difficult
 2012-11-15 15:52:35 +00:00
Hieu Hoang
0bc0b85358 resolved merge conflicts 2012-11-12 21:12:01 +00:00
Hieu Hoang
6b354f1e90 move moses/src/* to moses/ 2012-11-12 20:21:32 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Hieu Hoang
ac4a75a0af c++ version of fuzzy match works 2012-11-12 16:37:27 +00:00
Hieu Hoang
88b2f05e03 process empty lines regardless 2012-11-09 01:26:21 -08:00
Kenneth Heafield
4296e9720b Make Chart's exit behavior consistent with phrase 2012-10-22 11:38:37 +01:00
Barry Haddow
2e1049aee0 fix order in show-weights 2012-10-17 22:16:47 +01:00
Barry Haddow
365e680115 Merge remote-tracking branch 'origin/master' into miramerge 
NB Untested

Conflicts:
	Jamroot
	moses-chart-cmd/src/Main.cpp
	moses/src/ChartManager.cpp
	moses/src/RuleTable/LoaderStandard.cpp
	moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp
	moses/src/Word.cpp
 2012-10-15 21:35:56 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge 
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-14 14:18:03 +01:00
Kenneth Heafield
e33e0ffd61 It works! 2012-10-12 14:25:39 +01:00
Kenneth Heafield
e75b51bb73 Fix more conflations, update lazy 2012-10-12 14:09:45 +01:00
Kenneth Heafield
3291083be7 Fix some conflations of search algorithm with model 2012-10-12 14:01:10 +01:00
Kenneth Heafield
6f9db664a5 Work Master all the way up to main 2012-10-12 13:53:08 +01:00
Kenneth Heafield
018696367b Remove unused function parameters 2012-10-11 17:11:42 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
Hieu Hoang
4fd980c386 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-05 19:13:04 +01:00
Hieu Hoang
c966ca36b1 revert Jacob's change 033fa821ca 2012-10-05 19:12:29 +01:00
Kenneth Heafield
483e6b666b Print usage information before exit 2012-10-05 17:49:52 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Barry Haddow
1ce788e2b8 Fixes for regression tests 2012-09-26 14:40:06 +01:00
Hieu Hoang
a9c890e55e rename CTO to CTOs 2012-09-25 17:34:43 +01:00
Jacob Dlougach
106bad253c Fix compilation warning. 2012-09-24 15:22:30 +04:00
Jacob Dlougach
6e6e731ceb Align unknown word in most simple cases 2012-09-24 15:19:24 +04:00
Jacob Dlougach
033fa821ca Option to print alignment in chart decoder. 2012-09-22 19:09:34 +04:00
Jacob Dlougach
097735469e Refactor output collector so that it can delete the output and debug streams. Very useful if your output can be either cout/cerr or stream. 2012-09-21 17:46:43 +04:00
Barry Haddow
54433bb221 Take notice of calc in t-option flag 2012-09-04 17:50:30 +01:00
Hieu Hoang
97f46537b7 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-30 21:07:19 +01:00
Barry Haddow
2b4e61d826 Merge branch 'trunk' into miramerge 
Compiles, not tested.

Conflicts:
	Jamroot
	OnDiskPt/PhraseNode.h
	OnDiskPt/TargetPhrase.cpp
	OnDiskPt/TargetPhrase.h
	OnDiskPt/TargetPhraseCollection.cpp
	mert/BleuScorer.cpp
	mert/Data.cpp
	mert/FeatureData.cpp
	moses-chart-cmd/src/Main.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartManager.cpp
	moses/src/LM/Ken.cpp
	moses/src/LM/Ken.h
	moses/src/LMList.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionaryTree.h
	moses/src/ScoreIndexManager.h
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/Word.cpp
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-07-17 13:36:50 +01:00
Eva Hasler
027a20730e merge Jamfiles 2012-07-04 11:49:07 +01:00
Hieu Hoang
75e038f4cf create namespace for all classes 2012-07-02 17:05:11 +01:00
Hieu Hoang
85624125ce commented all classes in OnDiskPt and moses-chart-cmd. Leave ken's lm directory 2012-06-28 20:14:45 -04:00
Hieu Hoang
647e320629 commented all classes in OnDiskPt and moses-chart-cmd. Leave ken's lm directory 2012-06-28 20:12:31 -04:00
Colin Cherry
07a5c67ebc Merge branch 'master' into miramerge 
Conflicts:
	Jamroot
	misc/queryPhraseTable.cpp
	scripts/training/train-model.perl
 2012-06-14 17:08:16 -04:00
Eva Hasler
e1c1a5343c merge 2012-06-07 11:16:52 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Hieu Hoang
465c5cbf97 move all executables into bin 2012-05-31 12:55:05 +01:00
Barry Haddow
c397d2068b Merge branch 'trunk' into miramerge. Still to fix build. 
Conflicts:
	Jamroot
	mert/Data.cpp
	mert/Data.h
	mert/FeatureArray.cpp
	mert/FeatureArray.h
	mert/FeatureData.cpp
	mert/FeatureData.h
	mert/FeatureStats.cpp
	mert/FeatureStats.h
	mert/mert.cpp
	moses-chart-cmd/src/IOWrapper.h
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/IOWrapper.cpp
	moses-cmd/src/IOWrapper.h
	moses-cmd/src/Main.cpp
	moses/src/GlobalLexicalModel.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/ScoreIndexManager.h
	moses/src/TargetPhrase.h
	regression-testing/tests/phrase.lexicalized-reordering-bin/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering-cn/truth/results.txt
	regression-testing/tests/phrase.lexicalized-reordering/truth/results.txt
	regression-testing/tests/phrase.multiple-translation-system-lr/truth/results.txt
	regression-testing/tests/phrase.show-weights.lex-reorder/truth/results.txt
	regression-testing/tests/phrase.show-weights/truth/results.txt
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/filter-model-given-input.pl
	scripts/training/mert-moses.pl
 2012-05-24 21:11:35 +01:00
Hieu Hoang
4888e114ed Check factor is not null before outputting 2012-05-17 16:25:53 +01:00
Hieu Hoang
22ca90bd8a Check factor is not null before outputting 2012-05-17 16:25:53 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Christian Federmann
b9b1517e4f Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Christian Federmann
4ccab95808 Merged in fixes for compiler warnings regarding comparing signed and unsigned integer expressions. 2012-05-10 14:48:51 +02:00
Eva Hasler
74c2cf3417 fix bug in OutputNBestList 2012-04-11 13:02:23 +01:00
Eva Hasler
56f1101dfc ignore empty input lines 2012-04-07 21:03:30 +01:00
Barry Haddow
5a17ef82b3 Merge remote branch 'github/miramerge' into bjam 
Conflicts:
	mira/Decoder.h
	mira/Main.cpp
	mira/Main.h
	moses-chart-cmd/src/IOWrapper.cpp
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/Main.cpp
	moses/src/BleuScoreFeature.cpp
	moses/src/BleuScoreFeature.h
	moses/src/TargetNgramFeature.h
 2012-02-01 10:12:16 +00:00
Phil Williams
039bd5bd4c Create a subdirectory in moses/src for the main CYK+ source files. 2012-01-25 23:14:36 +00:00
Phil Williams
ec9ea87e4d Create a subdirectory in moses/src for the main CYK+ source files. 2012-01-25 23:14:36 +00:00
Phil Williams
d0af7167f8 moses_chart: rule lookup now produces a vector of stack pointers (and a 
TargetPhraseCollection pointer) instead of a CYK+ dotted rule.
 2012-01-25 12:26:28 +00:00
Phil Williams
72baeab59e moses_chart: rule lookup now produces a vector of stack pointers (and a 
TargetPhraseCollection pointer) instead of a CYK+ dotted rule.
 2012-01-25 12:26:28 +00:00
Phil Williams
bba1af9f4e Remove obsolete #if HAVE_CONFIG_H directives. 2012-01-23 10:37:35 +00:00
Phil Williams
360113ad6b Remove obsolete #if HAVE_CONFIG_H directives. 2012-01-23 10:37:35 +00:00
Barry Haddow
1e10bb7ef7 Merge from miramerge. 
Reverted ChartHypothesis as it breaks chart-decoding.
 2012-01-20 15:35:55 +00:00
Eva Hasler
b704381a42 restore order of scores returned by decoder and in nbestlist 2012-01-18 12:26:51 +00:00
Kenneth Heafield
06648fd832 Surround mains in try-catch blocks. 2012-01-13 10:20:42 -05:00
Kenneth Heafield
868255af03 Surround mains in try-catch blocks. 2012-01-13 10:20:42 -05:00
Eva Hasler
50d3a62bda change order of -show-weights output to match nbest list order 2011-12-14 10:51:35 +00:00
Eva Hasler
85ce6547fd -show-weights: output sparseProducerWeight if != 1, otherwise 'sparse' 2011-12-13 19:13:13 +00:00
Barry Haddow
072848a4df Merge branch 'master' into bjam. Doesn't compile. 
Conflicts:
	.gitignore
	Makefile.am
	config.h.in
	configure.in
	m4/boost.m4
	moses/src/LM/Factory.cpp
	moses/src/LM/ParallelBackoff.h
	moses/src/LM/RandLM.h
	moses/src/Makefile.am
	moses/src/PDTAimp.h
	moses/src/Phrase.h
	moses/src/PhraseDictionaryTree.cpp
	moses/src/ScoreComponentCollection.h
	moses/src/ScoreIndexManager.cpp
	moses/src/StaticData.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TranslationOptionCollection.cpp
	moses/src/TranslationSystem.cpp
	scripts/Makefile
	scripts/released-files
 2011-12-08 23:17:30 +00:00
Eva Hasler
1dcc3c3c6f implement EvaluateChart() for TargetNgramFeature, add sparse features to chart decoder nbest list 2011-12-06 21:33:23 +00:00
Hieu Hoang
71c78ef0ce move vs and xcode project files into separate contrib folder 2011-12-02 08:33:39 +07:00
Hieu Hoang
39db162cc0 move vs and xcode project files into separate contrib folder 2011-12-02 08:33:39 +07:00
Kenneth Heafield
9fe831c60c Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
a0d79781e5 Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
42975b0635 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
a65ed7e587 Jam: install executables in legacy paths and stop leaving a.out files everywhere 2011-11-21 13:20:52 -05:00
Barry Haddow
5baa595a91 Further direction removal 2011-11-21 11:14:05 +00:00
Barry Haddow
3dc30fd51a Remove direction from Phrase 2011-11-21 10:49:26 +00:00
Hieu Hoang
ce0065ff2a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-18 22:13:46 +07:00
Hieu Hoang
ce773fc65a xcode 2011-11-18 22:07:18 +07:00
Kenneth Heafield
5c9b28c55a Introducing Jamfiles 
Currently supports kenlm, irstlm, and srilm options.

bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
 2011-11-18 14:37:01 +00:00
Hieu Hoang
caac64a33b xcode 2011-11-18 21:33:58 +07:00
Kenneth Heafield
bf78f7a1ac Replace assert with CHECK until people learn how to use assert properly 2011-11-18 12:07:41 +00:00
Barry Haddow
d57d0c0656 Merge branch 'master' into miramerge 
Conflicts:
	Makefile.am
	config.h.in
	configure.in
	kenlm
	moses-chart-cmd/src/IOWrapper.cpp
	moses/src/Parameter.cpp
	scripts/Makefile
 2011-11-17 17:46:17 +00:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00
Hieu Hoang
253f32a2e5 load hiero format for reading suffix arrays 2011-11-14 00:14:40 +07:00
Hieu Hoang
87500bc93d visual studio 2011-11-11 22:24:25 +00:00
Barry Haddow
6890472ba1 Merge branch 'master' into miramerge 
Conflicts:
	.gitignore
	config.h.in
	moses/src/ChartTrellisPath.cpp
	moses/src/Makefile.am
 2011-11-11 08:25:13 +00:00