moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
10,348 Commits 136 Branches 26 Tags 147 MiB
ce372477c9
Commit Graph

413 Commits

Author SHA1 Message Date
Hieu Hoang
eaacbb1c92 compiles 2013-02-22 22:23:55 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
01af82310b delete ScoreProducer 2013-02-21 20:03:35 +00:00
Barry Haddow
24b5746193 Initial checkin. Missing some test data 2013-02-21 17:59:53 +00:00
Hieu Hoang
56506281c5 move class PointerState into its own file 2013-02-21 14:48:23 +00:00
Hieu Hoang
ce26defbf7 move class LanguageModelChartState into its own file 2013-02-21 14:29:51 +00:00
Hieu Hoang
eb789874ea delete CLOCK_MONOTONIC 2013-02-21 01:09:05 +00:00
Hieu Hoang
b059eac235 eclipse 2013-02-20 18:43:11 +00:00
Hieu Hoang
e091990565 delete mention of Distortion score producer and its weight in static data 2013-02-19 22:29:48 +00:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
e3712d55dd minor error 2013-02-15 13:53:35 +00:00
Hieu Hoang
d1f39b6aa6 lm implementation default to 0 2013-02-14 13:30:00 +00:00
Hieu Hoang
85ce3e5b40 eclipse project 2013-02-14 12:15:35 +00:00
Hieu Hoang
5a26a4c84f delete class Dictionary 2013-02-06 11:29:54 +00:00
Hieu Hoang
be85bffb19 Merge branch 'master' into weight-new 2013-02-05 12:36:38 +00:00
Rico Sennrich
50a8e94a8f tmcombine: better error message for unsupported phrase tables 2013-02-05 11:44:50 +01:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b use new constructor for PhraseDictionaryFeature 2013-02-04 12:07:21 +00:00
Hieu Hoang
4ecdeac694 refactor class PhraseDictionaryFeature 2013-02-03 22:26:18 +00:00
Hieu Hoang
2573d0a122 delete LM/Factory.* 2013-02-01 21:01:44 +00:00
Hieu Hoang
51c26c84b8 refactor SparsePhraseDictionaryFeature 2013-01-31 12:19:25 +00:00
Hieu Hoang
6c00a0f627 delete m_fLMsLoaded 2013-01-30 11:37:14 +00:00
Hieu Hoang
47fe787f58 refactor class BleuScoreFeature 2013-01-29 13:16:22 +00:00
Hieu Hoang
49345b6b56 eclipse project 2013-01-28 15:34:44 +00:00
Hieu Hoang
4d32d8b64b merge 2013-01-19 18:47:04 +00:00
Hieu Hoang
b6fd7bf994 eclipse 2013-01-19 18:43:58 +00:00
Hieu Hoang
3bbccf078c refactor LexicalReordering 2013-01-15 18:32:13 +00:00
Hieu Hoang
61d9a91f73 change TargetNgramFeature and TargetBigramFeature 2013-01-15 14:10:49 +00:00
Hieu Hoang
7d15818a66 eclipse project file 2013-01-14 11:01:03 +00:00
Hieu Hoang
fa60724391 merge 2013-01-14 10:39:41 +00:00
Rico Sennrich
647bc11c0a fix display of error message 2013-01-11 11:24:41 +01:00
Hieu
8e4f5a927d eclipse 2013-01-07 18:03:40 +00:00
Hieu
9973832624 eclipse 2013-01-07 18:03:32 +00:00
Hieu
86327b1e77 eclipse 2013-01-07 18:03:20 +00:00
Hieu
3bf83af8d1 eclipse 2013-01-07 18:03:11 +00:00
Hieu
18b162266c eclipse 2013-01-07 18:02:55 +00:00
Hieu
133e375e24 eclipse 2013-01-07 18:02:40 +00:00
Hieu Hoang
8799e721ac move phrase tables and generation tables to staticData 2012-12-21 14:54:43 +00:00
Hieu Hoang
d0f59264a0 eclipse parallel build 2012-12-19 10:32:24 +00:00
Hieu Hoang
667b8a495f decoder -show-weight to output consistent new format 2012-12-17 17:17:44 +00:00
hieu
05045d574c don't display unknown weight penalty when showing weight, don't usually tune. Also, change delimiter in mert extractor from : to = 2012-12-16 18:29:53 +00:00
hieu
3777faaed2 bug in weight-overwrite 2012-12-14 17:40:31 +00:00
hieu
6694df6519 mert-moses.perl create ini file in new format 2012-12-14 16:43:12 +00:00
Hieu Hoang
cffadb5ff8 always append number to feature function name 2012-12-07 18:13:37 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
bc1e96730d move CKY+Parser to TranslationModel/ 2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18 move the rest of DynSA to TranslationModel/ 2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Hieu Hoang
0b54d32038 move fuzzy-match to TranslationModel/ 2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Hieu Hoang
ea2ad978ef eclipse files 2012-11-26 23:10:23 +00:00
Hieu Hoang
7d6d91a2e8 move zmert to contrib folder 2012-11-20 16:42:49 +00:00
Hieu Hoang
82ce52e650 eclipse 2012-11-16 17:31:24 +00:00
Wilker Aziz
502bb0405d changing constructor's interface, pass tlimit to constructor 2012-11-15 18:05:03 +01:00
Rico Sennrich
4813dfb4f3 fix mosesserver includes 2012-11-15 17:05:38 +01:00
Wilker Aziz
84b1079f4b option to apply an operation (e.g. natural log) over phrase/rule's scores 2012-11-15 15:56:27 +01:00
Wilker Aziz
cf46249007 docs 2012-11-15 13:02:50 +01:00
Wilker Aziz
22b02d4f9c improved interface, better docs, +fixing after the changes with alignment-info 2012-11-15 12:58:04 +01:00
Wilker Aziz
9e76804bde Python wrap for OnDiskWraper, docs and example. 2012-11-14 18:14:46 +01:00
Wilker Aziz
6bbf6db180 Wrapping OnDiskPt, Added OnDiskPt/Util.h with the tokenization procedure, so that they can be called from the Python wrap. 2012-11-13 17:27:33 +01:00
Wilker Aziz
c767ee264f Fixing dependencies 2012-11-13 14:12:16 +01:00
Wilker Aziz
ed8ef91563 doc: building 2012-11-13 11:43:36 +01:00
Wilker Aziz
229cc1563d + package structure, + better setup.py with max-factors and kenlm-max-order, binpt -> dictree 2012-11-13 11:39:12 +01:00
Hieu Hoang
9c1cd9cf37 server compile error 2012-11-12 23:35:07 +00:00
Hieu Hoang
0bc0b85358 resolved merge conflicts 2012-11-12 21:12:01 +00:00
Hieu Hoang
6b354f1e90 move moses/src/* to moses/ 2012-11-12 20:21:32 +00:00
Hieu Hoang
5e3ef23cef move moses/src/* to moses/ 2012-11-12 19:56:18 +00:00
Hieu Hoang
ac4a75a0af c++ version of fuzzy match works 2012-11-12 16:37:27 +00:00
Hieu Hoang
ea24000a84 c++ version of fuzzy match works 2012-11-12 13:58:39 +00:00
Hieu Hoang
6ea72d72f1 eclipse 2012-11-10 12:17:20 +00:00
Hieu Hoang
f92eff62b2 eclipse files 2012-11-08 23:46:46 -08:00
Hieu Hoang
90b704562e eclipse files 2012-11-08 14:39:30 -07:00
Hieu Hoang
2e6346faa0 xcode and eclipse 2012-11-08 14:07:33 -07:00
Hieu Hoang
762a6b3219 xcode and eclipse 2012-11-08 14:06:57 -07:00
Hieu Hoang
deb694fb7c minor compile error on macosx. size_t != uint64_t 2012-10-30 14:56:20 -07:00
Rico Sennrich
06126ae6e2 tmcombine: ignore phrase pairs with 0 probability in optimization 2012-10-29 10:29:51 +01:00
Hieu Hoang
ff0946dd3e eclipse files 2012-10-23 17:07:28 +01:00
Hieu Hoang
87b6520d82 add moses server back in. Changed ScoreComponentCollection to expose dense feature array 2012-10-22 14:41:23 +01:00
Hieu Hoang
7a19ac861c vs project files. /Krishna Nanda 2012-10-19 17:56:45 +01:00
Hieu Hoang
cb0b94fad5 delete all mention of terminal in word alignment class 2012-10-19 16:00:42 +01:00
Hieu Hoang
fb040861f7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-18 16:20:02 +01:00
Hieu Hoang
c3229460a3 eclipse 2012-10-18 16:19:06 +01:00
Rico Sennrich
9e03090ca2 fix regression from having all 3 counts in phrase table. 2012-10-18 16:09:38 +02:00
Hieu Hoang
5bb498c922 eclipse project 2012-10-18 12:24:03 +01:00
Hieu Hoang
9f12beb881 eclipse project 2012-10-17 16:40:23 +01:00
Barry Haddow
365e680115 Merge remote-tracking branch 'origin/master' into miramerge 
NB Untested

Conflicts:
	Jamroot
	moses-chart-cmd/src/Main.cpp
	moses/src/ChartManager.cpp
	moses/src/RuleTable/LoaderStandard.cpp
	moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp
	moses/src/Word.cpp
 2012-10-15 21:35:56 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge 
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-14 14:18:03 +01:00
Kenneth Heafield
e75b51bb73 Fix more conflations, update lazy 2012-10-12 14:09:45 +01:00
Hieu Hoang
2b32a29199 enable threading 2012-10-09 14:10:04 +01:00
Hieu Hoang
78e5884dd7 enable threading 2012-10-09 14:01:41 +01:00
Hieu Hoang
1c73dd1605 mkdtemp template must be have 6 'X' in Linux 2012-10-09 12:06:14 +01:00
Hieu Hoang
f0b6ff1094 if don't find best match, pick the 1st 2012-10-08 21:42:16 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
Hieu Hoang
8076866728 xcode 2012-10-08 17:45:29 +01:00
Hieu Hoang
90e87bb8f9 eclipse project files 2012-10-05 17:28:43 +01:00
Hieu Hoang
83374e2810 eclipse project files 2012-10-05 17:17:27 +01:00
Hieu Hoang
9ae55243e2 remove dependency on boost filesystem object 2012-10-04 15:08:22 +01:00
Wilker Aziz
7f5b6b2310 better doc 2012-10-03 20:04:48 +02:00
wlin12
f92d63c9a2 input type bug fix 2012-10-02 18:54:51 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Hieu Hoang
a9c890e55e rename CTO to CTOs 2012-09-25 17:34:43 +01:00
Hieu Hoang
bd90816716 delete ChartTranslationOptionCollection. Roll everything into manager 2012-09-25 17:08:38 +01:00
Kenneth Heafield
15b0ae1aef Single-threaded compilation fixes 2012-09-21 18:34:48 -04:00
Jacob Dlougach
b1c702afab XCode project files update 2012-09-21 16:16:10 +04:00
Wilker Aziz
ab191b562e query results can now be sorted and pruned 2012-09-18 11:39:39 +02:00
Arianna Bisazza
be5678afb7 combine-ptables: Implementation of fillup and other operations of translation and reordering models combination 2012-09-18 11:06:50 +02:00
Wilker Aziz
f6e3eff8d9 signatures changed to cpp strings 2012-09-14 15:35:05 +02:00
Wilker Aziz
c300705772 i) check for invalid paths; ii) added sample data; iii) added --with-cmph in setup.py 2012-09-14 12:51:31 +02:00
Wilker Aziz
629805a90a Added an option to use/not use cmph and details about building/compiling in README 2012-09-14 11:59:18 +02:00
Wilker Aziz
8a2309b75b Customized delimiter + properties added to BinayPhraseTable 2012-09-12 11:46:43 +02:00
Wilker Aziz
92295911b1 Renaming python PhaseTable to BinaryPhaseTable + better docs 2012-09-12 11:05:28 +02:00
Wilker Aziz
85dd58fed3 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-09-12 00:50:31 +02:00
Wilker Aziz
2ad634dd88 Better setup.py + python tree moved under contrib/ 2012-09-12 00:48:43 +02:00
Marcin Junczys-Dowmunt
3f5dcf4d06 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-09-11 16:13:03 +02:00
junczys
bac859c451 Fix locking in AlignmentInfoCollection.* 2012-09-11 16:06:05 +02:00
Rico Sennrich
0f3de74934 possible fix for tmcombine for models without alignment info 2012-09-11 14:33:30 +02:00
wlin12
dca9d8952d added some more documentation 2012-09-07 18:41:25 +01:00
wlin12
d3e19c4fb2 adding the code for relative entropy pruning to contrib/relent-filter 2012-09-07 17:35:58 +01:00
wlin12
6202c7cc60 adding the code for relative entropy pruning to contrib/relent-filter 2012-09-07 17:33:44 +01:00
Rico Sennrich
4e2fc82854 new training option -write-lexical-counts 
(creates additional files lex.counts.e2f and lex.counts.f2e)
 2012-09-06 11:48:54 +02:00
Hieu Hoang
71b6404091 eclipse 2012-09-04 10:28:19 +01:00
Hieu Hoang
92b15c103f delete reranker, not finished according to Holger Schwenk. 2012-09-02 12:14:32 +01:00
Marcin Junczys-Dowmunt
174b5006b2 Removed debugging artefact 2012-08-24 12:04:23 +00:00
Hieu Hoang
1ca447cc99 Merge https://github.com/hieuhoang/mosesdecoder 2012-08-24 00:40:50 +01:00
Rico Sennrich
d33b860ec3 fix sigtest filter for hierarchical models 2012-08-22 14:53:48 +02:00
Marcin Junczys-Dowmunt
94b37ddf8f Removed debugging artifact 2012-08-22 14:25:33 +02:00
Marcin Junczys-Dowmunt
74d8426e36 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-22 12:00:37 +02:00
Marcin Junczys-Dowmunt
6fbac429b1 faster, better memory footprint, replaced sets with ordered vectors 2012-08-22 12:00:22 +02:00
Hieu Hoang
a3450ea99b eclipse project files 2012-08-20 15:08:37 +01:00
Hieu Hoang
2711f1f621 eclipse project files 2012-08-20 13:35:24 +01:00
Hieu Hoang
2d32304c24 rename tm-mt extraction to fuzzy match 2012-08-13 23:53:14 +01:00
Hieu Hoang
a7b8c75b44 servlet and jquery interfaces for moses server. Thanks to Alexander Ulanov 2012-08-12 13:18:58 +01:00
Jonathan Clark
e99576aedc Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2012-08-10 15:32:08 -04:00
Jonathan Clark
6f008096ea Use Moses' Timer class, which is based on wall-time instead of the C clock() function, which measures clock ticks used within the *process* rather than each thread. This makes timings more meaningful in multi-threaded mode. However, these timings will still be inaccurate on Windows (second-level only). 2012-08-10 15:32:00 -04:00
Hieu Hoang
1d2f887ffc Delete CellCollection class 2012-08-10 12:35:49 +01:00
Hieu Hoang
4ad66381ff xcode 2012-08-09 13:18:46 +01:00
Hieu Hoang
654ed29209 better indication of what phrase table implementation is being loaded 2012-08-09 12:47:48 +01:00
Hieu Hoang
fd122ea630 xcode 2012-08-08 18:29:26 +01:00
Hieu Hoang
9b465f535e get rid of tmpnam 2012-08-06 21:41:24 +01:00
Hieu Hoang
f9a3d05d28 xcode 2012-08-06 19:11:59 +01:00
Hieu Hoang
308db7444a xcode projects for compact pt and lex table 2012-08-06 18:31:05 +01:00
Hieu Hoang
3308589346 minor compile error 2012-07-31 15:30:40 +01:00
Hieu Hoang
431a4f19f1 delete temporary files 2012-07-31 15:05:18 +01:00
Hieu Hoang
a1ab8e354a cleanup of variables. Need to delete temporary files 2012-07-31 02:21:48 +01:00
Hieu Hoang
379baad879 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles. It works 2012-07-31 00:00:20 +01:00
Hieu Hoang
28d7ce1745 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles. It works 2012-07-30 23:49:13 +01:00