moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 13:23:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,480 Commits 136 Branches 26 Tags 147 MiB
9cf86f6191
Commit Graph

394 Commits

Author SHA1 Message Date
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
Rico Sennrich
58ed19ce6a remove hacks for phrase penalty from MultiModel phrase type. 2014-01-02 12:29:38 +01:00
jiejiang
744376b3fb moses windows build, with some TODO list 2013-12-18 20:15:39 +00:00
Hieu Hoang
e64368e7e4 Forgot to call SetFeaturesToApply() for SkeletonPT and Transliteration phrase table 2013-12-10 12:42:05 +00:00
Hieu Hoang
a5d0296699 make transliteration phrase table thread safe 2013-12-06 16:25:17 +00:00
Hieu Hoang
f77fd7fb45 set parameters for fuzzy match. Not tested 2013-12-06 14:23:22 +00:00
Hieu Hoang
0e156afd5b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-06 13:07:40 +00:00
Rico Sennrich
96ca814b86 special handling of partial rules that can only have terminal symbol next; 
we only need to search once for matching terminals.

speed: 336s -> 309s
VmPeak: 2914132kB -> 2783064kB
RSSMax: 2766976kB -> 2699148kB
 2013-12-06 12:54:58 +00:00
Hieu Hoang
3ab1a9996b comment 2013-12-06 11:32:53 +00:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
b33cf30bc1 transliteration pt obery backoff argument. Probably not threadable yet 2013-12-05 13:06:35 +00:00
Hieu Hoang
0dac035a12 arguments for transliteration phrase-table 2013-12-04 19:16:37 +00:00
Hieu Hoang
51f5bbea5d transliteration phrase-table now working. Just need to not hardcode some variables and make it obey -decoding-graph-backoff 2013-12-04 18:47:33 +00:00
Hieu Hoang
dd78bf0951 add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:31:15 +00:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
a57c9d6fe8 delete -parsing-algorithm. Scope-3 parsing depends on the phrase-table implementation used, not this argument 2013-11-22 17:35:22 +00:00
Hieu Hoang
31632301f9 Scope-3 parsing working again 2013-11-22 16:26:21 +00:00
Hieu Hoang
c4dfc60f95 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-22 15:26:23 +00:00
Hieu Hoang
5c6d88a463 add new phrase table for Scope-3 parsing. Doesn't quite work... 2013-11-22 15:26:14 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
8381f0c95c replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 13:38:30 +00:00
Hieu Hoang
0f3f675698 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 18:18:02 +00:00
Hieu Hoang
16cf3bb4c7 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 17:19:57 +00:00
Hieu Hoang
aca78534c4 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 14:02:38 +00:00
Hieu Hoang
a77e928628 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 11:59:36 +00:00
Hieu Hoang
c2ffc022ea replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 18:52:15 +00:00
Hieu Hoang
22864c2b4b replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 17:23:19 +00:00
Hieu Hoang
c8f19220e9 replace CHECK with UTIL_THROW_IFin OnDiskPt 2013-11-18 17:08:58 +00:00
Hieu Hoang
2f00ae936b move collection of phrase-table from Staticdata to PhraseDictionary 2013-11-15 17:26:26 +00:00
Hieu Hoang
17887a2796 replace nth_element() with macro that execute sort() instead for gcc 4.8.1 & 4.8.2 2013-11-15 10:55:38 +00:00
Hieu Hoang
40eefd0fc5 don't compile compact pt if --with-cmph not specified 2013-10-31 13:16:20 +00:00
Hieu Hoang
b926346bfe compiles with eclipse under OSX Mavericks 2013-10-30 21:23:16 +00:00
Hieu Hoang
bd82b7355b remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
Hieu Hoang
ab8402cfe8 remove description argument from feature function constructor. Redundant 2013-10-29 18:20:55 +00:00
Hieu Hoang
4cc4913aa6 remove description argument from feature function constructor. Redundant 2013-10-29 18:09:42 +00:00
Ulrich Germann
cdc8f8f37f Fixed header includes to reflect recent reorganization of the file structure by HH. 2013-10-28 21:59:05 +00:00
Ulrich Germann
d33f235230 Changed member corpus in TSA from Ttrack<Token> const* to 
boost::shared_ptr<Ttrack<Token> const>.
 2013-10-28 21:53:58 +00:00
Hieu Hoang
a0b6c381e0 correct creation of input paths for lattices 2013-10-04 13:08:14 +01:00
Hieu Hoang
f18e35c42a correct creation of input paths for lattices 2013-10-03 18:58:45 +01:00
Hieu Hoang
73513c182d correct creation of input paths for lattices 2013-10-03 16:58:47 +01:00
Hieu Hoang
8ccc99a947 correct creation of input paths for lattices 2013-10-03 12:03:09 +01:00
Hieu Hoang
6759af3821 beautify 2013-10-03 11:33:48 +01:00
Hieu Hoang
bb511af0ee minor rename of variables 2013-10-02 16:51:16 +01:00
Hieu Hoang
9e890479a2 get ready to do lattice for scfg 2013-09-28 19:06:04 +01:00
Hieu Hoang
9d9c43f9a7 skelete pt 2013-09-28 09:42:17 +01:00
Hieu Hoang
06c5621d97 skelete pt 2013-09-27 20:45:20 +01:00
Hieu Hoang
ba1f1cb06b skelete pt 2013-09-27 09:43:43 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00
Hieu Hoang
dbaabb1985 move Uli's new pt into it's own folder. Comment out bjam compile. Doesn't work on MacOSX yet 2013-09-26 12:16:03 +01:00
Hieu Hoang
4285a6c7df move Uli's new pt into it's own folder. Comment out bjam compile. Doesn't work on MacOSX yet 2013-09-26 10:10:12 +01:00
Ulrich Germann
d511744f90 Changed int to size_t to avoid compiler signed/unsigned comparison warnings. 2013-09-25 22:34:55 +01:00
Ulrich Germann
050b089ea0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/TranslationModel/SkeletonPT.cpp
 2013-09-25 22:33:27 +01:00
Ulrich Germann
4fffe80c0c Formatting. 2013-09-25 22:09:21 +01:00
Hieu Hoang
847f7c1ea2 skeleton PT 2013-09-25 20:59:13 +01:00
Hieu Hoang
1758381c98 skeleton PT 2013-09-25 19:24:50 +01:00
Hieu Hoang
deafd5922d skeleton PT 2013-09-25 16:57:01 +01:00
Ulrich Germann
82274ffda7 Merge branch 'dynamic-phrase-tables' 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/Phrase.cpp
 2013-09-25 13:52:05 +01:00
=
e3ba4a9890 Initial check-in. 2013-09-25 00:51:50 +01:00
=
61dacaa9bd Moved duplicate struct CompareTargetPhrase to TargetPhraseCollection.{h|cpp} 2013-09-25 00:05:45 +01:00
=
d0a5921fbb Fixed some code formatting. 2013-09-25 00:03:46 +01:00
=
c227cde790 Fixed code formatting. 2013-09-24 23:57:49 +01:00
=
515ee545b1 Fixed code formatting. 2013-09-24 23:57:32 +01:00
=
ae550d05f4 Fixed some code formatting issues. 2013-09-24 23:56:47 +01:00
=
42f9f81495 Fixed some code formatting issues. 2013-09-24 23:56:23 +01:00
Hieu Hoang
fc4cabce98 skeleton PT 2013-09-24 22:50:43 +01:00
Hieu Hoang
e6f53d83c2 get rid of some warnings 2013-09-22 18:24:32 +02:00
Hieu Hoang
9894941294 properties is on 7th column, not 6th 2013-09-03 15:02:53 +02:00
Hieu Hoang
fe36cbf737 move LexicalReordering to FF directory 2013-08-30 16:28:28 +01:00
Hieu Hoang
04783309ba move DecodeFeature to FF directory 2013-08-30 16:03:06 +01:00
Hieu Hoang
f5fc57008f save properties in target phrase object 2013-08-29 13:36:01 +01:00
Kenneth Heafield
1a9a964b68 presize vector 2013-08-26 23:37:37 +01:00
Hieu Hoang
f544d3aced mark with LEGACY 2013-08-23 21:34:10 +01:00
Hieu Hoang
83df3629a9 mark GetTargetPhraseCollectionNonCache with LEGACY 2013-08-23 21:08:53 +01:00
Hieu Hoang
de9decc30d mark GetTargetPhraseCollection with LEGACY 2013-08-23 21:02:03 +01:00
Hieu Hoang
4dfb625536 beautify 2013-08-23 13:53:30 +01:00
Hieu Hoang
fcf426a098 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 15:58:17 +01:00
Hieu Hoang
9e60195995 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5 caching error for compact pt 2013-08-20 16:06:48 +01:00
Hieu Hoang
ae54494417 caching for Marcin's phrase table 2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
9f92642e59 beautify 2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2 minor renaming 2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07 move caching code to PhraseDictionary. Available to all phrase tables 2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5 add phrase table caching 2013-08-15 20:20:44 +01:00
Hieu Hoang
88f888f534 const TargetPhrase in TargetPhraseCollection 2013-08-08 14:38:41 +01:00
Hieu Hoang
441acf15e6 beautify 2013-08-07 14:18:12 +01:00
Hieu Hoang
5eef91c0ea get ready to delete source phrase from TargetPhrase class 2013-08-07 14:10:42 +01:00
Hieu Hoang
71073868a8 PhraseDictionaryTreeAdaptor::GetTargetPhraseCollectionLegacy return tpColl and vector of source phrases 2013-08-07 12:55:10 +01:00
Hieu Hoang
89f39bf89d mark a function as legacy 2013-08-07 11:48:18 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
afcf65098f parsing doesn't depend on input sentence anymore 2013-08-02 18:09:47 +01:00
Hieu Hoang
0596c3e9e4 Add NonTerminalSet variable to InputPath 2013-08-02 15:54:49 +01:00
Hieu Hoang
bb1f49e10c Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-31 14:29:18 +01:00
Rico Sennrich
b32366ab8c fix future and total cost in multimodel(counts). (was broken since merge of branch weight-new in May) 2013-07-31 14:18:18 +02:00
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Hieu Hoang
77872f7521 beautify 2013-07-30 15:04:37 +01:00