moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-06 00:08:52 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,020 Commits 136 Branches 26 Tags 147 MiB
d249e398ea
Commit Graph

255 Commits

Author SHA1 Message Date
Hieu Hoang
5b82661163 make GetParam() a const method with no side effect 2014-11-27 21:09:05 +00:00
Hieu Hoang
cafd01854d make GetParam() a const method with no side effect 2014-11-27 18:41:40 +00:00
Hieu Hoang
604208964a make GetParam() a const method with no side effect 2014-11-27 12:51:23 +00:00
Hieu Hoang
efed89d0e6 eclipse 2014-11-24 13:46:08 +00:00
Phil Williams
5240c430ce Merge s2t branch 
This adds a new string-to-tree decoder, which can be enabled with the -s2t
option.  It's intended to be faster and simpler than the generic chart
decoder, and is designed to support lattice input (still WIP).  For a en-de
system trained on WMT14 data, it's approximately 40% faster in practice.

For background information, see the decoding section of the EMNLP tutorial
on syntax-based MT:

  http://www.emnlp2014.org/tutorials/5_notes.pdf

Some features are not implemented yet, including support for internal tree
structure and soft source-syntactic constraints.
 2014-11-04 13:13:56 +00:00
Rico Sennrich
61c00ed636 n-best tree output 2014-09-12 19:17:23 +02:00
Matthias Huck
3da03f4459 tiny changes 2014-08-07 21:42:30 +01:00
Hieu Hoang
341969e61d Merge ../mosesdecoder into hieu 2014-06-10 18:04:55 +01:00
Hieu Hoang
a695c9b50b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-10 17:27:34 +01:00
Hieu Hoang
4b98495e78 don't load data when just showing weightd 2014-06-10 17:27:20 +01:00
Ulrich Germann
c7a0520a18 Made moses shut up by changing unconditional 'cerr's to VERBOSE(1,...) 2014-06-05 01:43:26 +01:00
Hieu Hoang
8e2c4a89c0 Merge ../mosesdecoder into hieu 2014-06-04 12:53:06 +01:00
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of 
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
 2014-05-31 14:33:31 +01:00
Hieu Hoang
6b1e147cff add -default-non-term-for-empty-range-only 2014-04-07 14:00:40 +01:00
Hieu Hoang
e5a6d63cf2 Merge branch 'master' of github.com:moses-smt/mosesdecoder into hieu 2014-03-21 21:41:04 +00:00
Rico Sennrich
45630a5851 various optimizations to make CYK+ parser several times faster and eat less memory. 
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).

if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
 2014-03-21 11:12:24 +00:00
Hieu Hoang
5e93c3f804 conflicts 2014-03-07 12:18:18 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature 
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
 2014-03-03 13:56:19 +00:00
Hieu Hoang
1e5cd16fbf xml parsing for source syntax 2014-02-26 18:09:27 +00:00
Hieu Hoang
c48d8b5e31 update last weight override 2014-02-26 10:32:48 +00:00
Hieu Hoang
b9c6c7a2a6 need to zero out all weights, especially sparse weights 2014-02-23 21:35:34 +00:00
Hieu Hoang
7509e8bbaa reset sparse weights 2014-02-23 20:46:16 +00:00
Hieu Hoang
1716514eda create ResetWeights(). Only for dense weights 2014-02-23 20:07:28 +00:00
Hieu Hoang
cb2805151b delete -adjacent-only. Rubbish 2014-01-27 12:25:02 +00:00
Hieu Hoang
9745924937 output list of available feature functions, separated by space, rather than lines 2014-01-25 10:39:47 +00:00
Rico Sennrich
5d2b4d8efc sparse feature weights can now be set in moses.ini; overrides weights in weight-file. 2014-01-20 15:54:17 +00:00
Hieu Hoang
493f5d6817 minor error in option to override feature name /Maria Nadejde 2014-01-09 18:47:34 +00:00
phikoehn
6c34ff207f additional time reporting and stardardization 2014-01-05 02:26:47 +00:00
phikoehn
073a601eb0 make good use of the new precise timer... 2014-01-03 18:45:31 +00:00
phikoehn
7763b4c41f sparse feature support for alternate weight setting 2013-12-14 02:56:01 +00:00
Hieu Hoang
ebc6e59b17 consistent global variable g_mosesDebug 2013-12-11 19:04:42 +00:00
Hieu Hoang
ba209202ef move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
Hieu Hoang
09d50f87b1 move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
Hieu Hoang
d3301fa1a3 move backoff parameter into decode graph class 2013-12-05 12:19:55 +00:00
Hieu Hoang
1d56e4c0b1 minor verbose message 2013-12-03 15:56:11 +00:00
Hieu Hoang
028edf8550 add -feature-name-overwrite. Specifically to replace PhraseDictionaryMemory with PhraseDictionaryScope3 for scope-3 decoding 2013-11-22 19:13:09 +00:00
Hieu Hoang
a57c9d6fe8 delete -parsing-algorithm. Scope-3 parsing depends on the phrase-table implementation used, not this argument 2013-11-22 17:35:22 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
43dc333cd7 replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 18:26:58 +00:00
Hieu Hoang
749bd7fc8f add decoder arg -no-cache for mira tuning 2013-11-21 11:52:20 +00:00
Hieu Hoang
3f8972d67b move collection of generation-table from Staticdata to GenerationDictionary 2013-11-15 17:43:41 +00:00
Hieu Hoang
2f00ae936b move collection of phrase-table from Staticdata to PhraseDictionary 2013-11-15 17:26:26 +00:00
Hieu Hoang
d51702f387 output list of available feature functions 2013-11-01 15:16:47 +00:00
Phil Williams
69f5e4bec3 Merge branch 'master' into GHKMStruct 2013-10-09 16:21:49 +01:00
Hieu Hoang
6759af3821 beautify 2013-10-03 11:33:48 +01:00
Hieu Hoang
52215fdf79 speed up compiling by removing headers from StaticData.h 2013-10-03 11:16:06 +01:00
Hieu Hoang
6ccc17b804 speed up compiling by removing headers from StaticData.h 2013-10-03 11:05:53 +01:00
Hieu Hoang
f2d218f8ee move checking of legacy phrase-table to StaticData 2013-10-02 20:02:05 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
 2013-09-29 15:27:09 +01:00
Hieu Hoang
31ce9b510e beautify 2013-09-27 09:35:24 +01:00