phikoehn
073a601eb0
make good use of the new precise timer...
2014-01-03 18:45:31 +00:00
Hieu Hoang
18aaf4750a
destroy feature functions at end. Otherwise it shows up on valgrind as memory leak
2013-12-31 20:15:43 +00:00
jiejiang
744376b3fb
moses windows build, with some TODO list
2013-12-18 20:15:39 +00:00
Hieu Hoang
f13d0c8244
UTIL_THROW_IF -> UTIL_THROW_IF2
2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e
delete includes for util/check.hh
2013-11-21 18:58:28 +00:00
Hieu Hoang
3ffc5e7a8f
replace CHECK with UTIL_THROW_IF in moses-cmd
2013-11-18 18:27:01 +00:00
Hieu Hoang
3f8972d67b
move collection of generation-table from Staticdata to GenerationDictionary
2013-11-15 17:43:41 +00:00
Hieu Hoang
2f00ae936b
move collection of phrase-table from Staticdata to PhraseDictionary
2013-11-15 17:26:26 +00:00
phikoehn
ecc30bcfe2
also report lm scores, and matched n-gram length (thanks Ken!)
2013-10-13 22:05:07 +01:00
phikoehn
e6257ddc43
one more fix
2013-10-13 09:04:03 +01:00
phikoehn
8e23a3f2c1
more enriched trace
2013-10-13 06:59:05 +01:00
Hieu Hoang
6ccc17b804
speed up compiling by removing headers from StaticData.h
2013-10-03 11:05:53 +01:00
Hieu Hoang
31ce9b510e
beautify
2013-09-27 09:35:24 +01:00
Hieu Hoang
deafd5922d
skeleton PT
2013-09-25 16:57:01 +01:00
Hieu Hoang
00b21b4f53
placeholder for chart decoding
2013-09-22 15:36:50 +02:00
Hieu Hoang
574d716f23
placeholder for chart decoding
2013-09-22 15:09:49 +02:00
Hieu Hoang
ffbfcb5577
placeholders work in pb decoder. God i'm bored
2013-09-19 16:33:21 +02:00
Hieu Hoang
a40d9082cd
more placeholder code and 'NO BEST TRANSLATION' to stderr for pb
2013-09-18 23:47:50 +02:00
Hieu Hoang
4dfb625536
beautify
2013-08-23 13:53:30 +01:00
Hieu Hoang
55bd87d38c
Merge pull request #43 from jgwinnup/master
...
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59
beautify
2013-08-15 21:14:04 +01:00
Hieu Hoang
841ce108a5
add phrase table caching
2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af
Added option to output unknown words with prefix 'UNK'
2013-08-15 11:30:08 -04:00
Hieu Hoang
efc765ddff
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36
use input path for unknown word processing in phrase-based
2013-08-13 20:01:13 +01:00
Hieu Hoang
8756ad8ffd
beautify
2013-08-09 18:17:18 +01:00
Hieu Hoang
6f7d239f13
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-08-07 15:19:22 +01:00
Hieu Hoang
441acf15e6
beautify
2013-08-07 14:18:12 +01:00
Hieu Hoang
a1f5167f85
get ready to delete source phrase from TargetPhrase class
2013-08-07 11:37:40 +01:00
Hieu Hoang
66d4c2b0be
source phrase is a pointer in translation options.
2013-08-07 10:28:28 +01:00
phikoehn
ab4e3c63a6
enriched trace
2013-08-07 05:31:45 +01:00
Hieu Hoang
a83c166678
delete Hypothesis::GetSourcePhrase(). Take it directly from TranslationOption::GetSourcePhrase()
2013-08-05 13:46:54 +01:00
Hieu Hoang
ea67f29b8f
segfault outputting placeholder
2013-08-01 14:26:54 +01:00
Hieu Hoang
77872f7521
beautify
2013-07-30 15:04:37 +01:00
Hieu Hoang
d3aa3ee65c
source and target factors for placeholders
2013-07-19 18:23:38 +01:00
Hieu Hoang
beda0767f9
support for placeholder in pb model
2013-07-19 17:58:52 +01:00
Hieu Hoang
82224a7a46
feature functions can be both sparse AND dense
2013-06-09 18:48:09 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
06a5c86695
delete LMList
2013-05-27 16:50:21 +01:00
Hieu Hoang
e8dadb58ce
split classes in DummyScoreProducers into separate files
2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f
move feature functions into moses/FF
2013-05-24 18:02:49 +01:00
Hieu Hoang
f04ec4c56d
1. remove all code for MetaFeature from mira.
...
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
0f75865faa
1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
...
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
4890e4673a
get rid of FeatureFunction::unlimited. Every ff can have sparse AND dense features
2013-05-08 15:34:56 +01:00
Hieu Hoang
0425083c12
use GetWeightedScore() instead of InnerProduct(...)
2013-05-02 10:30:20 +01:00
Hieu Hoang
4894df6494
merge
2013-04-29 19:04:00 +01:00
Lane Schwartz
ef3d30146a
Re-enabled commented out code.
...
Hopefully this commit will now compile on all versions of Boost.
2013-04-29 12:24:44 -04:00
Christian Buck
046e031723
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-04-20 20:33:16 +01:00
Hieu Hoang
b1da4dbe0e
merged
2013-04-19 15:03:34 +01:00
Barry Haddow
a8fe122e4b
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-19 08:35:01 +01:00
Hieu Hoang
9749ca5fd9
Fixed blank lines when using -print-alignment-info
2013-04-18 16:38:52 +01:00
Christian Buck
464b752128
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-04-12 19:44:02 +01:00
Christian Buck
9c2c6c603b
typo
2013-04-12 19:39:04 +01:00
Barry Haddow
c6e36f4dd7
Fix compile error
2013-04-12 16:29:52 +01:00
Hieu Hoang
44a0e52e30
fixed ShowWeights() for confusion networks. This is a reason why we should get rid of ShortNames and move to refactored moses pdq
2013-04-09 14:44:32 +01:00
Hieu Hoang
72aa0a80bd
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-25 13:51:47 +00:00
Joan Puigcerver
4a954f2be7
Fixes compilation error using libboost_1_50
...
Problem spotted in https://github.com/moses-smt/mosesdecoder/issues/32
fixed.
According to the Boost doc, nbestPath.parent_path().filename()
returns a path object, to get the correspondent std::string
representation, one must call one of the methods listed in:
http://www.boost.org/doc/libs/1_53_0/libs/filesystem/doc/reference.html#path-native-format-observers
native() is supposed to return the path in the specific OS
path format (using backslashes for Windows). Anyway, since we
are considering only the filename here, the result is the same.
2013-03-24 20:01:59 +01:00
Hieu Hoang
fd4e954322
merge
2013-03-24 09:57:36 +00:00
Hieu Hoang
db005f6503
compile error caused by different versions of boost
2013-03-23 15:58:07 +00:00
Lane Schwartz
3a4e63c558
Ensure directory exists for outputting hypergraphs
2013-03-22 12:14:28 -04:00
Lane Schwartz
b2bba0bae3
Work on compression and defaults for outputting hypergraphs.
2013-03-21 16:48:47 -04:00
Lane Schwartz
28c980d58e
Allow hypergraph output to be in plain text, gzip, or bzip2.
...
The output-search-graph-hypergraph flag now takes two params:
* The first param must be "none", "gzip", or "bzip2"
* The second param is the hypergraph directory,
which must already exist
2013-03-21 15:19:31 -04:00
Lane Schwartz
22c77f7331
Work on decreasing memory requirement for outputting hypergraph
2013-03-21 12:17:49 -04:00
Hieu Hoang
7888c7ba23
eclipse project files
2013-03-15 22:02:00 +00:00
Hieu Hoang
2d252d2dd0
memory leak
2013-03-15 16:11:15 +00:00
Hieu Hoang
3da09b921c
memory leak
2013-03-15 12:30:39 +00:00
Hieu Hoang
cedb41be2a
change : back to =
2013-03-14 19:06:01 +00:00
Hieu Hoang
ca43a88bd2
change feature weight delimiter from = to :
2013-03-13 18:26:24 +00:00
Hieu Hoang
2f78fe5fe5
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-13 17:54:03 +00:00
Hieu Hoang
21c51194fa
add -print-alignment-info
2013-03-13 12:12:33 +00:00
Hieu Hoang
35bffae402
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-04 18:19:28 +00:00
Lane Schwartz
ec69acf3d4
Don't open all hypergraph output files at once.
2013-03-04 12:07:37 -05:00
Lane Schwartz
8573a66da0
Close hypergraph output files.
2013-03-04 09:15:46 -05:00
Hieu Hoang
bcecfe55db
merge with Lane's search graph output
2013-02-24 00:31:29 +00:00
Hieu Hoang
30e0d1e0fa
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-02-22 22:39:24 +00:00
Lane Schwartz
4adeb7e338
Output feature weights to a separate file when producing hypergraph
2013-02-22 16:28:48 -05:00
Lane Schwartz
04f107fbb0
Add flag to output search graph in Kenneth's hypergraph format.
2013-02-22 16:28:48 -05:00
Lane Schwartz
774ed64f2e
Work to allow output search graph in HTK standard lattice format
2013-02-22 16:28:47 -05:00
Hieu Hoang
01af82310b
delete ScoreProducer
2013-02-21 20:03:35 +00:00
Hieu Hoang
ebd7b85aa6
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-02-20 10:11:21 +00:00
Lane Schwartz
2e6b5e7a23
Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder
2013-02-14 12:03:35 -05:00
Lane Schwartz
f9a46adc31
Specify -start-translation-id to tell Moses the line number of the first sentence
2013-02-13 15:52:40 -05:00
Hieu Hoang
f00d781c37
merge with master
2013-02-13 14:17:20 +00:00
Hieu Hoang
1a8cd20b51
-print-id for christian buck and phi
2013-02-11 18:01:33 +00:00
Hieu Hoang
6885e04b42
move feature function variables into FeatureFunction.h
2012-12-31 00:57:21 +00:00
Hieu Hoang
efbc8bb6c4
move language model from TranslationSystem back to StaticData
2012-12-20 16:38:15 +00:00
Hieu Hoang
c2d9d84ba0
move feature function variables from TranslationSystem back to StaticData
2012-12-19 14:37:00 +00:00
Hieu Hoang
667b8a495f
decoder -show-weight to output consistent new format
2012-12-17 17:17:44 +00:00
hieu
05045d574c
don't display unknown weight penalty when showing weight, don't usually tune. Also, change delimiter in mert extractor from : to =
2012-12-16 18:29:53 +00:00
hieu
57b33f40cf
don't display unknown weight penalty when showing weight. Don't usually tune
2012-12-15 19:20:07 +00:00
hieu
5ab3c3f081
output weight formatted according to discussions with Ken & Barry
2012-12-12 12:22:13 +00:00
Hieu Hoang
d1fcb37b06
make output of feature scores the same in moses-cmd as in moses-chart-cmd
2012-12-07 13:34:44 +00:00
Hieu Hoang
3d6d53bf49
delete hardcoded if() statements to show scores in n-best list. Excluded UnknownWordPenalty and made sure PhraseModel & Generation is in particular order
2012-12-06 17:28:56 +00:00
Hieu Hoang
08ca44b34e
delete hardcoded if() statements for show weights. Excluded UnknownWordPenalty and made sure PhraseModel & Generation is in particular order
2012-12-06 17:13:00 +00:00
Hieu Hoang
28b70a5697
delete hardcoded if() statements for show weights. Excluded UnknownWordPenalty and made sure PhraseModel & Generation is in particular order
2012-12-06 16:59:54 +00:00
Hieu Hoang
4f3805a0d7
change \!UnknownWordPenalty to UnknownWordPenalty
2012-12-05 11:58:21 +00:00
Hieu Hoang
cb270a76be
all regression tests passed
2012-12-04 18:39:06 +00:00
Hieu Hoang
08b508d686
indentation
2012-12-04 17:54:39 +00:00
Hieu Hoang
9fe742ce52
get rid function GetScoreProducerWeightShortName(). Fails 1 regression test
2012-12-04 17:09:23 +00:00