Barry Haddow
c99a889420
Refactor hypergraph output code
2014-08-06 15:29:39 +01:00
Barry Haddow
ff188c454a
Sparse features trainable with hg mira
...
(In phrase-based Moses)
2014-08-06 11:38:51 +01:00
Hieu Hoang
fbbc756117
add virtual void ChangeSource(InputType *&input) const
...
to FeatureFunction
2014-08-01 22:41:24 +01:00
Hieu Hoang
353eff77d3
Fixed build failure when compiled without --with-mm.
2014-07-17 23:33:39 +01:00
Ulrich Germann
dfb97f8886
Added missing EOL at end of file.
2014-07-17 22:47:57 +01:00
Ulrich Germann
4d4e194dac
Fixed build failure when compiled without --with-mm.
2014-07-17 22:46:01 +01:00
Ulrich Germann
4d41211c2c
Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes.
2014-07-09 02:41:28 +01:00
Ulrich Germann
28d64e2339
Simulated post-editing sessions feeding reference and alignment into the system after automatic translation of each source sentence.
2014-07-09 02:40:40 +01:00
Nicola Bertoldi
1fe4eb0528
beautify
2014-06-08 09:44:59 +02:00
Nicola Bertoldi
306dc26edd
the management of passthrough xml-tags is introduced
2014-06-06 00:53:36 +02:00
Nicola Bertoldi
20b3e8929e
beautify
2014-05-19 15:35:08 +02:00
Nicola Bertoldi
fe1ed42f81
Merge branch 'master' into dynamic-models
2014-04-30 08:32:46 +02:00
Nicola Bertoldi
20381cbf89
merged master into dynamic-models and solved conflicts
2014-04-28 19:18:38 +02:00
Ulrich Germann
7c145d045b
Merge branch 'master' into dynamic-phrase-tables
...
Conflicts:
contrib/server/Jamfile
contrib/server/mosesserver.cpp
2014-04-28 10:00:07 +01:00
Barry Haddow
b9c25afd45
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-04-17 19:02:57 +01:00
Ulrich Germann
aa1d942175
Reformatting for readability.
2014-04-03 20:35:02 +01:00
Nicola Bertoldi
03825e3ffd
changes
2014-03-13 19:41:40 +01:00
Ulrich Germann
f1449cd7fe
Merge branch 'dynamic-phrase-tables'
2014-03-11 14:17:42 +00:00
Ulrich Germann
b3043d9b00
Reformatting for readability. In ReadInput: delete source only if non-NULL.
2014-03-11 13:53:54 +00:00
Kenneth Heafield
ca9e3aaf84
Fix -output-hypo-score
2014-03-10 11:50:45 -07:00
Barry Haddow
ffd7af1168
Fixes to hypergraph and htk outputs, better cmd line help.
...
Mixing boost paths and strings is bad.
Leaks in htk output.
assert that should be an exception
2014-02-06 20:15:25 +00:00
Rico Sennrich
043444b293
copy weights of untuneable features from original config in mert
2014-01-20 10:06:42 +00:00
Nicola Bertoldi
4b072f2097
merge master into this branch
2014-01-17 14:04:15 +01:00
jiejiang
5f1217d793
merged upstream with origin for mingw
2014-01-15 18:16:56 +00:00
Nicola Bertoldi
e452a13062
beautify
2014-01-15 16:49:57 +01:00
phikoehn
9ea0f5dd0e
reporting on init (pretty slow for binary phrase table!) and bug fix in experiment.perl with setting filter settings
2014-01-05 22:39:47 +00:00
phikoehn
6c34ff207f
additional time reporting and stardardization
2014-01-05 02:26:47 +00:00
phikoehn
073a601eb0
make good use of the new precise timer...
2014-01-03 18:45:31 +00:00
Hieu Hoang
18aaf4750a
destroy feature functions at end. Otherwise it shows up on valgrind as memory leak
2013-12-31 20:15:43 +00:00
jiejiang
744376b3fb
moses windows build, with some TODO list
2013-12-18 20:15:39 +00:00
Hieu Hoang
f13d0c8244
UTIL_THROW_IF -> UTIL_THROW_IF2
2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e
delete includes for util/check.hh
2013-11-21 18:58:28 +00:00
Hieu Hoang
3ffc5e7a8f
replace CHECK with UTIL_THROW_IF in moses-cmd
2013-11-18 18:27:01 +00:00
Hieu Hoang
3f8972d67b
move collection of generation-table from Staticdata to GenerationDictionary
2013-11-15 17:43:41 +00:00
Hieu Hoang
2f00ae936b
move collection of phrase-table from Staticdata to PhraseDictionary
2013-11-15 17:26:26 +00:00
phikoehn
ecc30bcfe2
also report lm scores, and matched n-gram length (thanks Ken!)
2013-10-13 22:05:07 +01:00
phikoehn
e6257ddc43
one more fix
2013-10-13 09:04:03 +01:00
phikoehn
8e23a3f2c1
more enriched trace
2013-10-13 06:59:05 +01:00
Hieu Hoang
6ccc17b804
speed up compiling by removing headers from StaticData.h
2013-10-03 11:05:53 +01:00
Hieu Hoang
31ce9b510e
beautify
2013-09-27 09:35:24 +01:00
Hieu Hoang
deafd5922d
skeleton PT
2013-09-25 16:57:01 +01:00
Hieu Hoang
00b21b4f53
placeholder for chart decoding
2013-09-22 15:36:50 +02:00
Hieu Hoang
574d716f23
placeholder for chart decoding
2013-09-22 15:09:49 +02:00
Hieu Hoang
ffbfcb5577
placeholders work in pb decoder. God i'm bored
2013-09-19 16:33:21 +02:00
Hieu Hoang
a40d9082cd
more placeholder code and 'NO BEST TRANSLATION' to stderr for pb
2013-09-18 23:47:50 +02:00
Hieu Hoang
4dfb625536
beautify
2013-08-23 13:53:30 +01:00
Hieu Hoang
55bd87d38c
Merge pull request #43 from jgwinnup/master
...
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59
beautify
2013-08-15 21:14:04 +01:00
Hieu Hoang
841ce108a5
add phrase table caching
2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af
Added option to output unknown words with prefix 'UNK'
2013-08-15 11:30:08 -04:00
Hieu Hoang
efc765ddff
implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input
2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36
use input path for unknown word processing in phrase-based
2013-08-13 20:01:13 +01:00
Hieu Hoang
8756ad8ffd
beautify
2013-08-09 18:17:18 +01:00
Hieu Hoang
6f7d239f13
Merge github.com:moses-smt/mosesdecoder into hieu_opt_input
2013-08-07 15:19:22 +01:00
Hieu Hoang
441acf15e6
beautify
2013-08-07 14:18:12 +01:00
Hieu Hoang
a1f5167f85
get ready to delete source phrase from TargetPhrase class
2013-08-07 11:37:40 +01:00
Hieu Hoang
66d4c2b0be
source phrase is a pointer in translation options.
2013-08-07 10:28:28 +01:00
phikoehn
ab4e3c63a6
enriched trace
2013-08-07 05:31:45 +01:00
Hieu Hoang
a83c166678
delete Hypothesis::GetSourcePhrase(). Take it directly from TranslationOption::GetSourcePhrase()
2013-08-05 13:46:54 +01:00
Hieu Hoang
ea67f29b8f
segfault outputting placeholder
2013-08-01 14:26:54 +01:00
Hieu Hoang
77872f7521
beautify
2013-07-30 15:04:37 +01:00
Hieu Hoang
d3aa3ee65c
source and target factors for placeholders
2013-07-19 18:23:38 +01:00
Hieu Hoang
beda0767f9
support for placeholder in pb model
2013-07-19 17:58:52 +01:00
Hieu Hoang
82224a7a46
feature functions can be both sparse AND dense
2013-06-09 18:48:09 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
06a5c86695
delete LMList
2013-05-27 16:50:21 +01:00
Hieu Hoang
e8dadb58ce
split classes in DummyScoreProducers into separate files
2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f
move feature functions into moses/FF
2013-05-24 18:02:49 +01:00
Hieu Hoang
f04ec4c56d
1. remove all code for MetaFeature from mira.
...
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
0f75865faa
1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
...
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
981351758a
delete class TranslationSystem
2013-05-11 14:13:26 +01:00
Hieu Hoang
4890e4673a
get rid of FeatureFunction::unlimited. Every ff can have sparse AND dense features
2013-05-08 15:34:56 +01:00
Hieu Hoang
0425083c12
use GetWeightedScore() instead of InnerProduct(...)
2013-05-02 10:30:20 +01:00
Hieu Hoang
4894df6494
merge
2013-04-29 19:04:00 +01:00
Lane Schwartz
ef3d30146a
Re-enabled commented out code.
...
Hopefully this commit will now compile on all versions of Boost.
2013-04-29 12:24:44 -04:00
Christian Buck
046e031723
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-04-20 20:33:16 +01:00
Hieu Hoang
b1da4dbe0e
merged
2013-04-19 15:03:34 +01:00
Barry Haddow
a8fe122e4b
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-19 08:35:01 +01:00
Hieu Hoang
9749ca5fd9
Fixed blank lines when using -print-alignment-info
2013-04-18 16:38:52 +01:00
Christian Buck
464b752128
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-04-12 19:44:02 +01:00
Christian Buck
9c2c6c603b
typo
2013-04-12 19:39:04 +01:00
Barry Haddow
c6e36f4dd7
Fix compile error
2013-04-12 16:29:52 +01:00
Hieu Hoang
44a0e52e30
fixed ShowWeights() for confusion networks. This is a reason why we should get rid of ShortNames and move to refactored moses pdq
2013-04-09 14:44:32 +01:00
Hieu Hoang
72aa0a80bd
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-25 13:51:47 +00:00
Joan Puigcerver
4a954f2be7
Fixes compilation error using libboost_1_50
...
Problem spotted in https://github.com/moses-smt/mosesdecoder/issues/32
fixed.
According to the Boost doc, nbestPath.parent_path().filename()
returns a path object, to get the correspondent std::string
representation, one must call one of the methods listed in:
http://www.boost.org/doc/libs/1_53_0/libs/filesystem/doc/reference.html#path-native-format-observers
native() is supposed to return the path in the specific OS
path format (using backslashes for Windows). Anyway, since we
are considering only the filename here, the result is the same.
2013-03-24 20:01:59 +01:00
Hieu Hoang
fd4e954322
merge
2013-03-24 09:57:36 +00:00
Hieu Hoang
db005f6503
compile error caused by different versions of boost
2013-03-23 15:58:07 +00:00
Lane Schwartz
3a4e63c558
Ensure directory exists for outputting hypergraphs
2013-03-22 12:14:28 -04:00
Lane Schwartz
b2bba0bae3
Work on compression and defaults for outputting hypergraphs.
2013-03-21 16:48:47 -04:00
Lane Schwartz
28c980d58e
Allow hypergraph output to be in plain text, gzip, or bzip2.
...
The output-search-graph-hypergraph flag now takes two params:
* The first param must be "none", "gzip", or "bzip2"
* The second param is the hypergraph directory,
which must already exist
2013-03-21 15:19:31 -04:00
Lane Schwartz
22c77f7331
Work on decreasing memory requirement for outputting hypergraph
2013-03-21 12:17:49 -04:00
Hieu Hoang
7888c7ba23
eclipse project files
2013-03-15 22:02:00 +00:00
Hieu Hoang
2d252d2dd0
memory leak
2013-03-15 16:11:15 +00:00
Hieu Hoang
3da09b921c
memory leak
2013-03-15 12:30:39 +00:00
Hieu Hoang
cedb41be2a
change : back to =
2013-03-14 19:06:01 +00:00
Hieu Hoang
ca43a88bd2
change feature weight delimiter from = to :
2013-03-13 18:26:24 +00:00
Hieu Hoang
2f78fe5fe5
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-13 17:54:03 +00:00
Hieu Hoang
21c51194fa
add -print-alignment-info
2013-03-13 12:12:33 +00:00
Hieu Hoang
35bffae402
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-03-04 18:19:28 +00:00
Lane Schwartz
ec69acf3d4
Don't open all hypergraph output files at once.
2013-03-04 12:07:37 -05:00