Hieu Hoang
ef33496ea5
non-term must have only 1 factor.
2014-07-09 15:47:34 +01:00
Hieu Hoang
d8ca5b1c6c
comment out debugging message
2014-06-21 17:35:34 -04:00
Hieu Hoang
3454d28ab8
change char[] to std::string
2014-06-21 10:03:40 -04:00
Hieu Hoang
78bfca3ecf
expand max string size when binarizing. MUST change this soon
2014-06-21 08:23:26 -04:00
Hieu Hoang
747661ba3e
sparse features in on-disk-pt
2014-06-06 20:35:58 +01:00
Hieu Hoang
0114766b54
sparse features in on-disk-pt
2014-06-06 20:00:15 +01:00
Hieu Hoang
bdf4fb2d53
sparse features in on-disk-pt
2014-06-06 19:35:20 +01:00
Hieu Hoang
9e0ebc16ee
sparse features in on-disk-pt
2014-06-06 19:23:43 +01:00
Hieu Hoang
d8729a92c9
properties in OnDiskPt
2014-06-06 14:25:10 +01:00
Hieu Hoang
8c64819773
properties in OnDiskPt
2014-06-06 12:19:28 +01:00
Hieu Hoang
f507c0f82d
output correct source non-term from on-disk phrase-table
2014-04-07 17:23:13 +01:00
Rico Sennrich
45630a5851
various optimizations to make CYK+ parser several times faster and eat less memory.
...
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).
if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
2014-03-21 11:12:24 +00:00
Hieu Hoang
a9c81857c1
minor addition of non-const method
2013-12-29 23:33:46 +00:00
Hieu Hoang
ad617e0c86
minor change from UINT32 to UINT64
2013-12-29 23:18:16 +00:00
Hieu Hoang
f13d0c8244
UTIL_THROW_IF -> UTIL_THROW_IF2
2013-11-22 20:27:46 +00:00
Hieu Hoang
0a8390981e
delete includes for util/check.hh
2013-11-21 18:58:28 +00:00
Hieu Hoang
c8f19220e9
replace CHECK with UTIL_THROW_IFin OnDiskPt
2013-11-18 17:08:58 +00:00
Hieu Hoang
deb2797632
replace CHECK with UTIL_THROW_IF. It's gonna be a fun week
2013-11-15 20:14:10 +00:00
Hieu Hoang
f4150c2494
faster compilation by taking some #includes from Word.h and Phrase.h
2013-10-04 15:40:23 +01:00
Hieu Hoang
9d9c43f9a7
skelete pt
2013-09-28 09:42:17 +01:00
Hieu Hoang
a1f5167f85
get ready to delete source phrase from TargetPhrase class
2013-08-07 11:37:40 +01:00
Hieu Hoang
852242b804
beautify
2013-07-08 19:02:18 +01:00
Hieu Hoang
8d857fa26e
OnDisk pt passes regression
2013-07-08 19:01:28 +01:00
Hieu Hoang
7114b164c7
cleanup of OnDiskPt methods
2013-07-05 11:10:10 +01:00
Hieu Hoang
e073d22301
prefix subphrase optimization
2013-07-05 10:52:12 +01:00
Hieu Hoang
abe6bb7c22
refactor parsing of feature functiona args
2013-06-10 18:11:55 +01:00
Hieu Hoang
6f21727ecd
table limit = 0 means no limit, for on-disk
2013-06-08 00:22:27 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
805eef6c18
delete sourcePhrase variable in TargetPhrase class
2013-05-28 01:25:27 +01:00
Hieu Hoang
e8dadb58ce
split classes in DummyScoreProducers into separate files
2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f
move feature functions into moses/FF
2013-05-24 18:02:49 +01:00
Hieu Hoang
f4a75b30f7
Make lhsTarget a pointer
2013-05-22 11:22:17 +01:00
Hieu Hoang
38c4b3695f
delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer
2013-05-22 10:26:06 +01:00
Hieu Hoang
0e1c246010
delete references to WordPenaltyProducer
2013-05-21 13:22:04 +01:00
Hieu Hoang
ff880ec6f1
delete references to LMList
2013-05-21 12:27:13 +01:00
Hieu Hoang
499487fb98
get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly
2013-05-13 15:36:09 +01:00
Hieu Hoang
fdcfe95574
start framework for evaluating target phrase score
2013-05-02 17:19:45 +01:00
Hieu Hoang
ce95c117f6
merge
2013-04-29 18:46:48 +01:00
Kenneth Heafield
f1d3663810
Back FactorCollection with a memory pool. Less memory for large vocabularies.
2013-04-25 19:42:30 +01:00
Hieu Hoang
71a2b49a47
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-04-01 16:43:32 +01:00
phikoehn
0a978e9f01
bug fixes
2013-04-01 14:31:32 +01:00
Hieu Hoang
194adf8130
change format for phrase model
2013-02-22 19:17:57 +00:00
Hieu Hoang
59449f2925
make TranslationModel subdirectory and move files from moses/ into it
2012-11-27 15:08:31 +00:00
Wilker Aziz
9e76804bde
Python wrap for OnDiskWraper, docs and example.
2012-11-14 18:14:46 +01:00
Wilker Aziz
6bbf6db180
Wrapping OnDiskPt, Added OnDiskPt/Util.h with the tokenization procedure, so that they can be called from the Python wrap.
2012-11-13 17:27:33 +01:00
Hieu Hoang
44f24bd673
resolved merge conflicts
2012-11-12 20:35:32 +00:00
Hieu Hoang
f8438f80cc
move moses/src/* to moses/
2012-11-12 20:30:39 +00:00
Hieu Hoang
5e3ef23cef
move moses/src/* to moses/
2012-11-12 19:56:18 +00:00
Kenneth Heafield
d4f433c7f4
Put core Moses into one library libmoses.
2012-11-12 18:07:53 +00:00
Kenneth Heafield
c34ecf12de
TargetPhrase doesn't have a FactorDirection constructor.
...
It was implicitly doing TargetPhrase(Phrase(size_t)) wastefully
2012-10-22 17:40:23 +01:00