Lane Schwartz
76a8850487
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2017-01-02 12:57:58 -06:00
Lane Schwartz
578e65298f
Add InMemoryPerSentenceOnDemandLM
2017-01-02 12:57:52 -06:00
Lane Schwartz
999d6b6371
Added labelled score breakdown to translation options in TranslationRequest.
...
This will enable a client to get the feature value(s) associated with a particular feature for a particular translation option
2017-01-02 12:52:01 -06:00
Ulrich Germann
d3320cc290
Merge pull request #171 from doried-a-a/master
...
Fixing errors while building with oxlm
2016-12-30 13:10:19 +01:00
Doried Abd-Allah
347980fd42
fixing errors while building with oxlm: renamed iptr to boost_iptr because of a conflict with eigen library required by oxlm, added boost_serialization to oxlm requirements in jamroot
2016-12-29 15:16:07 +02:00
Hieu Hoang
6c075b67c5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-12-29 12:07:32 +00:00
Hieu Hoang
06a0ae18f2
Merge ../mosesdecoder.perf
2016-12-29 12:04:15 +00:00
Hieu Hoang
c30b28f43b
Edge case of wall at the end of sentence /Mike Ladwig
2016-12-29 12:03:59 +00:00
Hieu Hoang
e14a71c3ea
debugging messages
2016-12-28 10:57:19 +00:00
Hieu Hoang
e6ff671a82
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2016-12-27 18:55:13 +00:00
Hieu Hoang
c6eec7335f
distortion-limit=-1 is unlimited distortion
2016-12-27 13:55:03 +00:00
Hieu Hoang
28c0564589
Merge pull request #170 from moses-smt/alvations-patch-1
...
Changed \p{Hyphen} to \p{Line_Break} in mteval-v13a.pl
2016-12-23 15:00:49 +00:00
Hieu Hoang
59119c0044
Merge pull request #168 from tofula/master
...
Named group added for the safer 'protected patterns' recognition regexp
2016-12-23 10:26:19 +00:00
Hieu Hoang
fc8829cdda
Merge pull request #169 from lonevvolf/master
...
Fix for number at the end of a string
2016-12-23 09:50:57 +00:00
alvations
c6c3bc84b7
Changed \p{Hyphen} to \p{LineBreak}
...
Using Perl v5.18.2, it's reporting this warning:
**Use of 'Hyphen' in \p{} or \P{} is deprecated because: Supplanted by Line_Break property values; see www.unicode.org/reports/tr14**
2016-12-23 14:21:20 +08:00
Hieu Hoang
3eb0145850
Merge branch 'perf_moses2' of github.com:hieuhoang/mosesdecoder into perf_moses2
2016-12-21 18:06:55 +00:00
Hieu Hoang
e72bc47910
eclipse
2016-12-21 18:04:22 +00:00
Hieu Hoang
25b87e14de
unused method
2016-12-16 15:58:50 +00:00
Hieu Hoang
304a6652f7
debugging message
2016-12-14 18:16:30 +00:00
Hieu Hoang
dd1532637b
delete debugging message
2016-12-14 18:09:52 +00:00
Hieu Hoang
bc6c1f4160
cleanup
2016-12-07 10:09:38 +00:00
Hieu Hoang
8ef7db569a
merge similar sorting functions
2016-12-07 00:38:11 +00:00
Hieu Hoang
ab28a3fc8c
can prune stack < max stack size
2016-12-07 00:16:38 +00:00
Hieu Hoang
883f2e4f14
get ready to merge similar sorting functions
2016-12-06 18:36:44 +00:00
Hieu Hoang
7cdff3a148
use arrays, not vector
2016-12-06 18:10:56 +00:00
Hieu Hoang
7e922f7a5d
beam pruning even with nbest
2016-12-06 16:08:16 +00:00
Hieu Hoang
30aa185cf2
beam pruning
2016-12-06 16:02:10 +00:00
Hieu Hoang
8f012ba9c9
tweak
2016-12-06 09:39:59 -05:00
Hieu Hoang
ac6f234592
update worse score. Best hypos are already sorted using partial sort, don't need to go thru each of them
2016-12-06 09:31:29 -05:00
Hieu Hoang
a6d226c6b6
update worse score during pruning
2016-12-06 14:00:04 +00:00
Hieu Hoang
40a2588fd0
erase object from set
2016-12-06 13:29:43 +00:00
Hieu Hoang
e6adaad567
Merge ../mosesdecoder into perf_moses2
2016-12-06 13:23:37 +00:00
Hieu Hoang
e8a6677bbb
bug in state comparison. If 2 states are actually the same object, return true, not false
2016-12-06 13:23:26 +00:00
lonevvolf
d68211cba9
Fix for number at the end of a string
2016-12-06 09:41:32 +01:00
Hieu Hoang
6356ccae03
debug
2016-12-06 00:20:41 +00:00
Hieu Hoang
9a272ba519
add inter-stack pruning
2016-12-05 22:47:37 +00:00
Hieu Hoang
fc4fa0f19c
add inter-stack pruning
2016-12-05 18:04:26 +00:00
Hieu Hoang
f7cf9a84ed
use GetBestHypo()
2016-12-05 17:29:52 +00:00
Hieu Hoang
b373a37d00
get ready to change GetSortedAndPruneHypos() to non-const
2016-12-05 17:26:58 +00:00
Hieu Hoang
62e2c85220
delete batch algorithm
2016-12-05 17:05:13 +00:00
Hieu Hoang
a0182da3c9
Merge ../mosesdecoder into perf_moses2
2016-12-05 15:55:45 +00:00
Hieu Hoang
114702fcd8
hack kenlm's populate load by catting files into memory. Also check that all files exists
2016-12-05 15:54:51 +00:00
Hieu Hoang
b188c3b649
check that all files exists
2016-12-05 15:31:02 +00:00
Hieu Hoang
bb36df3a5e
refine worseScore discarding
2016-12-05 14:34:24 +00:00
Hieu Hoang
3275f1be13
warning
2016-12-05 13:29:52 +00:00
Hieu Hoang
00d5dfca4d
Word -> WORD for template class
2016-12-05 13:25:00 +00:00
Hieu Hoang
a95a461ec7
delete unused param to get rid of annoying but irrelevant warning in clang
2016-12-05 13:19:19 +00:00
Hieu Hoang
b572841b09
delete beam threshold variable, keep worse score discarding
2016-12-05 13:11:50 +00:00
Hieu Hoang
525d7272e1
separate m_bestScore and m_minBeamScore. Conflated with m_worseScore
2016-12-01 16:43:06 +00:00
Hieu Hoang
a269d9ab71
rename m_worseScore -> m_minBeamScore
2016-12-01 15:31:22 +00:00