Commit Graph

995 Commits

Author SHA1 Message Date
Lane Schwartz
a18b6676b1 Allow user to specify whether PhraseDictionaryMemoryPerSentenceOnDemand are probability values or not 2017-01-02 14:22:26 -06:00
Doried Abd-Allah
347980fd42 fixing errors while building with oxlm: renamed iptr to boost_iptr because of a conflict with eigen library required by oxlm, added boost_serialization to oxlm requirements in jamroot 2016-12-29 15:16:07 +02:00
MosesAdmin
28c8ff5ad0 daily automatic beautifier 2016-11-13 00:00:33 +00:00
Lane Schwartz
c854df84cb Add per-sentence on-demand translation model.
This translation model reads its phrase table from a TranslationTask object's ContextScope.

This data can come from, for example, a mosesserver XML-RPC client.
2016-11-12 11:31:43 -06:00
Hieu Hoang
883cbc2a4f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-10-06 16:27:26 +01:00
Hieu Hoang
d8362f8a55 compile error 2016-10-06 16:23:53 +01:00
MosesAdmin
871c64cec5 daily automatic beautifier 2016-10-06 15:14:56 +01:00
Hieu Hoang
b7f1b360be merge 2016-10-06 14:00:32 +01:00
Hieu Hoang
a2fd8d5b2c quering -> querying 2016-10-06 13:57:33 +01:00
Hieu Hoang
babc5acf70 check that pt exists 2016-10-06 13:48:06 +01:00
Hieu Hoang
fa888166c0 no segfault. yay 2016-10-06 13:10:55 +01:00
Hieu Hoang
7d7ae1b72c add StoreVocab 2016-10-05 16:43:04 +01:00
Hieu Hoang
0e4e64b26d getKey() -> Moses::getKey() 2016-10-05 16:26:33 +01:00
Hieu Hoang
041b13eb19 compiles but segfault 2016-10-05 15:32:56 +01:00
Hieu Hoang
2eea4dd5e0 compiles 2016-10-04 16:48:52 +01:00
Hieu Hoang
3a72b4958a update Moses::ProbingPT with Moses2::ProbingPT. Does not compile 2016-10-03 19:02:06 +01:00
MosesAdmin
5069aa4370 daily automatic beautifier 2016-10-03 17:24:24 +01:00
Hieu Hoang
8421a26188 return correct target phrases 2016-10-03 13:43:41 +01:00
Hieu Hoang
22423d45e2 lookup in size order for compact pt 2016-09-30 17:54:47 +01:00
Philipp Koehn
6e5da8cc2c reversing change: now compact phrase table memory mapping is turned on by default, can be turned off with -minphr-memory (as before 2015-12-12) 2016-09-04 19:31:51 +01:00
Hieu Hoang
d196279be8 compile error on some gcc 2016-08-18 09:24:02 +01:00
Michael Denkowski
3aedc0bf68 Standalone phrase distance feature
(Uses input coordinates populated by XML input and target phrase coordinates
 populated by phrase dictionary implementation)
2016-08-12 12:05:12 +02:00
Michael Denkowski
ae1e51d81a Support storing coordinates of target phrase
- Keep track of named spaces in StaticData
- Adding coords to phrases implemented for Mmsapt
2016-08-12 12:05:12 +02:00
Michael Denkowski
d29916bbb3 Roll back to just tracking coordinates in mmsapt
(distance wants to be a separate FF)
2016-08-12 12:05:12 +02:00
Michael Denkowski
5c2b8d843c Distance feature for mmsapt
- Make ttask visible to scorers
- Only track sentence ids if using distance feature
2016-08-12 12:05:12 +02:00
Michael Denkowski
7db3fedc3b Track sentence ids in mmsapt sampling 2016-08-12 12:05:11 +02:00
MosesAdmin
7e0bc639c1 daily automatic beautifier 2016-06-28 11:18:58 +01:00
Hieu Hoang
ebae7ce520 move ConvertFromMoses() to Moses 2016-06-28 11:15:40 +01:00
Hieu Hoang
ad240a9f5b move Moses classes out of OnDiskPt - Word 2016-06-28 10:46:51 +01:00
Hieu Hoang
cef30724d5 move Moses classes out of OnDiskPt - TargetPhrase 2016-06-28 10:28:19 +01:00
Hieu Hoang
aca2db894c move Moses classes out of OnDiskPt 2016-06-28 10:08:30 +01:00
michaelhutt
9945502e50 fixes std::bad_alloc in processPhraseTableMin for large models
+ only seems to affect the Intel compiler at O3
2016-05-12 16:44:09 -04:00
Ulrich Germann
31c8946c8c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-04-15 16:39:57 +01:00
Hieu Hoang
4c07496eb2 compile error with suffix array 2016-03-23 15:18:20 +00:00
Michael Denkowski
fa15d60afd Revert "Query member phrase tables in batch mode for forward compatibility"
This reverts commit 2462c81f7a.

Looks like legacy is still the least-breaking way to query phrase tables
2016-03-21 16:44:23 -04:00
Michael Denkowski
2a9034eaec Revert "daily automatic beautifier"
This reverts commit 578d667ca2.
2016-03-21 16:41:49 -04:00
MosesAdmin
578d667ca2 daily automatic beautifier 2016-03-19 00:00:38 +00:00
Michael Denkowski
2462c81f7a Query member phrase tables in batch mode for forward compatibility
Use GetTargetPhraseCollectionBatch instead of GetTargetPhraseCollectionLEGACY
2016-03-18 14:37:46 -04:00
Ulrich Germann
98bcf53ec2 Namespace bug fix. 2016-02-18 16:39:34 +00:00
Ulrich Germann
bbcd10a62d Better option handling in check-coverage3. 2016-02-15 16:48:46 +00:00
Ulrich Germann
105225d398 Bug fix. 2016-02-06 15:19:44 +00:00
Ulrich Germann
cf97a8599f Show all entries in check-coverage3. 2016-01-28 00:09:12 +00:00
Ulrich Germann
63b2933902 Improvements to check-coverage3.cc. 2016-01-22 17:52:40 +00:00
Ulrich Germann
56e13d152a Bug fix. 2016-01-20 20:14:38 +00:00
Ulrich Germann
2ab4e0f2fe Look-up phrases with context weights. 2016-01-20 18:44:01 +00:00
Ulrich Germann
cb477df36d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-15 22:52:44 +00:00
Ulrich Germann
37e68bcb31 Added Marcin Junczys-Dowmunt's implementation of Johnson et al.'s significance-based phrase table pruning to the master branch. 2016-01-15 22:52:29 +00:00
Michael Denkowski
297691db57 Default number of workers to thread count
(control workers with command line --threads option)
2016-01-13 14:02:03 -05:00
Ulrich Germann
9caeda5751 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2016-01-04 22:58:48 +00:00
Ulrich Germann
b32d7754cd Code cleanup. 2016-01-04 22:51:43 +00:00