Commit Graph

11540 Commits

Author SHA1 Message Date
Ulrich Germann
7e344d1c53 1. Added variant of CreateRuleLookupManager variant as required by the new
pure virtual function in PhraseTable.h (from the master branch).

2. Bug fix in pool_stats.
2014-03-19 20:43:47 +00:00
Ulrich Germann
c91fb5cc84 Added mmlex-lookup utility program. 2014-03-19 20:41:29 +00:00
Ulrich Germann
ef974cd6ad Merge branch 'master' into dynamic-phrase-tables 2014-03-18 18:25:35 +00:00
Ulrich Germann
740c9dc096 Memory-mapped stuff is now compiled only with --with-mm. 2014-03-18 18:23:59 +00:00
Ulrich Germann
ef2c012470 Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	moses/Jamfile
2014-03-18 18:23:23 +00:00
Ulrich Germann
febb2afc4d Initial check-in. 2014-03-18 12:23:53 +00:00
Ulrich Germann
f20220066b Added choice of denominator for PhraseScoreFwd. 2014-03-18 12:23:31 +00:00
Ulrich Germann
a8eb6645c7 Bug fix. Added sanity check when adding data to dynamic suffix array. 2014-03-18 12:22:29 +00:00
Ulrich Germann
0562415ac0 Added program calc-coverage. 2014-03-18 12:21:12 +00:00
Ulrich Germann
e55dfa26b3 Added program calc-coverage. 2014-03-18 12:20:55 +00:00
Ulrich Germann
4aa88aaf2c Bug fix in constructor. 2014-03-18 12:20:29 +00:00
Ulrich Germann
a11b79175b Added function fill_token_seq. 2014-03-18 12:19:35 +00:00
Ulrich Germann
3f9cefe44e Removed some debugging messages.
Moved fill_token_seq to tpt_tokenindex.h.
2014-03-18 12:18:05 +00:00
Ulrich Germann
394a40b934 Added program calc-coverage. 2014-03-18 12:17:07 +00:00
Kenneth Heafield
fc61084743 Compiler warning 2014-03-17 07:18:11 -07:00
Kenneth Heafield
6bbf437ff7 Surround locks with WITH_THREADS 2014-03-17 07:08:25 -07:00
Phil Williams
69f92bd6e4 moses_chart: implement -output-unknowns option. 2014-03-17 13:09:54 +00:00
Hieu Hoang
ea5577c598 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-14 09:05:50 +00:00
Hieu Hoang
c501e5fab6 accidental error in perl script 2014-03-14 09:04:49 +00:00
Phil Williams
04dbd3c7aa moses_chart: more efficient scope-3 parsing if sentence length < max-chart-span 2014-03-14 08:49:09 +00:00
Ulrich Germann
e0f95fee06 Bug fixes in dynamic phrase tables. 2014-03-14 02:42:38 +00:00
Hieu Hoang
0e308e41ca recommit Rico's change to score format 2014-03-13 18:30:24 +00:00
Hieu Hoang
711bd9c163 eclipse 2014-03-13 18:25:01 +00:00
Ulrich Germann
ce75b58f6f Routine check-in. 2014-03-13 13:41:32 +00:00
Nadir Durrani
054a648713 Transliteration Script - Modifications 2014-03-13 13:10:38 +00:00
Ulrich Germann
94657fd589 Work in progress. 2014-03-12 23:13:44 +00:00
Ulrich Germann
9e104ed6a1 Reverted to version prior to last check-in. 2014-03-12 19:18:25 +00:00
Ulrich Germann
240f52255b Disabled 'rt' in the header specifications. Didn't work in this branch. 2014-03-12 08:09:01 +00:00
Ulrich Germann
9025ac065f Added utilities:
- mam2symal converts memory-mapped word alignments to symal format
- mam_verify performs a sanity check on memory-mapped word alignments
2014-03-12 08:06:55 +00:00
Ulrich Germann
b26eabba39 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2014-03-11 22:29:55 +00:00
Kenneth Heafield
d6df82514b I like gzip 2014-03-11 11:35:38 -07:00
Kenneth Heafield
8ae4d153c8 Consolidated, consistent rt target fixes single-threaded build 2014-03-11 11:29:40 -07:00
Kenneth Heafield
e1d8f5c2ae Do not compile pcqueue_test for single-threaded builds 2014-03-11 11:11:24 -07:00
Ulrich Germann
f1449cd7fe Merge branch 'dynamic-phrase-tables' 2014-03-11 14:17:42 +00:00
Ulrich Germann
c02fbf7664 Completely rewritten. Now multi-threaded. 2014-03-11 13:57:42 +00:00
Ulrich Germann
76eb3d56b9 Proper initialization of class members of InputFeature. 2014-03-11 13:56:40 +00:00
Ulrich Germann
d93c93df87 Reformatting for readability. 2014-03-11 13:55:16 +00:00
Ulrich Germann
b3043d9b00 Reformatting for readability. In ReadInput: delete source only if non-NULL. 2014-03-11 13:53:54 +00:00
Kenneth Heafield
ca9e3aaf84 Fix -output-hypo-score 2014-03-10 11:50:45 -07:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Ulrich Germann
fdc504d47a Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:08:00 +00:00
Ulrich Germann
6e4035fb12 Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:06:10 +00:00
Ulrich Germann
aa8ba7d9a7 Put alignment functionality into a separate class. Not working yet --- work in progress! 2014-03-10 12:03:27 +00:00
Ulrich Germann
ff4ce426e7 Made scorer in PScoreLex public for development purposes. Reset default number of workers to 20. 2014-03-10 12:02:05 +00:00
Ulrich Germann
f7ee316e12 Added initialization of wlex21 and COOCraw during loading. 2014-03-10 11:59:58 +00:00
Ulrich Germann
aad5d67947 Added option to also count raw cooccurrences. 2014-03-10 11:58:46 +00:00
Ulrich Germann
9cf86f6191 Added class Alignment as a friend and wlex21 and COOCraw for development purposes while working on word alignment issues. 2014-03-10 11:57:40 +00:00
Ulrich Germann
9159729ad0 Made internal table COOC public for development purposes. 2014-03-10 11:56:22 +00:00
Hieu Hoang
3f7778db95 Merge pull request #63 from mjdenkowski/master
Meteor scoring for Moses MERT
2014-03-06 22:40:50 +00:00
Michael Denkowski
bb201bbde8 Meteor scoring for Moses MERT 2014-03-06 16:07:01 -05:00