Commit Graph

11523 Commits

Author SHA1 Message Date
Ulrich Germann
a8eb6645c7 Bug fix. Added sanity check when adding data to dynamic suffix array. 2014-03-18 12:22:29 +00:00
Ulrich Germann
0562415ac0 Added program calc-coverage. 2014-03-18 12:21:12 +00:00
Ulrich Germann
e55dfa26b3 Added program calc-coverage. 2014-03-18 12:20:55 +00:00
Ulrich Germann
4aa88aaf2c Bug fix in constructor. 2014-03-18 12:20:29 +00:00
Ulrich Germann
a11b79175b Added function fill_token_seq. 2014-03-18 12:19:35 +00:00
Ulrich Germann
3f9cefe44e Removed some debugging messages.
Moved fill_token_seq to tpt_tokenindex.h.
2014-03-18 12:18:05 +00:00
Ulrich Germann
394a40b934 Added program calc-coverage. 2014-03-18 12:17:07 +00:00
Ulrich Germann
e0f95fee06 Bug fixes in dynamic phrase tables. 2014-03-14 02:42:38 +00:00
Ulrich Germann
ce75b58f6f Routine check-in. 2014-03-13 13:41:32 +00:00
Ulrich Germann
94657fd589 Work in progress. 2014-03-12 23:13:44 +00:00
Ulrich Germann
240f52255b Disabled 'rt' in the header specifications. Didn't work in this branch. 2014-03-12 08:09:01 +00:00
Ulrich Germann
9025ac065f Added utilities:
- mam2symal converts memory-mapped word alignments to symal format
- mam_verify performs a sanity check on memory-mapped word alignments
2014-03-12 08:06:55 +00:00
Ulrich Germann
b26eabba39 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2014-03-11 22:29:55 +00:00
Kenneth Heafield
d6df82514b I like gzip 2014-03-11 11:35:38 -07:00
Kenneth Heafield
8ae4d153c8 Consolidated, consistent rt target fixes single-threaded build 2014-03-11 11:29:40 -07:00
Kenneth Heafield
e1d8f5c2ae Do not compile pcqueue_test for single-threaded builds 2014-03-11 11:11:24 -07:00
Ulrich Germann
f1449cd7fe Merge branch 'dynamic-phrase-tables' 2014-03-11 14:17:42 +00:00
Ulrich Germann
c02fbf7664 Completely rewritten. Now multi-threaded. 2014-03-11 13:57:42 +00:00
Ulrich Germann
76eb3d56b9 Proper initialization of class members of InputFeature. 2014-03-11 13:56:40 +00:00
Ulrich Germann
d93c93df87 Reformatting for readability. 2014-03-11 13:55:16 +00:00
Ulrich Germann
b3043d9b00 Reformatting for readability. In ReadInput: delete source only if non-NULL. 2014-03-11 13:53:54 +00:00
Kenneth Heafield
ca9e3aaf84 Fix -output-hypo-score 2014-03-10 11:50:45 -07:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Ulrich Germann
fdc504d47a Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:08:00 +00:00
Ulrich Germann
6e4035fb12 Changes on main branch files while I was working on dynamic phrase tables. 2014-03-10 14:06:10 +00:00
Ulrich Germann
aa8ba7d9a7 Put alignment functionality into a separate class. Not working yet --- work in progress! 2014-03-10 12:03:27 +00:00
Ulrich Germann
ff4ce426e7 Made scorer in PScoreLex public for development purposes. Reset default number of workers to 20. 2014-03-10 12:02:05 +00:00
Ulrich Germann
f7ee316e12 Added initialization of wlex21 and COOCraw during loading. 2014-03-10 11:59:58 +00:00
Ulrich Germann
aad5d67947 Added option to also count raw cooccurrences. 2014-03-10 11:58:46 +00:00
Ulrich Germann
9cf86f6191 Added class Alignment as a friend and wlex21 and COOCraw for development purposes while working on word alignment issues. 2014-03-10 11:57:40 +00:00
Ulrich Germann
9159729ad0 Made internal table COOC public for development purposes. 2014-03-10 11:56:22 +00:00
Hieu Hoang
3f7778db95 Merge pull request #63 from mjdenkowski/master
Meteor scoring for Moses MERT
2014-03-06 22:40:50 +00:00
Michael Denkowski
bb201bbde8 Meteor scoring for Moses MERT 2014-03-06 16:07:01 -05:00
Ulrich Germann
81ed9937e1 Routine check-in. 2014-03-05 11:53:05 +00:00
Ulrich Germann
2b19b71095 Routine check-in. 2014-03-04 15:51:59 +00:00
Ian Johnson
23556697c4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-03 16:50:54 +00:00
Ian Johnson
58bc0fd854 RPM installers now support updating and release numbers on SPEC and SOURCE creation. 2014-03-03 16:50:36 +00:00
Rico Sennrich
c27ecbe5c6 rename SyntaxConstraintFeature to TreeStructureFeature
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)

no longer rely on name of FF for printing internal trees
2014-03-03 13:56:19 +00:00
Ulrich Germann
6c37b8d252 Routine check-in. 2014-03-03 12:13:41 +00:00
Rico Sennrich
01bc3c111e swap position of alignment and scores in phrase table halves (before consolidate step).
ensures that multiple hierarchical rules with same source/target phrase, but different alignment, are sorted correctly
2014-03-02 16:55:42 +00:00
Kenneth Heafield
952bb76b77 We weren't linking against tcmalloc... 2014-03-01 07:42:32 +00:00
Jun-ya NORIMATSU
14d9d50b76 Merge remote-tracking branch 'origin/master' 2014-02-28 13:39:16 +09:00
Jun-ya NORIMATSU
19bc1c317d improve DALMwrapper again. 2014-02-28 13:38:35 +09:00
Hieu Hoang
b48f410bee don't check object pointer before deleting /Markus Elfring 2014-02-26 10:43:37 +00:00
Hieu Hoang
c48d8b5e31 update last weight override 2014-02-26 10:32:48 +00:00
Ulrich Germann
3f678fa689 Updated pretokenizer for French. 2014-02-25 03:10:58 +00:00
Ulrich Germann
2b181ee691 Fixed Mmsapt constructor. 2014-02-25 03:10:16 +00:00
Ulrich Germann
4c003edb0d Fixed #include-s. 2014-02-25 03:09:19 +00:00
Hieu Hoang
b9c6c7a2a6 need to zero out all weights, especially sparse weights 2014-02-23 21:35:34 +00:00
Hieu Hoang
7509e8bbaa reset sparse weights 2014-02-23 20:46:16 +00:00