Ulrich Germann
94657fd589
Work in progress.
2014-03-12 23:13:44 +00:00
Ulrich Germann
240f52255b
Disabled 'rt' in the header specifications. Didn't work in this branch.
2014-03-12 08:09:01 +00:00
Ulrich Germann
9025ac065f
Added utilities:
...
- mam2symal converts memory-mapped word alignments to symal format
- mam_verify performs a sanity check on memory-mapped word alignments
2014-03-12 08:06:55 +00:00
Ulrich Germann
b26eabba39
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/Jamfile
2014-03-11 22:29:55 +00:00
Kenneth Heafield
d6df82514b
I like gzip
2014-03-11 11:35:38 -07:00
Kenneth Heafield
8ae4d153c8
Consolidated, consistent rt target fixes single-threaded build
2014-03-11 11:29:40 -07:00
Kenneth Heafield
e1d8f5c2ae
Do not compile pcqueue_test for single-threaded builds
2014-03-11 11:11:24 -07:00
Ulrich Germann
f1449cd7fe
Merge branch 'dynamic-phrase-tables'
2014-03-11 14:17:42 +00:00
Ulrich Germann
c02fbf7664
Completely rewritten. Now multi-threaded.
2014-03-11 13:57:42 +00:00
Ulrich Germann
76eb3d56b9
Proper initialization of class members of InputFeature.
2014-03-11 13:56:40 +00:00
Ulrich Germann
d93c93df87
Reformatting for readability.
2014-03-11 13:55:16 +00:00
Ulrich Germann
b3043d9b00
Reformatting for readability. In ReadInput: delete source only if non-NULL.
2014-03-11 13:53:54 +00:00
Kenneth Heafield
ca9e3aaf84
Fix -output-hypo-score
2014-03-10 11:50:45 -07:00
Ulrich Germann
a7c85780ee
Merge branch 'master' into dynamic-phrase-tables
...
Conflicts:
phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Ulrich Germann
fdc504d47a
Changes on main branch files while I was working on dynamic phrase tables.
2014-03-10 14:08:00 +00:00
Ulrich Germann
6e4035fb12
Changes on main branch files while I was working on dynamic phrase tables.
2014-03-10 14:06:10 +00:00
Ulrich Germann
aa8ba7d9a7
Put alignment functionality into a separate class. Not working yet --- work in progress!
2014-03-10 12:03:27 +00:00
Ulrich Germann
ff4ce426e7
Made scorer in PScoreLex public for development purposes. Reset default number of workers to 20.
2014-03-10 12:02:05 +00:00
Ulrich Germann
f7ee316e12
Added initialization of wlex21 and COOCraw during loading.
2014-03-10 11:59:58 +00:00
Ulrich Germann
aad5d67947
Added option to also count raw cooccurrences.
2014-03-10 11:58:46 +00:00
Ulrich Germann
9cf86f6191
Added class Alignment as a friend and wlex21 and COOCraw for development purposes while working on word alignment issues.
2014-03-10 11:57:40 +00:00
Ulrich Germann
9159729ad0
Made internal table COOC public for development purposes.
2014-03-10 11:56:22 +00:00
Hieu Hoang
3f7778db95
Merge pull request #63 from mjdenkowski/master
...
Meteor scoring for Moses MERT
2014-03-06 22:40:50 +00:00
Michael Denkowski
bb201bbde8
Meteor scoring for Moses MERT
2014-03-06 16:07:01 -05:00
Ulrich Germann
81ed9937e1
Routine check-in.
2014-03-05 11:53:05 +00:00
Ulrich Germann
2b19b71095
Routine check-in.
2014-03-04 15:51:59 +00:00
Ian Johnson
23556697c4
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-03-03 16:50:54 +00:00
Ian Johnson
58bc0fd854
RPM installers now support updating and release numbers on SPEC and SOURCE creation.
2014-03-03 16:50:36 +00:00
Rico Sennrich
c27ecbe5c6
rename SyntaxConstraintFeature to TreeStructureFeature
...
(makes it clearer what it does; build/print the internal tree structure in string-to-tree decoding)
no longer rely on name of FF for printing internal trees
2014-03-03 13:56:19 +00:00
Ulrich Germann
6c37b8d252
Routine check-in.
2014-03-03 12:13:41 +00:00
Rico Sennrich
01bc3c111e
swap position of alignment and scores in phrase table halves (before consolidate step).
...
ensures that multiple hierarchical rules with same source/target phrase, but different alignment, are sorted correctly
2014-03-02 16:55:42 +00:00
Kenneth Heafield
952bb76b77
We weren't linking against tcmalloc...
2014-03-01 07:42:32 +00:00
Jun-ya NORIMATSU
14d9d50b76
Merge remote-tracking branch 'origin/master'
2014-02-28 13:39:16 +09:00
Jun-ya NORIMATSU
19bc1c317d
improve DALMwrapper again.
2014-02-28 13:38:35 +09:00
Hieu Hoang
b48f410bee
don't check object pointer before deleting /Markus Elfring
2014-02-26 10:43:37 +00:00
Hieu Hoang
c48d8b5e31
update last weight override
2014-02-26 10:32:48 +00:00
Ulrich Germann
3f678fa689
Updated pretokenizer for French.
2014-02-25 03:10:58 +00:00
Ulrich Germann
2b181ee691
Fixed Mmsapt constructor.
2014-02-25 03:10:16 +00:00
Ulrich Germann
4c003edb0d
Fixed #include-s.
2014-02-25 03:09:19 +00:00
Hieu Hoang
b9c6c7a2a6
need to zero out all weights, especially sparse weights
2014-02-23 21:35:34 +00:00
Hieu Hoang
7509e8bbaa
reset sparse weights
2014-02-23 20:46:16 +00:00
Hieu Hoang
1716514eda
create ResetWeights(). Only for dense weights
2014-02-23 20:07:28 +00:00
Ulrich Germann
e70766a6de
Preprocessor for tokenization that fixes known errors in the raw input.
2014-02-22 00:28:33 +00:00
Ulrich Germann
a8d66cd68d
Removed Mmsapt constuctor with both descriptor and config line.
2014-02-22 00:27:07 +00:00
Ulrich Germann
817e3695e0
Fixed some include paths.
2014-02-22 00:25:58 +00:00
Ulrich Germann
1252700c44
Removed constructor with both description and config line.
2014-02-22 00:25:02 +00:00
Ulrich Germann
d3d14ccf3d
- added option -no-escape to skip escaping of special characters
...
- fixed bug in aggressive tokenization
(est-a-dire was split as est @-@ a-dire
instead of est @-@ a @-@ dire)
2014-02-21 14:14:03 +00:00
Ulrich Germann
ef1d5b762e
Merge branch 'dynamic-phrase-tables' of file:///fs/sif0/germann/git/mosesdecoder into dynamic-phrase-tables
2014-02-21 12:59:52 +00:00
Ulrich Germann
4b95c3a906
Merge branch 'dynamic-phrase-tables' of ssh://thor//home/germann/git/mosesdecoder into dynamic-phrase-tables
...
due to resetting the location of the remote repository.
2014-02-21 01:09:38 +00:00
Ulrich Germann
ef2ef881a4
Merge branch 'dynamic-phrase-tables' of file:///home/germann/git/mosesdecoder into dynamic-phrase-tables
2014-02-21 01:04:02 +00:00
