moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-06 19:49:41 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,686 Commits 136 Branches 26 Tags 147 MiB
42cbebe550
Commit Graph

1064 Commits

Author SHA1 Message Date
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Hieu Hoang
17140e4ae7 eclipse 2014-07-01 13:01:51 -04:00
Hieu Hoang
ee6e140738 eclipse 2014-06-25 16:14:25 -04:00
Hieu Hoang
fee06b2d95 eclipse 2014-06-25 16:04:04 -04:00
Hieu Hoang
629a201152 eclipse 2014-06-25 15:59:34 -04:00
Hieu Hoang
52eb4ef57b eclipse 2014-06-25 15:53:14 -04:00
Hieu Hoang
5d4083a3cf eclipse 2014-06-25 15:39:07 -04:00
Hieu Hoang
19e4504a57 eclipse 2014-06-25 15:16:37 -04:00
Hieu Hoang
d7cbef5cbe minor format change in consolidate 2014-06-25 07:04:11 -04:00
Hieu Hoang
1b9267adf3 redo eclipse projects 2014-06-25 00:03:59 -04:00
Hieu Hoang
d949774f41 redo eclipse projects 2014-06-25 00:02:40 -04:00
Hieu Hoang
15630258d0 redo eclipse projects 2014-06-25 00:00:46 -04:00
Hieu Hoang
c35a49e606 eclipse 2014-06-21 17:45:21 -04:00
Hieu Hoang
c460330430 debug output for PhraseProperty 2014-06-19 19:23:33 +01:00
Hieu Hoang
d5228dec08 Merge ../mosesdecoder.hieu 2014-06-16 11:39:17 +01:00
XapaJIaMnu
054994cadd Fix a small error in the html generator 2014-06-16 11:02:55 +01:00
Hieu Hoang
6e3b6d013b add SyntaxRHS FF 2014-06-15 21:41:52 +01:00
Hieu Hoang
eba3dc3626 escape 2014-06-14 08:38:20 +01:00
Hieu Hoang
dea105f663 redo property API 2014-06-13 15:34:24 +01:00
Hieu Hoang
6cd343737c add NonTermContext property 2014-06-13 12:04:40 +01:00
Hieu Hoang
20797b93d8 eclipse 2014-06-13 11:02:01 +01:00
Hieu Hoang
eb78782c5d merge with master 2014-06-13 10:35:35 +01:00
Hieu Hoang
2c6cdb5889 bjam for ProbingPT 2014-06-13 09:48:32 +01:00
Hieu Hoang
15c56071cb eclipse 2014-06-12 17:53:40 +01:00
Hieu Hoang
ad4825ad44 integrated probing pt into decoder 2014-06-11 14:25:18 +01:00
Hieu Hoang
253f8e35fd integrated probing pt into decoder 2014-06-11 13:52:20 +01:00
XapaJIaMnu
2f752fe833 Truncate revision output 2014-06-11 10:51:31 +01:00
XapaJIaMnu
793aef6715 Fix small oversight 2014-06-11 10:24:44 +01:00
Hieu Hoang
341969e61d Merge ../mosesdecoder into hieu 2014-06-10 18:04:55 +01:00
XapaJIaMnu
d1554c4cdc Add moses speedtesting framework and readmes. 2014-06-10 16:28:46 +01:00
Hieu Hoang
651967e109 eclipse 2014-06-09 16:24:19 +01:00
Hieu Hoang
45ed0a5b1f Merge ../mosesdecoder into hieu 2014-06-08 13:22:34 +01:00
Hieu Hoang
91a7c19b7c eclipse project for consolidate 2014-06-08 12:41:54 +01:00
Hieu Hoang
a5f46e65cb eclipse 2014-06-06 17:25:09 +01:00
Hieu Hoang
5032fc1d33 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-06-06 11:15:28 +01:00
Hieu Hoang
3f82e7eb01 eclipse 2014-06-06 11:15:31 +01:00
Hieu Hoang
b589c3d5c2 Merge ../mosesdecoder into hieu 2014-06-06 11:11:47 +01:00
Rico Sennrich
76b6a5b6c9 compatibility with more python versions (python3; 2.7.3) 2014-06-06 10:32:23 +01:00
Hieu Hoang
d95bd5bdae span length property 2014-06-05 20:57:00 +01:00
Hieu Hoang
51b8a0aaad added --MinHoleSource 2014-06-05 17:32:43 +01:00
Hieu Hoang
21da8299b8 eclipse 2014-06-04 23:02:11 +01:00
Hieu Hoang
1b163edffe eclipse 2014-06-04 22:40:25 +01:00
Hieu Hoang
4a3ac7411d span length 2014-06-04 16:52:57 +01:00
Hieu Hoang
742d342fbb don't output SpanLength property if no non-terms 2014-06-04 14:23:51 +01:00
Hieu Hoang
8e2c4a89c0 Merge ../mosesdecoder into hieu 2014-06-04 12:53:06 +01:00
Hieu Hoang
b2de22fccb Merge pull request #65 from proycon/master 
python-contrib was not up to date anymore with current PhraseDictionaryTree() constructor: fixed and reran cython (newer version) to generate cpp
 2014-06-04 12:40:54 +01:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
 2014-06-03 18:55:53 +01:00
Hieu Hoang
631cf9e993 minor error in arg 2014-06-03 12:26:00 +01:00
Hieu Hoang
acd88761b4 minor error in arg 2014-06-03 12:20:47 +01:00
Hieu Hoang
a134fb4000 add filter-by-source-word-count.perl 2014-06-02 15:43:35 +01:00
Maarten van Gompel
bdc60e40bc Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version.. 2014-06-02 14:41:33 +02:00
Maarten van Gompel
0b5825a853 Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version.. 2014-06-02 14:38:32 +02:00
Hieu Hoang
40d5a98733 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-05-31 21:39:55 +01:00
Hieu Hoang
ea1fb296fe add span length to training 2014-05-31 21:39:47 +01:00
Hieu Hoang
3ecd625920 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-05-30 09:32:14 +01:00
Hieu Hoang
a270811d84 Merge ../mosesdecoder into hieu 2014-05-30 09:31:14 +01:00
Hieu Hoang
d658caeb00 Merge ../mosesdecoder into hieu 2014-05-30 05:41:49 +01:00
Hieu Hoang
6fae97f757 debugging when alignment is inconsistent. Usually due to non-printing chars 2014-05-30 05:37:06 +01:00
isnowfy
9c1809cf34 moseserver can return search graph for chart decoding 2014-05-28 00:08:12 +08:00
Hieu Hoang
6c66d9455a add --MaxScope to extract-mixed-syntax 2014-05-27 16:51:43 +01:00
Hieu Hoang
4e61748460 add --MaxScope to extract-mixed-syntax 2014-05-27 16:35:15 +01:00
Hieu Hoang
5353df3ee8 --NoNieceTerminal in extract-mixed-syntax 2014-05-21 18:33:51 +01:00
Hieu Hoang
bcff66b491 --NoNieceTerminal in extract-mixed-syntax 2014-05-21 18:31:31 +01:00
Hieu Hoang
78192888df Merge ../mosesdecoder into hieu 2014-05-21 14:58:14 +01:00
Hieu Hoang
d799d188c7 eclipse 2014-05-21 14:14:28 +01:00
Hieu Hoang
401c4940cf debugged FF NieceTerminal 2014-05-21 13:43:32 +01:00
Hieu Hoang
b60ac0321f rename DuplicateWord -> NieceTerminal 2014-05-20 20:02:49 +01:00
Hieu Hoang
e31ce4d3be add FF DuplicateWord 2014-05-20 19:51:46 +01:00
Ulrich Germann
9cda90afdf Major revision of m4m. May not be backwards-compatible. 2014-05-18 21:53:19 +01:00
Ulrich Germann
ff6a27b56e Tried to get merge-sorted to compile under bjam. Didn't work. 2014-05-18 21:49:22 +01:00
Ulrich Germann
b136e292af Put libraries in the right order for things to work. 2014-05-18 15:51:56 +01:00
Ulrich Germann
16b95c08ce Initial check-in. 2014-05-18 15:44:33 +01:00
Ulrich Germann
05e7de7f99 Fixed file path for ug_stream.h in merge-sorted.cc. 2014-05-18 15:44:04 +01:00
Hieu Hoang
238864a53e Merge ../mosesdecoder into hieu 2014-05-16 16:17:01 +01:00
Hieu Hoang
65a1e176e5 bugs in FF MaxSpanFreeNonTermSource 2014-05-16 16:16:20 +01:00
Hieu Hoang
1e96ffcf3d rename FF RuleAmbiguity to RuleScope 2014-05-16 12:47:43 +01:00
Hieu Hoang
999b39018e Merge ../mosesdecoder into hieu 2014-05-13 19:50:56 +01:00
Hieu Hoang
4aed98a90b eclipse 2014-05-13 19:50:44 +01:00
Hieu Hoang
1d0584389e eclipse 2014-05-08 22:42:30 +01:00
Hieu Hoang
7632fbd51c Merge ../mosesdecoder into hieu 2014-05-08 21:09:35 +01:00
Hieu Hoang
3ef5d76860 add MaxSpanFreeNonTermSource. Need to change FF framework to take in derivation 2014-05-08 16:34:04 +01:00
Hieu Hoang
4b15ff28d6 default value 2014-05-07 18:03:38 +01:00
Hieu Hoang
b5b58a978f Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-05-07 17:37:37 +01:00
Hieu Hoang
6d76cee2eb add --MaxSpanFreeNonTermSource 2014-05-07 17:37:27 +01:00
Hieu Hoang
221c8d1505 comments 2014-05-07 17:22:52 +01:00
Hieu Hoang
48b945bc2d delete old extract-mixed 2014-05-07 16:27:54 +01:00
Hieu Hoang
1b7ed9e651 Merge ../mosesdecoder into hieu 2014-05-07 14:31:33 +01:00
Hieu Hoang
49a91b7aa9 eclipse 2014-05-07 14:31:13 +01:00
Hieu Hoang
71242a3578 Merge ../mosesdecoder into hieu 2014-05-07 12:11:24 +01:00
Hieu Hoang
2beed771d2 minor error. Segfault if phrase length is bigger than max-phrase-length 2014-05-01 16:47:17 +01:00
Hieu Hoang
17c10d45f3 merge 2014-05-01 14:52:38 +01:00
Hieu Hoang
55064961f7 mert-sge-nosync /Raymond Ng 2014-04-30 16:51:26 +01:00
Ulrich Germann
7c145d045b Merge branch 'master' into dynamic-phrase-tables 
Conflicts:
	contrib/server/Jamfile
	contrib/server/mosesserver.cpp
 2014-04-28 10:00:07 +01:00
Hieu Hoang
da6ade7d94 get-by-line-number.perl 2014-04-24 17:48:12 +01:00
Hieu Hoang
51f020b2c4 Merge ../mosesdecoder into hieu 2014-04-20 00:20:25 +01:00
Hieu Hoang
def22cef44 Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-04-18 18:11:56 +01:00
Hieu Hoang
7f41ab2390 trying to count the total number of possible translations 2014-04-18 16:32:29 +01:00
Barry Haddow
00a2bd395a word alignment from server, thanks to Jyotesh Choudhari 2014-04-17 21:22:30 +01:00
Hieu Hoang
8d69327eb1 merge 2014-04-17 20:22:40 +01:00
Hieu Hoang
e22b68e2fd roll back change in mosesserver. Doesn't work with xmlrpc-c v. 1.16.33 - ie very old lib on Ubuntu 12.04 2014-04-17 20:15:06 +01:00
Hieu Hoang
a4d32a2b09 minor compile errors in ChartKBestExtractor 2014-04-17 20:04:02 +01:00
Hieu Hoang
46cef770b7 add header allowOrigin * 2014-04-12 17:20:34 +02:00
Ulrich Germann
f85bf72a8e Merge branch 'master' into dynamic-phrase-tables 
Conflicts:
	moses/TranslationModel/UG/mmsapt.cpp
 2014-04-11 19:24:37 +01:00
Ulrich Germann
1a380b9a8a Fixed typo 2014-04-11 12:29:32 +01:00
Hieu Hoang
9644a30858 add FF RuleAmbiguity 2014-04-11 10:22:03 +01:00
Hieu Hoang
91d6bfe0d5 start on FF ReferenceComparison 2014-04-10 21:34:34 +01:00
Hieu Hoang
af408f4228 eclipse 2014-04-08 22:09:43 +01:00
Hieu Hoang
7ae44a96f1 add FF CountNonTerms 2014-04-08 17:16:24 +01:00
Hieu Hoang
f31c004063 eclipse 2014-04-08 15:48:04 +01:00
Ulrich Germann
21f141ce0d Merge branch 'master' into dynamic-phrase-tables 
Conflicts:
	moses/InputPath.cpp
	moses/Word.cpp
 2014-04-08 14:58:29 +01:00
Hieu Hoang
58f8fcd205 add --HieroSourceLHS 2014-04-08 12:27:51 +01:00
Hieu Hoang
57ce48c5bc add --HieroSourceLHS 2014-04-08 12:22:11 +01:00
Hieu Hoang
b98dac2971 merge 2014-04-06 19:07:13 +01:00
Hieu Hoang
09dc0e9913 add FF/SetSourcePhrase 2014-04-06 16:57:54 +01:00
Hieu Hoang
a17bead267 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-04-05 14:48:41 +01:00
Hieu Hoang
b7b502fbf5 eclipse 2014-04-04 22:34:38 +01:00
Hieu Hoang
cb8533b0f7 comment out debugging message 2014-04-04 11:42:16 +01:00
Hieu Hoang
831e52119c comment out debugging message 2014-04-04 11:33:31 +01:00
Hieu Hoang
59098ac664 merge 2014-04-04 11:20:06 +01:00
Hieu Hoang
afb3d01344 eclipse 2014-04-03 23:27:08 +01:00
Hieu Hoang
b5784c9c77 eclipse 2014-04-03 23:23:21 +01:00
Hieu Hoang
5297620e8e eclipse 2014-04-03 23:15:05 +01:00
Hieu Hoang
f6956bfe99 eclipse 2014-04-03 23:14:19 +01:00
Ulrich Germann
b1b9f6cfa2 Additions / changes to Moses server so that it can be used for Moses tuning. 2014-04-03 20:38:14 +01:00
Hieu Hoang
6fa561e39e comment out debugging message 2014-04-03 18:24:48 +01:00
Hieu Hoang
f344cbe61b Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-03-31 14:22:27 +01:00
Hieu Hoang
a36d7c292d parse chunk tagger output 2014-03-27 19:25:05 +00:00
Rico Sennrich
63ca61ba0b tmcombine: don't crash if model contains sparse features or other data 
(no adaptation; tmcombine will copy sparse features / data from first model)
 2014-03-27 15:27:10 +00:00
Hieu Hoang
989df9deb1 remove temp directory 2014-03-24 17:00:53 +00:00
Hieu Hoang
5e5ad96729 segfault when there's nothing in the stack 2014-03-24 16:50:43 +00:00
Hieu Hoang
3e1d86549b Merge branch 'master' of ../mosesdecoder into hieu 2014-03-24 16:09:31 +00:00
Hieu Hoang
4a91739ad5 eclipse 2014-03-24 16:09:28 +00:00
Hieu Hoang
88d9ddd45b Merge branch 'master' of ../mosesdecoder into hieu 2014-03-24 16:05:20 +00:00
Hieu Hoang
d9fb9ce23c eclipse 2014-03-24 16:05:17 +00:00
Hieu Hoang
e8a41de438 Merge branch 'master' of ../mosesdecoder into hieu 2014-03-24 16:04:06 +00:00
Hieu Hoang
4ccb001b29 eclipse 2014-03-24 16:03:44 +00:00
Hieu Hoang
97c7afad98 learnability analysis scripts 2014-03-21 21:40:47 +00:00
Ulrich Germann
f1d39b50fc Added support for Mmsapt. 2014-03-21 11:03:45 +00:00
Hieu Hoang
c8d256979f learnability analysis scripts 2014-03-20 23:28:00 +00:00
Hieu Hoang
4c7ea7fe08 delete debugging messages 2014-03-20 12:30:14 +00:00
Hieu Hoang
a7ca294cf6 delete debugging messages 2014-03-20 12:11:22 +00:00
Hieu Hoang
b556cdc464 add --MultiLabel 2014-03-20 12:09:22 +00:00
Hieu Hoang
f4befcf125 probing pt source vocab 2014-03-19 12:59:55 +00:00
Hieu Hoang
e389b8f51d dumb labelling - label constituent with character if start & end words begin with that character 2014-03-17 10:43:18 +00:00
Hieu Hoang
4ccbfc59d0 dumb labelling - label constituent with character if start & end words begin with that character 2014-03-17 10:24:07 +00:00
Hieu Hoang
28ccd68c84 retain lines 2014-03-16 10:20:24 +00:00
Hieu Hoang
044ff868fc merge 2014-03-13 21:36:41 +00:00
Hieu Hoang
711bd9c163 eclipse 2014-03-13 18:25:01 +00:00
Hieu Hoang
e5c48941fb Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-03-07 14:18:30 +00:00
Hieu Hoang
ec21f3c49c bug in adjacent non-term 2014-03-07 14:17:50 +00:00
Hieu Hoang
e003b75a5b bug in xml parsing 2014-03-07 14:08:06 +00:00
Hieu Hoang
5e93c3f804 conflicts 2014-03-07 12:18:18 +00:00
Hieu Hoang
58e59b8f14 filter to only output certain labels 2014-03-07 12:11:53 +00:00
Hieu Hoang
5c45762f67 escaping 2014-03-07 11:54:39 +00:00
Hieu Hoang
2a7e2c5fc5 don't choke if character is _ 2014-03-04 11:48:53 +00:00
Ian Johnson
23556697c4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-03-03 16:50:54 +00:00
Ian Johnson
58bc0fd854 RPM installers now support updating and release numbers on SPEC and SOURCE creation. 2014-03-03 16:50:36 +00:00
Hieu Hoang
fcb07173da add MaxNonTerm and MaxHieroNonTerm 2014-03-02 21:17:09 +00:00
Hieu Hoang
690e92c041 -O3 2014-02-28 21:59:36 +00:00
Hieu Hoang
9f2627faeb optional input & output files 2014-02-28 20:43:58 +00:00
Hieu Hoang
13411885dd use chunker with en 2014-02-28 18:26:24 +00:00
Hieu Hoang
e0baf23f30 use chunker with en 2014-02-28 18:21:37 +00:00
Hieu Hoang
4dc1bdfd2e makefile 2014-02-28 17:42:50 +00:00
Hieu Hoang
c77fbd59fb nested labels. Hack 2014-02-28 16:08:55 +00:00
Hieu Hoang
0ae73c5aa2 use open nlp chunker 2014-02-28 14:26:19 +00:00
Hieu Hoang
16761ec966 use open nlp chunker 2014-02-28 13:59:37 +00:00
Hieu Hoang
859fea99ee 2 consecutive NT for mixed-syntax 2014-02-28 11:16:57 +00:00
Hieu Hoang
db23101e46 minor rename 2014-02-28 10:54:50 +00:00
Hieu Hoang
8e87099a52 inverse file 2014-02-28 08:00:47 +00:00
Hieu Hoang
64a72dc451 boolean args 2014-02-28 00:43:25 +00:00
Hieu Hoang
8437811ca3 target phrase 2014-02-28 00:36:03 +00:00
Hieu Hoang
fb3d17267a glue rules 2014-02-28 00:29:08 +00:00
Hieu Hoang
32288f8747 glue rules 2014-02-28 00:20:52 +00:00
Hieu Hoang
ab465fde72 glue rules 2014-02-27 23:38:50 +00:00
Hieu Hoang
ab2b37f38c mixed syntax type 2014-02-27 22:05:24 +00:00
Hieu Hoang
599608b301 mixed syntax type 2014-02-27 21:53:00 +00:00
Hieu Hoang
894a0da44a mixed syntax type 2014-02-27 21:45:38 +00:00
Hieu Hoang
6fa811d62e mixed syntax type 2014-02-27 21:43:15 +00:00
Hieu Hoang
303c9cfa36 mixed syntax type 2014-02-27 21:35:29 +00:00
Hieu Hoang
6ea84f2f13 little bugs 2014-02-27 21:03:16 +00:00
Hieu Hoang
43ba21acc4 remove debugging message 2014-02-27 19:54:17 +00:00
Hieu Hoang
98824c40de syntax 2014-02-27 19:51:35 +00:00
Hieu Hoang
2c5621e7a5 syntax 2014-02-27 19:50:59 +00:00
Hieu Hoang
6a78ac6bf6 syntax 2014-02-27 18:33:15 +00:00
Hieu Hoang
079a25dc39 syntax 2014-02-27 17:55:57 +00:00
Hieu Hoang
5f7ffee5e8 add [X] non-term elsewhere. Get ready for syntax labels 2014-02-27 15:38:33 +00:00
Hieu Hoang
ff3e7da7a3 add [X] non-term elsewhere. Get ready for syntax labels 2014-02-27 15:09:05 +00:00
Hieu Hoang
efee9f8f95 set set<ptr> rather than set<object> 2014-02-27 14:59:23 +00:00
Hieu Hoang
715af8bcad parse command line 2014-02-27 14:24:57 +00:00
Hieu Hoang
a515289a75 xml parsing for source syntax 2014-02-27 13:00:13 +00:00
Hieu Hoang
ae1ab2d95e syntax 2014-02-26 23:48:54 +00:00
Hieu Hoang
58fbfa39db xml parsing for source syntax 2014-02-26 18:26:56 +00:00
Hieu Hoang
1e5cd16fbf xml parsing for source syntax 2014-02-26 18:09:27 +00:00
Hieu Hoang
a8bebb7659 inverse file 2014-02-26 14:41:23 +00:00
Hieu Hoang
2984573f28 fractional count 2014-02-26 14:18:36 +00:00
Hieu Hoang
15ed27fde8 remove debug messages 2014-02-26 13:51:42 +00:00
Hieu Hoang
c0d85d9c84 bug in rule comparison 2014-02-26 13:46:29 +00:00
Hieu Hoang
175f9bfb4e syntax 2014-02-26 13:22:09 +00:00
Hieu Hoang
2a2f519944 syntax 2014-02-26 12:47:09 +00:00
Hieu Hoang
b729a2891c bugs in rule validation 2014-02-26 12:38:41 +00:00