Commit Graph

1526 Commits

Author SHA1 Message Date
Nadir Durrani
e07b3afa12 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-09-24 13:04:28 +01:00
Nadir Durrani
74cd9c7a99 Removing Binaries 2013-09-24 13:03:20 +01:00
Hieu Hoang
e6d652aea5 delete generateSequences 2013-09-23 20:46:01 +02:00
Hieu Hoang
55874b34fb Merge github.com:moses-smt/mosesdecoder 2013-09-22 23:48:39 +02:00
Nadir Durrani
a7ca3df049 Generate Sequence File Changes 2013-09-22 15:55:39 +01:00
Nadir Durrani
7b745d3ee3 Training Script 2013-09-22 15:47:54 +01:00
Hieu Hoang
574d716f23 placeholder for chart decoding 2013-09-22 15:09:49 +02:00
Rico Sennrich
1113f83f98 documentation/permissions 2013-09-18 15:13:56 +02:00
Hieu Hoang
0d94d7067e update convert-moses-ini-to-v2.perl with memory pt for SCFFG decoding. Start on constrained ff 2013-09-16 07:46:45 +02:00
Barry Haddow
ef43d6e038 Need phrase penalty weight 2013-09-11 10:59:48 +01:00
Barry Haddow
03997dfc3a Change number of weights in example 2013-09-11 10:41:17 +01:00
phikoehn
9f40416ee4 changed default for hierarchical phrase table binarization 2013-09-08 18:30:48 +01:00
Rico Sennrich
7138056b8f flexibility scores 2013-09-07 23:04:01 +02:00
Barry Haddow
867c6efe6c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-09-06 13:29:29 +01:00
Barry Haddow
7425036c3a scoring correction 2013-09-06 13:29:20 +01:00
Hieu Hoang
d79d97c0e6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-28 11:06:44 +01:00
Hieu Hoang
1848946cb3 beautify 2013-08-28 11:06:27 +01:00
Nadir Durrani
4156c7acb6 Config files 2013-08-27 13:47:09 +01:00
Nadir Durrani
40f4267373 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-08-27 13:22:39 +01:00
Nadir Durrani
cde350a009 Code to generate Operation Sequences 2013-08-27 13:22:01 +01:00
Kenneth Heafield
02c9d448ea Script shouldn't trudge forward on error 2013-08-26 21:40:54 +01:00
Nadir Durrani
696c0eff61 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-08-26 13:22:57 +01:00
nadir
fb35e1f3c9 Training Scripts for Factored OSM 2013-08-26 13:21:04 +01:00
phikoehn
79a2c98ff7 better ems support for different binarizers and reordering models 2013-08-25 20:30:37 +01:00
Jeremy Gwinnup
a5fb4d1550 Fixed bug in tokenizer.perl where comma separated lists of single
characters aren't handled correctly

input> A,B,C,D,E,F

yielded> A, B,C , D,E , F

now yields> A, B, C, D, E, F

Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
phikoehn
b368085609 xml constraint 2013-08-15 11:46:45 +01:00
Hieu Hoang
249aefc0c3 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-08-12 13:04:29 +01:00
Hieu Hoang
02c7af3fb8 Mira changes. Manually applied Eva's patch 2013-08-12 13:03:26 +01:00
Hieu Hoang
ac50d9f349 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-01 16:55:46 +01:00
Hieu Hoang
f234aa203f number recognizer treats each word as atomic, replace all of the word or nothing at all. Recognizer is designed to be run after the text has been tokenized, not before 2013-08-01 16:55:11 +01:00
Hieu Hoang
bb1f49e10c Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-31 14:29:18 +01:00
Rico Sennrich
d0e2c43011 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-30 17:18:32 +02:00
Rico Sennrich
29cde2a204 allow overriding table filtering in config (required for multimodelcounts) 2013-07-30 16:46:23 +02:00
Hieu Hoang
2792291849 change default for PhrasePenalty to match what is was before 2013-07-30 15:44:30 +01:00
Hieu Hoang
b05a443f36 correct arguments to substitute-filtered-tables-and-weights.perl 2013-07-30 11:14:17 +01:00
Hieu Hoang
66349474d4 correct arguments to substitute-filtered-tables-and-weights.perl 2013-07-30 11:12:49 +01:00
Hieu Hoang
52ff87a6ce phrase penalty now has it's own ff. No longer in the phrase table 2013-07-29 17:51:20 +01:00
Hieu Hoang
9cdcf713a6 phrase penalty now has it's own ff. No longer in the phrase table 2013-07-29 12:55:44 +01:00
Hieu Hoang
2980dde163 add script to strip xml 2013-07-29 11:44:00 +01:00
Hieu Hoang
4bc7ce99ed add script to strip xml 2013-07-29 11:27:13 +01:00
Hieu Hoang
ff4c4339bd if using CreateOnDiskPt to binarize pt, use processLexicalTable to binarize reordering table. HACK 2013-07-28 12:00:35 +01:00
Hieu Hoang
abe90b5af7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-27 04:19:16 +01:00
Hieu Hoang
9dab7950fa move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 04:18:50 +01:00
Hieu Hoang
4ea975e108 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:58:27 +01:00
Hieu Hoang
90651a9b22 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:57:05 +01:00
Hieu Hoang
6be88d3f44 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:12:15 +01:00
Hieu Hoang
efd9789577 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:06:07 +01:00
Hieu Hoang
a3e3289b08 In corpus mode, replace number with number symbol 2013-07-25 15:54:47 +01:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
78381d0213 @NUM@ --> @num@. In case using recaser 2013-07-25 15:16:15 +01:00