moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 06:22:14 +03:00
Code Issues Packages Projects Releases Wiki Activity
11,368 Commits 136 Branches 26 Tags 147 MiB
2387f3123c
Commit Graph

3235 Commits

Author SHA1 Message Date
Ulrich Germann
050b089ea0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/TranslationModel/SkeletonPT.cpp
 2013-09-25 22:33:27 +01:00
Ulrich Germann
4fffe80c0c Formatting. 2013-09-25 22:09:21 +01:00
Ulrich Germann
daaf71c76e Changed type of m_batch_size to uint32_t to avoid compiler signed/unsigned comparison warnings. 2013-09-25 22:08:50 +01:00
Ulrich Germann
e1882032eb Formatting. 2013-09-25 22:07:59 +01:00
Ulrich Germann
94d10734f9 Formatting. Commented out unused variables. 2013-09-25 22:07:31 +01:00
Ulrich Germann
5b18448277 Fixed errors introduced during a merge. 2013-09-25 22:06:40 +01:00
Ulrich Germann
d02b265504 Added dependency on boost::iostreams. 2013-09-25 22:05:28 +01:00
Ulrich Germann
82a2639f22 Formatting. Fixed order in which members are initialized. 2013-09-25 22:05:01 +01:00
Ulrich Germann
b736fe2b61 Commented out unused variables. 2013-09-25 22:04:04 +01:00
Hieu Hoang
429a195c68 add type to ControlRecombination. type=2 disable recombination 2013-09-25 21:47:20 +01:00
Hieu Hoang
847f7c1ea2 skeleton PT 2013-09-25 20:59:13 +01:00
Hieu Hoang
56c1224c28 put some meat onto skeleton FFs 2013-09-25 20:19:05 +01:00
Hieu Hoang
1758381c98 skeleton PT 2013-09-25 19:24:50 +01:00
Hieu Hoang
deafd5922d skeleton PT 2013-09-25 16:57:01 +01:00
Ulrich Germann
82274ffda7 Merge branch 'dynamic-phrase-tables' 
Conflicts:
	moses/FF/ControlRecombination.cpp
	moses/Phrase.cpp
 2013-09-25 13:52:05 +01:00
Hieu Hoang
96df1f2659 lattices/confusion work with Hieu's binary pt, using new method 2013-09-25 13:03:09 +01:00
=
bfcefec239 cleanup 2013-09-25 00:54:57 +01:00
=
ad8d0fc135 cleanup 2013-09-25 00:54:32 +01:00
=
e3ba4a9890 Initial check-in. 2013-09-25 00:51:50 +01:00
=
db849ce2f5 Commented out unused variables. 2013-09-25 00:47:55 +01:00
=
7ce803ef1e Formatting. 2013-09-25 00:47:08 +01:00
=
13c9a44f3d Phrase::Contains(const Phrase& sought) throws exception, since it's not implemented yet. Added return value to make the compiler shut up. 2013-09-25 00:46:32 +01:00
=
62ad7cae6a Added emacs file type declaration 2013-09-25 00:43:53 +01:00
=
c80c5a1c35 Added new contributions to headers 2013-09-25 00:43:16 +01:00
=
bed0cb5a68 Fixed signed/unsigned integer comparison issue. 2013-09-25 00:18:18 +01:00
=
933e4e0a8e Call to EmptyHypothesisState(const InputType &input) now throws an exception, since implementation is missing. 2013-09-25 00:17:30 +01:00
=
e6fdcda02d Reformatting. Max 80 chars per line, pretty please. 2013-09-25 00:15:43 +01:00
=
8545b4d15e Added Mmsapt as a feature function. 2013-09-25 00:14:57 +01:00
=
7b9e30e4b9 Reformatting. 2013-09-25 00:13:49 +01:00
=
31ccd6c5b7 Code reformatting. Once upon a time there was a rule of courtesy not to make your lines of code longer than 80 characters. 2013-09-25 00:09:43 +01:00
=
794770e696 Moved duplicate struct CompareTargetPhrase to TargetPhraseCollection.{h|cpp} 2013-09-25 00:07:18 +01:00
=
61dacaa9bd Moved duplicate struct CompareTargetPhrase to TargetPhraseCollection.{h|cpp} 2013-09-25 00:05:45 +01:00
=
d0a5921fbb Fixed some code formatting. 2013-09-25 00:03:46 +01:00
=
30573ecf24 Added missing #include. 2013-09-25 00:00:06 +01:00
=
d100792140 Added Mmsapt as PT implementation type. 2013-09-24 23:59:29 +01:00
=
c227cde790 Fixed code formatting. 2013-09-24 23:57:49 +01:00
=
515ee545b1 Fixed code formatting. 2013-09-24 23:57:32 +01:00
=
ae550d05f4 Fixed some code formatting issues. 2013-09-24 23:56:47 +01:00
=
42f9f81495 Fixed some code formatting issues. 2013-09-24 23:56:23 +01:00
Hieu Hoang
fc4cabce98 skeleton PT 2013-09-24 22:50:43 +01:00
Hieu Hoang
cff36b6638 skeleton LM 2013-09-24 22:26:51 +01:00
Hieu Hoang
0237c8e3fe check to make sure there is an InputFeature when decoding lattice or confusion network 2013-09-23 22:20:58 +01:00
braunefe
f23c1d7769 Added All Translation Options for DIMw 2013-09-23 16:30:28 +02:00
Hieu Hoang
e6f53d83c2 get rid of some warnings 2013-09-22 18:24:32 +02:00
Hieu Hoang
3d8ac40e09 placeholder for chart decoding in nbest list 2013-09-22 17:10:23 +02:00
Hieu Hoang
476c6ea423 placeholder for chart decoding 2013-09-22 16:35:24 +02:00
Hieu Hoang
5f8e8f7db9 placeholder for chart decoding 2013-09-22 16:15:00 +02:00
Hieu Hoang
00b21b4f53 placeholder for chart decoding 2013-09-22 15:36:50 +02:00
Hieu Hoang
574d716f23 placeholder for chart decoding 2013-09-22 15:09:49 +02:00
Hieu Hoang
ffbfcb5577 placeholders work in pb decoder. God i'm bored 2013-09-19 16:33:21 +02:00
Hieu Hoang
996740de73 -mark-unknown works for chart decoding 2013-09-19 08:45:33 +02:00
Hieu Hoang
345b9bf850 oops. Segfault 2013-09-19 00:38:40 +02:00
Hieu Hoang
ff196639de comment 2013-09-18 17:27:18 +02:00
Hieu Hoang
89fe7d3db2 feature functions to only allow recombination for the same output 2013-09-18 16:27:10 +02:00
Hieu Hoang
692dc1c05f allow no best hypo 2013-09-18 15:57:59 +02:00
Hieu Hoang
24f1760c05 add max-unknowns arg to ConstrainedDecoding FF 2013-09-18 15:47:49 +02:00
Hieu Hoang
5625d30a26 add target phrase to arguments for Evaluate() during application to sentence 2013-09-18 12:35:31 +02:00
Hieu Hoang
a4f5879fef take out -constraint from Parameter. Now handled exclusively in FF 2013-09-18 06:23:22 +02:00
Hieu Hoang
68974c9f20 check there are hypos in stack vector before create translation options. constrained decoding works for syntax model 2013-09-18 04:56:57 +02:00
Hieu Hoang
7873dbb77a check there are hypos in stack vector before create translation options. constrained decoding works for syntax model 2013-09-18 04:45:19 +02:00
Hieu Hoang
f88908f972 add option to store rule source in target phrase 2013-09-17 18:29:06 +02:00
Hieu Hoang
3271d86c25 add option to store rule source in target phrase 2013-09-17 18:22:00 +02:00
Hieu Hoang
6c739bcbf5 constrained decoding FF works for both pb and hiero 2013-09-17 15:26:25 +02:00
Hieu Hoang
5ebb81a17a constrained decoding FF works for both pb and hiero 2013-09-17 15:06:17 +02:00
Hieu Hoang
764684bb6f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-09-17 09:56:38 +02:00
Hieu Hoang
2e5246844f comment out deletion of hypos with -inf scores. Apparently, all stacks must have hypos, otherwise terrible things happens. This is weird, empty stacks is perfectly reasonable. Need to ask Phil about this 2013-09-17 06:07:42 +02:00
Hieu Hoang
8fe087a92d comment out deletion of hypos with -inf scores. Apparently, all stacks must have hypos, otherwise terrible things happens. This is weird, empty stacks is perfectly reasonable. Need to ask Phil about this 2013-09-17 03:43:04 +02:00
Hieu Hoang
21319acb88 implement ConstrainedDecoding FF 2013-09-17 03:13:32 +02:00
Hieu Hoang
8b2bed458c implement ConstrainedDecoding FF 2013-09-17 02:40:25 +02:00
Hieu Hoang
ef2f6167e7 implement ConstrainedDecoding FF 2013-09-16 20:45:43 +02:00
Hieu Hoang
3b13068ce4 oops. forgot to check in new FF 2013-09-16 11:00:11 +01:00
Hieu Hoang
0d94d7067e update convert-moses-ini-to-v2.perl with memory pt for SCFFG decoding. Start on constrained ff 2013-09-16 07:46:45 +02:00
Barry Haddow
1a8a8fbb2d Re-enable unit tests. They all pass. 2013-09-14 17:15:41 +01:00
maria nadejde
5f37a545b1 fixed sparse feature output 2013-09-14 10:44:35 +02:00
maria nadejde
bf5c32df6c stuff that probably doesn't work 2013-09-13 19:43:04 +02:00
maria nadejde
92d0932c27 Stateless Feature InternalStructStatelessFF 2013-09-13 18:23:24 +02:00
maria nadejde
7077a04c3b Stateless Feature InternalStructStatelessFF 2013-09-13 18:21:23 +02:00
maria nadejde
3c441bdaa3 Merge branch 'GHKMStruct' of github.com:moses-smt/mosesdecoder into GHKMStruct 2013-09-13 18:18:52 +02:00
maria nadejde
48fa62838c Merge branch 'master' into GHKMStruct 2013-09-13 17:30:50 +02:00
Matthias Huck
c39bed60c0 Tree fragments in GHKM glue rules; 
output of LHS tag in tree fragments for UNKs;
GHKMParse info is now denoted as Tree info
 2013-09-13 17:10:21 +02:00
Hieu Hoang
3b03d803d9 make sure Evaluate(inputPath) is called for chart translation options 2013-09-13 09:27:48 +02:00
Hieu Hoang
9950279bc7 add pointer to input path to chart translation option 2013-09-12 19:50:09 +02:00
Matthias Huck
225f33e325 tiny changes to GHKMParse info in search 2013-09-12 17:37:54 +02:00
Phil Williams
f3320c1ca0 Add -Tghkm parameter 
Writes internal tree structure (if available) for 1-best derivation.
Code contributed by Nina Seemann.
 2013-09-12 11:31:12 +02:00
Hieu Hoang
b534e8c4b7 f*cking link error 2013-09-12 09:17:18 +01:00
Hieu Hoang
c36d8d048f ExternalFeature /cdec & phil blumson 2013-09-12 09:48:17 +02:00
Hieu Hoang
f379e5cb8a lattice decoding with sparse features 2013-09-10 15:36:21 +02:00
Hieu Hoang
16cfc786a8 lattice decoding with sparse features 2013-09-08 19:22:55 +02:00
Hieu Hoang
42fc86b259 lattice decoding with sparse features 2013-09-08 17:02:59 +02:00
Hieu Hoang
7214be82d4 lattice decoding with sparse features 2013-09-08 16:43:18 +02:00
Hieu Hoang
1adf7d0521 lattice decoding with sparse features 2013-09-08 15:57:31 +02:00
Hieu Hoang
65e2806b1d move lattice scoring into InputFeature class 2013-09-08 13:47:32 +02:00
Kenneth Heafield
b27d140619 Unfortunately UTrieNode wants a non-explicit copy constructor 2013-09-07 09:51:09 +01:00
Lane Schwartz
7e1cfc981f Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-09-06 14:01:32 -04:00
Lane Schwartz
226031ecf6 Checking in examples of CMake files. 
The example in contrib works, as does the one in biconcor.

The examples in lm and moses don't work at the moment,
but checking them in anyway as a starting point
for any potential work on them next week during the
MT Marathon.
 2013-09-06 13:39:46 -04:00
Ulrich Germann
384650fb60 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-09-06 17:05:39 +01:00
Ulrich Germann
64cfd3ec16 Minor cosmetic changes. 2013-09-06 17:04:46 +01:00
Ulrich Germann
8154654e7c Added using namespace std; 2013-09-06 17:02:32 +01:00
Hieu Hoang
8ae1614be4 no change commit. Force rerun of cruise control 2013-09-06 08:53:17 +02:00
Hieu Hoang
fbb2f9abb0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-09-05 23:34:39 +02:00
Hieu Hoang
12c4a0a68e lattice decoding with sparse features 2013-09-05 23:34:22 +02:00
Hieu Hoang
6f81004e20 lattice decoding with sparse features 2013-09-05 22:26:19 +02:00
Hieu Hoang
8803bcdba6 lattice decoding with sparse features 2013-09-05 22:25:32 +02:00
Hieu Hoang
56c4a41231 lattice decoding with sparse features 2013-09-05 22:22:53 +02:00
Hieu Hoang
cec177b493 no change commit. Force rerun of cruise control 2013-09-05 18:31:45 +01:00
Hieu Hoang
9894941294 properties is on 7th column, not 6th 2013-09-03 15:02:53 +02:00
Hieu Hoang
01b7f8a1e8 add skeleton feature functions 2013-09-01 16:58:23 +01:00
Hieu Hoang
af6b1f2b4e start on forced decoding for SCFG 2013-08-31 01:37:15 +01:00
Hieu Hoang
769f2fe00c start on forced decoding for SCFG 2013-08-30 17:45:56 +01:00
Hieu Hoang
fe36cbf737 move LexicalReordering to FF directory 2013-08-30 16:28:28 +01:00
Hieu Hoang
04783309ba move DecodeFeature to FF directory 2013-08-30 16:03:06 +01:00
Hieu Hoang
03fd06b38b convert Evaluate() methods into abstract, rather than empty functions. Every FF must implement them all 2013-08-30 15:49:00 +01:00
Lane Schwartz
c0fe9bb4ea Updating XCode project 2013-08-29 12:56:25 -04:00
Hieu Hoang
f5fc57008f save properties in target phrase object 2013-08-29 13:36:01 +01:00
Lane Schwartz
7675825eb7 Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-08-28 13:27:12 -04:00
Lane Schwartz
8a726a9de4 Changes to allow SRILM on Mac OS X. 
By default, SRILM defines a function called zopen.

However, on Mac OS X (and possibly other BSDs),
<stdio.h> already defines a zopen function.

To resolve this conflict, SRILM checks to see if HAVE_ZOPEN is defined.
If it is, SRILM will rename its zopen function as my_zopen.

So, before importing any SRILM headers,
it is important to define HAVE_ZOPEN if we are on an Apple OS.
 2013-08-28 12:39:47 -04:00
Hieu Hoang
d79d97c0e6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-28 11:06:44 +01:00
Hieu Hoang
1848946cb3 beautify 2013-08-28 11:06:27 +01:00
Hieu Hoang
89f88fdb6b refactor parsing of args for language models 2013-08-28 11:05:47 +01:00
Lane Schwartz
08225d8e57 Re-enable backward LM code. 
This commit updates that code to take into account Hieu's major refactoring.

Additionally, this commit re-instates changes from
commit 8459a86 (moses/LM/Jamfile, moses/LM/Ken.h, moses/LM/Ken.cpp),
commit d340218 (moses/LM/Ken.h),
commit 95e3a37 (moses/LM/Ken.h, moses/LM/Ken.cpp), and
commit aacc936 (moses/LM/Jamfile, moses/LM/Ken.cpp)

The above changes appear to have been improperly discarded
during the merge in commit 4894df6 and then again in commit 3ed17bb.
 2013-08-27 15:55:07 -04:00
Hieu Hoang
de888f2ab4 store arbitary key-value in translation rules 2013-08-27 09:42:24 +01:00
Kenneth Heafield
1a9a964b68 presize vector 2013-08-26 23:37:37 +01:00
Ulrich Germann
a58efc8ddf Initial check-in. 2013-08-26 16:56:49 +01:00
Nadir Durrani
1444837ff9 Factored-based OSM 2013-08-25 13:23:42 +01:00
Hieu Hoang
f544d3aced mark with LEGACY 2013-08-23 21:34:10 +01:00
Hieu Hoang
83df3629a9 mark GetTargetPhraseCollectionNonCache with LEGACY 2013-08-23 21:08:53 +01:00
Hieu Hoang
de9decc30d mark GetTargetPhraseCollection with LEGACY 2013-08-23 21:02:03 +01:00
Hieu Hoang
5625f37eb1 delete ChartBasedFeatureContext 2013-08-23 15:00:47 +01:00
Hieu Hoang
3ad3cd9004 delete ChartBasedFeatureContext 2013-08-23 14:39:42 +01:00
Hieu Hoang
1d653c87aa delete PhraseBasedFeatureContext 2013-08-23 14:25:25 +01:00
Hieu Hoang
4dfb625536 beautify 2013-08-23 13:53:30 +01:00
Hieu Hoang
0613d98beb delete PhraseBasedFeatureContext 2013-08-23 13:38:31 +01:00
Kenneth Heafield
9186ae2d82 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 10:21:37 +01:00
Kenneth Heafield
c4dc57f8a3 swap 2013-08-22 10:16:24 +01:00
Hieu Hoang
5accd5f2e5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 09:24:58 +01:00
Hieu Hoang
21c91dede2 delete GetWordPenaltyProducer(). Need non-const version only for mira 2013-08-22 09:24:46 +01:00
Hieu Hoang
fcf426a098 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 15:58:17 +01:00
Hieu Hoang
9e60195995 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5 caching error for compact pt 2013-08-20 16:06:48 +01:00
Hieu Hoang
51ac2d6567 Merge branch 'hieu_opt_input' of ../hh 2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38 prevent segfault in OSM model when used in factored model with decomposed phrase-tables 2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417 caching for Marcin's phrase table 2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca Merge ../mosesdecoder into hieu_opt_input 2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243 delete duplicate parameter 2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c Merge pull request #43 from jgwinnup/master 
Added option to output unknown words with prefix 'UNK'
 2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59 beautify 2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2 minor renaming 2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07 move caching code to PhraseDictionary. Available to all phrase tables 2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5 add phrase table caching 2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af Added option to output unknown words with prefix 'UNK' 2013-08-15 11:30:08 -04:00
phikoehn
c002a81c96 fixed logic errors 2013-08-15 13:36:56 +01:00
phikoehn
b368085609 xml constraint 2013-08-15 11:46:45 +01:00
Hieu Hoang
abfe02f154 refactor input score handling to use Evaluate(inputtype, inputpath). Not a placeholder factor anymore 2013-08-14 16:53:06 +01:00
Hieu Hoang
2b030339e0 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-14 12:38:26 +01:00
Hieu Hoang
8419a3af35 beautify 2013-08-14 12:37:22 +01:00
Hieu Hoang
bfdedf682b convert weight-p to PhrasePenalty. /Nicola Bertoldi 2013-08-14 12:36:40 +01:00
Hieu Hoang
896b751066 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-08-13 21:33:31 +01:00
Hieu Hoang
073b60db35 implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:47:03 +01:00
Hieu Hoang
efc765ddff implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36 use input path for unknown word processing in phrase-based 2013-08-13 20:01:13 +01:00
Hieu Hoang
563cdc527a use input path for unknown word processing in phrase-based 2013-08-13 19:44:52 +01:00
Hieu Hoang
dcf170a047 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:41:35 +01:00
Hieu Hoang
3775e37ee5 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:39:37 +01:00
Hieu Hoang
aa7eabf850 add parameter argument -feature-add for mira BLEU score feature 2013-08-13 15:34:03 +01:00
Hieu Hoang
0d60b7f2dd implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 12:16:55 +01:00
Hieu Hoang
f676100328 implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 12:12:58 +01:00
Hieu Hoang
af74ee1968 delete duplicate m_inputPathMatrix in TranslationOptionList 2013-08-13 11:44:58 +01:00
Hieu Hoang
4676bca90f minor renaming 2013-08-13 10:33:04 +01:00
Hieu Hoang
154ca336d6 separate out ChartTranslationOption into its own files 2013-08-12 19:01:06 +01:00
Hieu Hoang
9c2c862719 don't hold shared_ptr in RuleCubeItem. Hold only reference to it. Save some speed 2013-08-12 17:35:22 +01:00
Hieu Hoang
c07d8cb43f beautify 2013-08-12 10:35:03 +01:00
Hieu Hoang
2a240b59b2 delete debug messages 2013-08-12 10:34:38 +01:00
Hieu Hoang
46fce4029c create ChartTranslationOption class that store pointer to target phrase. Don't store target phrase itself. QUicker, but still not as quick as storing pointer to target phrase in hypo 2013-08-12 10:34:45 +01:00
Hieu Hoang
8756ad8ffd beautify 2013-08-09 18:17:18 +01:00
Hieu Hoang
a867063a3b convert to using shared pointers in ChartTranslationOptions 2013-08-09 18:16:31 +01:00
Hieu Hoang
4db9aa2973 convert to using shared pointers in ChartTranslationOptions 2013-08-09 15:20:45 +01:00
Hieu Hoang
f4d534ffd7 add InputPath objects of chart decoding. Start on lattice input for chart decoding 2013-08-09 10:27:46 +01:00
Hieu Hoang
59e7a179ca add InputPath objects of chart decoding. Start on lattice input for chart decoding 2013-08-08 21:29:22 +01:00
Hieu Hoang
15132a04aa comment 2013-08-08 17:58:38 +01:00
Hieu Hoang
9341f28d75 Evaluate(InputType) --> Evaluate(InputType, Phrase source) 2013-08-08 17:35:42 +01:00
Hieu Hoang
b044f31012 consistently set source phrase in translation options as soon as the trans opt is created 2013-08-08 17:10:56 +01:00
Hieu Hoang
4b28daeed2 consistently set source phrase in translation options as soon as the trans opt is created 2013-08-08 15:58:01 +01:00
Hieu Hoang
a60bbbf892 consistently set source phrase in translation options as soon as the trans opt is created 2013-08-08 15:03:01 +01:00
Hieu Hoang
88f888f534 const TargetPhrase in TargetPhraseCollection 2013-08-08 14:38:41 +01:00
Hieu Hoang
9062194f46 comments 2013-08-08 12:26:25 +01:00
Hieu Hoang
f70084178c Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-08-07 15:53:42 +01:00
phikoehn
e50fc722e9 bug fix alternative weight setting 2013-08-07 15:35:40 +01:00
Hieu Hoang
6f7d239f13 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-08-07 15:19:22 +01:00
Hieu Hoang
585ec0f7fe DONE: delete source phrase from TargetPhrase class 2013-08-07 15:18:45 +01:00
Hieu Hoang
0ab6a441b2 get ready to delete source phrase from TargetPhrase class 2013-08-07 15:02:36 +01:00
Hieu Hoang
b3a860fd4f get ready to delete source phrase from TargetPhrase class 2013-08-07 14:35:40 +01:00
Hieu Hoang
441acf15e6 beautify 2013-08-07 14:18:12 +01:00
Hieu Hoang
5eef91c0ea get ready to delete source phrase from TargetPhrase class 2013-08-07 14:10:42 +01:00
Hieu Hoang
71073868a8 PhraseDictionaryTreeAdaptor::GetTargetPhraseCollectionLegacy return tpColl and vector of source phrases 2013-08-07 12:55:10 +01:00
Hieu Hoang
5deefbddaf renaming a function 2013-08-07 12:34:31 +01:00
Hieu Hoang
24c4c8f210 mark a function as legacy 2013-08-07 12:11:39 +01:00
Hieu Hoang
89f39bf89d mark a function as legacy 2013-08-07 11:48:18 +01:00
Hieu Hoang
a1f5167f85 get ready to delete source phrase from TargetPhrase class 2013-08-07 11:37:40 +01:00
Hieu Hoang
66d4c2b0be source phrase is a pointer in translation options. 2013-08-07 10:28:28 +01:00
phikoehn
67c3063574 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2013-08-07 05:32:59 +01:00
phikoehn
ab4e3c63a6 enriched trace 2013-08-07 05:31:45 +01:00
Hieu Hoang
7a808a2edb push InpuutPath down into phrase dictionary for legacy methods 2013-08-06 17:09:53 +01:00
Hieu Hoang
646cf93c1f push InpuutPath down into phrase dictionary for legacy methods 2013-08-06 15:07:03 +01:00
Hieu Hoang
1753fdf6b1 push InpuutPath down into phrase dictionary for legacy methods 2013-08-06 15:04:57 +01:00
Hieu Hoang
5ec67ea71b mark a function as legacy 2013-08-06 14:43:02 +01:00
Hieu Hoang
d3f1f7e0d6 in the binary phrase table, save the source phrase used when doing lookups. 2013-08-06 13:45:03 +01:00
Hieu Hoang
24e6d6c272 all hypotheses have translation option. All translation options have target phrase 2013-08-05 16:53:15 +01:00
Hieu Hoang
a83c166678 delete Hypothesis::GetSourcePhrase(). Take it directly from TranslationOption::GetSourcePhrase() 2013-08-05 13:46:54 +01:00
Hieu Hoang
6872689bc2 TranslationOption::GetSourcePhrase() return a reference, not a pointer. It must always have the reference 2013-08-05 12:38:17 +01:00
Hieu Hoang
dbc545089b Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-05 12:16:09 +01:00
Hieu Hoang
302eec8283 beautify 2013-08-05 12:11:59 +01:00
Hieu Hoang
d395737639 minor cleanup 2013-08-02 18:24:36 +01:00
Hieu Hoang
ae2e2c6d83 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-02 18:15:09 +01:00
Hieu Hoang
afcf65098f parsing doesn't depend on input sentence anymore 2013-08-02 18:09:47 +01:00
Kenneth Heafield
78cdf82de8 Log10/loge weight change for incremental. TODO: debug n-best list generation 2013-08-02 17:56:41 +01:00
Hieu Hoang
0596c3e9e4 Add NonTerminalSet variable to InputPath 2013-08-02 15:54:49 +01:00
Hieu Hoang
f13bcf74cf begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 16:27:08 +01:00
Hieu Hoang
bb1f49e10c Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-31 14:29:18 +01:00
Rico Sennrich
b32366ab8c fix future and total cost in multimodel(counts). (was broken since merge of branch weight-new in May) 2013-07-31 14:18:18 +02:00
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Rico Sennrich
29cde2a204 allow overriding table filtering in config (required for multimodelcounts) 2013-07-30 16:46:23 +02:00
Hieu Hoang
231c32fae9 create queue of InputPath objects. Starting SCFG parsing with lattices and conf net 2013-07-30 15:28:20 +01:00
Hieu Hoang
77872f7521 beautify 2013-07-30 15:04:37 +01:00
Hieu Hoang
1d40a604df create queue of InputPath objects. Starting SCFG parsing with lattices and conf net 2013-07-30 15:03:47 +01:00
Rico Sennrich
7b6239b663 multimodelcounts: use Word objects instead of strings in map (avoid costly conversion and string comparison) 2013-07-30 15:03:25 +02:00
Rico Sennrich
ccdcecc86f multimodel and mosesserver: instead of optimizing first model, select model by name. 2013-07-30 13:54:50 +02:00
Hieu Hoang
c449610aaf Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-28 22:52:21 +01:00
Ulrich Germann
cb1c06d502 Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	moses/Jamfile
 2013-07-28 16:51:13 +01:00
Ulrich Germann
56bb485dd5 Fixed missing #include. 2013-07-28 16:39:13 +01:00
Ulrich Germann
b3ed0d56d7 Fixed missing #include. 2013-07-28 16:38:33 +01:00
Ulrich Germann
a47b6cfafa Added call to tp->Evaluate(src) before adding a phrase table entry to the TargetPhraseCollection during lookup. 2013-07-28 16:37:20 +01:00
Ulrich Germann
1b1771dcc9 Items under 'generic' now included in libmoses' 2013-07-28 16:30:41 +01:00
Ulrich Germann
a0c13837e0 Fixed computation of lexical scores. 2013-07-28 16:28:41 +01:00
Hieu Hoang
0b23a0e327 rollback excluding translation options that have incompatible alignments for placeholders. This should be exclude at the training step 2013-07-26 19:39:10 +01:00
Hieu Hoang
2aef439d8a Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:26:38 +01:00
Hieu Hoang
76a9730ca8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:23:12 +01:00
Barry Haddow
7081f06413 Fixes to the shared build 2013-07-25 15:24:34 +01:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
07693a3f96 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 08:42:24 +01:00
Hieu Hoang
c0aba71c79 bug processing unknown word with digits 2013-07-25 08:41:59 +01:00
Hieu Hoang
6ac4d4ddad Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-24 19:04:54 +01:00
Hieu Hoang
8ffd53e321 create target phrases, not Translation Options, for XML. Can be used in both pb and scfg 2013-07-24 18:06:46 +01:00
Hieu Hoang
d5d4051d8b create target phrases, not Translation Options, for XML. Can be used in both pb and scfg 2013-07-24 15:55:17 +01:00
Kenneth Heafield
71ae8c9d19 LM/Factory.cpp -> FF/Factory.cpp oops 2013-07-24 12:13:11 +01:00