moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 15:48:05 +03:00
Code Issues Packages Projects Releases Wiki Activity
2,094 Commits 136 Branches 26 Tags 147 MiB
6480940719
Commit Graph

2094 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
bhaddow
6480940719 set unit test flag 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3639 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-22 14:12:10 +00:00
bhaddow
9b438d9849 correction to error message 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3635 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-21 13:23:53 +00:00
bhaddow
a12386918b correction to score producer description 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3629 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-19 09:47:36 +00:00
bhaddow
0ab6122c8e correct short arg for weight-file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3628 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-19 09:32:04 +00:00
bhaddow
0f09365a99 Enable usage of target bigram feature in decoding. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3626 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-15 15:19:17 +00:00
bhaddow
4126c19f91 Implementation and testing of target bigram feature 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3624 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-14 21:52:35 +00:00
bhaddow
ec902882e0 Unit testing 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3615 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-12 13:00:36 +00:00
bhaddow
58f32a0088 Fixed so that multiple phrase tables works. Passes regression! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3614 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-11 14:09:39 +00:00
bhaddow
ec11eb7c59 Fix arithmetic error in scc, rounding error in tests. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3611 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-08 14:28:20 +00:00
bhaddow
7e72ceea22 Goodbye ScoreIndexManager. 
Compiles ok, but haven't dared to run regression yet.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-06 22:06:49 +00:00
bhaddow
82dba81917 Merged out from trunk to revision 3604 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3605 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-05 16:02:25 +00:00
bhaddow
927d32a576 Updating the truth 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3604 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-05 15:16:09 +00:00
hieuhoang1972
60db2a2971 Time logging info 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3601 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 18:08:10 +00:00
pjwilliams
be8dbd20e9 Remove unused Phrase::m_arity member variable. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3600 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 10:37:10 +00:00
hieuhoang1972
e504b797b2 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3599 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-01 00:21:27 +00:00
pjwilliams
2761762434 If Boost is available, use boost::unordered_map instead of std::map for 
storing child nodes in PhraseDictionaryNodeSCFG.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3598 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:28:30 +00:00
pjwilliams
687ddf2d10 Bump the minimum Boost version to 1.36 to get functional/hash. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3597 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:27:20 +00:00
pjwilliams
dd39c734e8 If Boost is available, use boost::unordered_set instead of std::set to store 
MosesChart::Cube's set of unique QueueEntry object values.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3596 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:10:25 +00:00
pjwilliams
79a61c5526 Add --enable-boost option to ./configure to allow the Boost library to be used 
in Moses (if not already required by --enable-threads).  This is off by default.
The --with-boost option can only be used if --enable-boost or --enable-threads
is given, since the AX_BOOST_BASE macro is only conditionally called.  This is
to avoid making Boost a requirement by default, but is a bit clunky.  Probably
easy to fix if your Autotools knowledge exceeds nowt...



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3595 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:07:01 +00:00
suzyh
d071296cde Fix to reuse-weights.perl to copy weights containing an exponent 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3590 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-29 04:04:12 +00:00
heafield
193109e200 Link kenlm by default (it was already being built). Allow --without-kenlm to avoid linking. Add myself to the build instructions. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3588 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 18:02:08 +00:00
heafield
770df2a92d Unbodge kenlm by moving compilation to kenlm/ instead of kenlm/lm. Changing the headers every 
time I copied to Moses was getting annoying.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3587 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 16:26:55 +00:00
bhaddow
ae53ffe5b6 get rid of some annoying debug 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3586 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 15:36:35 +00:00
heafield
d99066e4e9 Hieu wanted GetLmID 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3585 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 15:21:50 +00:00
bhaddow
a4b4ba15d7 Enable parallelisation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3584 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 15:13:50 +00:00
hieuhoang1972
8fa18b50a7 xcode. And don't invoke internal LM when sri is specified, even if sri isn't compiled 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3583 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 11:02:58 +00:00
heafield
c2b49c9d97 Now returning the same probabilities as SRI. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3582 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 00:22:33 +00:00
heafield
331283f040 LanguageModelKen now without segfaults. The load function was missing some undocumented initialization. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3581 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 21:52:15 +00:00
pjwilliams
34767c4d0a Oops, don't prune rule table if ttable-limit=0. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3580 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 20:49:42 +00:00
heafield
73565501f8 Make ltmain.sh executable so svn doesn't whine when the status is changed under its feet. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3579 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 20:41:39 +00:00
heafield
d1a7c636ac Jon Clark complained that IRSTLM puts 0.0 backoff for n-grams of longest order and that I throw 
an error.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3578 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 18:38:21 +00:00
hieuhoang1972
1ea4970325 svn properties 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3577 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 18:16:10 +00:00
hieuhoang1972
1c342ffefd Deal with updated file format. Thanks to Christof Pintaske 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3576 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 18:03:22 +00:00
heafield
5b74b38527 Remove vestigial dub parameter. Surrender to tab-based whitespace. More passive-aggressive message about nGramOrder. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3575 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 16:01:58 +00:00
heafield
cac7600662 Make --with-kenlm=$PWD/kenlm compile mine instead of IRST. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3574 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 15:07:28 +00:00
hieuhoang1972
375ed9b7fe ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3573 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 10:46:39 +00:00
heafield
e6184ae947 Updates to kenlm: 
Kludged and slow interface requested by Hieu because apparently Moses can't store language model state.  
Separate files for ARPA reading, vocabulary, and weights.  
Remove build shell scripts that won't work after Hieu changed the header file layout.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3572 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 03:46:44 +00:00
heafield
61f5472f1c Avoid some unused parameter complaints and force automake dependencies to fix parallel make. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3571 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 00:57:11 +00:00
hieuhoang1972
559a5e3ece ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3570 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 22:29:01 +00:00
hieuhoang1972
a82c2d5531 ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3569 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 17:02:53 +00:00
hieuhoang1972
f7ceddd0a9 ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3568 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 16:49:07 +00:00
pjwilliams
f5a096e2fa In ChartTranslationOptionList::Add(), always consider every target phrase as 
the TargetPhraseCollection won't be ordered.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3567 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 12:09:29 +00:00
pjwilliams
81372704de Enforce ttable-limit for memory-based rule table. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3566 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 11:38:09 +00:00
pjwilliams
ab62fe2ed3 QueueEntry::CreateChildEntry() should always succeed, so remove isOK check 
and add assertion to test for failure.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3565 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 10:41:57 +00:00
pjwilliams
d7a61c751f Don't bother popping QueueEntrys off the priority queue when destructing 
MosesChart::Cube.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3564 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-26 10:30:28 +00:00
hieuhoang1972
031617a8db delete unused function 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3563 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-25 20:30:19 +00:00
hieuhoang1972
ea04dc5209 vs.net 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3562 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-24 21:01:11 +00:00
hieuhoang1972
465d1cef0a make class name consistent for chart & pb decoders 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3561 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-23 17:39:32 +00:00
hieuhoang1972
4d34e5155e make class name consistent for chart & pb decoders 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3560 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-23 16:54:32 +00:00
hieuhoang1972
0b6a29327c make class name consistent for chart & pb decoders 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3559 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-23 16:32:44 +00:00