moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-06 08:18:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
6,174 Commits 136 Branches 26 Tags 147 MiB
42e10d010b
Commit Graph

250 Commits

Author SHA1 Message Date
pkoehn
42e10d010b added reporting of sparse features in n-best list 
git-svn-id: http://svn.statmt.org/repository/mira@3926 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
pkoehn
b919b862b8 added phrase length feature 
git-svn-id: http://svn.statmt.org/repository/mira@3925 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
bhaddow
08c3efdf88 phrase boundary feature 
git-svn-id: http://svn.statmt.org/repository/mira@3893 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
bhaddow
c8e7c5da05 initialisation of source phrase member variable in TargetPhrase 
git-svn-id: http://svn.statmt.org/repository/mira@3849 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
bhaddow
367ac683a3 Implementation of phrase pair feature 
git-svn-id: http://svn.statmt.org/repository/mira@3842 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
bhaddow
3348dcd03e Configurable factor id for target bigram 
git-svn-id: http://svn.statmt.org/repository/mira@3812 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
bhaddow
a2730c445d Merge up to 3791 from trunk. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-05 13:49:44 +00:00
evahasler
1de7aa4f81 enable batch optimisation, batch history updating, fix bug in Decoder.cpp (new: staticData.ReLoadBleuScoreFeatureParameter()) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3734 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-24 17:06:54 +00:00
chardmeier
837a667a95 Cleaned up language modelling code by disentangling the decoder's LM feature 
function from the LM toolkit abstraction layer. There are two different groups
of classes now:
- LanguageModel, which inherits from StatefulFeatureFunction and contains
  the n-gram model feature function.
- LanguageModelImplementation, which is the base class of the individual
  LM implementations (SRI, IRST, RandLM, KenLM) and provides methods to
  query LM probabilities and states.
Each LanguageModel controls a LanguageModelImplementation. Implementations can
be shared by more than one LanguageModel.
This should make it easier to use the LM libraries as a backend for other
feature functions while retaining the flexibility to use different LM toolkits.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3719 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-17 14:06:21 +00:00
bhaddow
9b438d9849 correction to error message 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3635 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-21 13:23:53 +00:00
bhaddow
0f09365a99 Enable usage of target bigram feature in decoding. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3626 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-15 15:19:17 +00:00
bhaddow
7e72ceea22 Goodbye ScoreIndexManager. 
Compiles ok, but haven't dared to run regression yet.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3608 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-06 22:06:49 +00:00
bhaddow
82dba81917 Merged out from trunk to revision 3604 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3605 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-05 16:02:25 +00:00
hieuhoang1972
03419ac02a it runs\!\! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3542 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 20:27:26 +00:00
ales-t
5ca82431e4 Return true if GetParam returns empty vector. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3524 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 14:43:38 +00:00
hieuhoang1972
19ab98040d return weights as score component collection 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3521 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 14:25:08 +00:00
ales-t
540d6dd6e7 Fixed some compilation errors. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3516 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 13:46:40 +00:00
ales-t
4e48b1d9fe Prepared the integration of target bigram features. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3515 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 13:36:03 +00:00
hieuhoang1972
0eddbe99e1 bleu weight changeable 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3513 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 13:21:51 +00:00
hieuhoang1972
6a8ee95ebb bleu weight changeable 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3508 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 12:37:30 +00:00
smaj
36b6aad53e Calling of InitFeatureNames moved. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3496 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-16 20:40:20 +00:00
bhaddow
907766d67a reduce compile time dependencies 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3488 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-16 15:45:56 +00:00
bhaddow
ba5ccb7bc5 debugging and fixes for BleuScoreFeature 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3479 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-16 12:49:57 +00:00
smaj
5204e29681 Fixed usage of []. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3470 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-15 16:30:52 +00:00
bhaddow
e7f307b9bf Fix init of bleu score feature. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3443 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 16:55:33 +00:00
bhaddow
a2ecc074a3 initialisation of bleu score feature 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3441 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 16:25:33 +00:00
hieuhoang1972
d87f0192dd mira 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3440 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 16:03:21 +00:00
hieuhoang1972
1d62aea63e mira 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3439 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 15:05:56 +00:00
hieuhoang1972
6b79f5ee6d mira 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3434 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 12:49:07 +00:00
hieuhoang1972
6bdcbe44f5 dynamic updating 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3432 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 10:13:06 +00:00
hieuhoang1972
ff7ce559b7 dynamic updating 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3431 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-14 09:42:37 +00:00
bhaddow
d3680b4255 Make sure distortion feature are adjacent 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3418 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-07 10:54:04 +00:00
bhaddow
904133fcb7 Merge in the multiple models branch. These changes allow the moses server 
to support multiple translation, language and generation models within the
same process. The main design change is the introduction of a TranslationSystem
object to manage the models, which have been moved out of StaticData.
The changes should have no effect on existing systems.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3394 1f5c12ca-751b-0410-a591-d2e778427230
 2010-08-10 13:12:00 +00:00
chardmeier
6f8d9fa0fb Added limited backwards compatibility with old ini file format for phrase table specs. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3253 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-13 14:12:05 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-08 15:51:59 +00:00
pjwilliams
01f4ca892a Remove the lmstats parameter since it doesn't have any effect except as 
a synonym for translation-details.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3237 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-07 17:38:20 +00:00
hieuhoang1972
034528988d better -T output for chart decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3231 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-06 19:46:23 +00:00
hieuhoang1972
b6a92ba8af delete param object after decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3228 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-06 11:26:52 +00:00
bojar
30921793a4 Ondrej Odchazel's update for AJAX-CAT 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3217 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-03 21:39:23 +00:00
hieuhoang1972
2bf009008b move sentence-based cache cleaning into IRST LM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3203 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-26 14:56:06 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available). 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-23 15:01:06 +00:00
chardmeier
ca353d3e68 - word lattice distortion calculation and distortion limit checks revisited 
- crash in a controlled way if a jump in a word lattice exceeds max-phrase-length
- check if a sufficient number of ttable-limits is specified in the configuration

Thanks to Arianna Bisazza for help with sorting out lattice distortion and
to Suzy Howlett for help with debugging the other issues.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3193 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-22 08:42:32 +00:00
hieuhoang1972
49d3780bcc re-merge lattice mbr & consensus decoding 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3115 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-12 09:51:29 +00:00
leven101
8839474d3d changed assertion on ttable entry in moses.ini 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3081 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 20:50:22 +00:00
hieuhoang1972
5bab778f02 merge 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3079 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:57:38 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
bhaddow
521d50fe63 Implementation of consensus decoding - first cut. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3071 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-07 15:47:58 +00:00
leven101
a47e6b7bee incorporate suffix array classes (not final solution) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3053 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-06 11:37:50 +00:00