moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-08-17 15:30:26 +03:00
Code Issues Packages Projects Releases Wiki Activity

fixed kneserNey phrase probability smoothing bug reported by Česlav Przywara <ceslav@przywara.cz>

Browse Source
This commit is contained in:
phikoehn 2013-03-13 17:52:24 +00:00
parent 21c51194fa
commit 5ba153806b
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
phrase-extract/consolidate-main.cpp
View File

@ -256,7 +256,7 @@ void processFiles( char* fileNameDirect, char* fileNameIndirect, char* fileNameC
if (kneserNeyFlag) {
float D = kneserNey_D3;
if (countEF < 2) D = kneserNey_D1;
if (countEF < 3) D = kneserNey_D2;
else if (countEF < 3) D = kneserNey_D2;
if (D > countEF) D = countEF - 0.01; // sanity constraint
float p_b_E = n1_E / totalCount; // target phrase prob based on distinct