moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
964 Commits 136 Branches 26 Tags 147 MiB
7ecb0ce66e
Commit Graph

162 Commits

Author SHA1 Message Date
hieuhoang1972
7ecb0ce66e change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1227 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-21 19:48:53 +00:00
hieuhoang1972
f3cbacba3e code cleanup - make FactorCollection and StaticData totally accessible only globally 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1218 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-16 18:08:37 +00:00
hieuhoang1972
e247f1da6f fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1209 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-13 19:15:34 +00:00
hieuhoang1972
6b4dfc4db2 added #def to use hypo pool 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1206 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-12 11:05:13 +00:00
hieuhoang1972
006e2724e0 take out irstlm on VS build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1195 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-09 17:36:07 +00:00
hieuhoang1972
9cf7257d27 don't skip empty lines 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1169 1f5c12ca-751b-0410-a591-d2e778427230
 2007-02-05 10:24:01 +00:00
hieuhoang1972
e7838339bb exit/return from main() 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1141 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 16:21:28 +00:00
nicolabertoldi
be039bf84a Reduced time to die!!! 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1139 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 14:47:13 +00:00
hieuhoang1972
e1823a52ac prune arcList & LatticePathCollection (contenders for n-best paths) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f fixed mem leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-21 13:38:03 +00:00
redpony
0f3ee4b814 If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-08 14:46:48 +00:00
hieuhoang1972
dd721e1b4f Mac xcode proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e dismantle IODevoce framework 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 23:06:30 +00:00
hieuhoang1972
c49a2e31bf eclipse preferences. not sure if need to go into svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7 lots of small changes and code clean up: 
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241 Modified output of feature scores. 
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48 updated eclispe project file to work with calipso version 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949 statically zlib on WIN32 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac eclipse project file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80 added internal, x-platform LM which exactly mimics SRILM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f changes to make LMs work in Windows 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927 solved bug in n-best list creation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2 rename InputOutput to IODevice 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a visual studio project files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59 code cleanup and commenting brought about when documenting for jhu report 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4 xcode proj files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc taken boost out of eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90 delete zlib-win32 proj. library should be in default path 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e put back Visual Leak Detector for Win32 build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386 cleanup... renamed --report-source-word-span into --report-segmentation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c cleanup of verbose logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:03:27 +00:00
swadey
0ffbcca545 - Added necessary zlib-win32 implementation for winbloze 
- update project files for vc++ and fixed minor code issues

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9 make building moses/moses-cmd a single make command rather than two 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-23 15:18:53 +00:00
redpony
1700da00bf remove .cvsignore files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:39:02 +00:00
redpony
1022363f39 remove acsite 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:06:24 +00:00
redpony
fe74de6b44 Remove files that are autogenerated 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:50:36 +00:00
redpony
75796cb419 remove misleading file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:34:50 +00:00
redpony
6eaba82546 remove references to boost, fix formatting, fix make-release-tarball to work with svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:24:09 +00:00
redpony
2e8001f428 prepare for public releases 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 16:24:39 +00:00
redpony
cc97567b2b remove references to JHU fs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:26:27 +00:00
redpony
b116321fd9 remove references to Mysql 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:20:23 +00:00
redpony
3fb417f914 remove references to boost 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3 remove mysql dependency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85 eclipse proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:39:59 +00:00
mfederico
2a3037692b Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 18:31:16 +00:00
eherbst
54166381c9 *** empty log message *** 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881 fixed check for n_gram.h in irstlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:32:01 +00:00