moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
894 Commits 136 Branches 26 Tags 147 MiB
c49a2e31bf
Commit Graph

149 Commits

Author SHA1 Message Date
hieuhoang1972
c49a2e31bf eclipse preferences. not sure if need to go into svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7 lots of small changes and code clean up: 
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241 Modified output of feature scores. 
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48 updated eclispe project file to work with calipso version 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949 statically zlib on WIN32 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac eclipse project file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80 added internal, x-platform LM which exactly mimics SRILM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f changes to make LMs work in Windows 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927 solved bug in n-best list creation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2 rename InputOutput to IODevice 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a visual studio project files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59 code cleanup and commenting brought about when documenting for jhu report 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4 xcode proj files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc taken boost out of eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90 delete zlib-win32 proj. library should be in default path 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e put back Visual Leak Detector for Win32 build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386 cleanup... renamed --report-source-word-span into --report-segmentation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c cleanup of verbose logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:03:27 +00:00
swadey
0ffbcca545 - Added necessary zlib-win32 implementation for winbloze 
- update project files for vc++ and fixed minor code issues

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9 make building moses/moses-cmd a single make command rather than two 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-23 15:18:53 +00:00
redpony
1700da00bf remove .cvsignore files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:39:02 +00:00
redpony
1022363f39 remove acsite 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:06:24 +00:00
redpony
fe74de6b44 Remove files that are autogenerated 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:50:36 +00:00
redpony
75796cb419 remove misleading file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:34:50 +00:00
redpony
6eaba82546 remove references to boost, fix formatting, fix make-release-tarball to work with svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:24:09 +00:00
redpony
2e8001f428 prepare for public releases 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 16:24:39 +00:00
redpony
cc97567b2b remove references to JHU fs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:26:27 +00:00
redpony
b116321fd9 remove references to Mysql 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:20:23 +00:00
redpony
3fb417f914 remove references to boost 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3 remove mysql dependency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85 eclipse proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:39:59 +00:00
mfederico
2a3037692b Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c Added decoding time computation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-15 18:31:16 +00:00
eherbst
54166381c9 *** empty log message *** 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881 fixed check for n_gram.h in irstlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 23:32:01 +00:00
redpony
da207d0016 add optional LM statistics reporting. enable with '-L true' on command line 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-14 22:44:01 +00:00
ccorbett
4e3631e1b0 IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 19:51:17 +00:00
hieuhoang1972
2a7179a8fa choice of not labelling n-best output for wade shen's mert script 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 19:08:39 +00:00
ccorbett
7019abf652 reordering scores are now implemented for n-best lists 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 18:11:52 +00:00
hieuhoang1972
dfe2e58187 output trans & gen scores in order they were created 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@687 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-13 03:03:18 +00:00
zens
61294d90ad - generate distinct nbest surface strings (if 3rd token of n-best-list is 'distinct') 
- some sanity checks


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@674 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-12 00:06:55 +00:00
eherbst
5cb683cd7e moved class InputType to InputType.h; 
added more detailed statistics-keeping to SentenceStats;
added custom malloc/realloc (see Util.h);
some commenting


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@666 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 21:04:38 +00:00
redpony
8e986774e1 print input line number in logs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@663 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 20:16:27 +00:00
redpony
8e4128beef add dropped word analysis, fix potential out of memory crash 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21 visual studio proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-11 16:21:27 +00:00
redpony
eff4b3447e FactorTypeSet->FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 22:41:26 +00:00
redpony
5a0787310b FactorTypeSet -> FactorMask 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 20:42:34 +00:00
phkoehn
525a181f12 re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-10 04:20:06 +00:00