moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 15:48:05 +03:00
Code Issues Packages Projects Releases Wiki Activity
789 Commits 136 Branches 26 Tags 147 MiB
2c4971d5d5
Commit Graph

789 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hieuhoang1972
2c4971d5d5 phrase dictionary renaming for consistency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@885 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 10:37:28 +00:00
hieuhoang1972
fd5a8a0307 phrase dictionary renaming for consistency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@884 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 10:36:03 +00:00
hieuhoang1972
c4322be10b testing 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@883 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 10:32:06 +00:00
hieuhoang1972
064ae992fd aa 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@882 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 10:30:15 +00:00
hieuhoang1972
765a6b1d50 added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@881 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-17 09:45:18 +00:00
hieuhoang1972
63ad7063f4 xcode proj files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-12 11:46:57 +00:00
nicolabertoldi
605e47d978 psyco library is maintained only for 386-compatible processors. 
I modified score-nbest.py to import psyco only if $MACHTYPE is equal to "i386"
If MACHTYPE does not matchpsyco library is not imported,
but script works properly.
I do not know if the control is efffective under Windows


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@879 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-12 09:49:09 +00:00
nicolabertoldi
24d3ed8a37 Changes to mert-moses.pl: 
- added a flag (--no-filter-phrase-table) to disallow filtering of phrase tables (useful if binary hrase tables are used)
- added a flag to compute bleu score without text normalization (--nonorm) (default is with normalization)
- added a flag to compute bleu score with the "closest reference length" (--closest), which is 
   alternative to "average reference length" (--average) or "shortest reference length" (default)
- added a parameter (--inputype=[0|1]) to manage different input types (0 for text, 1 for confusion network, default is 0)
Changes to moses-parallel.pl:
- corrected a typos


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@878 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-11 16:58:30 +00:00
nicolabertoldi
0646dc6472 Temporary bash files generated and used by moses-parallel.pl 
and qsub-wrapper.pl are transformed in readable and executable files.
qsub call them as binary files (see option -b yes)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@877 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-11 09:27:43 +00:00
bojar
d90b1d348e reuses lexical translation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@876 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-10 13:53:45 +00:00
mfederico
e6a29236cf irstlm: compile-lm permits to filter a LM with respect to a small dictionary. Fixed a bug in lmtable::filter2 to filter binary quantized LMs. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@875 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-10 10:20:25 +00:00
hieuhoang1972
930cc9e164 visual studio project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@874 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-10 08:08:34 +00:00
bojar
c742700aba cleans before compiling 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@873 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-09 15:07:50 +00:00
bojar
2eb05906aa skips giza if older output reusable 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@872 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-09 15:01:27 +00:00
mfederico
fc5e348fec irstlm: extension to quantize-lm to work with gizipped LMs. Requires use of temporary bidirectional filestream. So, it's a bit slowers and requires some diskspace on /tmp 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@871 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 21:52:09 +00:00
bojar
998a8216ba skips mkcls and some other steps, if already finished 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@870 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 21:19:29 +00:00
bojar
cef863c4a7 keep a copy of the scripts, so that we don't miss them in previous revisions 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@869 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 18:38:21 +00:00
bojar
33e7d3a8c4 fixed a typo in Makefile and check-dependencies checks for mkcls 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@868 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 16:51:31 +00:00
nicolabertoldi
a73c412b88 added clean to some Makefiles 
use of "make clean" in scripts/Makefile



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@867 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 15:07:30 +00:00
bojar
c8f5e2aeba fixed an error message 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@866 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 10:47:16 +00:00
bojar
0bba065b91 Added two shell scripts to test if an SVN revision is compilable or not. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@865 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 10:44:52 +00:00
hieuhoang1972
af941199cd added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@864 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-06 10:42:14 +00:00
hieuhoang1972
7568620463 fixed minor potential problem 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@863 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 19:31:09 +00:00
hieuhoang1972
6860dea051 rollback 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@862 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 19:20:44 +00:00
hieuhoang1972
7a1414e4c1 added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@861 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 18:50:21 +00:00
hieuhoang1972
d9e67b804b verbose info submitted by Lexi Birch 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@860 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 14:22:00 +00:00
mfederico
64305754d2 irstlm: added inputfilestream to util.h and modified compile-lm to read gzipped files. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@859 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 13:04:19 +00:00
hieuhoang1972
7c1f978c06 added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@858 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 10:01:18 +00:00
hieuhoang1972
efd3ada355 added comments 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@857 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 09:45:49 +00:00
hieuhoang1972
e5231db547 minor compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@856 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 08:39:27 +00:00
hieuhoang1972
90a71c8c9a getting rid of warnings 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@855 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 07:45:17 +00:00
hieuhoang1972
605bbcfc54 getting rid of warnings 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@854 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-05 07:42:06 +00:00
hieuhoang1972
73f7f04f96 win32 compatibility in IRSTLM - roll forward 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@853 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 15:23:16 +00:00
mfederico
82c9074866 irstlm: added some checks on word length in dictionary.cpp 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@852 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 14:45:38 +00:00
mfederico
e3718305a8 irstlm: just removed one warning message from compile-lm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@851 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 14:43:42 +00:00
mfederico
8cedaed05f irstlm: commit of lmtable.h with MAX_LINE 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@850 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 14:27:39 +00:00
hieuhoang1972
e8ee650cc4 win32 compatibility in IRSTLM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@849 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 13:27:45 +00:00
mfederico
8ca67f1c42 irstlm: removed some modifications about file management which created some compilation problem 
in my version. They will be put back as soon as solved.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@848 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 12:31:51 +00:00
hieuhoang1972
db16923b16 win32 compatibility in IRSTLM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@847 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 10:48:59 +00:00
hieuhoang1972
bfe81f62e7 win32 compatibility in IRSTLM 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@846 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 10:26:53 +00:00
mfederico
ecc894b33b irstlm: increased MAX_WORD to 500 chars in dictionary.h and added checks to see if words exceed this limit. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@845 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-04 08:54:23 +00:00
redpony
e5a880a092 inline constructors, destructors in Word. test new commit mailer. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@844 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:56:13 +00:00
hieuhoang1972
0926bf40cc taken boost out of eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:48:09 +00:00
hieuhoang1972
d14b54c740 taken boost out of eclipse project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@842 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:47:39 +00:00
redpony
1753207076 get ride of internal language model code since it is no longer possible to enable it. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@841 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 18:41:39 +00:00
hieuhoang1972
38cef854ab minor compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@840 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 13:05:36 +00:00
hieuhoang1972
b5b961efed visual studio project 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@839 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-03 12:55:45 +00:00
bojar
5bcb34be17 changed fstream to istream in lmtable, so irstlm now supports reading gzippped models (via InputFileStream) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@838 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-02 14:32:18 +00:00
mfederico
a12bb015a7 lmtable.cpp: fast sorting of language model generated by SRILM is now performed on disk, without overhead on memory. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@837 1f5c12ca-751b-0410-a591-d2e778427230
 2006-10-02 11:50:58 +00:00
redpony
47e192f02c remove unused DistortionOrientation files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@836 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-29 19:39:08 +00:00