moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-26 19:37:58 +03:00
Code Issues Packages Projects Releases Wiki Activity
739 Commits 136 Branches 26 Tags 147 MiB
a61645851e
Commit Graph

739 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
redpony
a61645851e Creating branch for multi-factor performance improvements 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@831 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-25 21:38:04 +00:00
redpony
3788a7179e accidentally committed 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@829 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-25 21:37:15 +00:00
redpony
7740dd7401 Creating branch for multi-factor performance improvements, merge down from trunk 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@828 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-25 21:35:51 +00:00
redpony
441b147b35 Get rid of FactorArrayWrapper/FactorArray and use only Word. Memory pool is currently disabled, but the net cleanup resulted in better performance despite this (there are fewer copies of FactorArray -> Word now). 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@827 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-25 21:35:10 +00:00
redpony
b4614dbb56 Creating branch for multi-factor performance improvements 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@826 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-25 16:15:54 +00:00
bojar
27fe632194 being safe and dying when unknown --cmdline-option supplied 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@824 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-21 14:45:03 +00:00
bojar
c6c02a83c6 Just a short description added. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@823 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-21 12:23:42 +00:00
redpony
735d2f5349 add a few comments, especially to the prefix tree code 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@822 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-20 21:49:34 +00:00
redpony
7ba47164e9 get rid of unused function header 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@821 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-20 19:56:33 +00:00
bojar
271b78d94c Just checking if I can commit. Added my name. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@820 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-20 14:20:17 +00:00
redpony
d3e39a10eb remove dead code 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@819 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-19 05:48:25 +00:00
redpony
f31d568747 only print CN stats at verbose level 2 (more in line with Philipp's cleanup) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@818 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-19 03:32:47 +00:00
redpony
43e0cd8759 get rid of multiple calls to sort phrase dictionary by estimated costs. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@817 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-18 23:46:27 +00:00
redpony
9582bcecff turn on O3 optimization for symal 
increase MAX_WORD in symal.cpp (I was hitting this limit in a chinese corpus that had some tokenization errors)



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@816 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-18 15:36:04 +00:00
redpony
1e7a253a43 Building misc/ along with the rest of the suite. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@815 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-15 21:32:48 +00:00
redpony
da7fed9e7e add --corpus-compression [gz|bz2] to allow corpora to be compressed 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@814 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-15 12:38:13 +00:00
redpony
7d50d155dc fix compilation error on gcc 4.1, fix warnings in mert 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@813 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-12 19:46:16 +00:00
redpony
c69cfaf33e Allow the factor delimiter, that is, the string that separates the factors in a 'word' to be specified to moses and to train-factored-phrase-model.perl. The default is still to use '|'. Multi-character delimiters are allowed (for example, '+++'). Added a regression test for multi-character delimiters. 
Remove JHU dependencies on make release.  It now looks for GIZA++ and sets the BINDIR inside train-factored-phrase-model.perl at installation time (note: because of this, this script MUST BE released before it can be run now).



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@812 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-12 15:53:50 +00:00
hieuhoang1972
841e589ffd rename files for consistency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@811 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-09 17:22:56 +00:00
hieuhoang1972
e4c96d8209 rename files for consistency 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@810 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-09 17:01:00 +00:00
hieuhoang1972
a4534d3452 test 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@809 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-09 16:37:19 +00:00
hieuhoang1972
5cb31a4d90 delete zlib-win32 proj. library should be in default path 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e put back Visual Leak Detector for Win32 build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-08 12:38:14 +00:00
phkoehn
572c577ef7 initial release 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@806 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-01 18:02:56 +00:00
nicolabertoldi
041e6ed3c5 Changes to compilation scripts: 
- irstlm/src/Makefile.am did not install some files
- irstlm/mkinstalldirs needed by OSX
- irstlm/regenerate-makefiles.sh substitutes 
  explicit calls of aclocal, autoconf and automake

Changes to scoring script used by MERT
- added the option ("-e") to compute BLEU wrt the
  "closest" reference length like in multi-bleu.perl
- now multi-bleu.perl manages 0 counts for ngram-statistics




git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@805 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-01 14:54:41 +00:00
phkoehn
d79e6007c1 bug fix with parameter handling, -beam-threshold now also -b 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@804 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-31 15:44:06 +00:00
phkoehn
6d54aca44a minor fixes, boolean switches can now be applied without value, e.g. "-t" 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@803 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 19:52:16 +00:00
phkoehn
1de5a36386 cleanup... renamed --report-source-word-span into --report-segmentation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 19:51:07 +00:00
phkoehn
1d7bf5f8c2 regression tests had to adjusted to changes in verbose handling 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@801 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:05:45 +00:00
phkoehn
f084e13a1c cleanup of verbose logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:03:27 +00:00
phkoehn
821c14ec31 a bit more cleanup of verbose logging 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@799 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:02:04 +00:00
phkoehn
bafe7fc2ab cleanup of logging and reporting, now 4 verbose levels (0-3) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@798 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-30 17:00:41 +00:00
phkoehn
36391efb99 test 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@797 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-29 20:07:51 +00:00
swadey
0ffbcca545 - Added necessary zlib-win32 implementation for winbloze 
- update project files for vc++ and fixed minor code issues

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-24 20:11:08 +00:00
redpony
32615b51c3 new directory layout 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@795 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-23 17:17:10 +00:00
redpony
b7ffa5f8b9 make building moses/moses-cmd a single make command rather than two 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-23 15:18:53 +00:00
redpony
1700da00bf remove .cvsignore files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:39:02 +00:00
redpony
d462e718e8 add a little logging to make-release-tarball.sh 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@792 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:37:12 +00:00
redpony
89d2ed8087 fix bug in build instructions 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@791 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:33:18 +00:00
redpony
61af46ffd7 fixes for irstlm on Linux machines 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@790 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:14:47 +00:00
redpony
63a2eee1b6 add maintainer mode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@789 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:08:41 +00:00
redpony
1022363f39 remove acsite 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:06:24 +00:00
redpony
7648827090 add instructions 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@787 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 15:01:35 +00:00
redpony
fe74de6b44 Remove files that are autogenerated 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:50:36 +00:00
redpony
75796cb419 remove misleading file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:34:50 +00:00
redpony
6eaba82546 remove references to boost, fix formatting, fix make-release-tarball to work with svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-21 14:24:09 +00:00
redpony
069af29c31 add suggestion to use --enable-maintainer-mode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@783 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 17:27:17 +00:00
redpony
e7630f52bc remove CVSROOT stuff 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@782 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 17:19:50 +00:00
redpony
2e8001f428 prepare for public releases 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-20 16:24:39 +00:00
redpony
cc97567b2b remove references to JHU fs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
 2006-08-19 20:26:27 +00:00