redpony
a61645851e
Creating branch for multi-factor performance improvements
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@831 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-25 21:38:04 +00:00
redpony
3788a7179e
accidentally committed
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@829 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-25 21:37:15 +00:00
redpony
7740dd7401
Creating branch for multi-factor performance improvements, merge down from trunk
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@828 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-25 21:35:51 +00:00
redpony
441b147b35
Get rid of FactorArrayWrapper/FactorArray and use only Word. Memory pool is currently disabled, but the net cleanup resulted in better performance despite this (there are fewer copies of FactorArray -> Word now).
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@827 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-25 21:35:10 +00:00
redpony
b4614dbb56
Creating branch for multi-factor performance improvements
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/cdyer-multifactor@826 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-25 16:15:54 +00:00
bojar
27fe632194
being safe and dying when unknown --cmdline-option supplied
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@824 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-21 14:45:03 +00:00
bojar
c6c02a83c6
Just a short description added.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@823 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-21 12:23:42 +00:00
redpony
735d2f5349
add a few comments, especially to the prefix tree code
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@822 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-20 21:49:34 +00:00
redpony
7ba47164e9
get rid of unused function header
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@821 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-20 19:56:33 +00:00
bojar
271b78d94c
Just checking if I can commit. Added my name.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@820 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-20 14:20:17 +00:00
redpony
d3e39a10eb
remove dead code
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@819 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-19 05:48:25 +00:00
redpony
f31d568747
only print CN stats at verbose level 2 (more in line with Philipp's cleanup)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@818 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-19 03:32:47 +00:00
redpony
43e0cd8759
get rid of multiple calls to sort phrase dictionary by estimated costs.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@817 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-18 23:46:27 +00:00
redpony
9582bcecff
turn on O3 optimization for symal
...
increase MAX_WORD in symal.cpp (I was hitting this limit in a chinese corpus that had some tokenization errors)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@816 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-18 15:36:04 +00:00
redpony
1e7a253a43
Building misc/ along with the rest of the suite.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@815 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-15 21:32:48 +00:00
redpony
da7fed9e7e
add --corpus-compression [gz|bz2] to allow corpora to be compressed
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@814 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-15 12:38:13 +00:00
redpony
7d50d155dc
fix compilation error on gcc 4.1, fix warnings in mert
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@813 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-12 19:46:16 +00:00
redpony
c69cfaf33e
Allow the factor delimiter, that is, the string that separates the factors in a 'word' to be specified to moses and to train-factored-phrase-model.perl. The default is still to use '|'. Multi-character delimiters are allowed (for example, '+++'). Added a regression test for multi-character delimiters.
...
Remove JHU dependencies on make release. It now looks for GIZA++ and sets the BINDIR inside train-factored-phrase-model.perl at installation time (note: because of this, this script MUST BE released before it can be run now).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@812 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-12 15:53:50 +00:00
hieuhoang1972
841e589ffd
rename files for consistency
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@811 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-09 17:22:56 +00:00
hieuhoang1972
e4c96d8209
rename files for consistency
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@810 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-09 17:01:00 +00:00
hieuhoang1972
a4534d3452
test
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@809 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-09 16:37:19 +00:00
hieuhoang1972
5cb31a4d90
delete zlib-win32 proj. library should be in default path
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e
put back Visual Leak Detector for Win32 build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:38:14 +00:00
phkoehn
572c577ef7
initial release
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@806 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-01 18:02:56 +00:00
nicolabertoldi
041e6ed3c5
Changes to compilation scripts:
...
- irstlm/src/Makefile.am did not install some files
- irstlm/mkinstalldirs needed by OSX
- irstlm/regenerate-makefiles.sh substitutes
explicit calls of aclocal, autoconf and automake
Changes to scoring script used by MERT
- added the option ("-e") to compute BLEU wrt the
"closest" reference length like in multi-bleu.perl
- now multi-bleu.perl manages 0 counts for ngram-statistics
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@805 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-01 14:54:41 +00:00
phkoehn
d79e6007c1
bug fix with parameter handling, -beam-threshold now also -b
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@804 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-31 15:44:06 +00:00
phkoehn
6d54aca44a
minor fixes, boolean switches can now be applied without value, e.g. "-t"
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@803 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 19:52:16 +00:00
phkoehn
1de5a36386
cleanup... renamed --report-source-word-span into --report-segmentation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 19:51:07 +00:00
phkoehn
1d7bf5f8c2
regression tests had to adjusted to changes in verbose handling
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@801 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:05:45 +00:00
phkoehn
f084e13a1c
cleanup of verbose logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:03:27 +00:00
phkoehn
821c14ec31
a bit more cleanup of verbose logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@799 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:02:04 +00:00
phkoehn
bafe7fc2ab
cleanup of logging and reporting, now 4 verbose levels (0-3)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@798 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:00:41 +00:00
phkoehn
36391efb99
test
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@797 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-29 20:07:51 +00:00
swadey
0ffbcca545
- Added necessary zlib-win32 implementation for winbloze
...
- update project files for vc++ and fixed minor code issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-24 20:11:08 +00:00
redpony
32615b51c3
new directory layout
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@795 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-23 17:17:10 +00:00
redpony
b7ffa5f8b9
make building moses/moses-cmd a single make command rather than two
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-23 15:18:53 +00:00
redpony
1700da00bf
remove .cvsignore files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:39:02 +00:00
redpony
d462e718e8
add a little logging to make-release-tarball.sh
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@792 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:37:12 +00:00
redpony
89d2ed8087
fix bug in build instructions
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@791 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:33:18 +00:00
redpony
61af46ffd7
fixes for irstlm on Linux machines
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@790 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:14:47 +00:00
redpony
63a2eee1b6
add maintainer mode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@789 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:08:41 +00:00
redpony
1022363f39
remove acsite
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:06:24 +00:00
redpony
7648827090
add instructions
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@787 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:01:35 +00:00
redpony
fe74de6b44
Remove files that are autogenerated
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:50:36 +00:00
redpony
75796cb419
remove misleading file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:34:50 +00:00
redpony
6eaba82546
remove references to boost, fix formatting, fix make-release-tarball to work with svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:24:09 +00:00
redpony
069af29c31
add suggestion to use --enable-maintainer-mode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@783 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 17:27:17 +00:00
redpony
e7630f52bc
remove CVSROOT stuff
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@782 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 17:19:50 +00:00
redpony
2e8001f428
prepare for public releases
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 16:24:39 +00:00
redpony
cc97567b2b
remove references to JHU fs
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:26:27 +00:00