nicolabertoldi
|
1b0576ba6c
|
small bug fixed: temporary concatenated sorted file is now deleted only at the end
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1486 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-24 07:50:51 +00:00 |
|
nicolabertoldi
|
8710cc9bc9
|
features can be activated using a comma- or blank-separated list
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1485 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-23 16:55:02 +00:00 |
|
nicolabertoldi
|
9e70b5ffd8
|
Features are activated using their names
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1484 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-23 16:30:02 +00:00 |
|
nicolabertoldi
|
8fe62f2b95
|
some small bugs fixed and clean up
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1483 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-23 14:15:19 +00:00 |
|
nicolabertoldi
|
4720d1cb9f
|
bug fixed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1482 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 17:01:53 +00:00 |
|
nicolabertoldi
|
918dae011a
|
bug fixed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1481 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 14:00:10 +00:00 |
|
nicolabertoldi
|
e7ac20d4d6
|
bug fixed in the name of a temporary file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1480 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 13:34:12 +00:00 |
|
nicolabertoldi
|
db9d0fc539
|
Added a more time-efficient (but more memory-consumptive) method to rescore nbest list
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1479 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 10:08:07 +00:00 |
|
nicolabertoldi
|
b827d51870
|
changes to cope with the new mert suite (enhanced-mert)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1478 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 09:45:19 +00:00 |
|
jdschroeder
|
a969197e16
|
Fixed passing decoder parameters when tuning on single machine.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1477 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 09:27:09 +00:00 |
|
nicolabertoldi
|
5759005857
|
Suite of scripts to perform MERT on a subset of fetures.
Look at the directory example to learn about its use.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1476 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-22 09:04:03 +00:00 |
|
redpony
|
0cf583e249
|
add --hmm-align option. Allows using Giza++'s HMM word alignment model as the underlying word alignment. It is much faster than Model 4 alignment and not much worse.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1474 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-19 03:44:05 +00:00 |
|
nicolabertoldi
|
901823d83a
|
explicit export of PYTHONPATH variable
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1473 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-18 15:33:04 +00:00 |
|
nicolabertoldi
|
81b439d728
|
minor changes in passing parameters to moses-parallel
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1472 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-18 12:36:49 +00:00 |
|
hieuhoang1972
|
4e1cad4bbe
|
fixed sync/async bug
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1471 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-04 17:31:31 +00:00 |
|
redpony
|
57dcaa8e80
|
performance fixes for scorer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1470 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-02 21:43:54 +00:00 |
|
hieuhoang1972
|
9cbc2922b4
|
separate word penalty for each decode step for async
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1469 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-10-02 12:52:00 +00:00 |
|
hieuhoang1972
|
d2d03c33e7
|
fixed bug which prevented mert working when phrase table NOT filtered or binarised
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1449 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-08-10 15:48:58 +00:00 |
|
hieuhoang1972
|
53fa2cb18a
|
async - don't use binarising or filtering
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1443 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-08-05 20:29:46 +00:00 |
|
hieuhoang1972
|
9eba034662
|
turn off debugging
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1435 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-07-25 10:05:34 +00:00 |
|
hieuhoang1972
|
2beb0c44e9
|
mkdir before doing generation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1425 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-07-14 09:54:05 +00:00 |
|
nicolabertoldi
|
75afdf04a5
|
I corrected direction of alignment
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1421 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-27 17:57:55 +00:00 |
|
nicolabertoldi
|
ac91cb78cc
|
two additional (and simpler) ways of extracting alignments: source-to-target and target-to-source
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1420 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-27 16:34:14 +00:00 |
|
nicolabertoldi
|
7f9c2856c2
|
changes to reduce disk memory consumption during training
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1419 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-27 16:30:20 +00:00 |
|
phkoehn
|
960bebdd4a
|
fixed clean script to handle '|'s
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1416 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-18 15:50:04 +00:00 |
|
redpony
|
c747cdd505
|
fix dumb error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1414 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-01 16:27:56 +00:00 |
|
redpony
|
1f050e198a
|
fix compile error, enable optimizations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1413 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-01 16:26:26 +00:00 |
|
redpony
|
564bb5a64e
|
make scorer use compiler optimization
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1412 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-06-01 16:22:30 +00:00 |
|
hieuhoang1972
|
aa25c7341d
|
fixed bug with non-ascii data, recieved from Jaakko Väyrynen
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1392 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-05-21 13:06:40 +00:00 |
|
bojar
|
74954cb0ae
|
prefer hardlinking, dropped dependency on a proprietary script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1381 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-05-09 00:54:07 +00:00 |
|
bojar
|
31def05428
|
- added a comment where the binarizer is
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1380 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-05-07 07:19:02 +00:00 |
|
abarun
|
ba90a05233
|
Added script to perform Minimum Bayes Risk reranking
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1372 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-05-02 17:26:01 +00:00 |
|
hieuhoang1972
|
13e07cef5f
|
multiple distance based distortion for async decoder
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1370 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-23 19:17:38 +00:00 |
|
redpony
|
485bda2db5
|
andreas zollman's changes to write span information
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1367 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-20 14:53:46 +00:00 |
|
jdschroeder
|
3e1aabc487
|
Removed a few errant svn diff lines that found their way into the file.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1366 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-19 10:52:17 +00:00 |
|
jdschroeder
|
752d148c6e
|
Changed initial setting of number of distortion weights from 0 to 1. For models with lexicalized reordering, this script was generating one too few weights in moses.ini
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1365 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-18 19:38:14 +00:00 |
|
redpony
|
c80d8b8d47
|
Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-18 14:08:46 +00:00 |
|
hieuhoang1972
|
45dde20c54
|
comment out psyco library
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1354 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-12 17:48:48 +00:00 |
|
hieuhoang1972
|
75c20e7609
|
Add alignment info to phrase table
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1352 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-11 19:58:38 +00:00 |
|
hieuhoang1972
|
b84191c9d3
|
Add alignment info to phrase table
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1351 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-11 19:56:43 +00:00 |
|
hieuhoang1972
|
b9d2288c22
|
compileable with visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1349 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-11 11:35:36 +00:00 |
|
hieuhoang1972
|
e868986885
|
compileable with visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1348 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-11 11:18:37 +00:00 |
|
jdschroeder
|
84d12552c2
|
added additional numbered count to output phrase table names so multiple phrase tables can be filtered and used at the same time
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1337 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-04 17:54:12 +00:00 |
|
jdschroeder
|
667e85264a
|
added LC_ALL=C call and temp directory specification to sort command, hoping to minimize failed sorts crashing processPhraseTable
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1336 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-04 17:07:16 +00:00 |
|
jdschroeder
|
04ae9361d2
|
added "-v 0" moses flag to decoder call to minimize log output.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1335 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-04-04 17:04:50 +00:00 |
|
hieuhoang1972
|
c17316495c
|
use pawd instead of pwd whenever we can
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1332 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-03-26 21:00:20 +00:00 |
|
hieuhoang1972
|
502093573b
|
set svn:eol property
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1331 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-03-26 20:06:44 +00:00 |
|
bojar
|
e7821e84ef
|
Added support for Ondrej Bojar's scoring of nbestlist, faster than python and
does not rescore previous iterations. The scoring tool is however not included
in the scripts distribution.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1329 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-03-26 09:26:05 +00:00 |
|
bojar
|
55ea5d6f94
|
Adding simple Czech rules to detokenizer. Making detokenizer 'released'.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1328 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-03-26 06:08:13 +00:00 |
|
bojar
|
58bf2089af
|
Adding detokenizer from WMT07 shared scripts.tgz, hoping there are no copyright
problems. Please withdraw if necessary.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1327 1f5c12ca-751b-0410-a591-d2e778427230
|
2007-03-26 05:46:50 +00:00 |
|