nicolabertoldi
|
44d7e0e0f7
|
fixed a bug related to the handling of feature names
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1821 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-05 11:26:54 +00:00 |
|
bhaddow
|
37cf805139
|
Fix bug in output of scorestats to text file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1820 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-05 11:08:29 +00:00 |
|
nicolabertoldi
|
281bf610b8
|
added binary read/load facility for feature data
added names of features in the header
added methods to access the features by name
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1819 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-05 07:23:34 +00:00 |
|
jfouet
|
f849154a73
|
fix FeatureStats::savetxt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1815 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-04 08:33:37 +00:00 |
|
jfouet
|
8e54557e9f
|
fix crash in getNextPound
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1814 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-04 08:32:19 +00:00 |
|
nicolabertoldi
|
1402f3036b
|
added ScorerFactory.h
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1811 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-06-03 08:56:37 +00:00 |
|
nicolabertoldi
|
af585bc492
|
nbest can be read from stdin, too
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1797 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-27 17:20:01 +00:00 |
|
nicolabertoldi
|
291260abf7
|
- made output more compliant with old version
- added PerSCorer.h and BleuScorer.h
- stored feature names
- fixed bug about output of best Point
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1796 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-27 16:50:52 +00:00 |
|
jfouet
|
89194be5eb
|
safer(hopefully) insertion of threshold in LineOptimize
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1795 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-23 12:02:14 +00:00 |
|
nicolabertoldi
|
c9593648bb
|
change from int to unsigned where needed
add some debugging output (to remove later)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1794 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-23 11:48:16 +00:00 |
|
bhaddow
|
e8d26f4f5c
|
Fixes to optimiser to stop it crashing and failing assert
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1793 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-22 17:19:41 +00:00 |
|
nicolabertoldi
|
09b5a0a282
|
modified log outputs to e comliant with old mert
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1792 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-21 16:52:00 +00:00 |
|
bhaddow
|
f1fa67d15e
|
Fixed small bug in initialisation of 1bests
removed failing assert
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1791 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-21 16:22:43 +00:00 |
|
nicolabertoldi
|
f87b4261cf
|
I fixed a small bug when reading parameters
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1789 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-21 10:03:48 +00:00 |
|
nicolabertoldi
|
b611428b2b
|
added missing file for managing gzipped files
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1788 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-21 09:33:19 +00:00 |
|
nicolabertoldi
|
8cf59edcdc
|
remove loadnbest from FeatureData and Scoredata; change test_scorer accordingly;
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1787 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-20 14:33:47 +00:00 |
|
nicolabertoldi
|
8a594fc254
|
reading from textual gzipped file is now possible
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1786 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-20 14:15:30 +00:00 |
|
jfouet
|
f30000b875
|
add type threshold
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1785 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-20 12:57:32 +00:00 |
|
jfouet
|
6ee4084797
|
simplification of LineOptimizer code (same behaviour)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1784 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-20 12:42:11 +00:00 |
|
bhaddow
|
39cf94984c
|
Fix bug in finding of leftmost, higher line in optimizer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1783 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-20 10:21:20 +00:00 |
|
bhaddow
|
86772c27e2
|
Fixed return of non-initialised variable
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1782 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-17 13:24:09 +00:00 |
|
bhaddow
|
74fb532e00
|
Option to use random optimiser
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1781 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-17 12:19:02 +00:00 |
|
bhaddow
|
83300050f7
|
Remove extraneous debug messages
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1766 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 20:24:00 +00:00 |
|
bhaddow
|
4ec448b3f2
|
Command line arg tidy up in extractor
Remove buffers from feature
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1761 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 19:57:01 +00:00 |
|
bhaddow
|
597c960933
|
Remove extra debug
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1752 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 16:58:15 +00:00 |
|
bhaddow
|
1512abb7bd
|
Save correct weight set!
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1750 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 16:51:39 +00:00 |
|
bhaddow
|
61e7ca1437
|
Fixes to optimiser: correct calculation of intersection, choice of bestx and prevent it
from deleting best point
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1749 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 16:47:01 +00:00 |
|
jfouet
|
2b07443683
|
bugfixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1740 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 14:21:24 +00:00 |
|
jfouet
|
044a43b512
|
add init.opt file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1731 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 12:35:17 +00:00 |
|
jfouet
|
e9df80a05c
|
bugfixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1726 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 10:57:24 +00:00 |
|
jfouet
|
bb42cb0dd5
|
bugfixes+ introduction of verbose level
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1723 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-16 07:09:15 +00:00 |
|
jfouet
|
ad79af41df
|
bug fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1719 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 20:49:49 +00:00 |
|
bhaddow
|
165f7d049f
|
pass by reference
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1717 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 20:44:24 +00:00 |
|
bhaddow
|
1a6dcf5e36
|
remove buffers
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1715 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 20:32:37 +00:00 |
|
bhaddow
|
6112215974
|
Fix crash in parameter reading
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1714 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 19:26:35 +00:00 |
|
jfouet
|
b231ffc8b1
|
add Types.h to unify the typedefs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1713 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 19:09:01 +00:00 |
|
bhaddow
|
ad2ee87603
|
Fix makefile
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1711 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 17:16:46 +00:00 |
|
bhaddow
|
933400a503
|
extractor uses scorer factory
remove feature_extractor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1710 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 17:14:11 +00:00 |
|
nicolabertoldi
|
cc1d95272a
|
add READMEs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1707 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 16:20:23 +00:00 |
|
bhaddow
|
c0643d47f2
|
Add scorer factory. Fix compile error in Optimizer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1706 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 16:03:49 +00:00 |
|
bhaddow
|
f320cf5174
|
Refactor PerScorer and BleuScorer to remove common code
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1704 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 14:48:11 +00:00 |
|
jfouet
|
b0ee845d7e
|
various small fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1702 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 14:17:34 +00:00 |
|
bhaddow
|
777ea5f754
|
Finish per scorer
Command line args for extractor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1700 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 14:13:32 +00:00 |
|
jfouet
|
c66aec9e83
|
implementation of the main
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1698 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 14:04:42 +00:00 |
|
jfouet
|
94d47101ca
|
add (almost empty) main
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1696 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 11:06:32 +00:00 |
|
jfouet
|
bfe3661110
|
implementation of optimization on a subset of the parameters + debug mode in the makefile
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1695 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 10:57:20 +00:00 |
|
nicolabertoldi
|
2ef6f3e2d8
|
main command for managing feature and error statistics is ready; small example fortesting is available in directory example
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1692 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 08:35:56 +00:00 |
|
bhaddow
|
1f84c9eab7
|
Get rid of warnings about lack of newlines
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1691 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-15 06:44:36 +00:00 |
|
bhaddow
|
f98de25e70
|
Stub out per scorer. some refactoring to make this possible
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1681 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 20:36:11 +00:00 |
|
bhaddow
|
e2921af063
|
Incremental interface for scorer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1678 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 19:47:34 +00:00 |
|
bhaddow
|
69c6164b82
|
normalisation script
normalisation of test data
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1673 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 17:17:44 +00:00 |
|
bhaddow
|
48533d1021
|
Fixes to bleu scorer
add method get ref length
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1669 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 16:31:22 +00:00 |
|
jfouet
|
cff8d4702b
|
add some sanity checks
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1668 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 16:19:00 +00:00 |
|
jfouet
|
13f6a427c5
|
buxfixes on lineOptimize
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1665 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 15:44:59 +00:00 |
|
jfouet
|
cb5305ab46
|
implementation of LineOptimizer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1659 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 14:25:07 +00:00 |
|
nicolabertoldi
|
9202738527
|
support for mergin; other small changes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1657 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 14:16:05 +00:00 |
|
bhaddow
|
87efff7d66
|
bleu scorer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1653 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 13:36:55 +00:00 |
|
jfouet
|
558c8bd9b7
|
fix compilation of Optimizer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1651 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 12:49:45 +00:00 |
|
bhaddow
|
b672d9f6df
|
Stubbing out of Scorer.
Scorer test data.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1646 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 12:23:58 +00:00 |
|
jfouet
|
43ba7835bb
|
class to inplement a set of lambda parameter and their stat score
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1642 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 11:32:17 +00:00 |
|
nicolabertoldi
|
36b25323c9
|
small changes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1641 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 11:28:54 +00:00 |
|
jfouet
|
40c93618fc
|
add const get accesor to FeatureDataand Array
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1639 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 11:11:55 +00:00 |
|
nicolabertoldi
|
b68b41f7e2
|
add Parameter
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1638 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 11:05:32 +00:00 |
|
jfouet
|
f9448b76a0
|
objet code for the Optimzer algorithm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1637 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 11:00:59 +00:00 |
|
nicolabertoldi
|
eb2d6e971d
|
changes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1636 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 10:51:42 +00:00 |
|
bhaddow
|
d794418121
|
First version of scorer
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1634 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 08:46:15 +00:00 |
|
nicolabertoldi
|
9c12330785
|
I am adding new object for handling statistics forerror measures
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1633 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 08:14:13 +00:00 |
|
nicolabertoldi
|
49891adeed
|
I am starting the improvement of Minimum Error Training scritps
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1632 1f5c12ca-751b-0410-a591-d2e778427230
|
2008-05-14 07:57:45 +00:00 |
|