Barry Haddow
22f0929081
Fix seg fault, and remove extra debug.
2011-11-16 13:08:24 +00:00
Barry Haddow
f0b81a29d8
Fix saving of features to file
2011-11-16 11:49:31 +00:00
Barry Haddow
c8f5efe30d
Merge branch 'miramerge' of github.com:moses-smt/mosesdecoder into miramerge
2011-11-16 10:40:18 +00:00
Barry Haddow
77d159fca4
remove getFeatureNames()
2011-11-16 10:40:04 +00:00
Eva
5a899e0402
fix Save
2011-11-16 11:12:51 +01:00
Eva
02bf6b2818
fix mira after changes to FeatureVector, fix saving and clearing of core features
2011-11-16 10:13:17 +01:00
Barry Haddow
afd42932db
resizing of feature vector
2011-11-12 23:32:45 +00:00
Barry Haddow
6890472ba1
Merge branch 'master' into miramerge
...
Conflicts:
.gitignore
config.h.in
moses/src/ChartTrellisPath.cpp
moses/src/Makefile.am
2011-11-11 08:25:13 +00:00
Barry Haddow
4e20e13265
Merge branch 'miramerge' into dense
...
Conflicts:
moses/src/BleuScoreFeature.h
2011-11-10 22:00:14 +00:00
Barry Haddow
d6f61ec061
Remove unwanted debug
2011-11-09 17:59:02 +00:00
Barry Haddow
5934817d89
Use array for dense features
2011-11-09 17:16:02 +00:00
Eva Hasler
f99c35395c
Merge remote branch 'github/miramerge' into miramerge
2011-11-09 15:41:33 +00:00
Barry Haddow
28ac3bffba
set num score components in ScoreProducer ctor
2011-11-08 21:22:34 +00:00
Phil Williams
9903a239ea
Assume HAVE_BOOST
2011-11-08 15:43:58 +00:00
Phil Williams
aa46d2eca0
moses_chart: speed up n-best list generation by deferring creation of
...
ChartTrellisPath objects until a detour is selected. The output
should be unchanged except in the case of ties and rounding differences
in score calculations.
This doesn't make much difference at n = 100 but helps for larger lists:
example real times for decoding the first 100 sentences of the
new-test2008 tuning set with four threads:
n before after
1 4m32.955s 4m28.584s
100 4m42.375s 4m36.311s
1500 13m17.681s 4m34.807s
And with the 'distinct' option:
before after
1 4m36.656s 4m32.883s
100 11m04.236s 4m35.221s
1500 129m21.593s 5m06.320s
2011-11-08 11:28:02 +00:00
Barry Haddow
818b2594c1
Fix compile error with mpi
2011-11-08 09:43:04 +00:00
Hieu Hoang
ae5e39fa86
delete premature lattice for scfg
2011-11-07 20:45:05 +07:00
Hieu Hoang
e0016712be
Merge github.com:hieuhoang/mosesdecoder
2011-11-07 20:23:52 +07:00
Hieu Hoang
dbba840e10
Merge github.com:moses-smt/mosesdecoder
2011-11-07 20:18:47 +07:00
Barry Haddow
daeed698c1
Faster with copy than +=
2011-11-07 10:54:53 +00:00
Hieu Hoang
0548a0ec3c
load hiero format for reading suffix arrays
2011-11-06 20:55:57 +07:00
Hieu Hoang
24f7065826
load hiero format for reading suffix arrays
2011-11-06 20:46:46 +07:00
Hieu Hoang
bb2385657e
load hiero format for reading suffix arrays
2011-11-06 16:08:37 +07:00
Hieu Hoang
86b9bf8bed
load hiero format for reading suffix arrays
2011-11-06 15:35:05 +07:00
Hieu Hoang
311b5a6244
load hiero format for reading suffix arrays
2011-11-06 15:31:11 +07:00
Hieu Hoang
a257803610
load hiero format for reading suffix arrays
2011-11-05 01:06:31 +07:00
Hieu Hoang
1afbc7a5ee
load hiero format for reading suffix arrays
2011-11-05 00:20:12 +07:00
Eva Hasler
905dcaeeb0
Merge branch 'miramerge' of ssh://mosesdecoder.git.sourceforge.net/gitroot/mosesdecoder/mosesdecoder into miramerge
2011-11-04 16:43:39 +00:00
Eva Hasler
aa32150525
adding class TargetNgramFeature, produces ngrams incl. or excl. lower order ngrams
2011-11-04 16:40:12 +00:00
Hieu Hoang
9b9ca34302
load hiero format for reading suffix arrays
2011-11-04 22:43:42 +07:00
Barry Haddow
42a3f28b42
Speed up decoding by cutting reducing score copies.
...
Hypothesis gets the weighted score from previous,
and lazily computes full breakdown. Changes lex
reorder scores very slightly (third decimal place),
hence test change.
2011-11-03 22:33:05 +00:00
Kenneth Heafield
1c72f79698
More informative error message about <s> errors
2011-11-01 10:24:40 +00:00
Kenneth Heafield
314313ad89
Report null context estimates to correct score breakdown
2011-10-30 17:56:42 +00:00
Hieu Hoang
df949b87de
lattice for scfg decoding
2011-10-30 19:34:36 +07:00
Hieu Hoang
b6b697c545
xcode
2011-10-30 19:17:15 +07:00
Hieu Hoang
aac12ed58f
xcode
2011-10-30 12:51:08 +07:00
Barry Haddow
90820ad0c5
Merge branch 'master' into miramerge.
...
Also fix mert-moses.pl to use correct flag for specifying
weights of non-core features.
Conflicts:
.gitignore
configure.in
ltmain.sh
moses/src/LM/Factory.cpp
moses/src/LMList.cpp
moses/src/LMList.h
moses/src/LanguageModel.cpp
moses/src/LanguageModel.h
moses/src/LanguageModelKen.h
moses/src/Makefile.am
moses/src/Manager.cpp
moses/src/PhraseDictionaryMemory.cpp
moses/src/PhraseDictionaryTree.cpp
moses/src/StaticData.cpp
moses/src/TargetPhrase.h
2011-10-28 15:54:23 +01:00
Hieu Hoang
42924144fd
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2011-10-28 19:13:14 +07:00
Hieu Hoang
62c901eb52
TMX extraction by Tom Hoar and Hilario Leal Fontes
2011-10-28 19:12:20 +07:00
Germán
899293243a
Modified code in Manager.cpp so that option -osgx outputs a superset of -osg.
2011-10-27 13:29:46 +02:00
Eva Hasler
7bbcc67344
scale by average of source and reference length (--scale-by-avg-length)
2011-10-26 11:36:00 +01:00
Eva Hasler
7d0a5fa11f
scale Bleu by complete source length or reference length
2011-10-26 11:16:45 +01:00
Eva Hasler
7a5637f803
fix new_state->m_source_length (?)
2011-10-25 16:30:02 +01:00
Eva Hasler
4ab2db98fe
add parameter --scale-by-x: scale Bleu precision (independent of source/target scaling)
2011-10-24 18:39:23 +01:00
Hieu Hoang
d98780c062
Just get ready but didn't fix bug yet
2011-10-24 19:13:56 +07:00
Hieu Hoang
ae3ecbc105
fix bug for tree-to-string. Didn't check source LHS
2011-10-24 19:13:17 +07:00
Hieu Hoang
82e2e094ff
fix bug for tree-to-string. Didn't check sourceLHS
2011-10-24 18:54:42 +07:00
Eva Hasler
e7c8120bf6
new parameter: scale by target length instead of input length
2011-10-24 10:43:53 +01:00
Hieu Hoang
cb87f251b2
xcode
2011-10-24 14:44:36 +07:00
Hieu Hoang
f8b6387642
xcode
2011-10-24 01:54:25 +07:00
