Commit Graph

1252 Commits

Author SHA1 Message Date
Kenneth Heafield
a0d79781e5 Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
ececab6e27 Fine, go back to allowing multi-threaded builds to link against IRSTLM 2011-12-01 17:52:11 +00:00
Kenneth Heafield
c53453b266 No more autotools (with bhaddow in the room) 2011-12-01 17:17:28 +00:00
Kenneth Heafield
10c1e9ec2e More explaination about <s> error 2011-12-01 13:21:55 +00:00
Kenneth Heafield
dd80a7956f Force single-threaded build if --with-irstlm 2011-11-30 12:17:47 +00:00
Kenneth Heafield
f564876e5e Avoid naming conflict with glibc's libutil 2011-11-28 09:19:45 +00:00
Kenneth Heafield
5a841e6619 Garbage collect uncalled AddEquivPhrase function 2011-11-26 14:09:27 -05:00
Kenneth Heafield
79eecac809 Actually, moses depends on OnDiskPt, not the other way around. 2011-11-25 08:33:16 -05:00
Hieu Hoang
aec299c1c9 compile error with threads 2011-11-24 00:48:32 +07:00
Kenneth Heafield
ccf08a29f3 Link against libSegFault if possible, --git option for installation. 2011-11-23 14:01:58 +00:00
Barry Haddow
ec36f64670 remove extra debug 2011-11-22 14:45:55 +00:00
Barry Haddow
5948912d1d Fix name of backoff parameter 2011-11-22 14:40:33 +00:00
Kenneth Heafield
463f2e232e Link dynamically against libz if we have to 2011-11-21 15:09:38 +00:00
Barry Haddow
7fd0e6ca7f Remove GetTargetPhrase() (already have GetCurrTargetPhrase()) 2011-11-21 12:35:58 +00:00
Barry Haddow
07cbc1c1e5 suppress warnings for srilm 2011-11-21 12:25:04 +00:00
Kenneth Heafield
7e27cd1d8a Jam: automatic boost linkage, install path argument, globs 2011-11-21 06:42:46 -05:00
Barry Haddow
5baa595a91 Further direction removal 2011-11-21 11:14:05 +00:00
Barry Haddow
3dc30fd51a Remove direction from Phrase 2011-11-21 10:49:26 +00:00
Kenneth Heafield
f15eee0abf Jam: Clean up boost library handling, assimilate mert 2011-11-18 11:27:57 -05:00
Kenneth Heafield
a5dea02f18 Merge branch 'master' of git@github.com:moses-smt/mosesdecoder 2011-11-18 10:41:06 -05:00
Kenneth Heafield
7a5a95009b Rename RandLM to Rand, avoiding a self-conflict for header names. Reduce header pollution. Add Jam support for RandLM. 2011-11-18 10:40:56 -05:00
Hieu Hoang
ce0065ff2a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-18 22:13:46 +07:00
Kenneth Heafield
a82c3ee347 Fix --without-trace, add synlm compilation 2011-11-18 15:07:59 +00:00
Kenneth Heafield
5c9b28c55a Introducing Jamfiles
Currently supports kenlm, irstlm, and srilm options.

bjam [--with-srilm=/path/to/sri] [--with-irstlm=/path/to/irst] -j8
Places binaries in dist/ that pass regression tests.
2011-11-18 14:37:01 +00:00
Hieu Hoang
caac64a33b xcode 2011-11-18 21:33:58 +07:00
Kenneth Heafield
380b6c7197 KenLM compilation macro cleanup 2011-11-18 14:16:07 +00:00
Kenneth Heafield
8614d8f566 Reduce header pollution 2011-11-18 14:10:15 +00:00
Kenneth Heafield
ca8653a999 Reduce SRI header pollution 2011-11-18 13:40:20 +00:00
Kenneth Heafield
bf78f7a1ac Replace assert with CHECK until people learn how to use assert properly 2011-11-18 12:07:41 +00:00
Kenneth Heafield
1192e6f2b0 Move language model ifdefs to Factory.cpp 2011-11-18 11:31:07 +00:00
Kenneth Heafield
d2033a0579 More source code that shouldn't be executable 2011-11-17 19:34:18 -05:00
Kenneth Heafield
72a4c8a0d3 Move kenlm up one level, simplify compilation 2011-11-17 12:49:55 +00:00
Arianna Bisazza
07a8558c02 slightly changed description of new parameter (-xb) 2011-11-16 13:53:10 +01:00
Arianna Bisazza
afbbfaacd4 xml-like markup symbols are now configurable 2011-11-16 13:38:22 +01:00
Arianna Bisazza
0593a3bf4c my first commit, affects 1 file 2011-11-16 11:22:29 +01:00
bhaddow
4bb9ecb8eb Fix compile error 2011-11-14 16:45:36 +00:00
Hieu Hoang
30d669750a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-14 19:02:07 +07:00
Hieu Hoang
253f32a2e5 load hiero format for reading suffix arrays 2011-11-14 00:14:40 +07:00
Kenneth Heafield
ce90c8716b Use GetId instead of pointers in log 2011-11-12 18:31:56 +00:00
Hieu Hoang
d97cf2d9a5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-11 22:25:54 +00:00
Hieu Hoang
87500bc93d visual studio 2011-11-11 22:24:25 +00:00
Hieu Hoang
7da1af411c xcode build 2011-11-11 20:55:55 +07:00
Phil Williams
9903a239ea Assume HAVE_BOOST 2011-11-08 15:43:58 +00:00
Phil Williams
aa46d2eca0 moses_chart: speed up n-best list generation by deferring creation of
ChartTrellisPath objects until a detour is selected.  The output
should be unchanged except in the case of ties and rounding differences
in score calculations.

This doesn't make much difference at n = 100 but helps for larger lists:
example real times for decoding the first 100 sentences of the
new-test2008 tuning set with four threads:

  n            before       after
  1         4m32.955s   4m28.584s
  100       4m42.375s   4m36.311s
  1500     13m17.681s   4m34.807s

And with the 'distinct' option:

               before       after
  1         4m36.656s   4m32.883s
  100      11m04.236s   4m35.221s
  1500    129m21.593s   5m06.320s
2011-11-08 11:28:02 +00:00
Hieu Hoang
ae5e39fa86 delete premature lattice for scfg 2011-11-07 20:45:05 +07:00
Hieu Hoang
e0016712be Merge github.com:hieuhoang/mosesdecoder 2011-11-07 20:23:52 +07:00
Hieu Hoang
dbba840e10 Merge github.com:moses-smt/mosesdecoder 2011-11-07 20:18:47 +07:00
Hieu Hoang
0548a0ec3c load hiero format for reading suffix arrays 2011-11-06 20:55:57 +07:00
Hieu Hoang
24f7065826 load hiero format for reading suffix arrays 2011-11-06 20:46:46 +07:00
Hieu Hoang
bb2385657e load hiero format for reading suffix arrays 2011-11-06 16:08:37 +07:00