mosesdecoder/lm/builder
2016-01-12 23:39:27 +00:00
..
adjust_counts_test.cc KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9. 2015-05-19 15:27:30 -04:00
adjust_counts.cc KenLM e06ec4dc59f765482d7545b3cb797b8fc128ab9f 2016-01-12 23:39:27 +00:00
adjust_counts.hh Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
CMakeLists.txt KenLM e06ec4dc59f765482d7545b3cb797b8fc128ab9f 2016-01-12 23:39:27 +00:00
combine_counts.hh KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9. 2015-05-19 15:27:30 -04:00
corpus_count_test.cc KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
corpus_count.cc KenLM a590a3a4dadf516a1cff28c8f1c06aa89766f519 including StringStream 2015-09-29 16:58:02 +01:00
corpus_count.hh Remove trailing whitespace in C++ files. 2015-04-30 12:05:11 +07:00
debug_print.hh KenLM a590a3a4dadf516a1cff28c8f1c06aa89766f519 including StringStream 2015-09-29 16:58:02 +01:00
discount.hh KenLM 5a7efd8fe1db88ee0a9f7e9479b24ac3ca348221 with Hieu's patch to exception.hh 2014-06-02 10:29:40 -07:00
dump_counts_main.cc KenLM a590a3a4dadf516a1cff28c8f1c06aa89766f519 including StringStream 2015-09-29 16:58:02 +01:00
hash_gamma.hh KenLM 5a7efd8fe1db88ee0a9f7e9479b24ac3ca348221 with Hieu's patch to exception.hh 2014-06-02 10:29:40 -07:00
header_info.hh KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
initial_probabilities.cc KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
initial_probabilities.hh KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
interpolate.cc KenLM a590a3a4dadf516a1cff28c8f1c06aa89766f519 including StringStream 2015-09-29 16:58:02 +01:00
interpolate.hh KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
Jamfile KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9. 2015-05-19 15:27:30 -04:00
lmplz_main.cc KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
output.cc KenLM a590a3a4dadf516a1cff28c8f1c06aa89766f519 including StringStream 2015-09-29 16:58:02 +01:00
output.hh KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
payload.hh KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9. 2015-05-19 15:27:30 -04:00
pipeline.cc Update kenlm 2015-09-10 16:04:09 +01:00
pipeline.hh KenLM 2a3e8fae3633c890cb3b342d461f9130c8e343fa excluding unfinished interpolation directory 2015-08-27 10:55:52 +01:00
README.md KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
TODO KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00

Dependencies

Boost >= 1.42.0 is required.

For Ubuntu,

sudo apt-get install libboost1.48-all-dev

Alternatively, you can download, compile, and install it yourself:

wget http://sourceforge.net/projects/boost/files/boost/1.52.0/boost_1_52_0.tar.gz/download -O boost_1_52_0.tar.gz
tar -xvzf boost_1_52_0.tar.gz
cd boost_1_52_0
./bootstrap.sh
./b2
sudo ./b2 install

Local install options (in a user-space prefix directory) are also possible. See http://www.boost.org/doc/libs/1_52_0/doc/html/bbv2/installation.html.

Building

bjam

Your distribution might package bjam and boost-build separately from Boost. Both are required.

Usage

Run

$ bin/lmplz

to see command line arguments

Running

bin/lmplz -o 5 <text >text.arpa