moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 05:55:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
2b19b71095
mosesdecoder/lm/builder
History
Kenneth Heafield 14e02978fc KenLM 5cc905bc2d214efa7de2db56a9a672b749a95591 
Avoid unspecified behavior of mmap when a file is resized reported by Christian Hardmeier
Fixes for Mavericks and a workaround for Boost's broken semaphore
Clean clang compile (of kenlm)

Merged some of 744376b3fb but also undid some of it because it was just masking a fundaemntal problem with pread rather than working around windows limitations
2014-01-27 16:51:35 -08:00
..
adjust_counts_test.cc KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
adjust_counts.cc KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
adjust_counts.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
corpus_count_test.cc KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
corpus_count.cc KenLM 5cc905bc2d214efa7de2db56a9a672b749a95591 2014-01-27 16:51:35 -08:00
corpus_count.hh KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
discount.hh KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST 2013-01-22 20:23:35 +00:00
header_info.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
initial_probabilities.cc KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
initial_probabilities.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
interpolate.cc KenLM 5cc905bc2d214efa7de2db56a9a672b749a95591 2014-01-27 16:51:35 -08:00
interpolate.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
Jamfile Compiler warnings, rename to ${binary}_main.cc 2013-01-20 13:43:19 +00:00
joint_order.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
lmplz_main.cc KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
multi_stream.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
ngram_stream.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
ngram.hh KenLM 6b4a1c7940a36026de1d96693ccb6ec0f16de8dc 2013-06-24 16:05:47 +01:00
pipeline.cc KenLM 85c82bd, revamp Moses timer to have more precision 2014-01-01 13:19:06 -08:00
pipeline.hh KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash 2013-05-19 10:12:06 -04:00
print.cc KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash 2013-05-19 10:12:06 -04:00
print.hh KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash 2013-05-19 10:12:06 -04:00
README.md KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
sort.hh KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
TODO KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00

README.md

Dependencies

Boost >= 1.42.0 is required.

For Ubuntu,

sudo apt-get install libboost1.48-all-dev

Alternatively, you can download, compile, and install it yourself:

wget http://sourceforge.net/projects/boost/files/boost/1.52.0/boost_1_52_0.tar.gz/download -O boost_1_52_0.tar.gz
tar -xvzf boost_1_52_0.tar.gz
cd boost_1_52_0
./bootstrap.sh
./b2
sudo ./b2 install

Local install options (in a user-space prefix directory) are also possible. See http://www.boost.org/doc/libs/1_52_0/doc/html/bbv2/installation.html.

Building

bjam

Your distribution might package bjam and boost-build separately from Boost. Both are required.

Usage

Run

$ bin/lmplz

to see command line arguments

Running

bin/lmplz -o 5 <text >text.arpa