moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-09-20 23:58:15 +03:00
Code Issues Packages Projects Releases Wiki Activity
2,317 Commits 136 Branches 26 Tags 147 MiB
79142d18e6
Commit Graph

52 Commits

Author SHA1 Message Date
oliver-wilson
c8bf9bec0c Add autoconf bits for DMapLM. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4054 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-30 15:47:55 +00:00
leven101
4ea818f34a Added wrapper files for online randomised LM prototype 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4002 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-08 15:05:19 +00:00
dowobeha
9112d9b749 Syntactic LM doesn't require boost. Enabling synlm no longer automatically enables boost or boost threads. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3995 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 16:35:42 +00:00
dowobeha
a040227376 Syntactic LM can now be enabled by passing --with-synlm to configure. The path to the ModelBlocks parser is now assumed to be synlm/hhmm, and no longer needs to be explicitly specified. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3994 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 15:48:28 +00:00
bhaddow
b5c14a88c2 Second try at fixing configure bug introduced with synlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3990 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-23 20:17:46 +00:00
bhaddow
77c0228c54 Make sure threaded moses is only on if --enable-threads is set. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3989 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-23 19:47:19 +00:00
dowobeha
9581b6aae2 Updated syntactic classes (cherry-picking from commit bf7a7bb8e7) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3973 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 19:28:23 +00:00
dowobeha
9375aa8846 Reverting changes. Revision 3971 was a bad commit. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3972 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 18:27:30 +00:00
dowobeha
bb941c01f6 Merge branch 'master' into local-trunk 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3971 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 18:07:21 +00:00
phkoehn
1cbe245919 re-organized syntax code for clarity - part I 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3924 1f5c12ca-751b-0410-a591-d2e778427230
 2011-03-11 13:08:43 +00:00
pjwilliams
d4359f9875 If Boost is available, use per-sentence object pools to allocate ProcessedRule 
and WordConsumed objects (which are used to store rule table lookup state).
Large numbers of these objects are used during decoding and this can
significantly improve performance, especially for multithreaded decoding,
though at the cost of increased total memory use.

The ./configure option --disable-boost-pool can be used to disable this
feature if memory is tight.  This currently only affects moses_chart with
in-memory rule tables.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3873 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-07 15:43:19 +00:00
pjwilliams
93b0a15a2d Add --with-tcmalloc option to ./configure to enable linking against Google's 
TCMalloc library.  Currently assumes tcmalloc is installed in a standard
system directory.



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3865 1f5c12ca-751b-0410-a591-d2e778427230
 2011-02-02 20:06:52 +00:00
bhaddow
a9cd71628a Change of boost macros - please make sure you favourite configuration still works 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3799 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-13 23:38:48 +00:00
heafield
a596b48971 Fix --enable-shared compilation. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3796 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-11 19:32:59 +00:00
heafield
2784923899 Rename a bunch of kenlm files. A ./regenerate-makefiles.sh is required. 
Make loading with MAP_POPULATE on Linux and read on other OSes the default.
Use LM #9 for lazy loading, as recommended by other devs.  
Slightly faster trie.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3688 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-06 00:40:16 +00:00
heafield
614d6002a6 Integrate heafield-refactorlm. Faster kenlm with new binary format. Stateful language model 
framework.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3671 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-27 17:50:40 +00:00
nicolabertoldi
bb08dcb5b6 made code compliant with the enhanced IRSTLM library; IRSTLM release 5.50.01 is needed; back compatibility is not assured; 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3662 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-26 16:06:01 +00:00
pjwilliams
687ddf2d10 Bump the minimum Boost version to 1.36 to get functional/hash. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3597 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:27:20 +00:00
pjwilliams
79a61c5526 Add --enable-boost option to ./configure to allow the Boost library to be used 
in Moses (if not already required by --enable-threads).  This is off by default.
The --with-boost option can only be used if --enable-boost or --enable-threads
is given, since the AX_BOOST_BASE macro is only conditionally called.  This is
to avoid making Boost a requirement by default, but is a bit clunky.  Probably
easy to fix if your Autotools knowledge exceeds nowt...



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3595 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-30 21:07:01 +00:00
heafield
193109e200 Link kenlm by default (it was already being built). Allow --without-kenlm to avoid linking. Add myself to the build instructions. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3588 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 18:02:08 +00:00
heafield
770df2a92d Unbodge kenlm by moving compilation to kenlm/ instead of kenlm/lm. Changing the headers every 
time I copied to Moses was getting annoying.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3587 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-28 16:26:55 +00:00
heafield
cac7600662 Make --with-kenlm=$PWD/kenlm compile mine instead of IRST. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3574 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-27 15:07:28 +00:00
hieuhoang1972
989eb55449 ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3544 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-21 23:10:15 +00:00
hieuhoang1972
32d3565b04 ken lm integration 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3543 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-21 22:43:29 +00:00
hieuhoang1972
0d6d78b5a9 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3308 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-08 11:42:28 +00:00
hieuhoang1972
ff89bfa724 change irstlm header & lib location 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3305 1f5c12ca-751b-0410-a591-d2e778427230
 2010-06-07 23:12:38 +00:00
rafpayen
2fc8cdbbaa better error message for srilm lib check 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3272 1f5c12ca-751b-0410-a591-d2e778427230
 2010-05-26 15:46:23 +00:00
bojar
34a0e9b3a2 support for SRILM's factored language models, implemented by Michal Richter 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3147 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-20 15:25:52 +00:00
rafpayen
baa0a9df1c Check srilm's library (machine-type is not reliable enough) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3139 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-19 14:02:48 +00:00
hieuhoang1972
c117ef7c17 Copy in changes from the chart_merge branch (doing it manually because the 
server doesn't seem to support subversion's --reintegrate option).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3078 1f5c12ca-751b-0410-a591-d2e778427230
 2010-04-08 17:16:10 +00:00
jfouet
79a8f0f133 restore trace by default 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2950 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-01 11:32:15 +00:00
jfouet
9501708565 use old macro name to enable LIBTOOL 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2947 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-25 15:36:39 +00:00
jfouet
42d1a8ab93 Disable shared library by default, use --enable-shared=yes to create libmoses.so 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2943 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 14:02:24 +00:00
jfouet
e14dc33dc8 enable trace with a configure options and fix compilation error when trace are disabled 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2938 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:37:49 +00:00
jfouet
c9af4f642d Add configurable path to zlib 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2937 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:35:18 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
jfouet
53c56df23e Add configure option to link with libsrilm.so 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2931 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:26:58 +00:00
jfouet
b72e7fa8d9 Add configure option to link with libsrilm.so 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2930 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:19:37 +00:00
bhaddow
4c85d70c85 Get rid of annoying configure warnings 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2642 1f5c12ca-751b-0410-a591-d2e778427230
 2009-12-17 15:15:43 +00:00
nicolabertoldi
36266e68c9 making configure compliant with IRSTLM configure wrt the name of platform 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2555 1f5c12ca-751b-0410-a591-d2e778427230
 2009-10-01 14:12:55 +00:00
bhaddow
c5d39f039f Merge moses-server branch (includes mt moses) into trunk. 
Plain (single-thread) moses should configure and build as before.
Multi-thread and server only available if appropriate options are selected
at configure/compile time.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2477 1f5c12ca-751b-0410-a591-d2e778427230
 2009-08-07 16:47:54 +00:00
bhaddow
1ef0f3844d Connect new mert to the moses build system 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2221 1f5c12ca-751b-0410-a591-d2e778427230
 2009-02-26 11:17:12 +00:00
bhaddow
ec68b5235f Fix minor bugs in randlm and irstlm config 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1937 1f5c12ca-751b-0410-a591-d2e778427230
 2008-11-05 18:06:14 +00:00
hieuhoang1972
a670ddddd9 configure for randlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1933 1f5c12ca-751b-0410-a591-d2e778427230
 2008-11-04 17:49:44 +00:00
redpony
232dc9889c enable moses to accept a file that lists feature name and weight pairs. 
enable moses to export its search graph as a phrase lattice encoded serialized in a Google protocol buffer. This requires protoc (http://code.google.com/p/protobuf/) to function, disabled by default.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1890 1f5c12ca-751b-0410-a591-d2e778427230
 2008-09-24 16:48:23 +00:00
nicolabertoldi
43ae535165 added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
 2008-04-02 17:08:54 +00:00
jdschroeder
3586421b6a Changed IRSTLM machine-specific library path to use uname -m, matches with latest IRSTLM install code 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1411 1f5c12ca-751b-0410-a591-d2e778427230
 2007-06-01 13:37:10 +00:00
nicolabertoldi
f77cda45c4 Removed irstlm stuff 
Modified instructions
Changed configure.in to load a machine-dependent irstlm library


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1395 1f5c12ca-751b-0410-a591-d2e778427230
 2007-05-22 15:40:56 +00:00
redpony
4906e9b4f1 update to use both irstlm and srilm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@964 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-08 18:49:47 +00:00
redpony
1e7a253a43 Building misc/ along with the rest of the suite. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@815 1f5c12ca-751b-0410-a591-d2e778427230
 2006-09-15 21:32:48 +00:00