Commit Graph

14102 Commits

Author SHA1 Message Date
Ulrich Germann
5cb1d95e09 Added member function for retrieving nbest list items without sorting. 2015-06-05 16:21:09 +01:00
Ulrich Germann
5a56a5b496 Added target for forced relinking only (no forced recompilation); temporarily disabled tcmalloc. 2015-06-05 16:20:08 +01:00
Ulrich Germann
83fa1b6a88 Initial check-in. 2015-06-03 12:59:32 +01:00
Ulrich Germann
0afe139810 Initial check-in. 2015-06-03 12:55:58 +01:00
Ulrich Germann
debdd21899 Optional initialization of SentenceBias. 2015-06-03 12:53:38 +01:00
Ulrich Germann
f024eede74 Added ca() as short replacement for approxOccurrenceCount() to tsa_tree_iterator. 2015-06-03 12:51:44 +01:00
Ulrich Germann
d62d2dc95f Bug fix. 2015-06-01 23:10:50 +01:00
Ulrich Germann
63870f3e7a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-06-01 18:56:17 +01:00
Ulrich Germann
aa4eed93d5 Bug fix related to getting rid of using namespace std; . 2015-06-01 18:55:40 +01:00
Ulrich Germann
cc800742b1 Updated Makefile for local compiles. 2015-06-01 18:26:27 +01:00
Ulrich Germann
99896cfd2c Untangling bitext class from Moses dependencies, so that the class can be used
independently of Moses again.
2015-06-01 18:25:04 +01:00
Ulrich Germann
349163f3fd Bug fix and in-line code documentation. 2015-06-01 18:21:52 +01:00
Ulrich Germann
25f98a446e Bug fix in building imTtrack directly from input stream. 2015-06-01 18:19:34 +01:00
Phil Williams
8a9505d72f Ongoing moses/phrase-extract refactoring 2015-06-01 16:54:12 +01:00
Phil Williams
f37415a259 Ongoing moses/phrase-extract refactoring 2015-06-01 16:40:35 +01:00
Phil Williams
f61091e38d Ongoing moses/phrase-extract refactoring 2015-06-01 14:23:25 +01:00
Phil Williams
bf42fa058c Add LeafIterator and ConstLeafIterator to MosesTraining::Syntax::Tree 2015-06-01 11:01:00 +01:00
Phil Williams
f3ccd68bee Add ConstPreOrderIterator to MosesTraining::Syntax::Tree 2015-06-01 10:35:50 +01:00
Phil Williams
c754aef37a Oops. Fix compile error. 2015-06-01 08:45:04 +01:00
Hieu Hoang
afb032014d skip perltidy. Not available on thor (Ubuntu 12.04) 2015-05-31 21:51:43 +04:00
Hieu Hoang
559cc4dac0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-31 21:28:10 +04:00
Hieu Hoang
ab9b9ae349 1st pass to automatically beautify 2015-05-31 21:27:55 +04:00
Phil Williams
985e7bbfc3 Ongoing moses/phrase-extract refactoring 2015-05-29 20:57:25 +01:00
Phil Williams
2f735998ca Rename MosesTraining::SyntaxTree to MosesTraining::SyntaxNodeCollection
This is the first step in a small-scale refactoring effort that will touch a
lot of the syntax-related code in moses/phrase-extract.  The end goals are:

  - a storage mechanism for general attribute/value pairs in XML-style
    tree / lattice input.  E.g. the "pcfg-score" and "semantic-role"
    attributes in:

     <tree label="PRP" pcfg-score="1.0" semantic-role="AGENT"> I </tree>

  - consolidation of the various near-duplicate Tree / XmlTreeParser classes
    that have accumulated over the years (my fault)

  - general de-crufting
2015-05-29 18:46:02 +01:00
Rico Sennrich
5d8af9c289 support memory-mapped files for NPLM training 2015-05-29 16:07:26 +01:00
Jeroen Vermeulen
ef028446f3 Add license notices to scripts.
This is not pleasant to read (and much, much less pleasant to write!) but
sort of necessary in an open project.  Right now it's quite hard to figure
out what is licensed how, which doesn't matter much to most people but can
suddenly become very important when people want to know what they're being
allowed to do.

I kept the notices as short as I could.  As far as I could see, everything
without a clear license notice is LGPL v2.1 or later.
2015-05-29 18:30:26 +07:00
Jeroen Vermeulen
26170a4179 Friendlier error reporting in beautify.py. 2015-05-29 09:37:37 +07:00
Barry Haddow
c27aa193ea Revert "Min score parameter". Doesn't work without filter.
This reverts commit ab2d396781.
2015-05-28 17:44:26 +01:00
Barry Haddow
ab2d396781 Min score parameter 2015-05-28 17:10:21 +01:00
Ulrich Germann
4bf6626a3d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-27 20:59:14 +01:00
Ulrich Germann
7ff1f9c063 Option bundling. 2015-05-27 20:45:55 +01:00
Phil Williams
842fc9780e senna2brackets.py: bug fixes + clean-up 2015-05-27 20:33:43 +01:00
Phil Williams
c086a8ee50 Add a wrapper script for parsing English text with SENNA 2015-05-26 16:44:13 +01:00
Jeroen Vermeulen
ea9b097aba OutputFileStream: accept ‘-’ for “stdout”.
This is a common convention: when a program gets a dash as the path of a
file that it should write, it writes to standard output instead.

Enhances portability to systems that don't have /dev/stdout.
2015-05-26 15:06:04 +07:00
Rico Sennrich
f6f56d11af ems: parse-relax comes last in train; do same for dev/test 2015-05-25 15:52:07 +01:00
Hieu Hoang
a693c83161 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-24 20:05:24 +04:00
Hieu Hoang
582a845524 don't use zcat 2015-05-24 20:04:01 +04:00
Ulrich Germann
c82ee9a4e9 Bug fix. 2015-05-24 16:44:41 +01:00
Ulrich Germann
e49ffb8efa Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-24 16:12:13 +01:00
Ulrich Germann
da052b7f2b Removed dependency on libcurlpp, as it was difficult to link that staticly. 2015-05-24 16:05:14 +01:00
Hieu Hoang
df5aff2d82 eclipse 2015-05-24 15:12:05 +01:00
Ulrich Germann
3a0cd0518d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-22 15:30:20 +00:00
Rico Sennrich
43527c82fc training script for monolingual Neural LM
(+bugfixes and usability improvements for RDLM training)
2015-05-22 15:31:08 +01:00
Rico Sennrich
a1678187fe wrapper for stanford dependency parser 2015-05-22 15:28:42 +01:00
Jeroen Vermeulen
30a03237fa List extraneous parts of the source tree. 2015-05-22 13:31:38 +07:00
Ulrich Germann
98c976bb1d Bug fix. 2015-05-21 22:17:43 +01:00
Ulrich Germann
33eee96f35 Bug fix related to context-sensitive decoding: --context-string had no effect, even when --context-window was not specified. 2015-05-21 16:36:51 +00:00
Ulrich Germann
812cbb0c8e Added missing #include in OxLM.cpp. 2015-05-21 17:28:09 +01:00
Hieu Hoang
097afb93df eclipse 2015-05-21 14:04:42 +04:00
Ulrich Germann
5807ca4714 Mert programs won't link with shared linking without -lboost_filesystem. 2015-05-21 02:56:03 +00:00