Commit Graph

312 Commits

Author SHA1 Message Date
Matthias Huck
9fd0486815 score-main: Seems like the list container is causing substantial efficiency issues.
Phrase scoring apparently takes hours longer in some cases. Switch back to vector.
2015-08-29 04:48:09 +01:00
Hieu Hoang
e0d2af268c eclipse 2015-08-11 13:10:38 +04:00
U-DESKTOP-ONHNTIV\hieuh
626a53e7df compile error on 4.9.3 on cygwin 2015-08-05 18:15:09 +01:00
MosesAdmin
b64af59af6 daily automatic beautifier 2015-07-25 00:00:40 +01:00
Matthias Huck
21aaec0105 Removed some duplicate code.
Can we move all or parts of moses/Util to util/, and
from the Moses namespace to the util namespace?

There's quite some common functionality in it that is not only relevant
to the decoder, but also to phrase extraction and possibly other parts
of the toolkit.
2015-07-24 21:01:13 +01:00
Matthias Huck
472529ade8 Moses::Scan too inefficient 2015-07-24 20:43:29 +01:00
Matthias Huck
9e31bced9a MinCount parameter in score-main 2015-07-24 19:42:15 +01:00
Philipp Koehn
93238fa319 directly write gzipped file 2015-07-20 11:46:07 -04:00
Phil Williams
c1142741a1 relax-parse: write node attributes to output 2015-07-17 14:11:56 +01:00
Jeroen Vermeulen
0ca2bcb28d End line after printing progress dots to stderr. 2015-07-16 15:51:16 +07:00
Phil Williams
e7228ec9fb extract-ghkm: minor refactoring 2015-07-06 14:41:34 +01:00
Phil Williams
44372d7787 extract-ghkm: fix a couple of exception-related issues 2015-07-06 12:05:41 +01:00
hieu
81f337bcd8 rollback c++11 for now 2015-07-01 09:42:07 +04:00
MosesAdmin
fba4a3e24d daily automatic beautifier 2015-06-29 00:00:54 +01:00
Hieu Hoang
f7c3d00824 more testing of c++11 waters 2015-06-28 22:20:42 +04:00
Phil Williams
90470e878d Fix some C++11-related compilation errors (clang) 2015-06-19 15:58:14 +01:00
MosesAdmin
f29f67710e daily automatic beautifier 2015-06-18 00:00:39 +01:00
Hieu Hoang
7031992caa use c++11 unordered set code 2015-06-17 11:42:46 +04:00
Hieu Hoang
80f0f71d03 Revert "1st casualty of c++11. clang 2.6 (latest c++ compiler on osx) doesn't support list of object init"
This reverts commit 42c5424c86.
2015-06-17 11:25:27 +04:00
Hieu Hoang
42c5424c86 1st casualty of c++11. clang 2.6 (latest c++ compiler on osx) doesn't support list of object init 2015-06-17 10:58:47 +04:00
MosesAdmin
2a798c0b9f daily automatic beautifier 2015-06-17 00:00:42 +01:00
Rico Sennrich
6c0f875385 testing the waters for c++11
please adjust your compiler options or complain if you rely on a compiler that doesn't support c++11 yet.
2015-06-16 16:43:03 +01:00
MosesAdmin
89c2df558c daily automatic beautifier 2015-06-14 00:00:44 +01:00
Jeroen Vermeulen
bd86ceffbe Check for error when opening gzfilebuf.
This replaces a segfault when a file can't be found with an exception.
Not as helpful as it could be yet, but certainly better than just
crashing.

Also, make InputFileStream constructor from path "explicit" to avoid
mistakes.
2015-06-13 21:31:53 +07:00
MosesAdmin
47c793ca46 daily automatic beautifier 2015-06-10 00:00:40 +01:00
Phil Williams
fa51da28c5 moses/phrase-extract refactoring
Final commit in this round of refactoring (which started with commit
2f735998...).  The main changes are:

  - a general storage mechanism for attribute/value pairs in XML-style
    tree / lattice input.  E.g. the "pcfg-score" and "semantic-role"
    attributes in:

     <tree label="PRP" pcfg-score="1.0" semantic-role="AGENT"> I </tree>

  - consolidation of the various near-duplicate Tree / XmlTreeParser classes
    that have accumulated over the years (my fault)

  - miscellaneous de-crufting
2015-06-09 16:50:27 +01:00
Phil Williams
c6a3d8e54a Ongoing moses/phrase-extract refactoring 2015-06-04 16:54:31 +01:00
Phil Williams
f6ddc45224 Ongoing moses/phrase-extract refactoring 2015-06-04 14:36:39 +01:00
MosesAdmin
5696a59ae4 daily automatic beautifier 2015-06-04 13:41:46 +01:00
Phil Williams
8653bd8159 Ongoing moses/phrase-extract refactoring 2015-06-03 14:20:00 +01:00
Phil Williams
9097fd8965 Ongoing moses/phrase-extract refactoring 2015-06-03 14:09:49 +01:00
Phil Williams
ed321791a7 Ongoing moses/phrase-extract refactoring 2015-06-03 11:10:45 +01:00
Phil Williams
5e09d3dc71 Ongoing moses/phrase-extract refactoring 2015-06-03 10:33:46 +01:00
Phil Williams
2e21f051f2 Ongoing moses/phrase-extract refactoring 2015-06-03 10:05:36 +01:00
Phil Williams
6bea23357c Ongoing moses/phrase-extract refactoring 2015-06-03 09:28:38 +01:00
Phil Williams
2f04d4a56e Ongoing moses/phrase-extract refactoring 2015-06-02 15:23:41 +01:00
Phil Williams
5ece895ab4 Ongoing moses/phrase-extract refactoring 2015-06-02 14:00:56 +01:00
Phil Williams
0c61970ac7 Ongoing moses/phrase-extract refactoring 2015-06-02 13:56:03 +01:00
Phil Williams
d3fb4a8002 Ongoing moses/phrase-extract refactoring 2015-06-02 10:16:42 +01:00
Jeroen Vermeulen
0981d23705 Lint-fixing binge. 2015-06-02 16:02:39 +07:00
Phil Williams
8a9505d72f Ongoing moses/phrase-extract refactoring 2015-06-01 16:54:12 +01:00
Phil Williams
f37415a259 Ongoing moses/phrase-extract refactoring 2015-06-01 16:40:35 +01:00
Phil Williams
f61091e38d Ongoing moses/phrase-extract refactoring 2015-06-01 14:23:25 +01:00
Phil Williams
bf42fa058c Add LeafIterator and ConstLeafIterator to MosesTraining::Syntax::Tree 2015-06-01 11:01:00 +01:00
Phil Williams
f3ccd68bee Add ConstPreOrderIterator to MosesTraining::Syntax::Tree 2015-06-01 10:35:50 +01:00
Phil Williams
c754aef37a Oops. Fix compile error. 2015-06-01 08:45:04 +01:00
Phil Williams
985e7bbfc3 Ongoing moses/phrase-extract refactoring 2015-05-29 20:57:25 +01:00
Phil Williams
2f735998ca Rename MosesTraining::SyntaxTree to MosesTraining::SyntaxNodeCollection
This is the first step in a small-scale refactoring effort that will touch a
lot of the syntax-related code in moses/phrase-extract.  The end goals are:

  - a storage mechanism for general attribute/value pairs in XML-style
    tree / lattice input.  E.g. the "pcfg-score" and "semantic-role"
    attributes in:

     <tree label="PRP" pcfg-score="1.0" semantic-role="AGENT"> I </tree>

  - consolidation of the various near-duplicate Tree / XmlTreeParser classes
    that have accumulated over the years (my fault)

  - general de-crufting
2015-05-29 18:46:02 +01:00
Jeroen Vermeulen
ea9b097aba OutputFileStream: accept ‘-’ for “stdout”.
This is a common convention: when a program gets a dash as the path of a
file that it should write, it writes to standard output instead.

Enhances portability to systems that don't have /dev/stdout.
2015-05-26 15:06:04 +07:00
Jeroen Vermeulen
a25193cc5d Fix a lot of lint, mostly trailing whitespace.
This is lint reported by the new lint-checking functionality in beautify.py.
(We can change to a different lint checker if we have a better one, but it
would probably still flag these same problems.)

Lint checking can help a lot, but only if we get the lint under control.
2015-05-17 20:04:04 +07:00