moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 05:55:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,805 Commits 136 Branches 26 Tags 147 MiB
e45c41e665
Commit Graph

13805 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Barry Haddow
e45c41e665 Testing of Viterbi decoding on hypergraph. 2015-04-17 12:29:41 +01:00
Ales Tamchyna
2180730a58 check word alignment points in VW training to avoid cryptic segfaults 2015-04-16 15:28:23 +02:00
Jeroen Vermeulen
6a4943ca41 Replace deprecated bcopy() with memcpy(). 
The bcopy() function is POSIX-specific and deprecated.  The recommended
replacement (at least for non-overlapping source and destination ranges)
is memcpy(), which is in the standard C library.

Note that the source and destination parameters are in a different order
between these two functions.
 2015-04-16 19:19:34 +07:00
Jeroen Vermeulen
21a93421dc Replace deprecated bzero() with memset(). 
The bzero() function is POSIX-specific and deprecated.  The recommended
replacement is memset(), which is in the standard C library.
 2015-04-16 19:03:57 +07:00
Hieu Hoang
e279135d78 create file stream and delete it at the end if user has specified a file for input & output 2015-04-16 00:50:54 +04:00
Hieu Hoang
54c16ee86e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-15 18:54:26 +04:00
Hieu Hoang
c544dba7ad don't use /dev/stdin and /dev/stdout. Compatibility issues with some Redhat 2015-04-15 18:53:13 +04:00
Hieu Hoang
044968bb4b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-14 11:30:33 +04:00
Hieu Hoang
7af653ac80 misc script to parallelize madamira on grid engine 2015-04-14 11:29:56 +04:00
Hieu Hoang
6162223690 add use warnings to all perl scripts 2015-04-13 20:42:33 +04:00
Phil Williams
05b31b53f2 Implement -output-unknowns for search algorithms 7 and 9 (T2S/F2S) 2015-04-13 16:31:58 +01:00
Hieu Hoang
2f7c328db9 codelite 2015-04-11 20:21:50 +04:00
Hieu Hoang
8190a5e1d6 Merge pull request #107 from flammie/master 
Finnish detokenisation
 2015-04-11 14:20:37 +04:00
Dingyuan Wang
4aba64ed53 Merge pull request #106 from gumblex/master 
Fix some problems in EMS
 2015-04-11 09:26:25 +08:00
Kenneth Heafield
d6a66d39bd Delete unused code 2015-04-10 09:36:57 -04:00
Jeroen Vermeulen
b8793fb788 Address two TODO notes in mert/evaluator.cpp. 
The notes were about two objects which were created on the free store
using "new", then cleaned up using "delete".  May have been a Java
habit; the solution was as simple as creating them on the stack.
 2015-04-10 13:25:51 +07:00
Jeroen Vermeulen
8a3ae2fd5c Portability and include fixes. 
Add <cstdlib> include for srand()/rand(), and <unistd.h> for open() etc.
Include <unistd.h> on Windows if using MinGW.  Disable MeteorScorer on
Windows, since it doesn't have fork() and pipe().
 2015-04-10 12:54:34 +07:00
Kenneth Heafield
0698da8b0f log(1 + ...) -> log1p(...) 2015-04-08 10:08:05 -04:00
Michael Denkowski
2682cc0f9b typo fix 2015-04-07 17:06:18 -04:00
Jeroen Vermeulen
464615a0c3 Fix some clang++ warnings. 
Compiling with clang++ at the default warning/error levels produces
some interesting warnings.  Here's a pair of fixes for the simplest
instances:

moses/TranslationModel/RuleTable/PhraseDictionaryFuzzyMatch.cpp:133:7:
warning: comparison of array 'path' equal to a null pointer is always
false [-Wtautological-pointer-compare]
  if (path == NULL) {
      ^~~~    ~~~~

(The code unnecessarily checks that an automatic variable has a
 non-null address).

moses/TranslationModel/DynSAInclude/onlineRLM.h:305:20:
warning: unsequenced modification and access to 'den_val' [-Wunsequenced]
  if(((den_val = query(&ngram[len - num_fnd], num_fnd - 1)) > 0) &&
               ^

(The code tries to cram too much into an "if" condition.)
 2015-04-07 22:58:17 +07:00
Flammie Pirinen
fc8ee03b8d examples 2015-04-07 16:19:07 +01:00
Flammie Pirinen
ef52bc66f6 full set of cases and caps 2015-04-07 16:16:43 +01:00
Flammie Pirinen
85230e8334 add fi to list to silence warnings 2015-04-07 16:00:48 +01:00
Flammie Pirinen
f9deb6de3b also lowercase if case fail 2015-04-07 15:55:02 +01:00
Flammie Pirinen
5817806ec7 fix detokenising : in abbrev. case suffix case 2015-04-07 15:51:29 +01:00
Hieu Hoang
54e55f2dcb better detection of pigz, sort, split. In case they are not in the default directory 2015-04-06 11:31:44 +04:00
Hieu Hoang
02185a85fb store temp run files in current directory, not /tmp 2015-04-05 17:02:48 +04:00
Hieu Hoang
93ad52d2f9 leave in runPath for debugging 2015-04-05 16:49:12 +04:00
Hieu Hoang
4cb8a1837e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-05 16:45:17 +04:00
Hieu Hoang
7ffdddef13 script to submit ems job to grid engine as 1 job. Hardcoded for NYUAD at the mo 2015-04-05 16:44:24 +04:00
Michael Denkowski
66cfd14159 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-04-03 16:50:19 -04:00
Michael Denkowski
fdf4f5f571 Consistent line ending behavior for alignment printing options 2015-04-03 16:49:41 -04:00
Dingyuan Wang
aea07b0a19 Fix some problems in EMS: 
* remove absolute links
* fix coverage bar highlighting
* change Base64 library to support UTF-8
 2015-04-03 23:47:25 +08:00
Barry Haddow
44c5ae344f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-03 15:47:22 +01:00
Barry Haddow
217f389230 Attempt at fixing sparse features for hgmira 2015-04-03 15:46:59 +01:00
Rico Sennrich
8d8097632b re-apply commit 1fb51dc (use gunzip -c instead of zcat) 
plus be more tolerant about xml input
 2015-04-03 15:00:45 +01:00
Jeroen Vermeulen
c52d7be025 Make an include path explicit. 
Better to see clearly where that header is supposed to come from, since
it lives halfway across the codebase.

I think this may also make the "classifier" dance in moses/Jamfile
unnecessary, which would be a nice simplification, but I'm not
confident enough to just make the change.
 2015-04-03 17:47:48 +07:00
Hieu Hoang
0c58e19491 uncomment out lines that clang choked on. Now works 2015-04-02 22:39:44 +04:00
Hieu Hoang
00065fee15 Merge pull request #105 from aminorex/master 
compile with clang 3.3 x86_x6, no warnings
 2015-04-02 22:29:42 +04:00
akimbal1
ad70c9a35d resolve conflicts 2015-04-02 14:15:15 -04:00
akimbal1
b4e24a2fb8 compile with clang 3.3 x86_x6, no warnings 2015-04-02 14:07:23 -04:00
Hieu Hoang
d71e516176 make it compile on osx/clang 2015-04-02 21:30:47 +04:00
Hieu Hoang
b2f9ba2b64 revert last commit to add MASTER_PATH. Not needed 2015-04-02 19:29:42 +04:00
Hieu Hoang
27b36e0c96 pass in PATH variable from master node. When you're running of a grid but really just qsubbing everything to 1 slave node 2015-04-02 19:15:21 +04:00
Hieu Hoang
2d1da3219d consistently use 'env perl' command for environments where the 1st perl in PATH isn't the default perl. Which is kinda stupid 2015-04-02 17:38:56 +04:00
Hieu Hoang
035c806059 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-02 14:10:42 +04:00
Hieu Hoang
d2137487f5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-02 14:08:19 +04:00
Hieu Hoang
e76247e19b Conditional import of Thread package for perl installations that don't support threads 2015-04-02 14:07:57 +04:00
Hieu Hoang
2dc75945e5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-04-02 09:54:38 +04:00
Hieu Hoang
f0e4f8b557 Merge pull request #103 from aminorex/master 
tokenizer improvements, faster better sentence splitter
 2015-04-02 09:49:41 +04:00