moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,030 Commits 136 Branches 26 Tags 147 MiB
08c57bce87
Commit Graph

13030 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
XapaJIaMnu
7b00ca1115 BilingualLM FF, compiles, untested. 2014-11-13 15:50:06 +00:00
XapaJIaMnu
37abe3f14a nearly done, compiles, untested 2014-11-13 15:50:06 +00:00
XapaJIaMnu
0af522e512 Getting source and target words, compiling 2014-11-13 15:50:06 +00:00
XapaJIaMnu
d1d38b4aa8 Started implementing evaluate when applied 2014-11-13 15:50:06 +00:00
XapaJIaMnu
b2b1d352d4 Don't do anything if we don't have enough ngrams 2014-11-13 15:50:06 +00:00
XapaJIaMnu
85db12549c EvaluateWithSource compiles 2014-11-13 15:50:06 +00:00
XapaJIaMnu
16eecbd35f Add scores for target side 2014-11-13 15:50:06 +00:00
XapaJIaMnu
598f4c194d Some neural integration 2014-11-13 15:50:06 +00:00
XapaJIaMnu
8f0ce75c33 my bad 2014-11-13 15:50:06 +00:00
XapaJIaMnu
683783d519 Compiles 2014-11-13 15:50:06 +00:00
XapaJIaMnu
4bea830188 doesn't work 2014-11-13 15:50:05 +00:00
Hieu Hoang
a7abd02fc6 add Bilingual LM class 2014-11-13 15:50:05 +00:00
Hieu Hoang
6dda0d19cf add Bilingual LM class 2014-11-13 15:50:05 +00:00
Rico Sennrich
00c35fb565 fix LMOOVFeature and implement it for NeuralLMWrapper 2014-11-13 10:36:26 +00:00
Matthias Huck
0fd987a8c6 avoid necessity of masking "{{" in the data 2014-11-12 18:28:59 +00:00
Paul Baltescu
d4b76d3945 Allow unnormalized scores in oxlm. 2014-11-12 15:19:45 +00:00
Phil Williams
a5d803ee14 extract-ghkm: add -T2S option 2014-11-12 14:03:24 +00:00
Hieu Hoang
28caa93d43 eclipse 2014-11-10 18:18:49 +00:00
Phil Williams
33677ab862 Minor clean-up. 2014-11-10 16:54:14 +00:00
Hieu Hoang
ad1d5ade7a softlink moses -> moses_chart for backward compatibility 2014-11-08 19:31:38 +00:00
Hieu Hoang
8d15287eee added phil's functions 2014-11-08 17:36:32 +00:00
Hieu Hoang
4687c1cc2b softlink moses -> moses_chart for backward compatibility 2014-11-08 17:16:22 +00:00
Hieu Hoang
18d2d56cc7 added phil's functions 2014-11-07 19:51:18 +00:00
XapaJIaMnu
ca06d05b66 BilingualNPLM requries specific source and target vocabulary lists 2014-11-07 15:28:49 +00:00
Hieu Hoang
e1092c0dad merge 2014-11-07 14:35:36 +00:00
XapaJIaMnu
6780f4e7f5 Training: Do the preparation step ourselves. No validation support yet. No decoder support yet. 2014-11-06 19:44:22 +00:00
Rico Sennrich
3dbf2b556b floor score of bilingualNPLM 2014-11-06 14:34:05 +00:00
Phil Williams
59a1ce7380 substitute-filtered-tables.perl: check for RuleTable feature 2014-11-06 11:14:51 +00:00
XapaJIaMnu
43a036351c moses/LM/BilingualLM.cpp 2014-11-05 16:08:34 +00:00
Hieu Hoang
1615d56b69 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-05 13:06:49 +00:00
Hieu Hoang
c8e49177a6 race condition in moses server 2014-11-05 13:06:33 +00:00
Ulrich Germann
2a05c79aa3 Merge pull request #81 from ljkieras/mm2dTable-open-readonly 
mm2dTable now opens its data file read-only, using mapped_file_source, s...
 2014-11-05 01:24:05 +00:00
Laura Kieras
ecae85e9a8 mm2dTable now opens its data file read-only, using mapped_file_source, so that we don't need write permissions on the file 2014-11-04 16:30:46 -05:00
Hieu Hoang
832fba09c8 eclipse 2014-11-04 15:04:26 +00:00
Rico Sennrich
ae8b9cbfef glue grammar: alignment for <s> and </s> 2014-11-04 14:05:13 +00:00
Phil Williams
5240c430ce Merge s2t branch 
This adds a new string-to-tree decoder, which can be enabled with the -s2t
option.  It's intended to be faster and simpler than the generic chart
decoder, and is designed to support lattice input (still WIP).  For a en-de
system trained on WMT14 data, it's approximately 40% faster in practice.

For background information, see the decoding section of the EMNLP tutorial
on syntax-based MT:

  http://www.emnlp2014.org/tutorials/5_notes.pdf

Some features are not implemented yet, including support for internal tree
structure and soft source-syntactic constraints.
 2014-11-04 13:13:56 +00:00
Rico Sennrich
e0b3105fc0 write tree fragment string, not pointer 2014-11-04 10:54:31 +00:00
Rico Sennrich
6fbcac2421 add EOS token </s> to each sentence 2014-11-04 10:22:29 +00:00
Rico Sennrich
7d2d2632a0 sort vocab by frequency 2014-11-04 10:21:19 +00:00
mjdenkowski
40e8f2eca0 Hypergraph output 2014-11-03 09:16:12 -05:00
Hieu Hoang
c9a8238474 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-10-31 16:41:32 +00:00
Hieu Hoang
545ffd6f37 test 2014-10-31 16:41:20 +00:00
Kenneth Heafield
fb30446210 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-10-31 12:27:26 -04:00
Kenneth Heafield
f4c6aee6ce Test libraries for dynamic/static instead of testing whole executable 
Rationale: some systems are missing static glibc but have static boost.  This will detect and link against static Boost on those systems.
 2014-10-31 12:22:32 -04:00
Hieu Hoang
7ca5e4fbc8 blame stats! 2014-10-31 01:07:33 +00:00
Nikolay Bogoychev
35a007e232 Merge branch 'master' into bilingual-lm 2014-10-27 11:56:56 +00:00
Ulrich Germann
07202c544c Added ptable-describe-features to list features used by PhraseDictionaryBitextSampling. 2014-10-25 12:06:38 -07:00
Ulrich Germann
44215b79c0 Added ptable-describe-features to list features used by PhraseDictionaryBitextSampling. 2014-10-25 12:06:24 -07:00
Hieu Hoang
834a89d96b utf8 encoding /Tomas Fulajtar 2014-10-24 07:33:48 -07:00
Marcin Junczys-Dowmunt
3d8526d72c merged in from wipoNew 2014-10-24 10:45:52 +02:00