moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-10-26 19:37:58 +03:00
Code Issues Packages Projects Releases Wiki Activity
9,608 Commits 136 Branches 26 Tags 147 MiB
7dc4faa97e
Commit Graph

284 Commits

Author SHA1 Message Date
Rico Sennrich
06126ae6e2 tmcombine: ignore phrase pairs with 0 probability in optimization 2012-10-29 10:29:51 +01:00
Hieu Hoang
ff0946dd3e eclipse files 2012-10-23 17:07:28 +01:00
Hieu Hoang
87b6520d82 add moses server back in. Changed ScoreComponentCollection to expose dense feature array 2012-10-22 14:41:23 +01:00
Hieu Hoang
7a19ac861c vs project files. /Krishna Nanda 2012-10-19 17:56:45 +01:00
Hieu Hoang
cb0b94fad5 delete all mention of terminal in word alignment class 2012-10-19 16:00:42 +01:00
Hieu Hoang
fb040861f7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-18 16:20:02 +01:00
Hieu Hoang
c3229460a3 eclipse 2012-10-18 16:19:06 +01:00
Rico Sennrich
9e03090ca2 fix regression from having all 3 counts in phrase table. 2012-10-18 16:09:38 +02:00
Hieu Hoang
5bb498c922 eclipse project 2012-10-18 12:24:03 +01:00
Hieu Hoang
9f12beb881 eclipse project 2012-10-17 16:40:23 +01:00
Barry Haddow
365e680115 Merge remote-tracking branch 'origin/master' into miramerge 
NB Untested

Conflicts:
	Jamroot
	moses-chart-cmd/src/Main.cpp
	moses/src/ChartManager.cpp
	moses/src/RuleTable/LoaderStandard.cpp
	moses/src/RuleTable/PhraseDictionaryALSuffixArray.cpp
	moses/src/Word.cpp
 2012-10-15 21:35:56 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge 
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-14 14:18:03 +01:00
Kenneth Heafield
e75b51bb73 Fix more conflations, update lazy 2012-10-12 14:09:45 +01:00
Hieu Hoang
2b32a29199 enable threading 2012-10-09 14:10:04 +01:00
Hieu Hoang
78e5884dd7 enable threading 2012-10-09 14:01:41 +01:00
Hieu Hoang
1c73dd1605 mkdtemp template must be have 6 'X' in Linux 2012-10-09 12:06:14 +01:00
Hieu Hoang
f0b6ff1094 if don't find best match, pick the 1st 2012-10-08 21:42:16 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge 
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
 2012-10-08 17:54:59 +01:00
Hieu Hoang
8076866728 xcode 2012-10-08 17:45:29 +01:00
Hieu Hoang
90e87bb8f9 eclipse project files 2012-10-05 17:28:43 +01:00
Hieu Hoang
83374e2810 eclipse project files 2012-10-05 17:17:27 +01:00
Hieu Hoang
9ae55243e2 remove dependency on boost filesystem object 2012-10-04 15:08:22 +01:00
Wilker Aziz
7f5b6b2310 better doc 2012-10-03 20:04:48 +02:00
wlin12
f92d63c9a2 input type bug fix 2012-10-02 18:54:51 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge 
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
 2012-09-26 22:49:33 +01:00
Hieu Hoang
a9c890e55e rename CTO to CTOs 2012-09-25 17:34:43 +01:00
Hieu Hoang
bd90816716 delete ChartTranslationOptionCollection. Roll everything into manager 2012-09-25 17:08:38 +01:00
Kenneth Heafield
15b0ae1aef Single-threaded compilation fixes 2012-09-21 18:34:48 -04:00
Jacob Dlougach
b1c702afab XCode project files update 2012-09-21 16:16:10 +04:00
Wilker Aziz
ab191b562e query results can now be sorted and pruned 2012-09-18 11:39:39 +02:00
Arianna Bisazza
be5678afb7 combine-ptables: Implementation of fillup and other operations of translation and reordering models combination 2012-09-18 11:06:50 +02:00
Wilker Aziz
f6e3eff8d9 signatures changed to cpp strings 2012-09-14 15:35:05 +02:00
Wilker Aziz
c300705772 i) check for invalid paths; ii) added sample data; iii) added --with-cmph in setup.py 2012-09-14 12:51:31 +02:00
Wilker Aziz
629805a90a Added an option to use/not use cmph and details about building/compiling in README 2012-09-14 11:59:18 +02:00
Wilker Aziz
8a2309b75b Customized delimiter + properties added to BinayPhraseTable 2012-09-12 11:46:43 +02:00
Wilker Aziz
92295911b1 Renaming python PhaseTable to BinaryPhaseTable + better docs 2012-09-12 11:05:28 +02:00
Wilker Aziz
85dd58fed3 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-09-12 00:50:31 +02:00
Wilker Aziz
2ad634dd88 Better setup.py + python tree moved under contrib/ 2012-09-12 00:48:43 +02:00
Marcin Junczys-Dowmunt
3f5dcf4d06 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-09-11 16:13:03 +02:00
junczys
bac859c451 Fix locking in AlignmentInfoCollection.* 2012-09-11 16:06:05 +02:00
Rico Sennrich
0f3de74934 possible fix for tmcombine for models without alignment info 2012-09-11 14:33:30 +02:00
wlin12
dca9d8952d added some more documentation 2012-09-07 18:41:25 +01:00
wlin12
d3e19c4fb2 adding the code for relative entropy pruning to contrib/relent-filter 2012-09-07 17:35:58 +01:00
wlin12
6202c7cc60 adding the code for relative entropy pruning to contrib/relent-filter 2012-09-07 17:33:44 +01:00
Rico Sennrich
4e2fc82854 new training option -write-lexical-counts 
(creates additional files lex.counts.e2f and lex.counts.f2e)
 2012-09-06 11:48:54 +02:00
Hieu Hoang
71b6404091 eclipse 2012-09-04 10:28:19 +01:00
Hieu Hoang
92b15c103f delete reranker, not finished according to Holger Schwenk. 2012-09-02 12:14:32 +01:00
Marcin Junczys-Dowmunt
174b5006b2 Removed debugging artefact 2012-08-24 12:04:23 +00:00
Hieu Hoang
1ca447cc99 Merge https://github.com/hieuhoang/mosesdecoder 2012-08-24 00:40:50 +01:00
Rico Sennrich
d33b860ec3 fix sigtest filter for hierarchical models 2012-08-22 14:53:48 +02:00
Marcin Junczys-Dowmunt
94b37ddf8f Removed debugging artifact 2012-08-22 14:25:33 +02:00
Marcin Junczys-Dowmunt
74d8426e36 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-22 12:00:37 +02:00
Marcin Junczys-Dowmunt
6fbac429b1 faster, better memory footprint, replaced sets with ordered vectors 2012-08-22 12:00:22 +02:00
Hieu Hoang
a3450ea99b eclipse project files 2012-08-20 15:08:37 +01:00
Hieu Hoang
2711f1f621 eclipse project files 2012-08-20 13:35:24 +01:00
Hieu Hoang
2d32304c24 rename tm-mt extraction to fuzzy match 2012-08-13 23:53:14 +01:00
Hieu Hoang
a7b8c75b44 servlet and jquery interfaces for moses server. Thanks to Alexander Ulanov 2012-08-12 13:18:58 +01:00
Jonathan Clark
e99576aedc Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2012-08-10 15:32:08 -04:00
Jonathan Clark
6f008096ea Use Moses' Timer class, which is based on wall-time instead of the C clock() function, which measures clock ticks used within the *process* rather than each thread. This makes timings more meaningful in multi-threaded mode. However, these timings will still be inaccurate on Windows (second-level only). 2012-08-10 15:32:00 -04:00
Hieu Hoang
1d2f887ffc Delete CellCollection class 2012-08-10 12:35:49 +01:00
Hieu Hoang
4ad66381ff xcode 2012-08-09 13:18:46 +01:00
Hieu Hoang
654ed29209 better indication of what phrase table implementation is being loaded 2012-08-09 12:47:48 +01:00
Hieu Hoang
fd122ea630 xcode 2012-08-08 18:29:26 +01:00
Hieu Hoang
9b465f535e get rid of tmpnam 2012-08-06 21:41:24 +01:00
Hieu Hoang
f9a3d05d28 xcode 2012-08-06 19:11:59 +01:00
Hieu Hoang
308db7444a xcode projects for compact pt and lex table 2012-08-06 18:31:05 +01:00
Hieu Hoang
3308589346 minor compile error 2012-07-31 15:30:40 +01:00
Hieu Hoang
431a4f19f1 delete temporary files 2012-07-31 15:05:18 +01:00
Hieu Hoang
a1ab8e354a cleanup of variables. Need to delete temporary files 2012-07-31 02:21:48 +01:00
Hieu Hoang
379baad879 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles. It works 2012-07-31 00:00:20 +01:00
Hieu Hoang
28d7ce1745 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles. It works 2012-07-30 23:49:13 +01:00
Hieu Hoang
ee9fce9637 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-30 21:19:06 +01:00
Hieu Hoang
97f46537b7 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-30 21:07:19 +01:00
Hieu Hoang
d02ceff656 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-27 00:10:49 +01:00
Hieu Hoang
e970a4fc2a move old code into its own folder 2012-07-26 16:16:47 +01:00
Hieu Hoang
63109d272b minor tweaks. Working now 2012-07-26 14:47:49 +01:00
Hieu Hoang
8329b46019 move old code into its own folder 2012-07-26 14:43:31 +01:00
Hieu Hoang
7dd138216f more debugging of tm-mt scripts 2012-07-26 14:41:34 +01:00
Hieu Hoang
824f34605d more debugging of tm-mt scripts 2012-07-26 13:04:33 +01:00
Hieu Hoang
41e990a814 more debugging of tm-mt scripts 2012-07-25 17:53:49 +01:00
Hieu Hoang
13a83ae0c7 split large cpp file into smaller .h & .cpp files 2012-07-25 12:24:31 +01:00
Hieu Hoang
7a44eaa7fb separate large cpp file into smaller header & cpp files 2012-07-25 12:22:13 +01:00
Hieu Hoang
46ed6eaa22 bring perl code into c++ 2012-07-24 16:42:35 +01:00
Hieu Hoang
c8a0107895 xcode for fuzzy-match program 2012-07-24 14:01:13 +01:00
Hieu Hoang
7787ae2a11 read in pt file. Compiles but and runs. Need to check scores 2012-07-23 16:31:38 +01:00
Hieu Hoang
8599b4fd24 read in pt file. Compiles but and runs. Need to check scores 2012-07-23 15:10:15 +01:00
Hieu Hoang
8bffcac320 error write input sentence to file for tm-mt extraction 2012-07-21 23:17:27 +01:00
Hieu Hoang
541fc740a6 Merge https://github.com/moses-smt/mosesdecoder 2012-07-20 14:23:38 +01:00
U-Hieu-PC\Hieu
1cbf457685 added paths to boost includes and libs 2012-07-20 14:15:11 +01:00
Hieu Hoang
fa5a7a92df Visual Studion project files. Submitted by a Windows developer. 2012-07-20 12:16:29 +01:00
Hieu Hoang
d8daac9bb4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-19 22:22:53 +01:00
Hieu Hoang
3f9c995e18 Add PhraseDictionaryTMExtract and ChartRuleLookupManagerMemoryPerSentence to deal with per per sentence grammar. eg. Adam's suffix array and Phi Koehn's TM extraction 2012-07-19 17:56:46 +01:00
Hieu Hoang
d988ca6ed4 Merge https://github.com/moses-smt/mosesdecoder 2012-07-19 16:45:52 +01:00
Rico Sennrich
dd2cf70f3f tmcombine: fix combination of lexical reordering models 2012-07-19 10:31:46 +02:00
Hieu Hoang
9a51e283db Visual Studion project files. Submitted by a Windows developer. 2012-07-19 08:59:46 +01:00
Hieu Hoang
23cfa630fe Added phrase dictionary for phi's tm extraction. Copy of SCFG phrase dictionart so far 2012-07-18 17:59:21 +01:00
Hieu Hoang
7aa3526471 Merge https://github.com/moses-smt/mosesdecoder 2012-07-18 16:32:44 +01:00
Hieu Hoang
b32c484c35 Added phrase dictionary for phi's tm extraction. Copy of SCFG phrase dictionart so far 2012-07-18 14:52:48 +01:00
U-Hieu-PC\Hieu
ceef0342cc visual studio build 2012-07-17 23:39:55 +01:00
Hieu Hoang
07498356d2 tm-mt integration. Runs all the way through to creating rule table without crashing 2012-07-17 18:20:53 +01:00