Commit Graph

2122 Commits

Author SHA1 Message Date
Kenneth Heafield
a0ce62e795 Got tired of waiting for loading. 2012-10-14 17:35:58 +01:00
Kenneth Heafield
0995fa52a8 Use non-terminal alignments 2012-10-14 16:05:29 +01:00
Barry Haddow
61ae24aa5d Merge remote-tracking branch 'origin/master' into miramerge
Conflicts:
	moses/src/PhraseDictionary.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
2012-10-14 14:18:03 +01:00
Kenneth Heafield
031995d897 Insert blanks properly 2012-10-13 20:49:49 +01:00
Kenneth Heafield
64f91af29d Refactor to streamline edge creation 2012-10-13 20:32:55 +01:00
Kenneth Heafield
8ed542cf29 Merge remote branch 'upstream/master'
Conflicts:
	moses/src/TargetPhrase.h
2012-10-13 19:39:59 +01:00
Kenneth Heafield
0d9095983d Remove tmodel from TargetPhrase 2012-10-13 19:30:39 +01:00
Kenneth Heafield
42f009d86d Hacky intermediate state 2012-10-13 18:42:42 +01:00
Kenneth Heafield
1f77801c24 Use newfangled score given in phrase. Fix bug for OOVs. 2012-10-13 13:35:37 -04:00
Kenneth Heafield
c55671b38e Merge remote branch 'upstream/master' 2012-10-13 12:04:09 -04:00
Kenneth Heafield
1b759c169a Rule score with left rest (default same) 2012-10-13 16:49:40 +01:00
Kenneth Heafield
a1d040be11 Update moses side for edges without scores. 2012-10-12 18:34:52 +01:00
Kenneth Heafield
a2758a1ea0 Fix the -100 score and save some memory 2012-10-12 17:04:36 +01:00
Kenneth Heafield
deaae35ed8 Add hack to show model score 2012-10-12 14:38:07 +01:00
Kenneth Heafield
e33e0ffd61 It works! 2012-10-12 14:25:39 +01:00
Kenneth Heafield
e75b51bb73 Fix more conflations, update lazy 2012-10-12 14:09:45 +01:00
Kenneth Heafield
3291083be7 Fix some conflations of search algorithm with model 2012-10-12 14:01:10 +01:00
Kenneth Heafield
6f9db664a5 Work Master all the way up to main 2012-10-12 13:53:08 +01:00
Barry Haddow
732b299ba3 Included AlignmentInfo in TargetPhrase hash 2012-10-11 22:18:56 +01:00
Barry Haddow
2bef14a43e hash and equals for AlignmentInfo 2012-10-11 22:03:32 +01:00
Barry Haddow
a638736722 Reinstate Moses unit tests 2012-10-11 21:33:11 +01:00
Kenneth Heafield
abd8f9d36b Add Manager for incremental. More ChartCellCollectionBase 2012-10-11 16:38:39 +01:00
Kenneth Heafield
0a37050b1d Rule lookup only needs ChartCellCollectionBase 2012-10-11 14:27:30 +01:00
Kenneth Heafield
b1ace96f09 Split off ChartParser.cpp from ChartManager.cpp 2012-10-11 13:45:36 +01:00
Kenneth Heafield
7a5976b721 Make ChartParser accept ChartParserCallback 2012-10-11 13:26:47 +01:00
Kenneth Heafield
ba1915bcf7 Split off ChartParser class 2012-10-11 12:29:02 +01:00
Kenneth Heafield
a6c161c697 Split off unknown word class from ChartManager 2012-10-11 11:54:22 +01:00
Kenneth Heafield
56be96cfaa Merge remote branch 'upstream/master'
Conflicts:
	lm/binary_format.cc
	lm/search_hashed.cc
	lm/search_hashed.hh
2012-10-10 18:31:36 +01:00
Hieu Hoang
75365d92cb move global variables into class. 2012-10-09 17:34:04 +01:00
Hieu Hoang
455e37a74c move global variable into class. Make PhraseDictionaryFuzzyMatch non-threadable so that Moses makes multiple copies of it when running multiple threads. I LOVE MOSES\!\!\! 2012-10-09 16:17:48 +01:00
Hieu Hoang
2b32a29199 enable threading 2012-10-09 14:10:04 +01:00
Hieu Hoang
d54b5f326b enable threading 2012-10-09 13:48:48 +01:00
Kenneth Heafield
c83fb459ac Merge remote branch 'upstream/master' 2012-10-09 13:11:14 +01:00
Hieu Hoang
1c73dd1605 mkdtemp template must be have 6 'X' in Linux 2012-10-09 12:06:14 +01:00
Kenneth Heafield
650ad22c9c Merge remote branch 'upstream/master'
Conflicts:
	util/file.cc
	util/file.hh
2012-10-09 11:30:31 +01:00
Hieu Hoang
9b0a5cafe1 comment out fuzzy matching output going to cout 2012-10-08 22:15:18 +01:00
Hieu Hoang
f0b6ff1094 if don't find best match, pick the 1st 2012-10-08 21:42:16 +01:00
Hieu Hoang
d92289648c put all temp files into temp directory and delete at the end 2012-10-08 20:52:27 +01:00
Barry Haddow
848aafb644 Merge remote branch 'github/master' into miramerge
Conflicts:
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartHypothesis.cpp
	moses/src/ChartTrellisNode.cpp
	moses/src/LM/Implementation.cpp
	moses/src/LM/Ken.cpp
	moses/src/TargetPhrase.cpp
	moses/src/TargetPhrase.h
2012-10-08 17:54:59 +01:00
Kenneth Heafield
4bc4101def Write hypothesis routing 2012-10-07 21:48:15 +01:00
Kenneth Heafield
6808d4f085 Start hack to get raw model out of LM classes 2012-10-07 21:47:24 +01:00
Kenneth Heafield
fce4bfbc25 Untested code for parser callback 2012-10-07 17:18:02 +01:00
Kenneth Heafield
240d663ae3 Merge remote branch 'upstream/master' 2012-10-07 11:02:08 +01:00
Hieu Hoang
4fd980c386 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-05 19:13:04 +01:00
Hieu Hoang
c966ca36b1 revert Jacob's change 033fa821ca 2012-10-05 19:12:29 +01:00
Kenneth Heafield
09b134ad67 Partly written Moses-side search 2012-10-05 18:00:22 +01:00
Kenneth Heafield
cb972b37d6 Merge remote branch 'upstream/master' 2012-10-05 17:52:09 +01:00
Kenneth Heafield
01e661939e Single-threaded FactorCollection shouldn't include thread 2012-10-05 17:38:12 +01:00
Kenneth Heafield
e3af51f3a4 Merge remote branch 'upstream/master'
Conflicts:
	jam-files/sanity.jam
2012-10-04 15:17:23 +01:00
Hieu Hoang
9ae55243e2 remove dependency on boost filesystem object 2012-10-04 15:08:22 +01:00
Kenneth Heafield
16833737b4 Useful methods for me, remove stale ones 2012-10-03 19:04:14 +01:00
Eva Hasler
e7e4dbd405 merge remaining changes to mira, word pair features, phrase pair features 2012-10-03 18:53:55 +01:00
Kenneth Heafield
9f460dd62a Merge remote branch 'upstream/master' 2012-10-03 14:27:14 +01:00
Kenneth Heafield
69a0fcde29 Merge ShrinkToLimit into ApplyThreshold 2012-10-03 14:23:46 +01:00
Kenneth Heafield
7a2f0d19bd Extract base class for ChartTranslationOptionList 2012-10-03 13:27:47 +01:00
Kenneth Heafield
1354d5c5f4 Remove unused forward declaration 2012-10-03 13:10:56 +01:00
Kenneth Heafield
0d86844a33 Base class switcheroo 2012-10-02 16:47:50 +01:00
Kenneth Heafield
542502e6fd Abstract ChartCellCollection, extract source labels 2012-10-02 16:34:25 +01:00
Kenneth Heafield
a9524f079f Splitting ChartCell into cube v non-cube 2012-10-02 14:30:55 +01:00
Kenneth Heafield
60f725f604 Restrict access to ChartCell 2012-10-02 13:27:02 +01:00
Eva Hasler
ebbf0d028c changes to mira, adding jackknife to experiment.perl 2012-10-01 20:36:52 +01:00
Kenneth Heafield
b7a280064e Merge remote branch 'upstream/master' 2012-10-01 17:31:57 +01:00
Kenneth Heafield
618e2d51a6 Apparently nobody uses hash.{h,cpp} 2012-10-01 17:18:49 +01:00
Kenneth Heafield
fec0cb7595 Change StackVec to contain ChartCellLabel* 2012-09-27 17:33:31 +01:00
Barry Haddow
9931a1e0fd Merge remote branch 'github/master' into miramerge 2012-09-26 22:50:48 +01:00
Barry Haddow
0a950ee9f4 Merge remote branch 'github/master' into miramerge
Compiles, but not tested. Had to disable relent filter. Strangely, it seems to contain the
whole of moses-cmd.

Conflicts:
	Jamroot
	OnDiskPt/TargetPhrase.cpp
	moses-cmd/src/Main.cpp
	moses/src/AlignmentInfo.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartTranslationOptionCollection.cpp
	moses/src/ChartTranslationOptionCollection.h
	moses/src/GenerationDictionary.cpp
	moses/src/Jamfile
	moses/src/Parameter.cpp
	moses/src/PhraseDictionary.cpp
	moses/src/StaticData.cpp
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/TranslationSystem.cpp
	moses/src/TranslationSystem.h
	moses/src/Word.cpp
	phrase-extract/score.cpp
	regression-testing/Jamfile
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
2012-09-26 22:49:33 +01:00
Kenneth Heafield
9c990ee3a8 Merge remote-tracking branch 'upstream/master'
Conflicts:
	moses/src/LM/Jamfile
2012-09-26 19:22:33 +01:00
Kenneth Heafield
080585b5c4 Start hacking 2012-09-26 19:21:07 +01:00
Kenneth Heafield
bc866f37ff New approach to forcing recompiles
Fixes annoying problem that unsuccessful build iterations would keep rebuilding Factory.o and CompactPT
2012-09-26 19:14:26 +01:00
Kenneth Heafield
3d8e1274b1 Abstract ChartCellLabel 2012-09-26 17:25:40 +01:00
Kenneth Heafield
32e46c716a Simplify call 2012-09-26 17:15:46 +01:00
Barry Haddow
1ce788e2b8 Fixes for regression tests 2012-09-26 14:40:06 +01:00
Kenneth Heafield
b47f7b15ad Merge remote-tracking branch 'upstream/master' 2012-09-26 12:54:48 +01:00
Kenneth Heafield
ab60d1ad6f Slightly less wasteful OnDiskPt word conversion
Ideally, OnDiskPt would convert its entire vocabulary to Word in advance.
2012-09-26 12:52:11 +01:00
Hieu Hoang
a9c890e55e rename CTO to CTOs 2012-09-25 17:34:43 +01:00
Hieu Hoang
bd90816716 delete ChartTranslationOptionCollection. Roll everything into manager 2012-09-25 17:08:38 +01:00
Kenneth Heafield
e8b4a92134 Try to fix rt for people who don't have it. 2012-09-25 15:20:23 +01:00
Kenneth Heafield
36137829d3 Genericize StackVec to const void * 2012-09-25 13:17:52 +01:00
Kenneth Heafield
4faab6c68f Extract kenlm into a submodule, referencing lazy 2012-09-24 18:30:51 +01:00
Jacob Dlougach
52cc46cebd Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-09-22 19:10:54 +04:00
Jacob Dlougach
033fa821ca Option to print alignment in chart decoder. 2012-09-22 19:09:34 +04:00
Kenneth Heafield
fb190812e4 Add -lrt to fix single-threaded linking 2012-09-21 23:21:23 +01:00
Barry Haddow
74e02afd7c Key pre-calculated chart ff scores on source&target 2012-09-21 15:57:48 +01:00
Barry Haddow
a48eac7ab1 Pre-calculation of chart stateless FFs 2012-09-21 15:00:24 +01:00
Jacob Dlougach
097735469e Refactor output collector so that it can delete the output and debug streams. Very useful if your output can be either cout/cerr or stream. 2012-09-21 17:46:43 +04:00
Barry Haddow
2030b4c614 Context for stateless chart ffs 2012-09-21 11:56:01 +01:00
Barry Haddow
bfae09725c Add option to dump OOVs to file 2012-09-21 08:55:37 +01:00
Barry Haddow
236611193e Update phrase-based features to use context object 2012-09-19 18:00:53 +01:00
Barry Haddow
b292cf67ce remove OnlineCommand 2012-09-13 22:19:19 +01:00
Barry Haddow
96b5c2e633 Chart stateless ff interface only allows essential info.
Not tested
2012-09-13 22:08:01 +01:00
Barry Haddow
23b2204cc1 precalculation of word translation feature 2012-09-13 21:23:37 +01:00
Barry Haddow
2f18deaed4 Unknown word producer needs an implementation 2012-09-13 18:35:33 +01:00
Barry Haddow
475e7501e1 Make sure all stateless features implement new interface.
And disable a couple that are not really stateless.
2012-09-13 18:16:13 +01:00
Marcin Junczys-Dowmunt
73031002ba Merge branch 'minphr' 2012-09-13 14:10:16 +00:00
Marcin Junczys-Dowmunt
200d1bdc34 Added tool to query compact phrase table 2012-09-13 14:09:32 +00:00
Arianna Bisazza
468b88ca67 Merge remote branch 'upstream/master' 2012-09-13 12:24:18 +02:00
Arianna Bisazza
5231312805 changed parameter name from future-distortion-cost to early-distortion-cost 2012-09-13 11:43:01 +02:00
Wilker Aziz
85dd58fed3 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-09-12 00:50:31 +02:00
Marcin Junczys-Dowmunt
3f5dcf4d06 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-09-11 16:13:03 +02:00
junczys
bac859c451 Fix locking in AlignmentInfoCollection.* 2012-09-11 16:06:05 +02:00
Wilker Aziz
2a7cf14b8e 1. Added libfuzzy-match to RuleTable's Jamfile
2. Wrapped PhraseDictionaryTree in binpt.pyx to be used from python
2012-09-11 15:33:57 +02:00
Barry Haddow
bc340ab7a2 Hash t-options directly.
Also, don't include source phrase in t-option as it is already
in target phrase.
2012-09-10 14:57:45 +01:00
Barry Haddow
c6c2f516f6 Eliminate waste 2012-09-07 19:28:08 +01:00
Barry Haddow
64931183d8 Use unordered map for toption score cache 2012-09-07 17:47:01 +01:00
wlin12
6202c7cc60 adding the code for relative entropy pruning to contrib/relent-filter 2012-09-07 17:33:44 +01:00
Barry Haddow
367fd9a245 precalculation of stateless features 2012-09-07 16:57:53 +01:00
Barry Haddow
63cf00b97e pre-calculation of stateless features. Not tested. 2012-09-06 21:41:03 +01:00
Barry Haddow
1862fe54cc Make sure source phrase is initialised 2012-09-04 19:07:57 +01:00
Barry Haddow
54433bb221 Take notice of calc in t-option flag 2012-09-04 17:50:30 +01:00
Lane Schwartz
357845c1a4 Removed duplicate usage printout when moses is called with no parameters. 2012-09-04 17:32:55 +01:00
phikoehn
5d9859ba0e merge issues 2012-09-03 07:27:41 +01:00
phikoehn
0e783dc529 bug fix to enable pruned search graph output by default 2012-09-03 07:23:32 +01:00
Marcin Junczys-Dowmunt
0e3edfd8ee Fixes for compact lexical reodering model for other formats than default 2012-08-23 10:26:22 +02:00
Barry Haddow
2f8bffb1e1 Fix bug in loading of in-memory rule tables.
The case where there was no phrase counts was not handled
correctly.
2012-08-17 16:27:17 +01:00
Marcin Junczys-Dowmunt
8a1ce8dfee Some cleaning 2012-08-15 17:31:30 +02:00
Marcin Junczys-Dowmunt
701fa7dd6c Typo 2012-08-14 16:43:24 +02:00
Marcin Junczys-Dowmunt
505b5f455d Fixed memory leak 2012-08-14 14:27:41 +02:00
Marcin Junczys-Dowmunt
d232c7bd66 Race conditions fixed 2012-08-14 11:37:21 +02:00
Marcin Junczys-Dowmunt
6dead1073e Missing check in destructor 2012-08-14 10:10:24 +02:00
Hieu Hoang
328370f547 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-13 23:54:21 +01:00
Hieu Hoang
2d32304c24 rename tm-mt extraction to fuzzy match 2012-08-13 23:53:14 +01:00
Marcin Junczys-Dowmunt
b16253f7fb Added destructors, fixes final segfault on some machines 2012-08-13 13:35:31 +00:00
Marcin Junczys-Dowmunt
9ba14604b6 Remove artifact std::cerr 2012-08-12 15:02:52 +02:00
Marcin Junczys-Dowmunt
698df14812 Remove artifact assert 2012-08-12 14:43:59 +02:00
Marcin Junczys-Dowmunt
2d1cafe131 Some refactoring 2012-08-11 20:10:58 +02:00
Marcin Junczys-Dowmunt
8df47a281f Fixed memory leak, replaced pthread_t with boost:🧵:id 2012-08-11 01:26:40 +02:00
Jonathan Clark
e99576aedc Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2012-08-10 15:32:08 -04:00
Jonathan Clark
6f008096ea Use Moses' Timer class, which is based on wall-time instead of the C clock() function, which measures clock ticks used within the *process* rather than each thread. This makes timings more meaningful in multi-threaded mode. However, these timings will still be inaccurate on Windows (second-level only). 2012-08-10 15:32:00 -04:00
Jonathan Clark
687f407d62 Make time more precise on platforms that have CLOCK_MONOTONIC (otherwise, we'll only have second-level precision) 2012-08-10 15:24:01 -04:00
Barry Haddow
ad6aa8dc8c Remove spaces from description 2012-08-10 14:55:48 +01:00
Hieu Hoang
5efcdc933f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-10 12:36:32 +01:00
Hieu Hoang
1d2f887ffc Delete CellCollection class 2012-08-10 12:35:49 +01:00
Marcin Junczys-Dowmunt
1e47e4950d Adding missing prefix 2012-08-10 13:22:09 +02:00
Marcin Junczys-Dowmunt
cd4b2d27e9 Bugfix fix for FreeBSD and I pray to God for OS X too 2012-08-09 19:53:27 +02:00
Marcin Junczys-Dowmunt
533b0852f8 Fix for FreeBSD and possibly OSX, added reference counting 2012-08-09 17:12:58 +02:00
Hieu Hoang
654ed29209 better indication of what phrase table implementation is being loaded 2012-08-09 12:47:48 +01:00
Kenneth Heafield
2842ac71e7 Fix temporary file handling 2012-08-08 10:14:47 -04:00
Marcin Junczys-Dowmunt
b35cd707fd Small bugfix for translation lexicon loading 2012-08-07 15:21:47 +02:00
Marcin Junczys-Dowmunt
d86d1a042f Added error messages concerning input formats, alignment data, scores 2012-08-07 14:18:07 +02:00
Hieu Hoang
ffb445c283 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-08-06 21:42:08 +01:00
Hieu Hoang
9b465f535e get rid of tmpnam 2012-08-06 21:41:24 +01:00
Marcin Junczys-Dowmunt
5323abadcc Merge branch 'minphr' 2012-08-06 20:09:06 +00:00
Marcin Junczys-Dowmunt
52e32e69da Added save wrapper for std::fwrite 2012-08-06 20:39:01 +02:00
Marcin Junczys-Dowmunt
4f5bfbf562 Added save wrapper for std::fwrite 2012-08-06 20:07:43 +02:00
Hieu Hoang
308db7444a xcode projects for compact pt and lex table 2012-08-06 18:31:05 +01:00
Hieu Hoang
0e2a479fb2 Minor compile error. 1. 'Cos of conditional compiler for single-threaded. 2. gcc version 2012-08-06 10:37:59 +01:00
Marcin Junczys-Dowmunt
c6af8d81b4 pthread compatibility issue across platforms 2 2012-08-05 09:23:28 +02:00
Marcin Junczys-Dowmunt
af5ca0fb79 pthread compatibility issue across platforms 2012-08-05 09:18:33 +02:00
Hieu Hoang
e01b8e26d3 compile error on some version of g++. Changed uint to pointer 2012-08-04 22:33:13 +01:00
Marcin Junczys-Dowmunt
c4bc2f5550 Delimiter bugfix in Word.cpp 2012-08-04 20:41:46 +00:00
Marcin Junczys-Dowmunt
762acb41f6 Jamfile 2012-08-04 17:07:08 +02:00
Marcin Junczys-Dowmunt
a245e9ea55 Correction of jamfiles etc. 2012-08-04 15:39:30 +02:00
Marcin Junczys-Dowmunt
88a860d776 Warnings, build issues 2012-08-03 19:29:21 +02:00
Marcin Junczys-Dowmunt
20487f9d7f Got rid of warnings 2012-08-03 17:45:00 +02:00
Marcin Junczys-Dowmunt
a35791893f Updated Jamsfiles, build instructions etc. 2012-08-03 16:38:45 +02:00
Marcin Junczys-Dowmunt
3ee709f76e Adding compact phrase table and reordering table to fresh fork 2012-08-03 12:04:39 +02:00
Marcin Junczys-Dowmunt
004cc0d3b1 Adding source file for compact phrase table 2012-08-02 18:32:55 +02:00
Hieu Hoang
80d8592ef8 found a function that exists in all versions of boost 2012-08-02 14:39:06 +01:00
Hieu Hoang
fe5f7eefa5 boost version compatibility 2012-08-02 13:36:46 +01:00
Hieu Hoang
276b767984 Minor boost compile error on some versions of boost 2012-08-01 17:56:20 +01:00
Hieu Hoang
3308589346 minor compile error 2012-07-31 15:30:40 +01:00
Hieu Hoang
431a4f19f1 delete temporary files 2012-07-31 15:05:18 +01:00
Hieu Hoang
a1ab8e354a cleanup of variables. Need to delete temporary files 2012-07-31 02:21:48 +01:00
Hieu Hoang
28d7ce1745 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles. It works 2012-07-30 23:49:13 +01:00
Hieu Hoang
ee9fce9637 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-30 21:19:06 +01:00
Hieu Hoang
97f46537b7 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-30 21:07:19 +01:00
Kenneth Heafield
1d6fa9178a Promote moses to a lib instead of an alias so people can link against it 2012-07-30 15:58:10 -04:00
Hieu Hoang
d02ceff656 wrap phi's suffix array implementation and extraction method in a wrapper class. Compiles 2012-07-27 00:10:49 +01:00
ehasler
6ba85d22a4 save all changes related to domain adaptation 2012-07-26 17:32:50 +01:00
Hieu Hoang
cb0983d69b read in pt file. Compiles but and runs. Need to check scores 2012-07-24 12:13:42 +01:00
Hieu Hoang
ccee295edb read in pt file. Compiles but and runs. Need to check scores 2012-07-23 16:36:39 +01:00
Hieu Hoang
7787ae2a11 read in pt file. Compiles but and runs. Need to check scores 2012-07-23 16:31:38 +01:00
Hieu Hoang
8599b4fd24 read in pt file. Compiles but and runs. Need to check scores 2012-07-23 15:10:15 +01:00
Hieu Hoang
180e00492f read in pt file. Compiles but and runs. Need to check scores 2012-07-23 14:31:05 +01:00
Hieu Hoang
64fd43b1db read in pt file. Compiles but doesn't run 2012-07-23 14:18:49 +01:00
Hieu Hoang
6822ce57a6 read in pt file. Compiles but doesn't run 2012-07-23 14:07:36 +01:00
Hieu Hoang
cabbf6c12c read in pt file. Doing ff, doesn't yet compile 2012-07-23 12:26:15 +01:00
Hieu Hoang
8bffcac320 error write input sentence to file for tm-mt extraction 2012-07-21 23:17:27 +01:00
Hieu Hoang
f4f925bb81 Per sentence grammar classes compiles but doesn't run 2012-07-19 19:36:46 +01:00
Hieu Hoang
01daffa715 Per sentence grammar classes compiles but doesn't run 2012-07-19 18:59:50 +01:00
Hieu Hoang
3f9c995e18 Add PhraseDictionaryTMExtract and ChartRuleLookupManagerMemoryPerSentence to deal with per per sentence grammar. eg. Adam's suffix array and Phi Koehn's TM extraction 2012-07-19 17:56:46 +01:00
Hieu Hoang
0b08696384 add InputType arg to CleanUp() to know which sentence is being cleaned up 2012-07-19 16:41:41 +01:00
Hieu Hoang
23cfa630fe Added phrase dictionary for phi's tm extraction. Copy of SCFG phrase dictionart so far 2012-07-18 17:59:21 +01:00
Hieu Hoang
7aa3526471 Merge https://github.com/moses-smt/mosesdecoder 2012-07-18 16:32:44 +01:00
Hieu Hoang
b32c484c35 Added phrase dictionary for phi's tm extraction. Copy of SCFG phrase dictionart so far 2012-07-18 14:52:48 +01:00
Hieu Hoang
473ed9d1b1 changed variable array to vector. Submitted by a Windows developer. 2012-07-17 22:45:23 +01:00
Barry Haddow
080fa0fa4e Fixed the multiple models tests.
Multiple models won't work properly though, since the default model
is now hard-coded in various spots.
2012-07-17 22:36:10 +01:00
Barry Haddow
2b4e61d826 Merge branch 'trunk' into miramerge
Compiles, not tested.

Conflicts:
	Jamroot
	OnDiskPt/PhraseNode.h
	OnDiskPt/TargetPhrase.cpp
	OnDiskPt/TargetPhrase.h
	OnDiskPt/TargetPhraseCollection.cpp
	mert/BleuScorer.cpp
	mert/Data.cpp
	mert/FeatureData.cpp
	moses-chart-cmd/src/Main.cpp
	moses/src/AlignmentInfo.h
	moses/src/ChartManager.cpp
	moses/src/LM/Ken.cpp
	moses/src/LM/Ken.h
	moses/src/LMList.h
	moses/src/LexicalReordering.h
	moses/src/PhraseDictionaryTree.h
	moses/src/ScoreIndexManager.h
	moses/src/StaticData.h
	moses/src/TargetPhrase.h
	moses/src/Word.cpp
	scripts/ems/experiment.meta
	scripts/ems/experiment.perl
	scripts/training/train-model.perl
2012-07-17 13:36:50 +01:00
Hieu Hoang
759aaf4e9d Merge https://github.com/moses-smt/mosesdecoder 2012-07-17 11:30:39 +01:00
Hieu Hoang
e31b4242e4 win32 build submitted by Windows developer. Includes small changes to order of hypothesis popping during cube pruning 2012-07-17 11:01:07 +01:00
Barry Haddow
3338c808be error checking 2012-07-16 09:13:33 +01:00
Hieu Hoang
3591f385d1 get philipp's code 2012-07-11 12:30:54 +01:00
U-Hieu-PC\Hieu
c7059e5e0b visual studio compiles but doesn't link 2012-07-11 10:54:21 +01:00
Hieu Hoang
e0f1a01020 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-07-10 10:23:40 +01:00
Hieu Hoang
16965f3469 convert new[] to vector. In case of leaks due to exception handling 2012-07-10 10:23:00 +01:00
Hieu Hoang
f7cabfdc50 windows-compatible. Thanks to Mike Lagwig 2012-07-10 10:08:23 +01:00
Hieu Hoang
f335047981 windows-compatible. Thanks to Mike Lagwig 2012-07-10 10:05:14 +01:00
Hieu Hoang
8180181a89 Merge https://github.com/moses-smt/mosesdecoder 2012-07-10 09:19:31 +01:00
Hieu Hoang
7d982bcd8e comments 2012-07-10 09:18:37 +01:00
Oliver Wilson
07eabb6f2d Fix up LM request batching and asynchronousely score TranslationOptions
too.
2012-07-06 16:48:26 +01:00