moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,931 Commits 136 Branches 26 Tags 147 MiB
15e4b16f49
Commit Graph

726 Commits

Author SHA1 Message Date
Hieu Hoang
2c5621e7a5 syntax 2014-02-27 19:50:59 +00:00
Hieu Hoang
6a78ac6bf6 syntax 2014-02-27 18:33:15 +00:00
Hieu Hoang
079a25dc39 syntax 2014-02-27 17:55:57 +00:00
Hieu Hoang
5f7ffee5e8 add [X] non-term elsewhere. Get ready for syntax labels 2014-02-27 15:38:33 +00:00
Hieu Hoang
ff3e7da7a3 add [X] non-term elsewhere. Get ready for syntax labels 2014-02-27 15:09:05 +00:00
Hieu Hoang
efee9f8f95 set set<ptr> rather than set<object> 2014-02-27 14:59:23 +00:00
Hieu Hoang
715af8bcad parse command line 2014-02-27 14:24:57 +00:00
Hieu Hoang
a515289a75 xml parsing for source syntax 2014-02-27 13:00:13 +00:00
Hieu Hoang
ae1ab2d95e syntax 2014-02-26 23:48:54 +00:00
Hieu Hoang
58fbfa39db xml parsing for source syntax 2014-02-26 18:26:56 +00:00
Hieu Hoang
1e5cd16fbf xml parsing for source syntax 2014-02-26 18:09:27 +00:00
Hieu Hoang
a8bebb7659 inverse file 2014-02-26 14:41:23 +00:00
Hieu Hoang
2984573f28 fractional count 2014-02-26 14:18:36 +00:00
Hieu Hoang
15ed27fde8 remove debug messages 2014-02-26 13:51:42 +00:00
Hieu Hoang
c0d85d9c84 bug in rule comparison 2014-02-26 13:46:29 +00:00
Hieu Hoang
175f9bfb4e syntax 2014-02-26 13:22:09 +00:00
Hieu Hoang
2a2f519944 syntax 2014-02-26 12:47:09 +00:00
Hieu Hoang
b729a2891c bugs in rule validation 2014-02-26 12:38:41 +00:00
Hieu Hoang
e824f9a640 merge rules 2014-02-26 11:44:11 +00:00
Hieu Hoang
e3734968d2 merge rules 2014-02-26 11:17:43 +00:00
Hieu Hoang
c48d8b5e31 update last weight override 2014-02-26 10:32:48 +00:00
Hieu Hoang
86e1060982 counts 2014-02-25 19:04:41 +00:00
Hieu Hoang
079e34f3f8 merge rules 2014-02-25 19:01:37 +00:00
Hieu Hoang
c7cf652710 alignments 2014-02-25 18:22:34 +00:00
Hieu Hoang
5834921bdf alignments 2014-02-25 18:04:16 +00:00
Hieu Hoang
6406dd344e start on fractional count 2014-02-25 17:32:12 +00:00
Hieu Hoang
83d2c31de8 leak 2014-02-25 16:50:45 +00:00
Hieu Hoang
aceab7c052 syntax 2014-02-25 16:34:18 +00:00
Hieu Hoang
c72da17e25 syntax 2014-02-25 15:03:51 +00:00
Hieu Hoang
9a0fecf03d syntax 2014-02-25 14:48:26 +00:00
Hieu Hoang
3ff1e0e70e syntax 2014-02-25 14:42:15 +00:00
Hieu Hoang
e8313145ae minor compile error 2014-02-25 13:17:08 +00:00
Hieu Hoang
98b602e656 target phrase 2014-02-24 22:28:33 +00:00
Hieu Hoang
bf559d73f4 target phrase 2014-02-24 22:25:32 +00:00
Hieu Hoang
3be867a6e2 minor renaming 2014-02-24 22:04:00 +00:00
Hieu Hoang
08a8f46c79 minor renaming 2014-02-24 21:47:07 +00:00
Hieu Hoang
950c8b8488 consecutive non-terms 2014-02-24 21:44:15 +00:00
Hieu Hoang
c1159b7a68 syntax 2014-02-24 21:30:43 +00:00
Hieu Hoang
35ea8bd0df minor renaming 2014-02-24 21:25:48 +00:00
Hieu Hoang
6aa2dbd89d syntax 2014-02-24 21:24:46 +00:00
Hieu Hoang
bbbd79535a syntax 2014-02-24 20:38:17 +00:00
Hieu Hoang
2f768d836c syntax 2014-02-24 20:32:50 +00:00
Hieu Hoang
d73799cbda check for isvalid and CanRecurse 2014-02-24 20:26:19 +00:00
Hieu Hoang
d8af91a27a syntax 2014-02-24 20:23:20 +00:00
Hieu Hoang
f77fcb501c syntax 2014-02-24 07:05:51 +00:00
Hieu Hoang
bcb61efcf9 syntax 2014-02-24 06:58:19 +00:00
Hieu Hoang
1716514eda create ResetWeights(). Only for dense weights 2014-02-23 20:07:28 +00:00
Hieu Hoang
9aadbc79d5 syntax 2014-02-23 18:33:37 +00:00
Hieu Hoang
dd8921aba6 syntax 2014-02-23 18:09:34 +00:00
Hieu Hoang
7f5054b003 syntax 2014-02-23 09:26:11 +00:00
Hieu Hoang
66546cb0e4 syntax 2014-02-22 21:33:52 +00:00
Hieu Hoang
bd7e5e3e7e syntax 2014-02-22 20:56:20 +00:00
Hieu Hoang
c736c81701 syntax 2014-02-22 20:29:14 +00:00
Hieu Hoang
90e80663d2 syntax 2014-02-22 20:25:17 +00:00
Hieu Hoang
f6e521390f output 2014-02-22 20:11:53 +00:00
Hieu Hoang
63f0f1b348 it runs 2014-02-22 20:05:44 +00:00
Hieu Hoang
ede6ff7585 debug 2014-02-22 19:23:41 +00:00
Hieu Hoang
b80978fb4c disallow unary rule 2014-02-22 19:16:09 +00:00
Hieu Hoang
5a30985ba6 change Debug() method 2014-02-22 18:46:43 +00:00
Hieu Hoang
1ccb1a6712 recursively extend rule 2014-02-21 17:18:24 +00:00
Hieu Hoang
18e6a0df43 store conistent phrases by source range 2014-02-21 16:36:10 +00:00
Hieu Hoang
de0091a06b added in error 2014-02-21 14:29:13 +00:00
Hieu Hoang
7f7462adef revert back to old algorithm 2014-02-21 14:27:30 +00:00
Hieu Hoang
6b936f3d8d create source phrase in rule 2014-02-21 13:03:43 +00:00
Hieu Hoang
324d16ee8e create source phrase in rule 2014-02-21 13:03:39 +00:00
Hieu Hoang
11bbfd8f68 create source phrase in rule 2014-02-21 12:31:51 +00:00
Hieu Hoang
b54f300957 create source phrase in rule 2014-02-21 12:31:46 +00:00
Hieu Hoang
9b87c4bc28 rules 2014-02-21 00:19:22 +00:00
Hieu Hoang
97711b2765 rules 2014-02-20 23:46:41 +00:00
Hieu Hoang
893f0937e8 revert back to old algorithm 2014-02-20 19:06:33 +00:00
Hieu Hoang
fb905f2fce archive 2014-02-20 18:57:46 +00:00
Hieu Hoang
b50bb1ac9b lattice 2014-02-20 18:34:14 +00:00
Hieu Hoang
e6823f2263 redo. No indices 2014-02-20 18:01:50 +00:00
Hieu Hoang
2ac2136866 do normal hiero extraction 2014-02-20 16:40:09 +00:00
Hieu Hoang
39a5bfb924 eclipse 2014-02-20 15:57:26 +00:00
Hieu Hoang
c4dd3c5a99 delete new extract 2014-02-20 15:50:14 +00:00
Hieu Hoang
46d040311b archive 2014-02-20 12:48:56 +00:00
Hieu Hoang
7868bf4dce debug 2014-02-20 12:34:03 +00:00
Hieu Hoang
0f77762be5 LHS non-term 2014-02-20 11:52:06 +00:00
Hieu Hoang
d6cd2b757b requireAlignedWord 2014-02-20 02:04:34 +00:00
Hieu Hoang
c0a5c33d86 output file 2014-02-20 01:43:31 +00:00
Hieu Hoang
799dfb25da requireAlignedWord 2014-02-20 01:38:24 +00:00
Hieu Hoang
d6053d650a minHoleSource 2014-02-20 01:22:31 +00:00
Hieu Hoang
90856c55a9 nonTermConsecSource 2014-02-20 01:03:38 +00:00
Hieu Hoang
b885a187ee max number of symbols 2014-02-20 00:58:28 +00:00
Hieu Hoang
0e5f5aca16 debug 2014-02-20 00:33:27 +00:00
Hieu Hoang
3544120029 debug 2014-02-20 00:00:37 +00:00
Hieu Hoang
65978cb909 debug 2014-02-19 23:53:43 +00:00
Hieu Hoang
d2b8ca0be1 output rules 2014-02-19 23:40:45 +00:00
Hieu Hoang
be50bb3195 output rules 2014-02-19 23:33:10 +00:00
Hieu Hoang
6f3b6fef6f output rules 2014-02-19 23:05:20 +00:00
Hieu Hoang
c9ef09fe21 output rules 2014-02-19 22:46:02 +00:00
Hieu Hoang
7e3c8db565 output rules 2014-02-19 21:56:08 +00:00
Hieu Hoang
a31003a953 output rules 2014-02-19 21:27:59 +00:00
Hieu Hoang
45c08a0772 destructors 2014-02-19 21:02:41 +00:00
Hieu Hoang
fe3374f449 Makefile 2014-02-19 20:53:43 +00:00
Hieu Hoang
e5c90d0193 fill out 2014-02-19 19:59:46 +00:00
Hieu Hoang
8e050c7bee fill out 2014-02-19 13:12:25 +00:00
Hieu Hoang
562f1c7c5d fill out 2014-02-19 13:05:32 +00:00
Hieu Hoang
19fe4446f2 find consistent phrases in set. 2014-02-19 12:32:25 +00:00
Hieu Hoang
4f8381c177 store consistent phrases in set. So they can be searched 2014-02-19 12:04:43 +00:00
Hieu Hoang
acd8b679ef store consistent phrases in set. So they can be searched 2014-02-18 20:12:55 +00:00
Hieu Hoang
64b82b2a0b create class for all consistent phrases. So they can be searched 2014-02-18 20:03:12 +00:00
Hieu Hoang
cf59d6ea85 extend rules 2014-02-18 19:41:16 +00:00
Hieu Hoang
db040c29ce extend rules 2014-02-18 19:20:53 +00:00
Hieu Hoang
92e455a6cc extend rules 2014-02-18 19:17:00 +00:00
Hieu Hoang
9f0fc31115 create rules 2014-02-18 18:45:09 +00:00
Hieu Hoang
643709ace1 create lattice 2014-02-18 17:17:07 +00:00
Hieu Hoang
ce225687b2 create lattice 2014-02-18 17:16:57 +00:00
Hieu Hoang
7cc1591f9a make consistent range inherit from lattice node 2014-02-18 16:05:13 +00:00
Hieu Hoang
b36d4cc135 minor renaming 2014-02-18 15:06:19 +00:00
Hieu Hoang
b7e9f9185c create consistent phrases. Compiled 2014-02-18 14:57:53 +00:00
Hieu Hoang
4b7884fdd3 don't allow rules with only non-terms on either source or target 2014-02-18 13:43:32 +00:00
Hieu Hoang
e4647e91a2 new extract-mixed-syntax 2014-02-17 23:37:40 +00:00
Hieu Hoang
78e4859333 new extract-mixed-syntax 2014-02-17 23:22:39 +00:00
Hieu Hoang
bad6076c66 eclipse 2014-02-17 23:02:44 +00:00
Hieu Hoang
32e6a72d5d don't allow rules with only non-terms on either source or target 2014-02-17 16:54:04 +00:00
Hieu Hoang
73b14cee57 don't constrain maxHoleSpanSourceDefault 2014-02-17 15:25:54 +00:00
Hieu Hoang
dea528e351 set default max unaligned words to really high 2014-02-14 13:57:24 +00:00
Hieu Hoang
ca999f6508 max span constraint. Mimic hiero extraction 2014-02-14 13:47:08 +00:00
Hieu Hoang
af871744b6 revision 2014-02-14 08:48:50 +00:00
Hieu Hoang
50cadc754f use boost::unordered_map for CacheColl. Marginally faster 2014-02-11 03:43:58 +00:00
Hieu Hoang
9f961e69ec revision 2014-02-07 21:27:27 +00:00
Hieu Hoang
1e798fb299 minor bug 2014-02-07 19:44:54 +00:00
Hieu Hoang
f628f6d92f label the intervening span, don't include the phrasal verbs itself 2014-02-05 18:55:01 +00:00
Hieu Hoang
75c727a518 label the intervening span, don't include the phrasal verbs itself 2014-02-05 18:24:26 +00:00
Hieu Hoang
31857c47a2 Merge branch 'master' into nikolay_probingPT 2014-02-05 17:14:51 +00:00
Hieu Hoang
76e07fc774 english phrasal verb detector 2014-02-05 12:18:52 +00:00
Hieu Hoang
ec1186ab9e english phrasal verb detector 2014-02-05 12:10:32 +00:00
Hieu Hoang
f55f81a85f english phrasal verb detector 2014-02-05 12:06:27 +00:00
Hieu Hoang
690f84c36b start on english phrasal verb detector 2014-02-04 19:54:39 +00:00
Hieu Hoang
2e99dea2d2 change maxHoleSpanSourceDefault 10 --> 7 2014-02-04 17:09:21 +00:00
Hieu Hoang
8ab7d6b618 delete tests MoreDefaultNonTermThanTerm() and MaxNonTerm() which restricts creation of rules 2014-02-04 14:11:40 +00:00
Hieu Hoang
ccf0922b33 increasing default max number of symbols 6-->7. More debugging info for rules 2014-02-04 13:24:00 +00:00
Hieu Hoang
1c1aadee8a make heuristics more comparable with extract-rules 2014-01-28 20:03:50 +00:00
Hieu Hoang
9f529cd0ec add min and max non-term span constraint 2014-01-28 19:06:05 +00:00
Hieu Hoang
99a41301b8 makefile 2014-01-28 14:48:02 +00:00
Hieu Hoang
6c3b8587ba bjam 2014-01-23 00:51:03 +00:00
Hieu Hoang
5800ff848c bjam 2014-01-22 20:57:06 +00:00
Hieu Hoang
e505a462a7 probing hash pt compiles. Need to hook up vocab 2014-01-22 18:24:51 +00:00
Hieu Hoang
63b9eac201 integration of Nikolay's probing pt into Moses 2014-01-22 13:06:10 +00:00
Hieu Hoang
47c0a72842 add source labeller to EMS 2014-01-21 16:09:01 +00:00
Hieu Hoang
27152ccce4 add source labeller to EMS 2014-01-20 23:26:06 +00:00
Hieu Hoang
c537d940a9 compile manual-label program 2014-01-20 19:27:46 +00:00
Hieu Hoang
b03e035b5d output glue rules 2014-01-20 18:37:48 +00:00
Hieu Hoang
4c009e31e8 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into hieu 2014-01-20 17:08:02 +00:00
Hieu Hoang
8fe07d1c9c oops. Minor compile error 2014-01-20 17:01:53 +00:00
Hieu Hoang
4d080a5bcb Merge branch 'master' into hieu 2014-01-17 18:09:18 +00:00
Hieu Hoang
58197b538e eclipse 2014-01-17 18:03:42 +00:00
Hieu Hoang
20e7d078a6 add feature function HyperParameterAsWeight 2014-01-17 17:59:36 +00:00
Hieu Hoang
0410ab67ea make it compatible with normal extract 2014-01-16 20:14:25 +00:00
Hieu Hoang
fef94f27a7 correct inverse alignment 2014-01-16 19:40:08 +00:00
Hieu Hoang
2cd6649e62 output inverse extract 2014-01-16 19:13:44 +00:00
Hieu Hoang
9555dc657d change --MaxSymbolsSource to --MaxSymbols 2014-01-16 17:18:51 +00:00
Hieu Hoang
54c65f7518 constraint number of target symbols, for fairer inverse probability 2014-01-16 17:16:39 +00:00
Hieu Hoang
8249d259f4 Manual source labelling for de-en 2014-01-15 17:43:16 +00:00
Hieu Hoang
9128c4d3b4 Manual source labelling for de-en 2014-01-15 10:30:31 +00:00
Hieu Hoang
7761899e1d Merge branch 'master' into hieu 2014-01-14 11:43:01 +00:00
Hieu Hoang
753b6f00c9 eclipse for score program 2014-01-08 17:59:40 +00:00
Hieu Hoang
63f6ea8fa7 eclipse 2014-01-06 11:55:22 +00:00
Hieu Hoang
b3a712baa0 output reordering only 2013-12-18 18:40:23 +00:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
1d56e4c0b1 minor verbose message 2013-12-03 15:56:11 +00:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Hieu Hoang
6fcbb33940 eclipse 2013-11-24 15:40:49 +00:00
Hieu Hoang
c4dfc60f95 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-22 15:26:23 +00:00
Hieu Hoang
5c6d88a463 add new phrase table for Scope-3 parsing. Doesn't quite work... 2013-11-22 15:26:14 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
aca78534c4 replace CHECK with UTIL_THROW_IF in Moses 2013-11-20 14:02:38 +00:00
Hieu Hoang
c2c86ce50d replace CHECK with UTIL_THROW_IF in Moses 2013-11-19 13:19:23 +00:00
Hieu Hoang
a1584c608f compile error in mosesserver 2013-11-17 23:04:04 +00:00
Hieu Hoang
2f00ae936b move collection of phrase-table from Staticdata to PhraseDictionary 2013-11-15 17:26:26 +00:00
Hieu Hoang
d66d6be1b1 eclipse project for mira program 2013-11-15 15:25:35 +00:00
Hieu Hoang
3d37a8ffda more compile errors, with clang 2013-11-14 19:30:45 +00:00
Hieu Hoang
58a73676d8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-14 18:04:14 +00:00
Hieu Hoang
0b1bb6a443 mert compiles under Mac OSX Mavericks. #ifdef PreProcessFilter.cpp and accomplices 2013-11-14 17:58:59 +00:00
Hieu Hoang
bbb6f0b145 tested DALM 2013-11-14 16:05:27 +00:00
Hieu Hoang
dc7d152594 eclipse 2013-11-14 14:21:04 +00:00
Hieu Hoang
ca1c62c652 eclipse 2013-11-11 23:17:56 +00:00
Hieu Hoang
17f1bf7728 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-11 15:37:14 +00:00
Hieu Hoang
2d8f9bc515 bug fixes for TargetNGramFeature 2013-11-11 15:32:58 +00:00
Hieu Hoang
d5cde1d874 DALM load 2013-11-11 14:39:53 +00:00
Hieu Hoang
08d888382d add DALM. Just a skeleton so far 2013-11-05 14:37:56 +00:00
Hieu Hoang
88569e2e0a rand lm compiles 2013-11-04 20:09:15 +00:00
Hieu Hoang
cd00ca77f4 eclipse 2013-11-01 16:22:10 +00:00
Hieu Hoang
4b004b26d3 output list of available feature functions 2013-11-01 15:17:24 +00:00
Hieu Hoang
d51702f387 output list of available feature functions 2013-11-01 15:16:47 +00:00
Hieu Hoang
b926346bfe compiles with eclipse under OSX Mavericks 2013-10-30 21:23:16 +00:00
Hieu Hoang
bd82b7355b remove description argument from feature function constructor. Redundant 2013-10-29 18:44:33 +00:00
Hieu Hoang
37896ed854 add NeuralLM 2013-10-28 23:21:02 +00:00
Hieu Hoang
0af1df9f8b add NeuralLM 2013-10-28 22:11:37 +00:00
Phil Williams
69f5e4bec3 Merge branch 'master' into GHKMStruct 2013-10-09 16:21:49 +01:00
Hieu Hoang
6e32bd3e19 correct creation of input paths for lattices 2013-10-02 18:42:56 +01:00
Hieu Hoang
6bce688517 eclipse 2013-09-30 17:29:05 +01:00
Phil Williams
2a28d1a73e Merge branch 'master' into GHKMStruct 
Conflicts:
	moses-chart-cmd/IOWrapper.cpp
	moses-chart-cmd/IOWrapper.h
	moses/FF/Factory.cpp
	moses/Parameter.cpp
	moses/StaticData.h
	phrase-extract/extract-ghkm/ScfgRuleWriter.cpp
	phrase-extract/score-main.cpp
 2013-09-29 15:27:09 +01:00
Hieu Hoang
847f7c1ea2 skeleton PT 2013-09-25 20:59:13 +01:00
Hieu Hoang
96df1f2659 lattices/confusion work with Hieu's binary pt, using new method 2013-09-25 13:03:09 +01:00
Hieu Hoang
4e4c6bd8b8 eclipse 2013-09-18 18:15:07 +02:00
Hieu Hoang
5625d30a26 add target phrase to arguments for Evaluate() during application to sentence 2013-09-18 12:35:31 +02:00
Hieu Hoang
0d94d7067e update convert-moses-ini-to-v2.perl with memory pt for SCFFG decoding. Start on constrained ff 2013-09-16 07:46:45 +02:00
maria nadejde
48fa62838c Merge branch 'master' into GHKMStruct 2013-09-13 17:30:50 +02:00
maria nadejde
d810a2c390 comment for Equal implementation 2013-09-13 17:30:16 +02:00
Hieu Hoang
c36d8d048f ExternalFeature /cdec & phil blumson 2013-09-12 09:48:17 +02:00
Lane Schwartz
226031ecf6 Checking in examples of CMake files. 
The example in contrib works, as does the one in biconcor.

The examples in lm and moses don't work at the moment,
but checking them in anyway as a starting point
for any potential work on them next week during the
MT Marathon.
 2013-09-06 13:39:46 -04:00
Lane Schwartz
addc8be211 Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-09-05 14:06:15 -04:00
Lane Schwartz
192bd8313c Adding more executables to XCode project 2013-09-05 14:06:09 -04:00
Lane Schwartz
31203ec308 XCode can now compile biconcor 2013-09-03 11:10:37 -04:00
Lane Schwartz
3be2f54a51 XCode can now compile moses_chart 2013-09-03 11:05:16 -04:00
Lane Schwartz
f1e4d6eb04 XCode can now compile moses and lmbrgrid 2013-09-03 10:59:53 -04:00
Lane Schwartz
fd81ca799d XCode can now compile queryOnDiskPt 
Also fixed some inconsistencies between
debug and release for some targets.
 2013-09-03 10:37:20 -04:00
Lane Schwartz
21801e85e7 XCode project can now compile CreateOnDiskPt 
If libmoses.a was compiled with LM_IRST,
then the following flags must be passed to the linker
when compiling CreateOnDiskPt:
-L $(XCODE_MOSES_LIBRARY_IRSTLM)
-lirstlm

If libmoses.a was compiled with LM_SRI,
then the following flags must be passed to the linker
when compiling CreateOnDiskPt:
-L $(XCODE_MOSES_LIBRARY_SRILM)
-ldstruct
-liconv
-lz
-lmisc
-loolm

Additionally, if libmoses.a was compiled with LM_SRI,
and SRILM was compiled with lbfgs,
then the following flags must be passed to the linker
when compiling CreateOnDiskPt:
-L $(XCODE_MOSES_LIBRARY_LBFGS)
-Xlinker -search_paths_first
-llbfgs

An note of explanation here may be warranted
with regard to the above lbfgs-related flags:
Mac OS X ships with a dynamic library that is loaded
with the flag -lz. SRILM compiles its own version of this
library. If SRILM is compiled statically, this becomes a problem.
We need XCode to link against the SRILM version of zlib,
but by default, the linker will search through all known library paths
for a dynamic version first. Only if no dynamic version is found will
it then search the library paths for a static version.
The fix for this problem is to use the -Xlinker flag to pass an additional
flag to the linker: -search_paths_first. This flag forces to linker to
iterate only once through each directory in its library path; within each
such directory it will first look for a dynamic version and
then, if necessary, for a static version. This solves the problem.
 2013-09-03 10:23:26 -04:00
Hieu Hoang
01b7f8a1e8 add skeleton feature functions 2013-09-01 16:58:23 +01:00
Lane Schwartz
19e94b4869 In XCode, removed headers from libmoses target. 2013-08-30 15:33:05 -04:00
Lane Schwartz
3bb4ac803a Adding targets to XCode project. 
Have working targets for kenlm binaries
and for libmoses, with the caveat that
only source files from the lm, moses, and util dirs
are currently included in libmoses.

The next step is adding the other relevant dirs
to libmoses.
 2013-08-30 15:26:59 -04:00
Hieu Hoang
fe36cbf737 move LexicalReordering to FF directory 2013-08-30 16:28:28 +01:00
Hieu Hoang
04783309ba move DecodeFeature to FF directory 2013-08-30 16:03:06 +01:00
Lane Schwartz
70eb3f13b9 More XCode configuration cleanup. 2013-08-29 16:26:49 -04:00
Lane Schwartz
27be036572 Clean up XCode configuration. 2013-08-29 16:02:19 -04:00
Lane Schwartz
f5a55e105b Cleaning up XCode project. 
Project is now configured such that it should compile
cleanly with or without optional libraries.

To compile the project, the user must (at minimum) have boost installed.

If boost is installed in a standard location, such as /usr/local,
then XCode should be able to find boost without any help from the user.

If boost is in a non-standard location, the user must configure XCode
such that the Source Tree variable XCODE_MOSES_INCLUDE_BOOST is set to
the directory where boost is installed.

For example, if you download and unzip boost in /path/to/boost_1_53_0,
then after compiling boost, headers would be located in
/path/to/boost_1_53_0/include and libraries would be located in
/path/too/boost_1_53_0/lib. In this case, set XCODE_MOSES_INCLUDE_BOOST=
/path/to/boost_1_53_0/include.

If you want to compile using IRSTLM, RandLM, SRILM, or the HHMM SynLM,
you will need to set the paths to those projects' respective include dirs
in the respective corresponding Source Tree variables:

For IRSTLM:
XCODE_MOSES_INCLUDE_IRSTLM

For RandLM:
XCODE_MOSES_INCLUDE_RANDLM

For SRILM:
XCODE_MOSES_INCLUDE_SRILM

For the HHMM syntactic LM:
XCODE_MOSES_INCLUDE_SYNLM_RVTL
XCODE_MOSES_INCLUED_SYNLM_WSJPARSE

At the moment, the project is configured with the
LM_SRI, LM_IRST, and LM_RAND preprocessor macros enabled,
which means that to compile the project, the respective source tree
variables must be defined. Alternatively, you could remove those macros
from the project definitions.
 2013-08-29 15:10:54 -04:00
Lane Schwartz
c0fe9bb4ea Updating XCode project 2013-08-29 12:56:25 -04:00
Hieu Hoang
de9decc30d mark GetTargetPhraseCollection with LEGACY 2013-08-23 21:02:03 +01:00
Hieu Hoang
5625f37eb1 delete ChartBasedFeatureContext 2013-08-23 15:00:47 +01:00
Hieu Hoang
1d653c87aa delete PhraseBasedFeatureContext 2013-08-23 14:25:25 +01:00
Hieu Hoang
841ce108a5 add phrase table caching 2013-08-15 20:20:44 +01:00
Hieu Hoang
154ca336d6 separate out ChartTranslationOption into its own files 2013-08-12 19:01:06 +01:00
Hieu Hoang
0bef0f63bf eclipse file 2013-08-01 13:53:06 +01:00
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Hieu Hoang
d1700435e0 eclipse file for extract 2013-07-26 14:00:19 +01:00
Hieu Hoang
4fde5f7ea2 eclipse file for extract-rules 2013-07-26 12:27:55 +01:00
Hieu Hoang
26c373ca3c Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-23 13:13:17 +01:00
Hieu Hoang
9b9e8cc759 eclipse file with randlm 2013-07-23 12:41:02 +01:00
Hieu Hoang
a098227abe add ControlRecombination feature function 2013-07-20 23:10:50 +01:00
Hieu Hoang
5b7a9af588 refactor RandLM. Compiles with eclipse but not with bjam 2013-07-20 00:19:04 +01:00
Hieu Hoang
d4e641de80 eclipse 2013-07-19 23:19:17 +01:00
Hieu Hoang
24a9a7949e eclipse 2013-07-19 09:37:33 +01:00
Hieu Hoang
ba5ece8abe Merge github.com:moses-smt/mosesdecoder into hieu_opt_input 2013-07-19 09:34:32 +01:00
Hieu Hoang
ecef376aed rename InputLatticeNode.h to InputPath.h 2013-07-06 22:42:52 +01:00
Hieu Hoang
ac8d10af38 move lookup of all subphrases into PhraseDictionary class 2013-07-03 16:57:23 +01:00
Hieu Hoang
39f864d181 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input2 2013-07-03 16:25:39 +01:00
Hieu Hoang
4995ea4f89 eclipse 2013-07-03 16:24:49 +01:00
Hieu Hoang
159911a92b Merge github.com:moses-smt/mosesdecoder into hieu_opt_input2 2013-07-03 13:35:10 +01:00
Hieu Hoang
bf9742f5f8 eclipse project for extract-ghkm 2013-07-03 12:35:45 +01:00
Hieu Hoang
46e1b8df22 eclipse 2013-07-02 13:03:40 +01:00
Hieu Hoang
8123772b43 separate class InputLatticeNode into seprate file 2013-07-01 23:27:13 +01:00
Hieu Hoang
8d98d026d4 Merge github.com:moses-smt/mosesdecoder into hieu_opt_input2 2013-07-01 22:30:41 +01:00
Hieu Hoang
bff761b605 a little bit more towards using prefix subphrase to optimize translation model lookup 2013-07-01 22:30:29 +01:00
Hieu Hoang
e3a9694c60 eclipse 2013-07-01 19:56:48 +01:00
Hieu Hoang
fa4b92fc0a Merge branch 'master' into nadir_osm 2013-06-28 14:19:30 +01:00
Hieu Hoang
e3390393a3 Merge branch 'master' of github.com:moses-smt/mosesdecoder into nadir_osm 2013-06-27 21:12:29 +01:00
Hieu Hoang
3833d67ec0 merge with master 2013-06-26 17:12:22 +01:00
Hieu Hoang
d43c174dcd merge 2013-06-25 10:50:26 +01:00
Hieu Hoang
e15a4fc882 add phrase penalty feature function 2013-06-25 06:54:23 +01:00
Hieu Hoang
69acbfa1d3 compiles, but only on eclipse 2013-06-24 14:45:20 +01:00
Hieu Hoang
96d116dba0 refactor parsing of feature functiona args 2013-06-10 16:29:07 +01:00
Hieu Hoang
b4ca44e8af refactor TargetWordInsertionFeature::Load() 2013-06-09 20:09:21 +01:00
Hieu Hoang
82224a7a46 feature functions can be both sparse AND dense 2013-06-09 18:48:09 +01:00
Hieu Hoang
d281d025cf implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far 2013-06-07 17:42:23 +01:00
Hieu Hoang
dc6479fad9 eclipse 2013-06-06 15:09:05 +01:00
Hieu Hoang
266a81c9cf add class InputFeature. To replace 7 year old hack of using phrase table weights for input scores for confusion networks and lattice inputs 2013-05-28 17:25:59 +01:00
Hieu Hoang
87c7875391 delete LMList 2013-05-27 16:57:09 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
49e69f19e2 split classes in DummyScoreProducers into separate files 2013-05-25 00:25:20 +01:00
Hieu Hoang
75a1849bcf split classes in FeatureFunction files 2013-05-24 19:11:15 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
6c322ba05e move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:33:30 +01:00
Hieu Hoang
4a280c8ca7 move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:23:31 +01:00
Hieu Hoang
41da563645 port SRILM to new weights format 2013-05-19 12:44:45 +01:00
Hieu Hoang
f04ec4c56d 1. remove all code for MetaFeature from mira. 
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
 2013-05-16 19:05:08 +01:00
Hieu Hoang
dcafe74892 port PhraseDictionaryMultiModelCount to new format 2013-05-13 17:20:14 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
b75d194833 gut LMList. Get ready for deletion 2013-05-11 13:23:50 +01:00
Hieu Hoang
ed7ab8146f port PhraseDictionaryMultiModel to new format 2013-05-10 12:30:01 +01:00
Hieu Hoang
e8497d5a7e IsTuneable() can now be set in the ini file 2013-05-09 12:05:19 +01:00
Hieu Hoang
2b4e1fbea6 delete FindNumFeatures() and FindName() 2013-05-09 11:48:12 +01:00
Hieu Hoang
ac9496e74f merge 2013-05-08 15:39:00 +01:00
Hieu Hoang
644cac03f6 eclipse 2013-05-07 11:40:03 +01:00
Hieu Hoang
8a371f6547 eclipse 2013-05-07 09:25:42 +01:00
Hieu Hoang
b9373c7edf eclipse 2013-05-03 10:49:10 +01:00
Hieu Hoang
372d0505d2 eclipse 2013-05-02 21:22:05 +01:00
Hieu Hoang
f0bae8cbc8 eclipse 2013-05-02 19:56:04 +01:00
Hieu Hoang
25b1ef9e08 eclipse 2013-05-02 19:53:42 +01:00
Hieu Hoang
acaabb66d9 change StatelessFeatureType for class WordTranslationFeature. Test phrase.word-translation passes 2013-05-01 14:56:09 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Hieu Hoang
6da2cf7663 eclipse 2013-04-24 14:19:16 +01:00
Hieu Hoang
7a5cd95205 eclipse 2013-04-10 18:23:11 +01:00
Hieu Hoang
d4ab31269f eclipse 2013-04-10 18:20:25 +01:00
Hieu Hoang
8ca771d262 merge 2013-04-09 15:07:58 +01:00
Hieu Hoang
44a0e52e30 fixed ShowWeights() for confusion networks. This is a reason why we should get rid of ShortNames and move to refactored moses pdq 2013-04-09 14:44:32 +01:00
Hieu Hoang
e1dc4131f6 merge 2013-03-27 08:45:16 +00:00
Hieu Hoang
eeeda717a4 eclipse 2013-03-26 15:47:30 +00:00
Hieu Hoang
f2acca0943 eclipse 2013-03-26 11:50:10 +00:00
Hieu Hoang
fd4e954322 merge 2013-03-24 09:57:36 +00:00
Hieu Hoang
db005f6503 compile error caused by different versions of boost 2013-03-23 15:58:07 +00:00
Hieu Hoang
2c26ad133e error parsing factors. And eclipse project files 2013-03-16 16:41:38 +00:00
Hieu Hoang
7888c7ba23 eclipse project files 2013-03-15 22:02:00 +00:00
Hieu Hoang
df5f0934be eclipse 2013-03-15 19:48:51 +00:00
Hieu Hoang
de2519fb88 eclipse 2013-03-15 19:48:11 +00:00
Hieu Hoang
ca43a88bd2 change feature weight delimiter from = to : 2013-03-13 18:26:24 +00:00
Hieu Hoang
c1143ce590 eclipse 2013-03-13 17:46:46 +00:00
Hieu Hoang
66ad6f32ce start merging PhraseDictionaryMemory and PhraseDictionarySCFG 2013-03-07 19:12:49 +00:00