moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-05 02:22:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
15,923 Commits 136 Branches 26 Tags 147 MiB
307742a32e
Commit Graph

755 Commits

Author SHA1 Message Date
Hieu Hoang
6d5aabcc57 move Swap() into Util2.h 2015-11-17 17:24:59 +00:00
Hieu Hoang
15fb911821 rename 2015-11-17 17:14:52 +00:00
Hieu Hoang
74d9382c55 swap hypos, don't erase and re-insert 2015-11-17 17:10:34 +00:00
Hieu Hoang
acff4fa6d5 mempool for input paths 2015-11-17 15:58:35 +00:00
Hieu Hoang
806b8bcba2 local recycler 2015-11-17 10:41:21 -05:00
Hieu Hoang
8f4cb5e9f7 mempool for batch vector 2015-11-17 15:29:45 +00:00
Hieu Hoang
f8744cf071 mempool for recycler 2015-11-17 14:35:54 +00:00
Hieu Hoang
ca6585167c compile errors 2015-11-17 13:05:26 +00:00
Hieu Hoang
372ef6bfcf gcc compile errors 2015-11-17 07:54:29 -05:00
Hieu Hoang
10b1f0c7cb use mempool allocator for stack 2015-11-17 12:40:33 +00:00
Hieu Hoang
c85f6e23ca stl-compatible allocator 2015-11-17 12:27:17 +00:00
Hieu Hoang
fefffe017e batch FF calculation 2015-11-17 10:46:17 +00:00
Hieu Hoang
d5f02dc167 batch lm 2015-11-17 10:33:25 +00:00
Hieu Hoang
40946eb345 batch FF calculation 2015-11-17 05:27:43 +00:00
Hieu Hoang
cf07b9d560 batch FF calculation 2015-11-17 05:09:55 +00:00
Hieu Hoang
cafba61397 KenLM batch 2015-11-16 19:06:10 +00:00
Hieu Hoang
8fe0adbac6 KenLM batch 2015-11-16 18:46:39 +00:00
Hieu Hoang
8cfe0d8a50 KenLM batch 2015-11-16 18:32:25 +00:00
Hieu Hoang
c88c15591e Merge branch 'perf_moses2' of github.com:hieuhoang/mosesdecoder into perf_moses2 2015-11-16 17:28:34 +00:00
Hieu Hoang
204c35e011 cpu affinity 2015-11-16 12:27:53 -05:00
Hieu Hoang
ffcc10a001 add cube pruning 2015-11-16 16:47:49 +00:00
Hieu Hoang
78eb3a4543 add cube pruning 2015-11-16 15:48:02 +00:00
Hieu Hoang
ea9bdab442 cpu affinity 2015-11-16 15:47:13 +00:00
Hieu Hoang
b402795794 add cube pruning 2015-11-16 14:50:58 +00:00
Hieu Hoang
c6f34a0d29 timer 2015-11-13 17:18:30 +00:00
Hieu Hoang
772dafd27e import classes into moses2 2015-11-13 16:38:10 +00:00
Hieu Hoang
500e967730 timer 2015-11-13 16:29:55 +00:00
Hieu Hoang
e58e2fd777 import classes into moses2 2015-11-13 10:40:55 +00:00
Hieu Hoang
8d7e273057 import classes into moses2 2015-11-13 01:03:57 +00:00
Hieu Hoang
2932a9bbdd import classes into moses2 2015-11-13 00:10:08 +00:00
Hieu Hoang
6ca362dd7b import classes into moses2 2015-11-13 00:05:54 +00:00
Hieu Hoang
6dc17336c1 segfault 2015-11-12 23:24:24 +00:00
Hieu Hoang
00c53b196f import classes into moses2 2015-11-12 23:21:14 +00:00
Hieu Hoang
8a2dc020a7 import classes into moses2 2015-11-12 23:18:30 +00:00
Hieu Hoang
a575cd14db import classes into moses2 2015-11-12 22:52:59 +00:00
Hieu Hoang
745a57c38b import classes into moses2 2015-11-12 22:51:13 +00:00
Hieu Hoang
8eb0cab57b import classes into moses2 2015-11-12 22:01:09 +00:00
Hieu Hoang
2a641af799 import classes into moses2 2015-11-12 21:58:07 +00:00
Hieu Hoang
03ef8d6654 import classes into moses2 2015-11-12 21:48:59 +00:00
Hieu Hoang
cac5a11977 import classes into moses2 2015-11-12 20:34:58 +00:00
Hieu Hoang
0c9ac9bea8 read from cin 2015-11-12 19:05:23 +00:00
Hieu Hoang
bd73cfd377 Moses::Scan -> Scan 2015-11-11 23:29:58 +00:00
Hieu Hoang
5034cd9107 Moses::Tokenize -> Tokenize 2015-11-11 23:28:18 +00:00
Hieu Hoang
a9333e0d82 remove Moses::Parameter from Moses2 2015-11-11 17:31:05 +00:00
Hieu Hoang
e3a5b232b8 remove all Moses from Moses2 2015-11-11 16:23:49 +00:00
Hieu Hoang
aa8dc8e787 import classes into moses2 2015-11-11 15:08:47 +00:00
Hieu Hoang
05741aa723 no pruning 2015-11-10 16:33:34 +00:00
Hieu Hoang
d748cd9484 comment out g_numHypos 2015-11-10 16:27:28 +00:00
Hieu Hoang
017e902441 stack pruning 2015-11-10 15:52:39 +00:00
Hieu Hoang
3040fe57b0 start of multithreading in moses2 2015-11-10 12:46:26 +00:00
Hieu Hoang
c0d74aa1bd start of multithreading in moses2 2015-11-10 12:02:19 +00:00
Hieu Hoang
8ed05f1278 start of multithreading in moses2 2015-11-10 11:28:17 +00:00
Hieu Hoang
819bc8180b debug 2015-11-10 00:17:24 +00:00
Hieu Hoang
b499c2ecd3 don't breakdown scores 2015-11-10 00:07:55 +00:00
Hieu Hoang
0dc960c2cd Merge branch 'perf_moses2' of github.com:hieuhoang/mosesdecoder into perf_moses2 2015-11-10 00:02:45 +00:00
Hieu Hoang
34d4bd2929 don't breakdown scores 2015-11-10 00:02:22 +00:00
Hieu Hoang
3b9d6b6593 Revert "don't re-add winning hypo into stack, just swap" 
This reverts commit 0dfebb9a06.
 2015-11-09 17:26:49 -05:00
Hieu Hoang
beebeb1508 return value 2015-11-09 21:12:32 +00:00
Hieu Hoang
0dfebb9a06 don't re-add winning hypo into stack, just swap 2015-11-09 18:28:24 +00:00
Hieu Hoang
76025091cb renaming future score -> estimated score 2015-11-09 13:54:53 +00:00
Hieu Hoang
564f57098a future score in hypothesis 2015-11-09 12:03:45 +00:00
Hieu Hoang
900c1222d5 change GetSystem() -> system 2015-11-09 00:29:15 +00:00
Hieu Hoang
20a3977e8f debug message 2015-11-09 00:07:34 +00:00
Hieu Hoang
d626244a9c don't use get 2015-11-06 19:06:41 +00:00
Hieu Hoang
d793b2579b prefix path 2015-11-06 18:50:25 +00:00
Hieu Hoang
5ed810bf85 max-phrase-length. And delete unused paths 2015-11-06 18:23:40 +00:00
Hieu Hoang
fce46d05b8 use ComputeDistortionDistance() 2015-11-06 18:01:58 +00:00
Hieu Hoang
f69dde6710 comment out debugging message 2015-11-06 17:55:35 +00:00
Hieu Hoang
739d4db501 distortion limit 2015-11-06 16:39:30 +00:00
Hieu Hoang
d9da1f2866 Stacks debugging 2015-11-06 16:09:44 +00:00
Hieu Hoang
97fd80bb95 Stacks class 2015-11-06 13:42:28 +00:00
Hieu Hoang
2c3080ac59 Stacks class 2015-11-06 13:19:44 +00:00
Hieu Hoang
3a9613d896 recycle pruned hypos 2015-11-06 12:35:02 +00:00
Hieu Hoang
d3e79a63ed count number of hypos 2015-11-06 11:51:14 +00:00
Hieu Hoang
713ba3b2c4 use partial sort in hypo pruning 2015-11-06 11:09:37 +00:00
Hieu Hoang
8e7c6e2a10 table-limit 2015-11-06 10:55:04 +00:00
Hieu Hoang
4fbd5a4a04 lazyken 2015-11-06 09:04:19 +00:00
Hieu Hoang
b7ca59c2cd recycle recombined hypos 2015-11-06 00:02:57 +00:00
Hieu Hoang
482585410e recycle recombined hypos 2015-11-06 00:00:48 +00:00
Hieu Hoang
0a9f2f8c18 recycle recombined hypos 2015-11-05 23:56:23 +00:00
Hieu Hoang
374d81e6a5 recycle hypo 2015-11-05 23:49:05 +00:00
Hieu Hoang
efaec35215 recycle recombined hypos 2015-11-05 17:07:39 +00:00
Hieu Hoang
9d5aff4b80 recycle recombined hypos 2015-11-05 16:58:45 +00:00
Hieu Hoang
b93b13eabf EvaluateWhenApplied() 2015-11-05 16:35:31 +00:00
Hieu Hoang
656b484442 EmptyHypothesisState() 2015-11-05 16:16:55 +00:00
Hieu Hoang
63f13edec3 create blank states 2015-11-05 15:59:09 +00:00
Hieu Hoang
d9cd216ceb create blank states 2015-11-05 15:34:24 +00:00
Hieu Hoang
31ae7d6f50 create init hypo with Init() 2015-11-05 15:06:34 +00:00
Hieu Hoang
9970c3d487 create init hypo with Init() 2015-11-05 14:57:24 +00:00
Hieu Hoang
b8a8876a99 stack pruning 2015-11-05 14:42:49 +00:00
Hieu Hoang
d0560722cd stack pruning 2015-11-05 14:41:05 +00:00
Hieu Hoang
3ec11d8589 turn references into pointers. For next refactoring 2015-11-05 13:58:00 +00:00
Hieu Hoang
16571f2fdf Revert "turn references into pointers. For next refactoring" 
This reverts commit feeb46808b.
 2015-11-05 13:30:08 +00:00
Hieu Hoang
3b866f03ad add distortion 2015-11-05 13:19:43 +00:00
Hieu Hoang
9298691373 don't use get methods in system 2015-11-05 11:19:37 +00:00
Hieu Hoang
feeb46808b turn references into pointers. For next refactoring 2015-11-05 10:58:41 +00:00
Hieu Hoang
c2d3e4f5c9 stack pruning 2015-11-04 17:23:04 +00:00
Hieu Hoang
3526915b67 leaks 2015-11-04 16:46:04 +00:00
Hieu Hoang
90f2b18578 it works 2015-11-04 16:11:56 +00:00
Hieu Hoang
f8d1c4438d estimatedScore -> estimatedScores 2015-11-04 15:25:09 +00:00
Hieu Hoang
ee85a0860c m_sos -> m_bos 2015-11-04 14:55:18 +00:00
Hieu Hoang
b4ee52ff76 ken lm 2015-11-04 14:54:20 +00:00
Hieu Hoang
ae4e587a8b folder structure like old Moses 2015-11-04 13:09:53 +00:00
Hieu Hoang
876a4fad1d ken lm 2015-11-04 13:03:26 +00:00
Hieu Hoang
16a966c0a1 probing pt 2015-11-04 00:37:35 +00:00
Hieu Hoang
766afc3a29 probing pt 2015-11-03 16:09:49 +00:00
Hieu Hoang
9aea59a8d7 probing pt 2015-11-03 15:04:26 +00:00
Hieu Hoang
03604bf8ae rename phrase classes 2015-11-03 14:20:10 +00:00
Hieu Hoang
6e5a8ac39c directory structure 2015-11-03 13:56:31 +00:00
Hieu Hoang
c118849e97 consistent naming of future scores, estimated scores 2015-11-03 09:58:39 +00:00
Hieu Hoang
4b08ffb202 future score 2015-11-03 05:39:27 +00:00
Hieu Hoang
b734ba8f98 future score 2015-11-02 15:39:01 +00:00
Hieu Hoang
0424ada99d future score 2015-11-02 14:06:03 +00:00
Hieu Hoang
f01a889d87 future score 2015-11-01 16:31:36 +00:00
Hieu Hoang
bfbf4e0492 future score 2015-11-01 16:30:07 +00:00
Hieu Hoang
9776b7875b future score 2015-11-01 16:22:53 +00:00
Hieu Hoang
59912d8fad LM score 2015-10-31 23:52:09 +00:00
Hieu Hoang
460d8e9692 LM state 2015-10-31 08:56:40 +00:00
Hieu Hoang
826f365e10 load mappings 2015-10-31 02:45:01 +00:00
Hieu Hoang
abb3922766 LM score 2015-10-30 20:05:11 +00:00
Hieu Hoang
921c3791c0 unknown wp 2015-10-30 19:10:04 +00:00
Hieu Hoang
4941d3fe13 LM score 2015-10-30 16:44:16 +00:00
Hieu Hoang
c6d19a2fe1 LM score 2015-10-30 16:27:38 +00:00
Hieu Hoang
40572dcbe6 LM score 2015-10-30 15:58:02 +00:00
Hieu Hoang
84ff19f2cf LM score 2015-10-30 15:35:06 +00:00
Hieu Hoang
40ed18acf7 LM score 2015-10-30 15:23:36 +00:00
Hieu Hoang
21c31578d2 LM state 2015-10-30 11:45:38 +00:00
Hieu Hoang
d163c37674 add LM 2015-10-30 10:41:55 +00:00
Hieu Hoang
74e393c582 gcc compile error 2015-10-29 19:11:11 +00:00
Hieu Hoang
9a68ff8da4 fixing scores 2015-10-29 18:15:12 +00:00
Hieu Hoang
82a2129eb4 fixing scores 2015-10-29 17:21:54 +00:00
Hieu Hoang
b1ee2bd643 states work. scores don't 2015-10-29 15:29:14 +00:00
Hieu Hoang
74b635e42f leak 2015-10-29 13:22:59 +00:00
Hieu Hoang
d58bbf158d stateful FF framework 2015-10-29 13:13:01 +00:00
Hieu Hoang
d54de8c8db stateful FF framework 2015-10-29 12:49:18 +00:00
Hieu Hoang
f066ffff81 FF framework 2015-10-29 01:08:03 +00:00
Hieu Hoang
975ecdd931 FF framework 2015-10-29 00:56:50 +00:00
Hieu Hoang
3f05ea5e6c FF framework 2015-10-29 00:47:06 +00:00
Hieu Hoang
d32b3f5968 FF framework 2015-10-28 23:35:21 +00:00
Hieu Hoang
4c096b639f FF framework 2015-10-28 23:31:46 +00:00
Hieu Hoang
4c02cae5f2 FF framework 2015-10-28 23:31:10 +00:00
Hieu Hoang
b652412946 FF framework 2015-10-28 23:26:17 +00:00
Hieu Hoang
59ee17d25f tweak mem pool 2015-10-28 19:37:34 +00:00
Hieu Hoang
ccfa606252 use shared ptr to delete target phrases 2015-10-28 19:35:16 +00:00
Hieu Hoang
2a1406f801 use shared ptr to delete target phrases 2015-10-28 18:26:54 +00:00
Hieu Hoang
b6816d9f4a add UnknownWordPenalty 2015-10-28 18:11:52 +00:00
Hieu Hoang
defc149f7e add UnknownWordPenalty 2015-10-28 17:49:27 +00:00
Hieu Hoang
e135ff2af7 make pools mutable. Can't pass no-const mgr or system 2015-10-28 17:24:45 +00:00
Hieu Hoang
0f7d4ffd79 make pools mutable. Can't pass no-const mgr or system 2015-10-28 17:23:55 +00:00
Hieu Hoang
2e85a318cb add UnknownWordPenalty 2015-10-28 17:12:02 +00:00
Hieu Hoang
6bdf78ef26 abstract pt 2015-10-28 16:45:52 +00:00
Hieu Hoang
9b0e756c83 FF framework 2015-10-28 16:42:12 +00:00
Hieu Hoang
8aba37df02 FF framework 2015-10-28 16:33:08 +00:00
Hieu Hoang
e225b64adf my MemPool 2015-10-28 16:11:12 +00:00
Hieu Hoang
77a2de1d9d my MemPool 2015-10-28 14:39:40 +00:00
Hieu Hoang
675fe68647 FF framework 2015-10-27 21:01:23 +00:00
Hieu Hoang
501ee075fa eclipse 2015-10-27 20:47:42 +00:00
Hieu Hoang
bc2faa87f2 FF framework 2015-10-27 20:39:48 +00:00
Hieu Hoang
afa318cf53 weights 2015-10-27 17:35:42 +00:00
Hieu Hoang
2a7aa7215f FF framework 2015-10-27 17:00:38 +00:00
Hieu Hoang
dfa5e346fa feature function factory 2015-10-27 16:54:15 +00:00
Hieu Hoang
9003770b42 FF framework 2015-10-27 15:46:37 +00:00
Hieu Hoang
a0f9494b47 sort hypos 2015-10-27 12:51:57 +00:00
Hieu Hoang
2f024d403f start nbest list 2015-10-27 12:08:32 +00:00
Hieu Hoang
d92742de99 add hypo to stack 2015-10-26 23:24:58 +00:00
Hieu Hoang
e8d88a2a3f output 2015-10-26 22:12:29 +00:00
Hieu Hoang
9e13596161 output 2015-10-26 21:11:47 +00:00
Hieu Hoang
de5c3cc797 debug info 2015-10-26 19:31:39 +00:00
Hieu Hoang
7e456724b8 warnings 2015-10-26 18:58:20 +00:00
Hieu Hoang
64e8e27c1c debug info 2015-10-26 18:42:42 +00:00
Hieu Hoang
74c4d84e6c debug info 2015-10-26 16:32:47 +00:00
Hieu Hoang
add010b029 add tps to input path 2015-10-26 16:14:17 +00:00
Hieu Hoang
b491873fd1 don't use destructor 2015-10-26 16:02:07 +00:00
Hieu Hoang
790c98360f use FactorCollection for vocab 2015-10-26 14:58:59 +00:00
Hieu Hoang
6d72539a22 FactorCollection is a friend of moses2 System 2015-10-26 13:51:21 +00:00
Hieu Hoang
75c052dc66 get num of factors from bjam arg like the rest of moses 2015-10-26 13:33:17 +00:00
Hieu Hoang
e2bb633632 eclipse 2015-10-26 13:26:58 +00:00
Hieu Hoang
c41d04e3c6 init moses2 2015-10-25 22:41:06 +00:00
Hieu Hoang
840063468e init moses2 2015-10-25 22:38:08 +00:00
Hieu Hoang
a7b9b2dbfc init moses2 2015-10-25 22:30:09 +00:00
Hieu Hoang
50cfde5413 init moses2 2015-10-25 22:22:02 +00:00
Hieu Hoang
105e45c90f init moses2 2015-10-25 22:08:08 +00:00
Hieu Hoang
1dd4222b63 init moses2 2015-10-25 21:46:30 +00:00
Hieu Hoang
9cfc682b15 StaticData -> System 2015-10-25 21:20:55 +00:00
Hieu Hoang
67f6ff1802 init moses2 2015-10-25 19:55:22 +00:00
Hieu Hoang
f0e522a1b6 init moses2 2015-10-25 16:35:20 +00:00
Hieu Hoang
06bb79053b add moses2 to bjam compile 2015-10-25 15:58:26 +00:00
Hieu Hoang
8e5dcd3d03 init moses2 2015-10-25 12:49:25 +00:00
Hieu Hoang
fb233b50e0 init moses2 2015-10-25 11:47:47 +00:00
Hieu Hoang
f9de39ca4c reuse moses' Bitmap 2015-10-25 10:52:18 +00:00
Hieu Hoang
8821529aa7 init moses2 2015-10-24 19:54:16 +01:00
Hieu Hoang
58b5086984 init moses2 2015-10-24 14:36:30 +01:00
Hieu Hoang
e10eed6436 init moses2 2015-10-24 13:31:43 +01:00
Hieu Hoang
2dc53a7c1d init moses2 2015-10-24 13:19:42 +01:00
Hieu Hoang
b4c03af243 init moses2 2015-10-24 13:14:49 +01:00
Hieu Hoang
94c192fa98 init moses2 2015-10-24 13:14:35 +01:00
Hieu Hoang
b3b97f03e5 init moses2 2015-10-24 12:39:15 +01:00
Hieu Hoang
3e514487cf init moses2 2015-10-24 03:32:30 +01:00
Hieu Hoang
0874d90b9d init moses2 2015-10-24 02:32:58 +01:00
Hieu Hoang
a71cfeb3db init moses2 2015-10-24 02:14:52 +01:00
Hieu Hoang
60a588ff29 init moses2 2015-10-24 02:02:50 +01:00
Hieu Hoang
e4655fb1c2 init moses2 2015-10-23 23:19:31 +01:00
Hieu Hoang
29295daf9c init moses2 2015-10-23 20:53:36 +01:00
Hieu Hoang
f467e60fe0 init moses2 2015-10-23 18:33:12 +01:00
Hieu Hoang
5d851f3838 init moses2 2015-10-23 16:46:35 +01:00