Commit Graph

296 Commits

Author SHA1 Message Date
Hieu Hoang
919c999e53 grad 2016-09-18 20:01:24 +01:00
Hieu Hoang
40a9791f69 softmax grad 2016-09-18 19:45:02 +01:00
Hieu Hoang
022a20efb7 eclipse 2016-09-18 19:36:35 +01:00
Hieu Hoang
1c0fdfca8d merge 2016-09-18 19:15:12 +01:00
Hieu Hoang
add31dea47 test nodes 2016-09-18 18:09:02 +01:00
Lane Schwartz
10ee031e61 Added comments to more methods 2016-09-18 18:20:46 +02:00
Lane Schwartz
6c4a6e0eb4 Is "ChainableStack" the most appropriate name for this data structure? 2016-09-18 17:42:48 +02:00
Lane Schwartz
a875db7333 Added @brief messages to methods 2016-09-18 17:41:55 +02:00
Lane Schwartz
c82623b0ac Commented methods that create Expr objects 2016-09-18 17:31:15 +02:00
Andre Martins
ebbc148cc6 Minimal example that shows that something is wrong in a computation graph that forks. 2016-09-18 16:15:37 +01:00
Lane Schwartz
dd270a4f92 Added TODO notes for Marcin 2016-09-18 17:09:38 +02:00
Marcin Junczys-Dowmunt
d02ec369fa Merge branch 'master' of github.com:emjotde/marian 2016-09-18 16:55:32 +02:00
Marcin Junczys-Dowmunt
5fa56d0b85 removed clipping 2016-09-18 16:55:28 +02:00
Lane Schwartz
b4c4463344 Added standardized copyright statement to all source files 2016-09-18 16:46:58 +02:00
Andre Martins
f5f5e44486 Merge branch 'master' of https://github.com/emjotde/Marian 2016-09-18 15:44:05 +01:00
Andre Martins
c9dc0cf934 Corrected bug in softmax; implemented cross-entropy node along with a few CUDA functions. 2016-09-18 15:43:28 +01:00
Lane Schwartz
88228e8fe2 Is "tensor.h" actually needed by npz_converter.h? 2016-09-18 16:27:09 +02:00
Lane Schwartz
cac6318818 Commented npz_converter.h 2016-09-18 16:25:30 +02:00
Marcin Junczys-Dowmunt
ed684e25b6 combined elementwise functions for softmax gradient into single kernel call, no temporary objects needed, slightly faster 2016-09-18 16:21:15 +02:00
Andre Martins
20c80e4bbc Moved max-subtraction (safe softmax) inside the Softmax implementation. 2016-09-17 23:09:35 +01:00
Hieu Hoang
9a6894949e eclipse 2016-09-17 23:19:07 +02:00
Hieu Hoang
1f308d2004 Merge ../Marian 2016-09-17 23:09:38 +02:00
Hieu Hoang
21bdc84e25 move eos to vocab 2016-09-17 23:09:33 +02:00
Marcin Junczys-Dowmunt
089f76751b Merge branch 'master' of github.com:emjotde/marian 2016-09-17 19:53:06 +02:00
Marcin Junczys-Dowmunt
bfd9c369f8 preparing mnist benchmark 2016-09-17 19:52:56 +02:00
Andre Martins
04fb8734a2 Training the encoder-decoder (one batch for now). 2016-09-17 09:35:23 +01:00
Marcin Junczys-Dowmunt
1d11b4a40e Merge branch 'master' of github.com:emjotde/marian 2016-09-17 08:12:53 +02:00
Marcin Junczys-Dowmunt
5ed36889a6 cleaned-up visualization 2016-09-17 08:12:45 +02:00
Andre Martins
f6de1677e1 Implemented safe softmax (but doesn't solve the problem yet, we need log-softmax). 2016-09-17 02:42:11 +01:00
Andre Martins
eb57df2a3e Some cleaning. 2016-09-17 02:00:03 +01:00
Andre Martins
22bbac3287 Eliminated non-deterministic behaviour. 2016-09-17 01:55:09 +01:00
Marcin Junczys-Dowmunt
09ce7e6349 renamed sgd.h to optimizers.h 2016-09-16 23:55:47 +02:00
Marcin Junczys-Dowmunt
6e90198426 demonstrate settings for need for safe softmax 2016-09-16 23:45:35 +02:00
Marcin Junczys-Dowmunt
c0b676c7c9 Tidying up optimizers 2016-09-16 23:32:09 +02:00
Marcin Junczys-Dowmunt
70f8277eb1 Merge branch 'master' of github.com:emjotde/marian 2016-09-16 23:27:05 +02:00
Marcin Junczys-Dowmunt
c46012a6c1 Adam optimizer 2016-09-16 23:26:54 +02:00
Hieu Hoang
ea66688a13 Merge ../Marian 2016-09-16 19:56:54 +02:00
Hieu Hoang
40ac84ba73 add argmax() 2016-09-16 19:56:01 +02:00
Hieu Hoang
948789787d add ArgmaxNodeOp 2016-09-16 19:49:59 +02:00
Andre Martins
cbc29a0ab1 Added ref for the backprop of the fast softmax. 2016-09-16 18:41:26 +01:00
Andre Martins
8f1a7382ec Merged. 2016-09-16 18:36:30 +01:00
Andre Martins
c54eaf17d5 Made e-d use actual MT data instead of synthetic. 2016-09-16 18:27:54 +01:00
Marcin Junczys-Dowmunt
2892fe0feb Merge branch 'master' of github.com:emjotde/marian 2016-09-16 19:25:10 +02:00
Marcin Junczys-Dowmunt
c77e589267 renamed softmax_fast to softmax 2016-09-16 19:24:57 +02:00
Lane Schwartz
015be2bf63 Merge branch 'master' of https://github.com/emjotde/Marian 2016-09-16 19:21:20 +02:00
Lane Schwartz
016c777d42 Don't make doc when make all 2016-09-16 19:21:15 +02:00
Marcin Junczys-Dowmunt
268d1e799c Merge branch 'master' of github.com:emjotde/marian 2016-09-16 19:03:52 +02:00
Marcin Junczys-Dowmunt
12fa4f40d2 removed cudaSetDevice 2016-09-16 19:03:45 +02:00
Marcin Junczys-Dowmunt
e37a54712d Update LICENSE.md 2016-09-16 18:57:11 +02:00
Marcin Junczys-Dowmunt
3f74962df7 Merge branch 'master' of github.com:emjotde/marian 2016-09-16 18:34:45 +02:00