Commit Graph

185 Commits

Author SHA1 Message Date
Huw Campbell
df9f80a9cf Update Readme with new network type 2017-02-03 22:47:28 +11:00
Huw Campbell
c8cfa399e7 Split back propagation function into two.
We now have one function which gives a Tape and
the output, and another which takes the Tape and
a loss gradient.

This has a great benefit, in that people can build
their own losses, which makes things like GANs
really easy.
2017-02-03 22:44:31 +11:00
Huw Campbell
7d476bf0f6 Semigroup dep for optparse 2017-02-03 21:18:53 +11:00
Huw Campbell
1e461cb07a Make Pad 3D faster.
Using dependent types in the deeper functions and
requiring a Proxy to reach them meant we required
dictionary passing to get the Nats. This made the
pad and crop layers almost 1000 times slower than
they should have been.
2017-02-03 21:05:14 +11:00
Huw Campbell
dbeb962ae6 Fix many warnings 2017-02-03 14:43:07 +11:00
Huw Campbell
7af621cbb6 Add c 3d pad and crop functions 2017-02-02 20:27:02 +11:00
Huw Campbell
a23103ee7b Add extra composition 2017-02-01 22:13:20 +11:00
Huw Campbell
32f3e317e8 Change fusing layers so we can have two paths of sub networks 2017-02-01 14:17:18 +11:00
Huw Campbell
e6179ce5a4 Add recurrent tapes 2017-01-28 14:13:00 +11:00
Huw Campbell
d82a121797 Remove Show constraint on UpdateLayer 2017-01-24 13:47:47 +11:00
Huw Campbell
148c7778ab Simplify Network Type 2017-01-23 12:47:10 +11:00
Huw Campbell
6ad9803286 Start working on Tape 2017-01-21 12:46:40 +11:00
Huw Campbell
51ae147306 Add benchmark file 2017-01-20 18:53:18 +11:00
Huw Campbell
16573158d8 Nicer type 2017-01-19 23:08:01 +11:00
Huw Campbell
9989092216 Update Readme 2017-01-19 20:52:22 +11:00
Huw Campbell
df75beee8d Missing test file 2017-01-19 19:49:13 +11:00
Huw Campbell
2369ec3407 Merge pull request #15 from HuwCampbell/topic/cereal
Add very basic model saving and loading
2017-01-19 19:06:36 +11:00
Huw Campbell
7c4916409d Add command line parameters for shakespeare example 2017-01-19 19:04:15 +11:00
Huw Campbell
bcd1856988 Update LSTM 2017-01-19 18:56:22 +11:00
Huw Campbell
48263cd9e2 Update README.md
Add recurrent
2017-01-17 19:47:39 +11:00
Huw Campbell
4dc408f39d Add very basic model saving and loading 2017-01-16 10:16:40 +11:00
Huw Campbell
20e7e483d7 Fix 7.10 builds 2017-01-16 00:29:25 +11:00
Huw Campbell
cc70f1fc0c Merge pull request #18 from HuwCampbell/topic/recurrent
Recurrent nets and other changes
2017-01-14 21:16:48 +11:00
Huw Campbell
ac0e4b22c8 Remove primes on shape instantiations
Add singletons for Shape and remove hacks on recurrent nets

Add Recurrent Nets
2017-01-14 21:09:07 +11:00
Huw Campbell
88021fbde7 Better testing 2016-12-15 20:04:45 +11:00
Huw Campbell
424d791a30 Fix silent conversion bug in pooling layer
Add quickcheck against reference implemenations for layer internals

Add skolem layer generators.
2016-12-15 11:21:37 +11:00
Huw Campbell
70e9b83b04 Remove unneeded function 2016-12-13 11:09:35 +11:00
Huw Campbell
fc958630c4 Merge pull request #16 from HuwCampbell/topic/performance
Topic/performance
2016-12-13 11:01:35 +11:00
Huw Campbell
bacfa8145b Update REAMDE and use type synonyms 2016-12-13 10:59:29 +11:00
Huw Campbell
9df47d5c7e Remove indexed Vector type 2016-12-13 09:51:55 +11:00
Huw Campbell
6417151620 Make Grenade fast
Changes shapes to get rid of the Vector, all data is
now held in contiguous memory.

Add fast c implementations for pooling layers.

Now does mnist on my laptop in 12 minutes.
2016-12-13 08:39:32 +11:00
Huw Campbell
1ec65a414f Add stupidly fast col2im 2016-12-13 01:11:18 +11:00
Huw Campbell
3830e55a7c Add stupidly fast im2col in c 2016-12-12 23:35:00 +11:00
Huw Campbell
f04bfebfee Speed up im2col, vid2col.
Each point on the output is written to precisely once, so we don't
need to initialise it or use an additive update modifier.
2016-12-12 12:59:41 +11:00
Huw Campbell
bd881faf2b Add some benchmarks 2016-12-12 10:20:40 +11:00
Huw Campbell
c0bb69de3b Update README 2016-12-09 22:48:41 +11:00
Huw Campbell
2cffa4a568 Merge pull request #14 from HuwCampbell/topic/performance
Topic/performance
2016-12-09 22:04:50 +11:00
Huw Campbell
267ebc2080 Optimise poolForwardFit 2016-12-09 22:03:29 +11:00
Huw Campbell
b914b91c1f Reimplement pooling backwards for speed 2016-12-09 22:03:29 +11:00
Huw Campbell
bbd29e71bd Make ST modifications strict 2016-12-09 22:03:29 +11:00
Huw Campbell
8b3ca1e0b6 Merge pull request #13 from HuwCampbell/topic/performance
Topic/performance
2016-12-09 10:44:51 +11:00
Huw Campbell
a29afe8603 Replace dodgy sequence 2016-12-09 09:17:23 +11:00
Huw Campbell
eb179d071b Add another test 2016-12-08 21:11:50 +11:00
Huw Campbell
24289dba41 Add faster maxIndex and maxElement for matrices 2016-12-08 21:07:18 +11:00
Huw Campbell
ff20855676 Minor changes 2016-12-08 10:32:07 +11:00
Huw Campbell
2433e1fba2 Remove old functions 2016-12-08 10:10:14 +11:00
Huw Campbell
670f2d952f Tests 2016-12-08 10:10:14 +11:00
Huw Campbell
b090b5f073 Make things faster 2016-12-08 10:10:14 +11:00
Huw Campbell
d360438fc0 Update hmatrix 2016-12-08 10:10:13 +11:00
Huw Campbell
2cb93c6a5b Use ExceptT in mnist 2016-12-08 10:10:04 +11:00