Commit Graph

7 Commits

Author SHA1 Message Date
Young Jin Kim
9c9a240354 Merged PR 10266: FBGEMM based Int8 model
FBGEMM based Int8 model - working with the master
1. Added int8 implementation into packed_gemm.h/cpp with FBGEMM
2. Update FBGEMM library to make it work on windows
3. Split 'ispacked' into packed8 and packed16
4. Change all names for PackFp32 to PackFp16 which is more accurate
2019-12-03 19:14:18 +00:00
Frank Seide
aea72867df lemmaEt should initialize with glorot_uniform2 2019-08-08 16:46:04 -07:00
Marcin Junczys-Dowmunt
50d64de62c
Merge pull request #415 from marian-nmt/chmod-x
C++ source should not have execute bits
2019-01-25 08:52:30 -08:00
Kenneth Heafield
f100a8649a C++ source is should not have execute bits 2019-01-23 23:20:46 +00:00
Frank Seide
4cf97df51e minibatch-size warmup (manually merged over from fseide/covbias);
minibatches are now fed in GPU-sized chunks rather than a massive joint batch for all GPUs in the update;
Adam hyper-parameter adjustment limited to learning rate, as momentum adjustment is counterproductive for MB scaling;
log output now includes the last batch size;
log output now shows current best for stalled validation metrics;
bug fix: Adam optimizer should persist denominators;
bug fix: Adam and Adagrad should use correct element size when persisting;
min and max renamed to minimum and maximum, for consistency with other toolkits;
pathie now compiles in manual VS Project
2018-12-12 18:40:46 -08:00
Marcin Junczys-Dowmunt
b44195c33d fix more warnings 2018-12-11 14:01:11 -08:00
Frank Seide
a8ad3a028e added VS Solution and Project 2018-08-19 16:18:32 -07:00