Commit Graph

15 Commits

Author SHA1 Message Date
Greg Tatum
db3826266d
Report the wasm size on builds (#460) 2023-08-17 07:55:49 +01:00
Nikolay Bogoychev
534ed37a3d
Remove wormhole references (#459)
* Remove warmhole references

* Remove more references to the WORMHOLE

* Update marian to wormhole removed marian

* Whoops

---------

Co-authored-by: Jelmer van der Linde <jelmer@ikhoefgeen.nl>
2023-08-14 15:22:54 +01:00
Abhishek Aggarwal
e34420647d
Upgrade emsdk to 3.1.8 (#414)
* Rework WASM compilation options

Necessary to work with newer versions of emscripten that are more picky about which option goes to the compiler, and which to the linker. Also took the opportunity to remove the need for the patching of the bergamot-translation-worker.js file, this can now easily be done through supported apis. Furthermore, I tried to downsize the generated javascript and wasm code a bit.

Initial estimates show that bergamot-translator compiled with emscripten 3.0.0 runs at about 3x the speed of 2.0.9 (when using embedded intgemm). Speed-up when using mozIntGemm is less dramatic.

* Updated marian-dev submodule
* Revert changes specific to patching external gemm modules for wasm
* Better Compilation and Link flags

 - Added "-O3" optimization flag for linking as well
 - "-g2" only for release and debug builds
 - "-g1" for release builds
 - Replaced deprecated "--bind" flag with "-lembind"
 - Removed redundant link flag

* Upgraded emsdk to 3.1.8
* Enclosed EXPORTED_FUNCTIONS values in a list
* Fixed the remaining 2.0.9 reference in circle ci build script
* Updated README

Co-authored-by: Jelmer van der Linde <jelmer@ikhoefgeen.nl>
2022-04-20 00:39:32 +01:00
Abhishek Aggarwal
c5167b3d8c
Import matrix-multiply from a separate wasm module (#232)
* Updated marian-dev submodule
* Import wasm gemm from a separate wasm module
 - The fallback implementation of gemm is currently being imported dynamically
   for wasm target
* Updated CI scripts and README to import GEMM from a separate wasm module
* Setting model config to int8shiftAlphaAll in wasm test page
2021-10-27 11:54:39 +02:00
Abhishek Aggarwal
8e4374282a Circle CI wasm artifacts for non-wormhole builds 2021-08-31 17:01:52 +02:00
Abhishek Aggarwal
3e46e3391c Consistent EMSDK version and parallel make jobs in README and github actions
- Set EMSDK version to 2.0.9 to make it consistent
   everywhere in repo
 - Set parallel make jobs to 2
2021-06-09 11:10:10 +02:00
Motin
0f8f8e026a
Pin emsdk version to the same one used in Circle CI (#165) 2021-05-20 08:59:30 +03:00
Abhishek Aggarwal
8a6c7b44a3 Avoid packaging vocab files into wasm binary in CI builds
- We don't need to package vocab files into wasm binary any more
   as a sync with upstream enabled passing vocabs as bytes
2021-05-12 09:55:49 +02:00
Abhishek Aggarwal
c478a626a8 Updating ci scripts for the latest upstream changes
- The upstream browsermt/bergamot-translator builds the wasm artifacts
   in top level build folder now
2021-05-04 13:53:33 +02:00
Abhishek Aggarwal
a7f6bb51d9 Minor cleanup in build-wasm.sh file 2021-04-14 14:51:08 +02:00
Abhishek Aggarwal
f5dffeb5ca Downgraded resource class to 'medium' for circle ci
- Also restricted parallel make compilation to 3
2021-04-14 14:19:13 +02:00
Motin
d1ecd007a6 Shallow clone bergamot-models repo since it has such a large history 2021-03-11 14:38:16 +01:00
Andre Natal
a2d6650097 Patch to load just production ready models 2021-03-11 14:38:16 +01:00
Andre Natal
e96d7047a7 Enable SIMD wormhole in circle ci build scripts
- Modify the APIs that compile & instantiate WASM module
2021-03-11 13:44:14 +01:00
abhi-agg
c64deb50a8
Imported CI scripts from mozilla/bergamot-translator-old (#1)
* CircleCI config, docs and badge

* Increase CircleCI RAM from 4gb to 16gb

Co-authored-by: Motin <motin@motin.eu>
2021-03-10 09:30:39 -08:00