Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NNEF integration #14

Open
1 of 2 tasks
bminixhofer opened this issue Aug 15, 2020 · 2 comments
Open
1 of 2 tasks

NNEF integration #14

bminixhofer opened this issue Aug 15, 2020 · 2 comments

Comments

@bminixhofer
Copy link
Owner

bminixhofer commented Aug 15, 2020

tract now supports NNEF in sonos/tract#340.

  • Check size reduction by replacing ONNX and TF with NNEF and building the package.
  • If the size reduction is significant (@kali sees 25%!) we should create a separate package @tractjs/nnef for NNEF support. It follows that ONNX and TF should also be split this way into @tractjs/onnx and @tractjs/tf. See the way TF.js does splitting into packages.

This and #12 should get us below 1MB!

@bminixhofer
Copy link
Owner Author

@kali I got around to checking this now:

Current WASM size: 4.7MB, 1.0MB gzipped
WASM size with tract_onnx and tract_tensorflow replaced by tract_nnef: 2.8MB, 680KB gzipped!

So a huge decrease, and definitely worth implementing in tractjs.

@kali
Copy link

kali commented Aug 17, 2020

Ha thanks, that's great news :) Working on the scan op support right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants