Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ternary net how to store the model #1

Open
luhaofang opened this issue Jun 13, 2016 · 4 comments
Open

Ternary net how to store the model #1

luhaofang opened this issue Jun 13, 2016 · 4 comments

Comments

@luhaofang
Copy link

No description provided.

@fengfu-chris
Copy link
Owner

You need to store the ternary weights and the scaling factor alpha. For
X * (alpha * Wt) = (alpha * X) * Wt
this would hold the potential of speeding up the forward propagation.

@mathmanu
Copy link

mathmanu commented Dec 5, 2016

@fengfu-chris
Why not do it as:
(X * Wt) * alpha
So convolution is just add/substract and finally a scaling is done to the output.
Is my understanding correct - is it possible to implement it this way?

@fengfu-chris
Copy link
Owner

@mathmanu That is correct. Both methods can be implemented with an additional Scale layer in Caffe.

@manwu1994
Copy link

@fengfu-chris
Why not do it as:
(X * Wt) * alpha
So convolution is just add/substract and finally a scaling is done to the output.
Is my understanding correct - is it possible to implement it this way?

I also agree with ((X * Wt) * alpha) that speeding up the inference in hardware, do you have any method to extract the alpha parameters of each neurons? Thank you...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants