Automatic differentiation

[Evizero]

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

[tbreloff]

Yes nothing stopping auto diff as part of the framework... Should be no more than a short method or 2 to implement. Let me know if you have a specific cost function or activation that you're interested in... I might be able to help out.

On Sep 4, 2015, at 4:08 PM, Christof Stocker [email protected] wrote:

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

—
Reply to this email directly or view it on GitHub.