You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While the most widely-used activation functions are predefined, it'd be better to have some sort of registry so that the serde deserialization works with custom activations.
It would also be good to note that there should be a separate flag or something for those activation functions which do not want to be randomly mutated to/fro.
The text was updated successfully, but these errors were encountered:
Might implement this using a trait or something and then just boxing it. The current Arc<dyn Fn> model could be very easily replaced by Arc<dyn Activation> and then blanket impl on Fn for some default trait stuff.
While the most widely-used activation functions are predefined, it'd be better to have some sort of registry so that the
serde
deserialization works with custom activations.It would also be good to note that there should be a separate flag or something for those activation functions which do not want to be randomly mutated to/fro.
The text was updated successfully, but these errors were encountered: