Skip to content

Release 0.2.0
Compare
Choose a tag to compare
@drasmuss drasmuss released this 02 Nov 19:38
v0.2.0
b34fa11

Added

  • Added documentation for package description, installation, usage, API, examples, and project information. (#20)
  • Added LMU FFT cell variant and auto-switching LMU class. (#21)
  • LMUs can now be used with any Keras RNN cell (e.g. LSTMs or GRUs) through the hidden_cell parameter. This can take an RNN cell (like tf.keras.layers.SimpleRNNCell or tf.keras.layers.LSTMCell) or a feedforward layer (like tf.keras.layers.Dense) or None (to create a memory-only LMU). The output of the LMU memory component will be fed to the hidden_cell. (#22)
  • Added hidden_to_memory, memory_to_memory, and input_to_hidden parameters to LMUCell, which can be used to enable/disable connections between components of the LMU. They default to disabled. (#22)
  • LMUs can now be used with multi-dimensional memory components. This is controlled through a new memory_d parameter of LMUCell. (#22)
  • Added dropout parameter to LMUCell (which applies dropout to the input) and recurrent_dropout (which applies dropout to the memory_to_memory connection, if it is enabled). Note that dropout can be added in the hidden component through the hidden_cell object. (#22)

Changed

  • Renamed lmu.lmu module to lmu.layers. (#22)
  • Combined the *_encoders_initializerparameters of LMUCell into a single kernel_initializer parameter. (#22)
  • Combined the *_kernel_initializer parameters of LMUCell into a single recurrent_kernel_initializer parameter. (#22)

Removed

  • Removed Legendre, InputScaled, LMUCellODE, and LMUCellGating classes. (#22)
  • Removed the method, realizer, and factory arguments from LMUCell (they will take on the same default values as before, they just cannot be changed). (#22)
  • Removed the trainable_* arguments from LMUCell. This functionality is largely redundant with the new functionality added for enabling/disabling internal LMU connections. These were primarily used previously for e.g. setting a connection to zero and then disabling learning, which can now be done more efficiently by disabling the connection entirely. (#22)
  • Removed the units and hidden_activation parameters of LMUCell (these are now specified directly in the hidden_cell. (#22)
  • Removed the dependency on nengolib. (#22)
  • Dropped support for Python 3.5, which reached its end of life in September 2020. (#22)
Assets 2
Loading