Suggestion on Add mutliple encoder

[YGHacker]

Hi there, I am interested in using more than 1 encoder on my speech tasks, does this framework support this feature? Currently in SLAM paper I see only one speech encode is included. I think including multiple encoders are useful and common in research papers.

If not, do you have idea/plan about how to modify the code in order to support training multiple encoders? Thanks in advance.

[ddlBoJack]

IMO, the code to add multiple encoders is easy to conduct. However, the difficulty is to train the model and find the scenario where duo encoders work better than a single encoder. And welcome PR if you find duo encoders work well in your scenario!

[YGHacker]

Thank you very much. As I am not familiar with the code base, could you kindly give an overview of possible steps?

[ddlBoJack]

You can refer to the README file in each example we provide.