Fix the problem that the sequence length is still limited when using relative positions#111

Open

wakafengfan wants to merge 1 commit intohuawei-noah:masterfrom wakafengfan:master

+58-6

Commits on Apr 8, 2021

The original relative_position_embeddings were created while a fixed matrix of relative_position_ids was preset to look up the table (i.e., the relative_position_ids matrix for sequences of length …
wakafengfan
committed