How do you train with those NOT-TEXT elements.

[linan142857]

Dear author,
For some documents that contain massive not-text elements, such as hundreds of thousands of "##LTLine##". How do you deal with them actually?
For example, you try to train&predict all those elements with text '##LTLine##'.

Thank you!

[liminghao1630]

Yes. We regard '##LTLine##' as a special token during train and predict.

[NandreyN]

Yes. We regard '##LTLine##' as a special token during train and predict.

Hi! Could you please tell integer identifiers of ##LTLine## and ##LTFigure## tokens within LayoutLM's vocabulary?

Thanks

[liminghao1630]

In fact, we did not add them to the vocabulary. They will also be tokenized into tokens and labeled in the way I mentioned at #25.

[NandreyN]

Thanks