Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solr 2.10 unable to handle immense field #1750

Open
kentsanggds opened this issue Jun 18, 2024 · 0 comments
Open

Solr 2.10 unable to handle immense field #1750

kentsanggds opened this issue Jun 18, 2024 · 0 comments
Labels
DGU data.gov.uk (CKAN)

Comments

@kentsanggds
Copy link
Contributor

Solr schema may need updating to split the field up -

Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="status" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[123, 34, 106, 111, 98, 95, 99, 111, 117, 110, 116, 34, 58, 32, 52, 53, 53, 44, 32, 34, 108, 97, 115, 116, 95, 106, 111, 98, 34, 58]...', original message: bytes can be at most 32766 in length; got 37690
at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:984) ~[?:?]
...
Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 37690
at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:281) ~[?:?]
...

@dj-maisy dj-maisy added the DGU data.gov.uk (CKAN) label Jul 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DGU data.gov.uk (CKAN)
Projects
None yet
Development

No branches or pull requests

2 participants