Skip to content

Use_case_Schema_validation

Tom Bentley edited this page May 24, 2022 · 2 revisions

Ensure that records in a (subset of) Produce requests are schema-valid.

Why?

  • Nothing in Kafka forces a client to use a schema registry, so it's possible for producing application to generate record that are invalid.
  • Sometimes a schema registry is adopted when there are existing producing applications, and it's desired to retrospectively add a schema for a legacy application which can't directly use the registry.

How?

Intercept Produce requests and validate them according to a schema.

There would need to be support for a variety of conditions about when to validate:

  • Every Nth request
  • Only for a certain principal (±clientId)
  • A mapping to topic names/ids to schemas

Challenges

Topic ids

See TopicIds.

Clone this wiki locally