feat: implement structured generators #19

JanPokorny · 2024-09-10T18:27:08Z

Replace generateStructured method by a separate ChatLLM polymorphic wrapper. The original functionality of generateStructured is replaced by JsonSchemaGenerator, as evidenced by the example structured.ts. Furthermore, there's JsonTypeGenerator that demonstrates the schema to the LLM as a TypeScript type instead of raw JSONSchema (some models like it better), and YamlSchemaGenerator which uses YAML for both presenting the schema and the response format.

examples/llms/structured.ts

src/generators/baseGenerator.ts

src/generators/jsonSchemaGenerator.ts

src/generators/jsonTypeGenerator.ts

src/generators/yamlSchemaGenerator.ts

src/drivers/base.ts

JanPokorny requested a review from Tomas2D September 10, 2024 18:27

JanPokorny force-pushed the janpokorny/feat-implement-structured-generators branch from cc563ca to fca8ea8 Compare September 10, 2024 18:28

JanPokorny changed the title ~~Implement structured generators~~ feat: implement structured generators Sep 10, 2024

JanPokorny force-pushed the janpokorny/feat-implement-structured-generators branch from fca8ea8 to 2f89572 Compare September 10, 2024 18:33

Tomas2D requested changes Sep 11, 2024

View reviewed changes

examples/llms/structured.ts Outdated Show resolved Hide resolved

src/generators/baseGenerator.ts Outdated Show resolved Hide resolved

src/generators/baseGenerator.ts Outdated Show resolved Hide resolved