v0.6.0

What's Changed

• add test_fingerprint to test widget by @mike0sv in #1386
• fix get dataset permissions by @svetleo-evidently in #1399
• fix get dataset permissions by @svetleo-evidently in #1401
• Docs: misc updates by @elenasamuylova in #1397
• Metrics redesign by @Liraim in #1389
• Store tests datasets in repo. by @Liraim in #1416
• New reports improvements. by @Liraim in #1414
• Openai errors by @svetleo-evidently in #1417
• fix descriptors params: include_reasoning and include_score by @svetleo-evidently in #1419
• Reference support in new version. by @Liraim in #1415
• default tests and include_tests logic by @mike0sv in #1418
• Support reference in metrics. by @Liraim in #1420
• Render for new ValueDrift and DataDriftPreset. by @Liraim in #1421
• Add approxvalue support in tests. by @Liraim in #1425
• recsys metrics by @mike0sv in #1423
• not equal by @mike0sv in #1424
• fixes by @mike0sv in #1426
• Fix data drift params and tests. by @Liraim in #1428
• Add explicit display names for metric results. by @Liraim in #1430
• default ref tests by @mike0sv in #1427
• Support value names in all metrics. by @Liraim in #1431
• new dummmy metrics by @mike0sv in #1432
• ValueStats render by @Liraim in #1433
• add run by @mike0sv in #1437
• Feature/ml vis by @mike0sv in #1434
• Text Evals render and DataSummaryPreset by @Liraim in #1435
• Replace RocAuc by label render. by @Liraim in #1439
• Add RegressionQuality render and RegressionPreset. by @Liraim in #1436
• Add ClassificationQuality render and ClassificationPreset. by @Liraim in #1438
• Tests summary in new reports. by @Liraim in #1442
• Feature/add run by @mike0sv in #1444
• fix descriptor columns by @mike0sv in #1440
• openai_errors_handle by @svetleo-evidently in #1443
• Support None / NaN in UniqueValuesCount metric by @Liraim in #1446
• Fix information about descriptors in snapshots. by @Liraim in #1448
• Support ByLabelValue in field iterators. by @Liraim in #1450
• FIPS compliant by @DueViktor in #1411
• Support V2 metrics in Distribution. by @Liraim in #1452
• default reference tests by @mike0sv in #1445
• add alias as display name by @mike0sv in #1453
• Support presets from new reports in old snapshots. by @Liraim in #1454
• fix prompts by @mike0sv in #1455
• UI: add histigram panel plot type by @DimaAmega in #1447

New Contributors

• @DueViktor made their first contribution in #1411

Full Changelog: v0.5.1...v0.6.0

v0.5.1

What's Changed

• fix empty strings in datagen by @mike0sv in #1385
• UI: go to report from dashboard plot by @mike0sv in #1383
• UI(feature): [Dashboard] vertical line at selected point by @DimaAmega in #1387
• move managers by @mike0sv in #1328
• UI: add dot on clicked point on dashoard by @DimaAmega in #1388
• fix CI by @DimaAmega in #1393
• add customdata for distribution by @mike0sv in #1392
• UI: refactor use widget wrapper by @DimaAmega in #1395

Full Changelog: v0.5.0...v0.5.1

v0.5.0

What's Changed

• No teams by @svetleo-evidently in #1375
• move projects from teams to org by @svetleo-evidently in #1376
• Dataset to project postmigration by @svetleo-evidently in #1379
• add project read permission for org viewer by @svetleo-evidently in #1377
• Docs: change TextOverviewPreset to TextEvals by @SkafteNicki in #1374
• No team_id in docs by @emeli-dral in #1381
• feat: add IsValidSQL() by @vectorvp in #1372

New Contributors

• @SkafteNicki made their first contribution in #1374
• @vectorvp made their first contribution in #1372

Full Changelog: v0.4.40...v0.5.0

v0.4.40

What's Changed

• add list users permission by @DimaAmega in #1362
• Move pipes import to support py3.13 by @mike0sv in #1361
• remove exp datagen by @DimaAmega in #1366
• Move datasets to project by @svetleo-evidently in #1365
• Docs: small fixes by @elenasamuylova in #1368

Full Changelog: v0.4.39...v0.4.40

v0.4.39

What's Changed

• UI: refactor playwright run by @DimaAmega in #1331
• run-snapshot-async by @svetleo-evidently in #1330
• Add ItemMatch + ItemNoMatch Descriptors by @jon-bown in #1338
• UI(tests): increase timeout to 4m by @DimaAmega in #1344
• Feature/dataset generator by @mike0sv in #1340
• Remove pip-audit by @Liraim in #1345
• Add JSONSchemaMatch feature and descriptor by @trey-capps in #1342
• IsValidJSON() descriptor by @gagan-bhullar-tech in #1325
• ExactMatch descriptor by @gagan-bhullar-tech in #1326
• Add WordMatch + WordNoMatch descriptor by @jon-bown in #1334
• use new wrapper/prompt api by @mike0sv in #1346
• Feat/add contains link descriptor by @Sifr-un in #1333
• Fix embeddings test presets error by @Liraim in #1347
• Add missing type aliases in how_to_make_custom_metric_and_test example by @Liraim in #1349
• Remove TextOverviewPresets references from examples and docs by @Liraim in #1348
• Fix llm example. by @Liraim in #1350
• Update Mypy rules and version. by @Liraim in #1343
• OpenAI error message by @svetleo-evidently in #1354
• added JSONMatch Descriptor by @ramachaitanya0 in #1337
• Add IsValidPython descriptor by @trey-capps in #1351
• Fix PyTorch-NumPy compatibility in build workflows by @Liraim in #1356
• UI: dark mode by @DimaAmega in #1355
• Fix typos by @strickvl in #1358
• fix(dashboard): filter by date test panels by @DimaAmega in #1359
• feat: Add BERTScore feature descriptor and feature by @projectultra in #1335

New Contributors

• @jon-bown made their first contribution in #1338
• @trey-capps made their first contribution in #1342
• @gagan-bhullar-tech made their first contribution in #1325
• @Sifr-un made their first contribution in #1333
• @ramachaitanya0 made their first contribution in #1337
• @projectultra made their first contribution in #1335

Full Changelog: v0.4.38...v0.4.39

v0.4.38

What's Changed

• UI(linter, formatter): setup biome by @DimaAmega in #1287
• UI: fix cache issue on CI by @DimaAmega in #1290
• UI: fix biome by @DimaAmega in #1291
• UI: a bit dry in CI by @DimaAmega in #1293
• Update NavigationProgress.tsx z-index by @DimaAmega in #1295
• Docs for v0.4.37 by @elenasamuylova in #1297
• Feature/llm playground by @mike0sv in #1298
• Fixing minor typo by @sapenov in #1303
• UI(refactor): CI: merge code-check job with type-check job by @DimaAmega in #1304
• UUID7 by @mike0sv in #1267
• ALIES INVASION by @mike0sv in #1301
• add llm env for example tests by @mike0sv in #1299
• make ui/base async by @mike0sv in #1307
• UI: Replace github icon to discord icon by @DimaAmega in #1322
• UI(fix): discord link by @DimaAmega in #1323

New Contributors

• @sapenov made their first contribution in #1303

Full Changelog: v0.4.37...v0.4.38

v0.4.37

What's Changed

• Fix README links by @elenasamuylova in #1257
• Fix missing feature_type in ColumnDriftMetric. by @Liraim in #1258
• serializable presets by @mike0sv in #1254
• Remove top version boundary for nltk. by @Liraim in #1261
• fix semantic similarity descriptor by @mike0sv in #1260
• fix openai model by @mike0sv in #1262
• Remove opentelemetry dependency. by @Liraim in #1264
• llm judges updates by @mike0sv in #1259
• get_api_route_handelers fix by @svetleo-evidently in #1266
• fix recsys stuff by @mike0sv in #1265
• fix typo by @svetleo-evidently in #1263
• LLMEval (binary judge) by @mike0sv in #1268
• Docs: major update by @elenasamuylova in #1270
• Raise validation error on import error by @mike0sv in #1269
• Docs: updates + 2 new tutorials by @elenasamuylova in #1274
• Bias and Toxicity evals by @emeli-dral in #1276
• Fix datasets.load_iris parameter in the README by @gcbeltramini in #1273
• UI: date range debounce by @DimaAmega in #1279
• Update llm_judges.py by @DimaAmega in #1284
• LLM evals with columns by @mike0sv in #1272
• Link config snapshot by @svetleo-evidently in #1283
• Collector save data by @mike0sv in #1282
• Remove text overview preset by @mike0sv in #1271
• cryptography version up by @svetleo-evidently in #1285
• rename semantic_similarity by @mike0sv in #1286
• Added examples for custom descriptors, semantic similarity by @emeli-dral in #1288

New Contributors

• @gcbeltramini made their first contribution in #1273

Full Changelog: v0.4.36...v0.4.37

v0.4.36

What's Changed

• Docs: Quickstart updates + Tracing by @elenasamuylova in #1244
• Fix hash in OpenAIFeature. by @Liraim in #1249
• Prompting examples updates by @emeli-dral in #1251
• add columns in llm descriptor by @mike0sv in #1250
• Change default address to 127.0.0.1 in UI and Collector service. by @Liraim in #1252
• fix #1234 by @mike0sv in #1253
• make type field literal type by @mike0sv in #1238

Full Changelog: v0.4.35...v0.4.36

v0.4.35

What's Changed

• fix typo by @mike0sv in #1245
• OpenAIPrompting -> LLMEval by @emeli-dral in #1246
• fix llm single column by @mike0sv in #1247
• Fix HuggingFaceFeature / CustomEvals hash error. by @Liraim in #1248

Full Changelog: v0.4.34...v0.4.35

v0.4.34

What's Changed

• UI(fix): SnapshotsListTemplate by @DimaAmega in #1235
• Multi-column descriptors by @mike0sv in #1222
• CI: fix skip test on python 3.12 by @DimaAmega in #1236
• UI(fix): in-order add categoryorder by @DimaAmega in #1240
• Hold reports in collector service until it uploaded to UI service. by @Liraim in #1241
• llm judges by @mike0sv in #1237
• Example/tracing tutorial by @emeli-dral in #1242

Full Changelog: v0.4.33...v0.4.34