Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New doc - MEAI evaluation quickstart #44574

Open
alexwolfmsft opened this issue Jan 28, 2025 · 0 comments
Open

New doc - MEAI evaluation quickstart #44574

alexwolfmsft opened this issue Jan 28, 2025 · 0 comments
Assignees
@gewarren
Labels
📌 seQUESTered Identifies that an issue has been imported into Quest.

Comments

@alexwolfmsft
Copy link
Contributor

alexwolfmsft commented Jan 28, 2025 •
edited by sequestor bot
Loading

Describe the issue or suggestion

Create a new doc that explains how to get started using MEAI for evaluations. Evaluations refer to the process of assessing the quality and accuracy of responses generated by AI models, such as SLMs or LLMs. Cover the following topics:

  • What are the MEAI evaluations libraries?
  • How to evaluate your AI prompts using testing scenarios
  • How to view and read the assessment results

Associated WorkItem - 368770
@dotnet-policy-service dotnet-policy-service bot added the ⌚ Not Triaged Not triaged label Jan 28, 2025
@dotnetrepoman dotnetrepoman bot added the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Jan 28, 2025
@dotnet-policy-service dotnet-policy-service bot removed the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Jan 28, 2025
@dotnetrepoman dotnetrepoman bot added the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Jan 28, 2025
@dotnet-policy-service dotnet-policy-service bot removed the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Jan 28, 2025
@alexwolfmsft alexwolfmsft self-assigned this Jan 29, 2025
@gewarren gewarren assigned gewarren and unassigned alexwolfmsft Feb 3, 2025
@dotnetrepoman dotnetrepoman bot added the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Feb 3, 2025
@dotnet-policy-service dotnet-policy-service bot removed the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Feb 3, 2025
@gewarren gewarren added 🗺️ reQUEST Triggers an issue to be imported into Quest. and removed ⌚ Not Triaged Not triaged intelligent-apps/subsvc labels Feb 3, 2025
@dotnetrepoman dotnetrepoman bot added the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Feb 3, 2025
@dotnet-policy-service dotnet-policy-service bot removed the 🗺️ mapQUEST Only used as a way to mark an issue as updated for quest. RepoMan should instantly remove it. label Feb 3, 2025
@sequestor sequestor bot added 📌 seQUESTered Identifies that an issue has been imported into Quest. and removed 🗺️ reQUEST Triggers an issue to be imported into Quest. labels Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gewarren gewarren

Labels
📌 seQUESTered Identifies that an issue has been imported into Quest.
Projects
dotnet/docs February 2025 sprint project
Status: 🔖 Ready
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gewarren @alexwolfmsft