Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eval graph with WDL #261

Open
carlosfmora opened this issue Apr 26, 2024 · 2 comments
Open

Eval graph with WDL #261

carlosfmora opened this issue Apr 26, 2024 · 2 comments

Comments

@carlosfmora
Copy link

carlosfmora commented Apr 26, 2024

Usually, the evaluation graph only has one attribute, centipawns or percentage. What if there was the option to graph through LC0's WDL? That provides much more information for the analyst.

For example, take a look at the WDL graph of the 2024 Candidates in round 13, the game between Gukesh and Firouzja
image
image

Or the most incredible game of the Candidates, game between Nepo and Caruana in round 14, A do-or-die game.
image
image

Or a crazy position, How to understand the traditional evaluation of nearly 50% in that position, while with WDL we can see that a draw is highly unlikely
image
image
WDL in final position:
image
image

My recommendation: two graphs

  • one for WDL across an entire game,
  • and another for a specific position (circular or bar chart)

image

@carlosfmora carlosfmora changed the title Eval graph Ideas Eval graph with WDL Apr 26, 2024
@mooskagh
Copy link

I think WDL is best viewed as a stacked graph. E.g. like here https://lczero.org/dev/stats/2022/ but horizontal rather than vertical.

It's a question though how to show two engines on the same axes though.

@comodoro
Copy link

Something like this, only nicer

game

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants