Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make experiment tracking optional #2079

Open
1 task
astrojuanlu opened this issue Sep 5, 2024 · 4 comments
Open
1 task

Make experiment tracking optional #2079

astrojuanlu opened this issue Sep 5, 2024 · 4 comments

Comments

@astrojuanlu
Copy link
Member

Description

One year ago #1831 we discussed the possibility of removing Experiment Tracking.

We have been reluctant to do it because we see some users using it.

But having it is an ongoing maintenance cost.

Hence one first step we can do is make it optional. This would alleviate some of the startup costs as well as reduce the amount of dependencies installed.

Possible Implementation

2 steps:

  1. Folks have to explicitly opt into exp tracking at installation time, pip install kedro-viz[experiment]
  2. Folks need to launch Kedro-Viz with exp tracking enabled, kedro viz run --enable-experiment-tracking

Possible Alternatives

?

Checklist

  • Include labels so that we can categorise your feature request
@rashidakanchwala
Copy link
Contributor

Also, try to decouple experiment tracking from flowchart.

@astrojuanlu
Copy link
Member Author

What would #2079 involve? Just separating the dependencies or also removing stuff from the UI? Do we have any sort of estimation of that work? I'm just wondering if it's worth the effort. Do we have any evidence that people don't use Viz because this feature exists, or that people find Viz is "too large" because of experiment tracking? Otherwise there won't be much user gain by just making it optional compared to having it there by default.

Originally posted by @merelcht in #2152 (comment)

@astrojuanlu
Copy link
Member Author

This is mostly for us to

  1. start decoupling the feature before deciding what to do with it (to avoid refactoring something that we'll eventually drop (Refactor Kedro-Viz FAST API app creation #2061 (comment)), and
  2. having an explicit way to measure who wants the feature. At the moment we rely on frontend telemetry that is yet poorly understood Review and explain frontend telemetry #2140

Do we have any evidence that people don't use Viz because this feature exists

FTR, we do not.

@rashidakanchwala
Copy link
Contributor

I can do a spike on some of the questioned Merel mentioned because I am also not sure if it's worth the effort making it optional/removing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Backlog
Development

No branches or pull requests

2 participants