Add native Charts/Plots (see PyCharm or Databricks Notebooks)

[Julian-J-S]

Description

Visualizing data is an essential part of data analysis / science / exploration.
However, creating many (useful) charts also leads to a lot of clutter in the notebook and makes them hard to read and work with.

On one hand you want quite some visualizations because they give great insight into the data.
On the other hand you want a good readability of the notebook.

Suggested solution

PyCharm and especially Databricks have great solutions to show Charts without cluttering up the notebooks by toggling between "DataFrame-view" and "Chart-view".

Databricks Notebooks (Table)

Databricks Notebooks (add visualization)

Databricks Notebooks (charts...)

PyCharm Notebook (Table View)

PyCharm Notebooks (Chart View)

Benefit 💪

• compact and readable notebook with the option to have lots of useful charts "hidden" inside tabs of a DataFrame output cell

Alternative

No response

Additional context

No response

[mscolnick]

@Julian-J-S, thanks for the FR. when you create these new tabs and charts, does it get saved to the notebook? do you know where? if the dataframe columns change, does it get reset or removed? if the dataframe is removed, do you lose all your configuration?

[Julian-J-S]

@Julian-J-S, thanks for the FR. when you create these new tabs and charts, does it get saved to the notebook? do you know where? if the dataframe columns change, does it get reset or removed? if the dataframe is removed, do you lose all your configuration?

Cannot tell you where it gets saved in the notebook.
I think it's a somewhat "proprietary" Databricks format.
You can download the Databricks notebooks as ".py/.ipynb" but you will lose those features. They are only available in the Databricks workspace.

If DataFrame columns change the graph tabs stay but it will present an error message with something like "identifier abc" / "column abc" not found if it is used by the chart which I like. You can easily "fix" the graph.

If the DataFrame is removed from the cell output all graph tabs are removed as well.