Did you think that wouldn't it be nice to have a tool that would plot T-SNE graphs at each epoch, and only of specific labels you want to visualize? Which can help you visualize the T-SNE graph for specific labels de-cluttering the T-SNE cloud with many other labels? Find out which datapoints are near to the cluster and which aren't? Look no more!
Manifolk is a Plotly+Dash+MySQLite web application that does exactly that. During your model training process, you generate T-SNE embeddings using your favourite package (e.g. sklearn's T-SNE) and then use Manifolk's API to store all of them into an SQLite database. After the training is over the Dash app can be launched to visualize the 3D T-SNE embeddings. beware the T-SNE embeddings you generate must be 3D, not 2D (because why not have an extra dimension?).
pip install --upgrade git+https://github.com/krishnachaitanya7/Manifolk.gitThe below screenshot shows how to change epochs and visualize the T-SNE at every epoch
The below screenshot shows how to change labels
The below image shows how to mark a unique datapoint which you want to track across epochs and different labels in the TSNE cloud
To run the TSNE-GUI plot:
cd $CURRENT_PROJECT_WORKSPACE
python tsne_plot.py