Skip to content

Exploring whether sparse autoencoders pick up on the intermediate representations needed to do IOI

Notifications You must be signed in to change notification settings

lucyfarnik/SAE-IOI

Repository files navigation

Exploring parts of the IOI circuit with sparse autoencoders (Neel Nanda MATS application)

Here's the research diary which has all the information about this project.

The main file is itsa_me_mainio.py.

Directories

The autoencoders dir is stolen borrowed from Hoagy and Aidan's SAE paper repo.

The models dir contains the SAEs I'm working with (which I got from Hoagy).

About

Exploring whether sparse autoencoders pick up on the intermediate representations needed to do IOI

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages