Skip to content

Commit

Permalink
Remove notebook (#73)
Browse files Browse the repository at this point in the history
* Remove notebook

* Update readme
  • Loading branch information
advay-modal authored Jul 9, 2024
1 parent 74650bc commit 4c2edf3
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 301 deletions.
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,6 @@ curl https://YOUR_MODAL_USERNAME--example-axolotl-inference-web.modal.run?input=
One of the key features of axolotl is that it flattens your data from a JSONL file into a prompt template format you specify in the config.
Tokenization and prompt templating are [where most mistakes are made when fine-tuning](https://hamel.dev/notes/llm/05_tokenizer_gotchas.html).

See the [nbs/inspect_data.ipynb](nbs/inspect_data.ipynb) notebook for guide on how to inspect your data and ensure it is being flattened correctly.
We strongly recommend that you always inspect your data the first time you fine-tune a model on a new dataset.

## Development
Expand Down
300 changes: 0 additions & 300 deletions nbs/inspect_data.ipynb

This file was deleted.

0 comments on commit 4c2edf3

Please sign in to comment.