Skip to content

Commit

Permalink
Merge pull request #2 from mwalmsley/dev
Browse files Browse the repository at this point in the history
Add v0.02 changes.

Saving new shards and training from scratch both run without errors. Full checks are in progress but slow.

I am slightly concerned that refactoring or new tf version has made the old weights checkpoints not work - I am creating new ones as part of the checks above.
  • Loading branch information
mwalmsley authored Oct 4, 2021
2 parents dcb89d4 + 0ad2905 commit 1d3511e
Show file tree
Hide file tree
Showing 572 changed files with 9,247 additions and 1,045 deletions.
22 changes: 21 additions & 1 deletion .gitignore
100644 → 100755
Original file line number Diff line number Diff line change
Expand Up @@ -130,4 +130,24 @@ dmypy.json

*.csv

wandb_api.txt
wandb_api.txt

*.pdf
*.png

settings.json

personal_examples.md
*.sh
*.parquet
*.tfrecord

# tensorboard data files
events.out*
*.json
checkpoint*

# mac junk
.DS_Store

.vscode
Empty file modified .readthedocs.yaml
100644 → 100755
Empty file.
3 changes: 2 additions & 1 deletion .vscode/settings.json
100644 → 100755
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
{
"python.pythonPath": "/home/walml/anaconda3/envs/zoobot/bin/python"
"python.pythonPath": "/home/walml/anaconda3/envs/zoobot/bin/python",
"restructuredtext.confPath": "${workspaceFolder}/docs"
}
Empty file modified LICENSE
100644 → 100755
Empty file.
19 changes: 13 additions & 6 deletions README.md
100644 → 100755
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

[![Documentation Status](https://readthedocs.org/projects/zoobot/badge/?version=latest)](https://zoobot.readthedocs.io/en/latest/?badge=latest)

Zoobot classifies galaxy morphology with deep learning. This code will let you:
Zoobot classifies galaxy morphology with deep learning. This code will let you:

- **Reproduce** and improve the Galaxy Zoo DECaLS automated classifications
- **Finetune** the classifier for new tasks
Expand Down Expand Up @@ -30,20 +30,27 @@ training_config.train_estimator(
)
```

Install with `pip install zoobot`. Zoobot requires Tensorflow >= 2.3.
Install using git and pip:
git clone [email protected]:mwalmsley/zoobot.git
pip install -r zoobot/requirements.txt (virtual env or conda highly recommended)
pip install -e zoobot
The `main` branch is for stable-ish releases. The `dev` branch includes the shiniest features but may change at any time.

To get started, see the [documentation](https://zoobot.readthedocs.io/).
To get started, see the [documentation](https://zoobot.readthedocs.io/).

I also include some working examples for you to copy and adapt:
I also include some working examples for you to copy and adapt:

- [train_model.py](https://github.com/mwalmsley/zoobot/blob/main/train_model.py)
- [make_predictions.py](https://github.com/mwalmsley/zoobot/blob/main/make_predictions.py)
- [finetune_minimal.py](https://github.com/mwalmsley/zoobot/blob/main/finetune_minimal.py)
- [finetune_advanced.py](https://github.com/mwalmsley/zoobot/blob/main/finetune_advanced.py)

Latest cool features on dev branch (June 2021):

Contributions are welcome and will be credited in any future work.
- Multi-GPU distributed training
- Support for Weights and Biases (wandb)
- Worked examples for custom representations

Contributions are welcome and will be credited in any future work.

If you use this repo for your research, please cite [the paper](https://arxiv.org/abs/2102.08414).

218 changes: 121 additions & 97 deletions create_shards.py
100644 → 100755

Large diffs are not rendered by default.

Empty file modified data/.gitkeep
100644 → 100755
Empty file.
Empty file added data/decals/.gitkeep
Empty file.
Empty file.
Empty file added data/decals/shards/.gitkeep
Empty file.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 1d3511e

Please sign in to comment.