Skip to content
This repository has been archived by the owner on May 18, 2023. It is now read-only.

Make cloud functions datasets processing use elpis core library #95

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

harrykeightley
Copy link
Collaborator

@nicklambourne please don't muder me- this looks intimidating but is really just massive deletion of functions which now live in the elpis core library. The additions are from the poetry lock file.

Changes:

  1. Add elpis as a poetry dependency, and fix torch version to avoid some dependency errors.
  2. Delete all code now covered by elpis core library for dataset processing.
  3. Extend the elpis core Dataset and ProcessingBatch classes to include cloud specific attributes (e.g. user_id). These become CloudDataset and ProcessingJob respectively.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant