Sea: A lightweight filesystem to process large neuroimaging data on HPC

[ValHayot]

Project info

Title:

Project lead:
Valerie Hayot-Sasson @ValHayot
Mathieu Dugre @mathdugre

Timezone:
UTC-4

Description:
Large file transfers to and from slow storage can impede the processing of neuroimaging workflows processing such data. Sea is a file system that aims to reduce the costs of such file transfers by leveraging compute-local storage whenever possible during pipeline execution to offset the overhead of reading and writing to local storage.

Link to project:
https://github.com/big-data-lab-team/sea

Mattermost handle:
@valeriehayot @mathdugre

Goals for the OHBM Brainhack

• Evaluate the performance improvement brought by Sea on various neuroimaging workflows
• Ensure compatibility of Sea with neuroimaging workflows

Good first issues:

• Testing execution of neuroimaging pipelines with Sea running
• Adding Github actions CI
• Creating test cases for commonly used file interaction functions
• Writing documentation for Sea

Skills:

• Knowledge of neuroimaging workflows/how to execute them

Chat channel:
hbmhack-sea

Image for the OHBM brainhack website

Project submission

Submission checklist

Once the issue is submitted, please check items in this list as you add under 'Additional project info'

Please include the following above (all required):

• Link to your project: could be a code repository, a shared document, etc. See here
• Include your Mattermost handle (i.e. your username). If you do not have an account, please sign up here.
• Goals for the OHBM Brainhack: describe what you want to achieve during this brainhack. See here.
• Flesh out at least 2 "good first issues": those are tasks that do not require any prior knowledge about your project, could be defined as issues in a GitHub repository, or in a shared document, cf here.
• Skills: list skills that would be particularly suitable for your project. We ask you to include at least one non-coding skill, cf. here.
• Chat channel: A link to a chat channel that will be used during the OHBM Brainhack. This can be an existing channel or a new one. We recommend using the Brainhack space on mattermost, cf. here.
• Provide an image of your project for the OHBM brainhack website

You can also include information about (all optional):

• Someone co-leading the project in the timeslot you have not selected to provide additional visibility.
• Number of participants, cf. here
• Twitter-size summary of your project pitch, cf. here
• Set up a kanban board on your repository to better divide the work and keep track of things, cf here
• Project snippet for the OHBM Brainhack website, cf. here

We would like to think about how you will credit and onboard new members to your project. We recommend reading references from this section. If you'd like to share your thoughts with future project participants, you can include information about (recommended):

• Specify how will you acknowledge contributions (e.g. listing members on a contributing page).
• Provide links to onboarding documents if you have some.

QMENTA has agreed to sponsor the event and provide computational resources through their platform.

• Get in touch with QMENTA through their Brain Innovation Hub Slack space, if you think your project would benefit from their support.

[ValHayot]

hi @ohbm/project-monitors: My project is ready!