Skip to content

Commit

Permalink
Merge pull request #449 from hdolinh/2023-10-delta
Browse files Browse the repository at this point in the history
2023 10 delta
  • Loading branch information
hdolinh authored Oct 20, 2023
2 parents b22872c + bbed0a9 commit d0b8673
Show file tree
Hide file tree
Showing 5 changed files with 71 additions and 4 deletions.
2 changes: 1 addition & 1 deletion materials/_quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ book:
- session_05.qmd # shiny
- session_06.qmd # practice: shiny + flexdashboard
- session_07.qmd # synthesis
- session_08.qmd # reproducible workflows
- session_08.qmd # reproducible workflows using targets
- session_09.qmd # parallel processing
- session_10.qmd # synthesis
- session_11.qmd # publishing data
Expand Down
17 changes: 16 additions & 1 deletion materials/book.bib
Original file line number Diff line number Diff line change
Expand Up @@ -274,7 +274,6 @@ @article{michener2015

}


@article{borowiec2023,
doi = {10.1371/journal.pcbi.1011251},
author = {Borowiec, Brittney G.},
Expand All @@ -290,3 +289,19 @@ @article{borowiec2023
number = {7},

}

@article{brousil2023,
title = {Improving ecological data science with workflow management software},
author = {Brousil, Matthew R. and Filazzola, Alessandro and Meyer, Michael F. and Sharma, Sapna and Hampton, Stephanie E.},
year = {2023},
month = {04},
date = {2023-04-23},
journal = {Methods in Ecology and Evolution},
pages = {1381--1388},
volume = {14},
number = {6},
doi = {10.1111/2041-210x.14113},
url = {http://dx.doi.org/10.1111/2041-210X.14113},
langid = {en}
}

15 changes: 15 additions & 0 deletions materials/sections/references.bib
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,18 @@ @misc{lter2022
url = {https://portal.edirepository.org/nis/mapbrowse?packageid=knb-lter-sbc.77.8},
langid = {en}
}

@article{brousil2023,
title = {Improving ecological data science with workflow management software},
author = {Brousil, Matthew R. and Filazzola, Alessandro and Meyer, Michael F. and Sharma, Sapna and Hampton, Stephanie E.},
year = {2023},
month = {04},
date = {2023-04-23},
journal = {Methods in Ecology and Evolution},
pages = {1381--1388},
volume = {14},
number = {6},
doi = {10.1111/2041-210x.14113},
url = {http://dx.doi.org/10.1111/2041-210X.14113},
langid = {en}
}
36 changes: 36 additions & 0 deletions materials/sections/reproducible-workflows-targets.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
---
title: "Reproducible Workflows Using `targets`"
format: html
bibliography: book.bib
---

## Learning Objectives {.unnumbered}

::: {.callout-note icon=false}
## Acknowledgements

This lesson is adapted from the journal article [Improving ecological data science with workflow management software](https://doi.org/10.1111/2041-210X.14113) by Brousil et al, and the journal's accompanying example, [A worked targets example for ecologists](https://targets-ecology.netlify.app/).

:::

## Benefits of Reproducible Workflows

What is a reproducible workflow?

Other interchangeable terms we hear for reproducible workflows are:

- Workflow Management Systems
- Data pipelines
- Data workflow

## Challenges of Reproducible Workflows

WMS requires moving away from performing serial analytical operations within single or multiple scripts to instead breaking an analysis into smaller functions that are modular, thereby providing more computational flexibility [@brousil2023]

Indeed, researchers will face a familiar trade-off—to invest the personnel time in learning and deploying a tool like WMS to save personnel and compute time later or to accept that less efficient, but more familiar analytical frameworks will come with costs in personnel time, compute time and potentially additional associated payments for computing resources. The balance will depend on the complexity of the analysis, the expectation of reusing the code over time and the resources available to the researcher (e.g. funds for computing or personnel) [@brousil2023].

## Leveraging Reproducible Workflows & Tools

### R Package: `targets` for Reproducible Worklows {.unnumbered}

## Exercise: Creating a Pipeline using `targets`
5 changes: 3 additions & 2 deletions materials/session_08.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
---
title: "Reproducible Workflows"
title: "Reproducible Workflows Using `targets`"
title-block-banner: true
---

<!--{{< include /sections/programmatic-data-access.qmd >}}-->
{{< include /sections/reproducible-workflows-targets.qmd >}}

0 comments on commit d0b8673

Please sign in to comment.