-
Notifications
You must be signed in to change notification settings - Fork 27
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #449 from hdolinh/2023-10-delta
2023 10 delta
- Loading branch information
Showing
5 changed files
with
71 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,36 @@ | ||
--- | ||
title: "Reproducible Workflows Using `targets`" | ||
format: html | ||
bibliography: book.bib | ||
--- | ||
|
||
## Learning Objectives {.unnumbered} | ||
|
||
::: {.callout-note icon=false} | ||
## Acknowledgements | ||
|
||
This lesson is adapted from the journal article [Improving ecological data science with workflow management software](https://doi.org/10.1111/2041-210X.14113) by Brousil et al, and the journal's accompanying example, [A worked targets example for ecologists](https://targets-ecology.netlify.app/). | ||
|
||
::: | ||
|
||
## Benefits of Reproducible Workflows | ||
|
||
What is a reproducible workflow? | ||
|
||
Other interchangeable terms we hear for reproducible workflows are: | ||
|
||
- Workflow Management Systems | ||
- Data pipelines | ||
- Data workflow | ||
|
||
## Challenges of Reproducible Workflows | ||
|
||
WMS requires moving away from performing serial analytical operations within single or multiple scripts to instead breaking an analysis into smaller functions that are modular, thereby providing more computational flexibility [@brousil2023] | ||
|
||
Indeed, researchers will face a familiar trade-off—to invest the personnel time in learning and deploying a tool like WMS to save personnel and compute time later or to accept that less efficient, but more familiar analytical frameworks will come with costs in personnel time, compute time and potentially additional associated payments for computing resources. The balance will depend on the complexity of the analysis, the expectation of reusing the code over time and the resources available to the researcher (e.g. funds for computing or personnel) [@brousil2023]. | ||
|
||
## Leveraging Reproducible Workflows & Tools | ||
|
||
### R Package: `targets` for Reproducible Worklows {.unnumbered} | ||
|
||
## Exercise: Creating a Pipeline using `targets` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,7 @@ | ||
--- | ||
title: "Reproducible Workflows" | ||
title: "Reproducible Workflows Using `targets`" | ||
title-block-banner: true | ||
--- | ||
|
||
<!--{{< include /sections/programmatic-data-access.qmd >}}--> | ||
{{< include /sections/reproducible-workflows-targets.qmd >}} | ||
|