Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate CWL parsing from cwltool to cwl-utils #58

Merged
merged 3 commits into from
Dec 10, 2024

Conversation

GlassOfWhiskey
Copy link
Member

@GlassOfWhiskey GlassOfWhiskey commented Jan 31, 2023

This commit replaces the cwltool parser with the faster auto-generated parser included in cwl-utils. Starting from this commit, cwltool is no more a StreamFlow requirement.

@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 4 times, most recently from e38eb72 to 461df47 Compare January 31, 2023 17:47
@codecov-commenter
Copy link

codecov-commenter commented Jan 31, 2023

Codecov Report

Attention: Patch coverage is 73.06590% with 94 lines in your changes missing coverage. Please review.

Project coverage is 71.11%. Comparing base (f9cc0ca) to head (eff0ca1).
Report is 2 commits behind head on master.

Files with missing lines Patch % Lines
streamflow/provenance/run_crate.py 7.35% 63 Missing ⚠️
streamflow/cwl/translator.py 88.56% 16 Missing and 15 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master      #58      +/-   ##
==========================================
+ Coverage   71.08%   71.11%   +0.02%     
==========================================
  Files          88       88              
  Lines       11085    11131      +46     
  Branches     1912     1936      +24     
==========================================
+ Hits         7880     7916      +36     
- Misses       2753     2768      +15     
+ Partials      452      447       -5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 2 times, most recently from a656498 to 025ba47 Compare February 1, 2023 20:00
@GlassOfWhiskey GlassOfWhiskey changed the title Migrate CWL parsing from cwltool to cwl-utils DO NOT MERGE: Migrate CWL parsing from cwltool to cwl-utils Feb 1, 2023
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 9 times, most recently from dd2d48d to 2502ef0 Compare February 12, 2023 15:28
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 6 times, most recently from 0899281 to 2eadb6d Compare March 4, 2023 15:49
@GlassOfWhiskey GlassOfWhiskey force-pushed the master branch 2 times, most recently from 2a84f23 to fe6fd4a Compare March 13, 2023 13:44
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 3 times, most recently from 32083a0 to 8acb8ad Compare June 18, 2023 19:26
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 13 times, most recently from 37fda1f to b1208e8 Compare December 4, 2024 21:00
This commit replaces the cwltool parser with the faster
auto-generated parser included in cwl-utils.
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 2 times, most recently from 2e9cb09 to f6c57cc Compare December 6, 2024 21:27
@GlassOfWhiskey GlassOfWhiskey changed the title DO NOT MERGE: Migrate CWL parsing from cwltool to cwl-utils Migrate CWL parsing from cwltool to cwl-utils Dec 6, 2024
@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 2 times, most recently from 798e7db to 667af1c Compare December 6, 2024 21:34
@@ -122,5 +122,5 @@ def highlight(self, msg):
)
defaultStreamHandler.setFormatter(formatter)
logger.addHandler(defaultStreamHandler)
logger.setLevel(logging.INFO)
logger.setLevel(logging.DEBUG)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
logger.setLevel(logging.DEBUG)
logger.setLevel(logging.INFO)

@@ -208,7 +208,7 @@ async def test_execute_step(context: StreamFlowContext):
port_target=None,
port_type="string",
cwl_element={},
context={"hints": {}, "requirements": {}},
context={"hints": {}, "requirements": {}, "version": "v1.2"},
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
context={"hints": {}, "requirements": {}, "version": "v1.2"},
context={"hints": {}, "requirements": {}, "version": CWL_VERSION},

from tests.utils.workflow import CWL_VERSION

@@ -350,7 +350,7 @@ async def test_workflow(context: StreamFlowContext):
port_target=None,
port_type="string",
cwl_element={},
context={"hints": {}, "requirements": {}},
context={"hints": {}, "requirements": {}, "version": "v1.2"},
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
context={"hints": {}, "requirements": {}, "version": "v1.2"},
context={"hints": {}, "requirements": {}, "version": CWL_VERSION},

cwl_element=cwl_utils.parser.cwl_v1_2.CommandOutputParameter(
type_="string"
),
context={"hints": {}, "requirements": {}, "version": "v1.2"},
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
context={"hints": {}, "requirements": {}, "version": "v1.2"},
context={"hints": {}, "requirements": {}, "version": CWL_VERSION},

@GlassOfWhiskey GlassOfWhiskey force-pushed the feature/cwl-utils branch 5 times, most recently from d51b266 to b5e587a Compare December 10, 2024 07:19
@GlassOfWhiskey GlassOfWhiskey merged commit 9a3ab42 into master Dec 10, 2024
32 checks passed
@GlassOfWhiskey GlassOfWhiskey deleted the feature/cwl-utils branch December 10, 2024 11:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants