Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose Multi-File AST #965

Draft
wants to merge 59 commits into
base: main
Choose a base branch
from
Draft

Conversation

LukasPietzschmann
Copy link
Collaborator

No description provided.

@LukasPietzschmann LukasPietzschmann added enhancement New feature or request normalize Related to R-AST extraction and normalization labels Sep 10, 2024
@LukasPietzschmann LukasPietzschmann self-assigned this Sep 10, 2024
@LukasPietzschmann LukasPietzschmann linked an issue Sep 10, 2024 that may be closed by this pull request
@LukasPietzschmann
Copy link
Collaborator Author

LukasPietzschmann commented Sep 10, 2024

@EagleoutIce if you've got time, you can take a look at the code. There is still a TODO I have to implement, but the rest should reviewable :)

Also, there's an error at the end of this line:

parse: await printStepResult(PARSE_WITH_R_SHELL_STEP, sanitizedResults.parse as string, StepOutputFormat.RdfQuads, config()),

I can't really make sense of it. Maybe you can assist me with that.

@EagleoutIce
Copy link
Member

sadly i do not have a lot of time at the moment, but looking at it the first time, suggest that it may be the as cast which wrongly tries to handle the striing aray as a strin

EagleoutIce and others added 21 commits September 12, 2024 10:05
* feat: first attempt at the new getLineage command

* feat: walk additional edges for determining the lineage

* feat: store lineage IDs in a set

* feat: prevent infinite recursion when determining the lineage IDs

* feat-fix: fixed lineage network request

* feat-fix: get the dfg and ast from the pipeline in the correct way

* doc: added lineage request doc

* feat-fix: add filetoken to error messages

Co-authored-by: Florian Sihler <[email protected]>

* feat-fix: updated comment for better clarity

* feat-fix: more guards, more better

* feat-fix: clearer function interface

* feat-fix: removed unused import

No I didn't push with --no-verify

* feat-fix: removed console.log

Co-authored-by: Florian Sihler <[email protected]>

* feat-fix: criteria resolve now only requires an idmap

* test(lineage): basic test setup

* lint-fix: handle linter issues and empty test labels

* refactor(lineage): remove redundant promise

* doc(lineage): refine wiki entries

---------

Co-authored-by: Florian Sihler <[email protected]>
* feat: support `setwd`

* lint-fix: handle linter errors
)

* feat: support `set.seed`

* feat: recognize options as side effect as well

* feat: support `on.exit` (closes #931)

* feat: supporting `sys.on.exit`

* lint-fix: handle linter errors
@EagleoutIce
Copy link
Member

EagleoutIce commented Sep 12, 2024

what happened with you now being a co-signed author on all of these commits?

@LukasPietzschmann
Copy link
Collaborator Author

I rebased this branch onto main ':)

@EagleoutIce
Copy link
Member

I pushed a respective fix which causes the parsing to happen sequentially! However, I still noticed that any additional file is normalized an additional time; i.e. there is another normalize call for this. Can you track that down? it is probably due to someone somewhere still not assuming the multifile ast exists (probably my old code) and just triggering a new parsing

@EagleoutIce
Copy link
Member

If you are ready, i will take on the merge regarding the 3-version upgrades we have

@EagleoutIce
Copy link
Member

Additionally, the case you established should probably be added as a test case to avoid regression.

@EagleoutIce EagleoutIce marked this pull request as draft October 25, 2024 10:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request normalize Related to R-AST extraction and normalization
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Expose Multi-File AST
4 participants