Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

COPY FROM api #31

Closed
wants to merge 1 commit into from
Closed

COPY FROM api #31

wants to merge 1 commit into from

Conversation

aykut-bozkurt
Copy link
Collaborator

Adds COPY FROM parquet api, which internally uses Postgres binary protocol to populate tables from parquet file.

}

let attlist = copy_attlist(&pstmt);
let attnamelist = copy_attnames(&pstmt);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

since this lo longer correspond to postgres code, can probably afford to just write attribute_name_list to make it easier to digest, e.g. I like the verbosity of the function above

}

#[pg_guard]
extern "C" fn copy_received_parquet_data_to_buffer(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe received->receive

bytes_to_copy as _
}

pub(crate) fn execute_copy_from(
Copy link
Collaborator

@marcoslot marcoslot Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this function is especially wild, could use a comment on what's going on here, and e.g. what copy_received_parquet_data_to_buffer is for / why we need it

We internally use Postgres binary protocol to populate tables from parquet file.
@aykut-bozkurt
Copy link
Collaborator Author

Addressed at development branch.

@aykut-bozkurt aykut-bozkurt deleted the copy-from-api branch October 17, 2024 13:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants