-
Notifications
You must be signed in to change notification settings - Fork 533
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Better communicate expectations of data order/contiguousness #5975
base: branch-24.08
Are you sure you want to change the base?
Better communicate expectations of data order/contiguousness #5975
Conversation
@@ -1172,6 +1172,19 @@ def from_input( | |||
if ( | |||
not fail_on_order and order != arr.order and order != "K" | |||
) or make_copy: | |||
if make_copy: | |||
info( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are other places where a copy can happen, specifically lines 1072, potentially 1104 (unless the dataframe is fully contiguous) and potentialy 1160, not sure if we need all of them but it would be good to cover most of the cases.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Regarding line 1072, the copy happens when the function is called with deepcopy=True
, which means that a copy was required anyway. The user cannot do much about it. Do we want to log this as well?
Regarding line 1104, can the data in the dataframe be non-contiguous? Not very familiar into the ways to check for the internals of cuDF, but it might be something we want to check too. However again, the user cannot do much about this to avoid a copy.
Regarding line 1160, unless mistaken this section of code should be in charge of data type conversions. Do we want to log this too? But, then to be consistent we would have to double check that every data type conversions is being caught. Given the time left for release, it might be a bit short.
Will be answering #5929 and #5930.