Replies: 1 comment 8 replies
-
|
Would https://www.getdaft.io/projects/docs/en/stable/api/expressions/#daft.expressions.Expression.fill_null work for you? |
Beta Was this translation helpful? Give feedback.
-
|
If i understand correctly, the hash value is derived from hashing the concatenated string of the field names, and you would like to append this hash value to each row of the dataframe? Lmk if this is what you're looking for |
Beta Was this translation helpful? Give feedback.
-
|
Actually, we are trying to hash the values of each column/field concatenated together for each row. We are not looking to compare and detect changes in the schema, but rather trying to identify which specific rows have been updated (by comparing hashes). I am not sure if the code snippet you provided does just that -- it looks more like it will add a column with the same hash value (of field names concatenated together) to each row. |
Beta Was this translation helpful? Give feedback.
-
|
Ah i see, a hash for the values of each row, how about something like this: I realize that this is not the most intuitive API, do you think something like |
Beta Was this translation helpful? Give feedback.
-
|
This is incredible -- thank you! We should spend more time reading documentation :) But to your point, |
Beta Was this translation helpful? Give feedback.
-
|
No problem! I made an issue here to track this: #4390. Feel free to open other discussions if you have any other questions! |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
It seems like Daft is missing something like .fill_null() on a dataframe to handle/replace nulls, etc. with something else. Similar methods do exist on vast majority of other dataframe libraries. Thank you!
Beta Was this translation helpful? Give feedback.
All reactions