-
Notifications
You must be signed in to change notification settings - Fork 7
handle filesystems #19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
f335a79 to
26d4fe9
Compare
34bb52b to
b0f082d
Compare
c620b44 to
a4077e8
Compare
a4077e8 to
db62935
Compare
6fc6bfd to
743dc47
Compare
bmschmidt
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great, thanks
| tile.overflow_loc.unlink() | ||
|
|
||
| # TODO: check with Ben that we should delete all the overflows here | ||
| for table in tables: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this include the deletion of tile.overflow_loc unlink() too?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yep! tables includes it
743dc47 to
0cb6dbd
Compare

use pyarrow filesystems for all file I/O to support s3 reads and writes