Fix issue where empty dir name in s3 key breaks listdir api.#771
Fix issue where empty dir name in s3 key breaks listdir api.#771varunmittal91 wants to merge 2 commits intofsspec:mainfrom
Conversation
|
@ianthomas23 , the tests here pass, but it does seem like this change ought to break something somewhere! |
I am sorry, I know what you mean. I wish there was a better way. If there is something you want me to look into, I will be happy to, |
|
Maybe I should have phrased it thus: I imagine that the lstrip you removed was there for a reason ;). It may be that changes elsewhere made it unnecessary. |
|
So s3 has a wiered thing, one of our customers have key s3://bucket_name//test//some_data With lstrip it removes those '/' but without that we can do a listdir. |
|
Note that |
|
oh okay, I can try and see if that resolves the usecase. Mahor problem is that i am using it with pyarrow and fspec which will do a listdir. |
|
Totally understand... you can maybe still pass a list of absolute filenames taken from |
|
okay I will give it a try, thanks for looking into it. |
3c94a6b to
8c023d9
Compare
8c023d9 to
49dd74e
Compare
49dd74e to
81e2e6f
Compare
81e2e6f to
92f677e
Compare
Tried writing this test case, but moto_service i think ignores these slashes anyway. Maybe somebody else will have a better luck with this test case.