Skip to content

Conversation

@Mahalaxmibejugam
Copy link
Contributor

Fixes the slower exists() and info() calls on the latest version, detailed explanation in #704 (comment)

This commit introduces an optimization to the `info()` method to reduce
the number of GCS API calls when inspecting a directory-like path that
only contains subdirectories without any immediate objects.

Also includes a test case to check the number of API calls for this edge
case
This commit introduces an optimization to the `info()` method to reduce
the number of GCS API calls when inspecting a directory-like path that
only contains subdirectories without any immediate objects.

Also includes a test case to check the number of API calls for this edge
case
@martindurant
Copy link
Member

Looks good, thank you!
I hope to get a +1 from one of the original issue reporters.

@martindurant
Copy link
Member

(sorry, I can't push to protected "main" to fix your linting).

Copy link

@APatrickJ APatrickJ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested (see #704 (comment)) and confirmed this fixed our performance issue

@martindurant
Copy link
Member

Thank you @Mahalaxmibejugam !

@martindurant martindurant merged commit 3d51c17 into fsspec:main Oct 29, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants