Skip to content
Permalink

Comparing changes

This is a direct comparison between two commits made in this repository or its related repositories. View the default comparison for this range or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: fsspec/s3fs
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 8c023d9637b59a70e8b170d54372744a9824d5df
Choose a base ref
..
head repository: fsspec/s3fs
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 49dd74e551de35a4fda948b2cdfea64c85b4b676
Choose a head ref
Showing with 765 additions and 321 deletions.
  1. +5 −2 .github/workflows/ci.yml
  2. +1 −1 ci/env.yaml
  3. +62 −0 docs/source/changelog.rst
  4. +2 −2 requirements.txt
  5. +107 −48 s3fs/_version.py
  6. +122 −39 s3fs/core.py
  7. +26 −0 s3fs/tests/test_s3fs.py
  8. +440 −229 versioneer.py
7 changes: 5 additions & 2 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -4,12 +4,13 @@ on: [push, pull_request]

jobs:
test:
name: Python ${{ matrix.python-version }}
name: Python ${{ matrix.python-version }} - AioBotocore ${{ matrix.aiobotocore-version }}
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
python-version: ["3.8", "3.9", "3.10", "3.11"]
python-version: ["3.8", "3.9", "3.10", "3.11", "3.12"]
aiobotocore-version: [">=2.5.4,<2.6.0", ">=2.7.0,<2.8.0", ">=2.8.0,<2.9.0", "<3.0.0"]

env:
BOTO_CONFIG: /dev/null
@@ -33,7 +34,9 @@ jobs:
shell: bash -l {0}
run: |
pip install git+https://github.com/fsspec/filesystem_spec
pip install --upgrade "aiobotocore${{ matrix.aiobotocore-version }}" boto3 # boto3 to ensure compatibility
pip install . --no-deps
pip show aiobotocore boto3 botocore
- name: Run Tests
shell: bash -l {0}
2 changes: 1 addition & 1 deletion ci/env.yaml
Original file line number Diff line number Diff line change
@@ -14,6 +14,6 @@ dependencies:
- black
- httpretty
- aiobotocore
- "moto>=4"
- "moto>=4,<5"
- flask
- fsspec
62 changes: 62 additions & 0 deletions docs/source/changelog.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,68 @@
Changelog
=========

2024.6.1
--------

no changes

2024.6.0
--------

no changes

2024.5.0
--------

- widen fsspec req version (#869)
- _bulk_delete must return list (#866)
- retry on "reduce request rate" (#865)

2024.3.1
--------

- accept kwargs in get_file (#863)

2024.3.0
--------

- don't fail ls is parent is unaccessible (#860)
- allow checksum error to retry (#858)
- don't lsbuckets for isdir(bucket) (#856)
- concurrent uplads of parts in put_file (#848)

2024.2.0
--------

- fix cache lookup in _info (#840)

2023.12.2
---------

no changes

2023.12.1
---------

- revert fallback to anon (#835)

2023.12.0
---------

- fall back to anon if no creds are found or passed at all (#823)
- **relax version bounds for aiobotocore** (#829)
- avoid key error if LastModified missing (#828)
- add make_mucket_versioned method (#825)
- retain TZ on modified time (#818)

2023.10.0
---------

- make protocol attribute a tuple (#812)
- update to aiobotocore 2.7.0 (#809)
- fix in _get_file following failure after connect (#805)
- test for du of nonexistent (#803)

2023.9.2
--------

4 changes: 2 additions & 2 deletions requirements.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
aiobotocore~=2.7.0
fsspec==2023.9.2
aiobotocore>=2.5.4,<3.0.0
fsspec==2024.6.1.*
aiohttp!=4.0.0a0, !=4.0.0a1
Loading