Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add S3 configuration to documentation #119

Open
pnuu opened this issue Sep 14, 2022 · 0 comments
Open

Add S3 configuration to documentation #119

pnuu opened this issue Sep 14, 2022 · 0 comments

Comments

@pnuu
Copy link
Member

pnuu commented Sep 14, 2022

The configuration of S3 connection should be added to documentation. This requires #110, #114 and #117 to be merged first.

For segment gatherer and checking which segments exist after startup and first message, this might be adaptable:

    All the connection configurations and such are done using the `fsspec` configuration system:

    https://filesystem-spec.readthedocs.io/en/latest/features.html#configuration

    An example configuration could be for example placed in `~/.config/fsspec/s3.json`::

        {
            "s3": {
                "client_kwargs": {"endpoint_url": "https://s3.server.foo.com"},
                "secret": "VERYBIGSECRET",
                "key": "ACCESSKEY"
            }
        }

Depending on how #114 is finalized, this might need some adjustment.

Originally posted by @pnuu in #117 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant