Skip to content

Debug USGS archivers #732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Debug USGS archivers #732

wants to merge 5 commits into from

Conversation

e-belfer
Copy link
Member

@e-belfer e-belfer commented Jul 9, 2025

Overview

Closes #654, #722, #684

What problem does this address?

  • Handle new version of USGS data
  • Handle can't connect errors

What did you change in this PR?

  • Move archivers to USGS folder
  • Grab links from USGSUSPVDB pages more flexibly to handle new version
  • Add user agent
  • Add certifi to handle specify certificate location
  • Drop the simultaneous number of connections to a source

Testing

How did you make sure this worked? How can a reviewer verify this?

To-do list

  • This works locally, but not consistently on the runner! Still more debugging to do here!
  • Update relevant documentation - like comments, docstrings, README, release notes, etc.
  • Review the PR yourself and call out any questions or issues you have

@e-belfer e-belfer self-assigned this Jul 9, 2025
@e-belfer e-belfer added bug Something isn't working usgsuspvdb USGS U.S. Large-Scale Solar Photovoltaic Database usgswtdb USGS U.S. Wind Turbine Database labels Jul 9, 2025
@e-belfer e-belfer moved this from New to In progress in Catalyst Megaproject Jul 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working usgsuspvdb USGS U.S. Large-Scale Solar Photovoltaic Database usgswtdb USGS U.S. Wind Turbine Database
Projects
Status: In progress
1 participant