Search results

Tag GCP infrastructure so we know where costs are coming from

cloudStuff that has to do with adapting PUDL to work in cloud computing context.Stuff that has to do with adapting PUDL to work in cloud computing context.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#4356 In catalyst-cooperative/pudl;

· jdangerx opened on Jun 25, 2025

Create Dagster job & assets that produce FERC-EIA ID mapping inputs

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

eia860Anything having to do with EIA Form 860Anything having to do with EIA Form 860

eia923Anything having to do with EIA Form 923Anything having to do with EIA Form 923

ferc1Anything having to do with FERC Form 1Anything having to do with FERC Form 1

gluePUDL specific structures & metadata. Stuff that connects datasets together.PUDL specific structures & metadata. Stuff that connects datasets together.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#4338 In catalyst-cooperative/pudl;

· zaneselvans opened on Jun 22, 2025

chardet.charsetprober hangs when downloading datapackages

datapkgFrictionless data package input, output, metadata, manipulationFrictionless data package input, output, metadata, manipulation

performanceMake PUDL run faster!Make PUDL run faster!

zenodoIssues having to do with Zenodo data archiving and retrieval.Issues having to do with Zenodo data archiving and retrieval.

Status: Open.

#4306 In catalyst-cooperative/pudl;

· zaneselvans opened on May 30, 2025

Brainstorm plan for shared tooling and PUDL scaling

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3945 In catalyst-cooperative/pudl;

· zschira opened on Nov 4, 2024

Add a Dagster RetryPolicy to PUDL's ETL

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

internal-onboardingGood first issues, for folks who have access to all of our systems.Good first issues, for folks who have access to all of our systems.

nightly-buildsAnything having to do with nightly builds or continuous deployment.Anything having to do with nightly builds or continuous deployment.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3913 In catalyst-cooperative/pudl;

· e-belfer opened on Oct 18, 2024

Handle high memory usage in CEMS parquet-to-duckdb conversion

epacemsIntegration and analysis of the EPA CEMS dataset.Integration and analysis of the EPA CEMS dataset.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3812 In catalyst-cooperative/pudl;

· jdangerx opened on Aug 26, 2024

Figure out how to handle multiple <code>DAGSTER_HOME</code> locations

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3752 In catalyst-cooperative/pudl;

· bendnorman opened on Jul 31, 2024

Update to Pandas v3.0

data-typesDtype conversions, standardization and implications of data typesDtype conversions, standardization and implications of data types

dependenciesPull requests that update a dependency filePull requests that update a dependency file

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3737 In catalyst-cooperative/pudl;

· zaneselvans opened on Jul 25, 2024

Avoid post-concatenation memory spike in CSV / Excel extractors

csvIssues related to working with / extracting data from CSV filesIssues related to working with / extracting data from CSV files

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

excelIssues involving data in Microsoft Excel spreadsheetsIssues involving data in Microsoft Excel spreadsheets

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3571 In catalyst-cooperative/pudl;

· zaneselvans opened on Apr 15, 2024

Optimize PyArrow Parquet outputs

outputExporting data from PUDL into other platforms or interchange formats.Exporting data from PUDL into other platforms or interchange formats.

parquetIssues related to the Apache Parquet file format which we use for long tables.Issues related to the Apache Parquet file format which we use for long tables.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3246 In catalyst-cooperative/pudl;

· zaneselvans opened on Jan 16, 2024

Speed up unit tests

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3097 In catalyst-cooperative/pudl;

· bendnorman opened on Nov 29, 2023

How to handle storage/access to pre-trained model weights (FERC1-FERC1 plant match)

cloudStuff that has to do with adapting PUDL to work in cloud computing context.Stuff that has to do with adapting PUDL to work in cloud computing context.

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

ferc1Anything having to do with FERC Form 1Anything having to do with FERC Form 1

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3020 In catalyst-cooperative/pudl;

· zschira opened on Nov 6, 2023