Search results

No Dagster logs but many uninformative logs in pytest

bugThings that are just plain broken.Things that are just plain broken.

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

developer experienceThings that make the developers' lives easier, but don't necessarily directly improve the data.Things that make the developers' lives easier, but don't necessarily directly improve the data.

performanceMake PUDL run faster!Make PUDL run faster!

testingWriting tests, creating test data, automating testing, etc.Writing tests, creating test data, automating testing, etc.

Status: Open.

#4482 In catalyst-cooperative/pudl;

· zaneselvans opened on Jul 25, 2025

Create Dagster job & assets that produce FERC-EIA ID mapping inputs

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

eia860Anything having to do with EIA Form 860Anything having to do with EIA Form 860

eia923Anything having to do with EIA Form 923Anything having to do with EIA Form 923

ferc1Anything having to do with FERC Form 1Anything having to do with FERC Form 1

gluePUDL specific structures & metadata. Stuff that connects datasets together.PUDL specific structures & metadata. Stuff that connects datasets together.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#4338 In catalyst-cooperative/pudl;

· zaneselvans opened on Jun 22, 2025

Field constraints missing from Dagster SQLite outputs

bugThings that are just plain broken.Things that are just plain broken.

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

metadataAnything having to do with the content, formatting, or storage of metadata. Mostly datapackages.Anything having to do with the content, formatting, or storage of metadata. Mostly datapackages.

sqliteIssues related to interacting with sqlite databasesIssues related to interacting with sqlite databases

testingWriting tests, creating test data, automating testing, etc.Writing tests, creating test data, automating testing, etc.

Status: Open.

Bug

#4169 In catalyst-cooperative/pudl;

· zaneselvans opened on Apr 4, 2025

Move ferc1 test_filter_for_freshest_data to asset check

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

data-validationIssues related to checking whether data meets our quality expectations.Issues related to checking whether data meets our quality expectations.

Status: Open.

#4150 In catalyst-cooperative/pudl;

· krivard opened on Mar 25, 2025

Dagster Housekeeping

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

epicAny issue whose primary purpose is to organize other issues into a group.Any issue whose primary purpose is to organize other issues into a group.

Status: Open.

#3956 In catalyst-cooperative/pudl;

· zaneselvans opened on Nov 11, 2024

Add a Dagster RetryPolicy to PUDL's ETL

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

internal-onboardingGood first issues, for folks who have access to all of our systems.Good first issues, for folks who have access to all of our systems.

nightly-buildsAnything having to do with nightly builds or continuous deployment.Anything having to do with nightly builds or continuous deployment.

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3913 In catalyst-cooperative/pudl;

· e-belfer opened on Oct 18, 2024

Dagster SQLite EventLog failures

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

sqliteIssues related to interacting with sqlite databasesIssues related to interacting with sqlite databases

Status: Open.

#3868 In catalyst-cooperative/pudl;

· zaneselvans opened on Sep 26, 2024

Figure out how to handle multiple <code>DAGSTER_HOME</code> locations

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3752 In catalyst-cooperative/pudl;

· bendnorman opened on Jul 31, 2024

Avoid post-concatenation memory spike in CSV / Excel extractors

csvIssues related to working with / extracting data from CSV filesIssues related to working with / extracting data from CSV files

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

excelIssues involving data in Microsoft Excel spreadsheetsIssues involving data in Microsoft Excel spreadsheets

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3571 In catalyst-cooperative/pudl;

· zaneselvans opened on Apr 15, 2024

Rename instances of <code>censusdp1tract_to_sqlite</code> in code to <code>censusdp1_to_sqlite</code>

censusdp1tractIssues related to the Census DP1 dataset which we distribute as an SQLite DBIssues related to the Census DP1 dataset which we distribute as an SQLite DB

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

good first issueGood issues for first-time contributors. Self-contained, low context, no credentials required.Good issues for first-time contributors. Self-contained, low context, no credentials required.

Status: Open.

#3288 In catalyst-cooperative/pudl;

· bendnorman opened on Jan 24, 2024

Remove <code>pudl_etl</code> and <code>ferc_to_sqlite</code> commands in favor of <code>dagster job execute</code>

cliScripts and other command line interfaces to PUDL.Scripts and other command line interfaces to PUDL.

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

developer experienceThings that make the developers' lives easier, but don't necessarily directly improve the data.Things that make the developers' lives easier, but don't necessarily directly improve the data.

Status: Open.

#3161 In catalyst-cooperative/pudl;

· bendnorman opened on Dec 15, 2023

How to handle storage/access to pre-trained model weights (FERC1-FERC1 plant match)

cloudStuff that has to do with adapting PUDL to work in cloud computing context.Stuff that has to do with adapting PUDL to work in cloud computing context.

dagsterIssues related to our use of the Dagster orchestratorIssues related to our use of the Dagster orchestrator

ferc1Anything having to do with FERC Form 1Anything having to do with FERC Form 1

performanceMake PUDL run faster!Make PUDL run faster!

Status: Open.

#3020 In catalyst-cooperative/pudl;

· zschira opened on Nov 6, 2023