Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(fct_transit_data_quality_issues): removes duplicate issues create… #3409

Merged
merged 1 commit into from
Aug 2, 2024
Merged

fix(fct_transit_data_quality_issues): removes duplicate issues create… #3409

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions warehouse/models/intermediate/transit_database/_int_transit_database.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,10 +60,12 @@ models:
- name: issue_type_key
- name: gtfs_dataset_key_at_creation
- name: gtfs_dataset_key_at_resolution
- name: gtfs_dataset_name
- name: status
- name: issue__
- name: service_key_at_creation
- name: service_key_at_resolution
- name: service_name
- name: resolution_date
- name: assignee
- name: issue_creation_time
Expand Down
13 changes: 6 additions & 7 deletions ...odels/intermediate/transit_database/int_transit_database__transit_data_quality_issues.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,11 +23,11 @@ unnested AS (
SELECT
id,
description,
issue_type_key,
gtfs_dataset_key,
gtfs_datasets[SAFE_OFFSET(0)] as gtfs_dataset_key,
status,
issue__,
service_key,
issue_type[SAFE_OFFSET(0)] AS issue_type_key,
services[SAFE_OFFSET(0)] AS service_key,
resolution_date,
assignee,
issue_creation_time,
Expand All @@ -47,10 +47,7 @@ unnested AS (
outreach_status,
should_wait_until,
dt
FROM stg_transit_database__transit_data_quality_issues,
UNNEST(gtfs_datasets) AS gtfs_dataset_key,
UNNEST(services) AS service_key,
UNNEST(issue_type) AS issue_type_key
FROM stg_transit_database__transit_data_quality_issues
),

joins AS (
Expand Down Expand Up @@ -114,11 +111,13 @@ int_transit_database__transit_data_quality_issues AS (
issue_type_name,
gtfs_dataset_key_at_creation,
gtfs_dataset_key_at_resolution,
gtfs_dataset_name,
gtfs_dataset_source_record_id,
status,
issue__,
service_key_at_creation,
service_key_at_resolution,
service_name,
service_source_record_id,
resolution_date,
assignee,
Expand Down
2 changes: 2 additions & 0 deletions warehouse/models/mart/transit_database/_mart_transit_database.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -911,6 +911,7 @@ models:
`issue_creation_time` and `resolution_date` fields present in the source data to time-bound
data validity. This field records the active GTFS dataset key mapped to the issue at the
time it was resolved.
- name: gtfs_dataset_name
- name: gtfs_dataset_source_record_id
- name: status
- name: issue__
Expand All @@ -927,6 +928,7 @@ models:
data validity. This field records the active service key mapped to the issue at the time it
was resolved.
- name: service_source_record_id
- name: service_name
- name: resolution_date
- name: assignee
- name: issue_creation_time
Expand Down
2 changes: 2 additions & 0 deletions warehouse/models/mart/transit_database/fct_transit_data_quality_issues.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,13 @@ fct_transit_data_quality_issues AS (
issue_type_name,
gtfs_dataset_key_at_creation,
gtfs_dataset_key_at_resolution,
gtfs_dataset_name,
gtfs_dataset_source_record_id,
status,
issue__,
service_key_at_creation,
service_key_at_resolution,
service_name,
service_source_record_id,
resolution_date,
assignee,
Expand Down
Loading