Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Patch 07/31/2024 data for hospital admission #2011

Open
aysim319 opened this issue Jul 31, 2024 · 3 comments
Open

Patch 07/31/2024 data for hospital admission #2011

aysim319 opened this issue Jul 31, 2024 · 3 comments
Assignees
Labels
data quality Missing data, weird data, broken data
Milestone

Comments

@aysim319
Copy link
Contributor

Actual Behavior:
Chronicle run for hopsital admission for 7/31 failed due to exceeding expected max files. The files themselves are correct and the expected max size needs to be increased

Expected behavior
should run fine
Context
(https://delphi-org.slack.com/archives/C01LZ3A2UMU/p1722393650290459)

@aysim319 aysim319 added the data quality Missing data, weird data, broken data label Jul 31, 2024
@aysim319 aysim319 self-assigned this Jul 31, 2024
@aysim319 aysim319 changed the title Patch 07/31/2014 data for hospital admission Patch 07/31/2014 data for hospital admission Jul 31, 2024
@minhkhul
Copy link
Contributor

minhkhul commented Jul 31, 2024

Let's wait for a few days and see if we keep geting 4+ files, which is max of what we expect. I wrote a script to check how many times have we received 3+ inpatient source files per day and there are a few from 2022. But only yesterday do we receive 5 files. Which means it could just be yesterday being a weird day.

@aysim319 aysim319 added this to the Data patching milestone Aug 12, 2024
@aysim319 aysim319 removed their assignment Aug 12, 2024
@aysim319 aysim319 changed the title Patch 07/31/2014 data for hospital admission Patch 07/31/2024 data for hospital admission Aug 22, 2024
@aysim319 aysim319 self-assigned this Aug 26, 2024
@aysim319
Copy link
Contributor Author

aysim319 commented Sep 17, 2024

Need to consider the parquet files in prod that is held off for now since more formal process needs to be taken going to take a while. But will patch the data and come back when things are more formally set up

@aysim319
Copy link
Contributor Author

finished with the patch, but not done with the parquet file until we figure out how to deal with them

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data quality Missing data, weird data, broken data
Projects
None yet
Development

No branches or pull requests

2 participants