generated from department-of-general-services/python-boilerplate
-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or requestprompt paymentWork related to the prompt payment ETL pipelineWork related to the prompt payment ETL pipeline
Description
Summary
Create a sub-package for CoreIntegrator with a class called PromptPayment
that will be used to scrape, download, and upload the Prompt Payment report to an archive.
To Do
- Create an
aging_report/core_integrator/
sub-package #18-
driver_utils.py
Used to create common functions used by Selenium chrome driver -
scraper.py
With aCoreIntegrator
class that actually downloads the report from CoreIntegrator -
prompt_payment.py
With aPromptPayment
class that manages calls to other classes and functions
-
- Implement the
CoreIntegrator
class #19-
_login()
Logs into CoreIntegrator -
_access_report()
Searches for the Prompt Payment report in CoreIntegrator -
_rename_download()
Renames the downloaded report -
scrape_report()
Public method that executes the full scrape and download workflow and returns the report as a dataframe
-
- Implement the
PromptPayment
class #20-
scrape()
InvokesCoreIntegrator.scrape_report()
and stores the result inself.df
-
archive()
InvokesArchives.upload_file()
to upload the scraped PromptPayment report to the DGS Fiscal archives folder
-
- Create a
prompt_payment
entry point to scrape and archive the Prompt Payment report #21
Definition of Done
- The Prompt Payment report can be downloaded from CoreIntegrator using
PromptPayment.scrape()
- The Prompt Payment report can be uploaded to SharePoint using
PromptPayment.archive()
- The methods above can be called using the
prompt_payment
entry point from the command line
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestprompt paymentWork related to the prompt payment ETL pipelineWork related to the prompt payment ETL pipeline