EQR contracts and identities

[bendnorman]

This PR contains a prototype ETL for extracting EQR data and notebooks with some initial exploration of the data.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[bendnorman]

Comments

• Except for a few duplicates, the Filer Unique Identifier and Company Identifier form a natural key for each quarter. (See entergy-identities-exploration_10_28_2022 notebook).
• I found about 15 sellers associated with Entergy (they either have Entergy in the company name or email address).
• The EQR Filing requirements pdf is a good resource for understanding the structure of the data. It would be helpful for Alex to review the “Who Must File” sections to make sure EQR captures the data he needs. It might be difficult to compare total purchase power with other data sources because they’re working with different subsets of companies.
• The contracts table’s natural key continues to elude me. The requirements pdf reveals there are multiple records for a contract if there are multiple customers, FERC Tariff Reference Numbers, products, quantities, or rate. See entergy-contracts-exploration_10_28_2022 notebook.

Questions

• I tried linking customers with the FERC Company registration table to get buyer CIDs (see entergy-customers-exploration_10_28_2022 notebook). 2,400 of 12,000 customers matched with some light cleaning and exact string comparisons. We need to figure out how many EQR customers we expect to have a CID. Dumb energy question: what types of entities purchase power? It seems like all kinds of entities might not have a CID. The requirements for obtaining a CID:

You must obtain a Company Identifier if your company is required by Commission regulations to submit an electronic filing for which a Company Identifier is required. If you are uncertain about whether an electronic filing you are required to submit requires a Company Identifier, you should obtain legal advice regarding FERC regulatory affairs and, if deemed necessary, consult with appropriate FERC staff.

so pretty vague. What entities don’t need file FERC forms?

• To confidently link customers to other data, we need more information about the EQR customers. Unfortunately, EQR doesn’t provide much. ~37% of contracts have a point of delivery balancing authority. We could also use something like https://opencorporates.com/ to find more information about EQR customers and CID companies. The CID table contains the company region (Western, Eastern, Central, Pipeline). Can we assume the buyers and sellers are in the same region?