[Unity Catalog] - Change Setup.py notebook (#982) and Programmatically create Date/Time Dims (#984) #995
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#988) * automate region vm + dbx type cluster in the region * Update e2e_samples/parking_sensors/scripts/configure_databricks.sh Co-authored-by: Elena Terenzi <[email protected]> * filtering photon support --------- Co-authored-by: Elena Terenzi <[email protected]> # Type of PR <!-- Removed items that do not match with your change. --> - Documentation changes - Code changes - Test changes - CI-CD changes - GitHub Template changes ## Purpose <!-- Describe the intention of the changes being proposed. What problem does it solve or functionality does it add? --> - ... ## Does this introduce a breaking change? If yes, details on what can break ## Author pre-publish checklist <!-- Please check check before publishing PR using "x". Remove a column if it's not applicable. --> - [ ] Added test to prove my fix is effective or new feature works - [ ] No PII in logs - [ ] Made corresponding changes to the documentation ## Validation steps <!-- Optional. --> - ... ## Issues Closed or Referenced <!-- This will automatically close the issue when the PR closes. --> - Closes #issue_number <!-- this references the issue but does not close with PR. --> - References #issue_number
thesqlpro
changed the title
3 tasks
This was
linked to
issues
Dec 27, 2024
thesqlpro
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Update the setup.py notebook to include changes for Unity Catalog and Date/Time Dimension creation.
Type of PR
Code changes to setup.py notebook
Purpose
This PR is designed to complete two tasks. The first is to upgrade the notebook to the usage of Unity Catalog. This included adding the USE CATALOG command but also removing mount points form table creations (Task #982). The second upgrade is dynamically creating Date and Time Dimensions as opposed to using mount points that are linked to ADLS locations of uploaded files (Task #984) .
Does this introduce a breaking change? If yes, details on what can break
Author pre-publish checklist
Validation steps
Issues Closed or Referenced
#982
#984