Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] Add acceptance tests #2493

Merged
merged 10 commits into from
Mar 20, 2025
Merged

[Python] Add acceptance tests #2493

merged 10 commits into from
Mar 20, 2025

Conversation

kanterov
Copy link
Collaborator

Changes

Add acceptance tests for experimental/python

@kanterov kanterov temporarily deployed to test-trigger-is March 14, 2025 11:39 — with GitHub Actions Inactive
@@ -0,0 +1,3 @@
trace uv run --with databricks-bundles==0.7.2 -q $CLI bundle validate --output json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why does this install the package from PyPI and not from local repo?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

local package doesn't contain all necessary code yet

@kanterov kanterov temporarily deployed to test-trigger-is March 14, 2025 12:41 — with GitHub Actions Inactive
@kanterov kanterov temporarily deployed to test-trigger-is March 14, 2025 13:07 — with GitHub Actions Inactive
@kanterov kanterov marked this pull request as ready for review March 14, 2025 13:13
@kanterov kanterov temporarily deployed to test-trigger-is March 14, 2025 13:13 — with GitHub Actions Inactive
@kanterov kanterov force-pushed the python-acceptance-tests branch from 4045d19 to c56be44 Compare March 17, 2025 11:48
@kanterov kanterov temporarily deployed to test-trigger-is March 17, 2025 11:48 — with GitHub Actions Inactive
@kanterov kanterov temporarily deployed to test-trigger-is March 17, 2025 11:51 — with GitHub Actions Inactive
@kanterov kanterov requested a review from pietern March 17, 2025 12:20
github-merge-queue bot pushed a commit that referenced this pull request Mar 18, 2025
## Changes
Fix issues with multiple resource loaders. 

Previously, we discarded outputs of all loaders except the last one.
That worked well if there is only a single resource loader.

## Tests
- Unit tests
- Acceptance tests in #2493
github-merge-queue bot pushed a commit that referenced this pull request Mar 18, 2025
## Changes
Fix issues with bundles using multiple mutators. 

Previously, we didn't correctly chain output between them.

## Tests
- Unit tests
- Acceptance tests in #2493
@pietern pietern requested a review from Copilot March 20, 2025 12:58
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request adds acceptance tests for experimental Python integrations. It introduces tests for variable resolution, job mutators, and resource loading, and updates the corresponding configuration files.

  • Adds acceptance tests in resolve-variable, mutator-ordering, resource-loading, and a test configuration file.
  • Updates databricks.yml files to configure mutators, resources, and bundle settings.

Reviewed Changes

Copilot reviewed 7 out of 13 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
acceptance/bundle/python/resolve-variable/resources.py Defines acceptance tests for variable resolution with various types including complex variables
acceptance/bundle/python/mutator-ordering/mutators.py Implements job mutators to append tasks to a job
acceptance/bundle/python/resource-loading/resources.py Provides resource loading tests using dictionary configs
acceptance/bundle/python/mutator-ordering/databricks.yml Configures the order of Python mutators and sync options
acceptance/bundle/python/resource-loading/databricks.yml Sets up resource configuration for resource-loading tests
acceptance/bundle/python/resolve-variable/databricks.yml Specifies variable defaults and resource configuration for variable resolution tests
acceptance/bundle/python/test.toml Test configuration toggling local and cloud environments
Files not reviewed (6)
  • acceptance/bundle/python/mutator-ordering/output.txt: Language not supported
  • acceptance/bundle/python/mutator-ordering/script: Language not supported
  • acceptance/bundle/python/resolve-variable/output.txt: Language not supported
  • acceptance/bundle/python/resolve-variable/script: Language not supported
  • acceptance/bundle/python/resource-loading/output.txt: Language not supported
  • acceptance/bundle/python/resource-loading/script: Language not supported
Comments suppressed due to low confidence (1)

acceptance/bundle/python/resolve-variable/resources.py:55

  • The job name is set to the unresolved variable 'Variables.string_variable'. Consider using bundle.resolve_variable(Variables.string_variable) to pass the actual string value.
            name=Variables.string_variable,

@kanterov
Copy link
Collaborator Author

Oh nice, we can outsource all nitpicks to Copilot

@kanterov kanterov requested a review from anton-107 as a code owner March 20, 2025 14:00
@kanterov kanterov temporarily deployed to test-trigger-is March 20, 2025 14:00 — with GitHub Actions Inactive
@kanterov kanterov temporarily deployed to test-trigger-is March 20, 2025 14:03 — with GitHub Actions Inactive
@kanterov kanterov temporarily deployed to test-trigger-is March 20, 2025 14:04 — with GitHub Actions Inactive
@kanterov kanterov added this pull request to the merge queue Mar 20, 2025
Merged via the queue into main with commit abdb858 Mar 20, 2025
9 checks passed
@kanterov kanterov deleted the python-acceptance-tests branch March 20, 2025 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants