Skip to content

Flaky integration test failure #15351

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
5 of 11 tasks
AlanCoding opened this issue Jul 9, 2024 · 1 comment · May be fixed by #15966
Open
5 of 11 tasks

Flaky integration test failure #15351

AlanCoding opened this issue Jul 9, 2024 · 1 comment · May be fixed by #15966
Labels
component:api needs_triage type:bug

Comments

@AlanCoding
Copy link
Member

Please confirm the following

  • I agree to follow this project's code of conduct.
  • I have checked the current issues for duplicates.
  • I understand that AWX is open source software provided for free and that I might not receive a timely response.
  • I am NOT reporting a (potential) security vulnerability. (These should be emailed to [email protected] instead.)

Bug Summary

Collection integration tests checks failed

TASK [bulk_job_launch : Delete Job Template] ***********************************
task path: /home/runner/.ansible/collections/ansible_collections/awx/awx/tests/output/.tmp/integration/bulk_job_launch-j8j3ssrr-ÅÑŚÌβŁÈ/tests/integration/targets/bulk_job_launch/tasks/main.yml:67
Using module file /home/runner/.ansible/collections/ansible_collections/awx/awx/plugins/modules/job_template.py
Pipelining is enabled.
<testhost> ESTABLISH LOCAL CONNECTION FOR USER: runner
<testhost> EXEC /bin/sh -c '/usr/bin/python3 && sleep 0'
The full traceback is:
  File "/tmp/ansible_job_template_payload_vrx_hk7z/ansible_job_template_payload.zip/ansible_collections/awx/awx/plugins/module_utils/controller_api.py", line 507, in make_request
    response = self.session.open(
  File "/tmp/ansible_job_template_payload_vrx_hk7z/ansible_job_template_payload.zip/ansible/module_utils/urls.py", line 899, in open
    r = urllib.request.urlopen(request, None, timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
fatal: [testhost]: FAILED! => {
    "changed": false,
    "invocation": {
        "module_args": {
            "allow_simultaneous": null,
            "ask_credential_on_launch": null,
            "ask_diff_mode_on_launch": null,
            "ask_execution_environment_on_launch": null,
            "ask_forks_on_launch": null,
            "ask_instance_groups_on_launch": null,
            "ask_inventory_on_launch": null,
            "ask_job_slice_count_on_launch": null,
            "ask_job_type_on_launch": null,
            "ask_labels_on_launch": null,
            "ask_limit_on_launch": null,
            "ask_scm_branch_on_launch": null,
            "ask_skip_tags_on_launch": null,
            "ask_tags_on_launch": null,
            "ask_timeout_on_launch": null,
            "ask_variables_on_launch": null,
            "ask_verbosity_on_launch": null,
            "become_enabled": null,
            "controller_config_file": null,
            "controller_host": null,
            "controller_oauthtoken": null,
            "controller_password": null,
            "controller_username": null,
            "copy_from": null,
            "credential": null,
            "credentials": null,
            "custom_virtualenv": null,
            "description": null,
            "diff_mode": null,
            "execution_environment": null,
            "extra_vars": null,
            "force_handlers": null,
            "forks": null,
            "host_config_key": null,
            "instance_groups": null,
            "inventory": null,
            "job_slice_count": null,
            "job_tags": null,
            "job_type": null,
            "labels": null,
            "limit": null,
            "name": "AWX-Collection-tests-bulk_job_launch-pFcZYEmgQUttbjTH",
            "new_name": null,
            "notification_templates_error": null,
            "notification_templates_started": null,
            "notification_templates_success": null,
            "organization": null,
            "playbook": null,
            "prevent_instance_group_fallback": null,
            "project": null,
            "request_timeout": null,
            "scm_branch": null,
            "skip_tags": null,
            "start_at_task": null,
            "state": "absent",
            "survey_enabled": null,
            "survey_spec": null,
            "timeout": null,
            "use_fact_cache": null,
            "validate_certs": null,
            "vault_credential": null,
            "verbosity": null,
            "webhook_credential": null,
            "webhook_service": null
        }
    },
    "msg": "You don't have permission to DELETE to /api/v2/job_templates/8/ (HTTP 403)."
}

This appears to be flaky, so documenting here.

AWX version

devel

Select the relevant components

  • UI
  • UI (tech preview)
  • API
  • Docs
  • Collection
  • CLI
  • Other

Installation method

N/A

Modifications

no

Ansible version

No response

Operating system

No response

Web browser

No response

Steps to reproduce

flaky

Expected results

passing

Actual results

sometimes may fail

Additional information

No response
@AlanCoding
Copy link
Member Author

In #15964, seen another version of this

TASK [role : Delete the project] ***********************************************
task path: /home/runner/.ansible/collections/ansible_collections/awx/awx/tests/output/.tmp/integration/role-k8k0cf_2-ÅÑŚÌβŁÈ/tests/integration/targets/role/tasks/main.yml:284
Using module file /home/runner/.ansible/collections/ansible_collections/awx/awx/plugins/modules/project.py
Pipelining is enabled.
<testhost> ESTABLISH LOCAL CONNECTION FOR USER: runner
<testhost> EXEC /bin/sh -c '/opt/hostedtoolcache/Python/3.13.3/x64/bin/python3 && sleep 0'
The full traceback is:
  File "/tmp/ansible_project_payload_aedjq45w/ansible_project_payload.zip/ansible_collections/awx/awx/plugins/module_utils/controller_api.py", line 493, in make_request
    response = self.session.open(
        method, url.geturl(),
    ...<4 lines>...
        data=data
    )
  File "/tmp/ansible_project_payload_aedjq45w/ansible_project_payload.zip/ansible/module_utils/urls.py", line 899, in open
    r = urllib.request.urlopen(request, None, timeout)
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 189, in urlopen
    return opener.open(url, data, timeout)
           ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 495, in open
    response = meth(req, response)
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 604, in http_response
    response = self.parent.error(
        'http', request, response, code, msg, hdrs)
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 533, in error
    return self._call_chain(*args)
           ~~~~~~~~~~~~~~~~^^^^^^^
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 466, in _call_chain
    result = func(*args)
  File "/opt/hostedtoolcache/Python/3.13.3/x64/lib/python3.13/urllib/request.py", line 613, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
fatal: [testhost]: FAILED! => {
    "changed": false,
    "invocation": {
        "module_args": {
            "allow_override": null,
            "controller_config_file": null,
            "controller_host": null,
            "controller_password": null,
            "controller_username": null,
            "copy_from": null,
            "credential": null,
            "custom_virtualenv": null,
            "default_environment": null,
            "description": null,
            "interval": 2.0,
            "local_path": null,
            "name": "AWX-Collection-tests-role-project-1-WAWZECQKtbPSVGdn",
            "new_name": null,
            "notification_templates_error": null,
            "notification_templates_started": null,
            "notification_templates_success": null,
            "organization": "Default",
            "request_timeout": null,
            "scm_branch": null,
            "scm_clean": null,
            "scm_delete_on_update": null,
            "scm_refspec": null,
            "scm_track_submodules": null,
            "scm_type": null,
            "scm_update_cache_timeout": null,
            "scm_update_on_launch": null,
            "scm_url": null,
            "signature_validation_credential": null,
            "state": "absent",
            "timeout": null,
            "update_project": false,
            "validate_certs": null,
            "wait": true
        }
    },
    "msg": "You don't have permission to DELETE to /api/v2/projects/7/ (HTTP 403)."
}

@AlanCoding AlanCoding linked a pull request Apr 28, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component:api needs_triage type:bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add retry loop to deletions in collection tests AlanCoding/awx
1 participant
@AlanCoding