Add step to file issues if tests fails after merging to main (#776)

* Add step to file issues if tests fails after merging to main

* Fix typo

* Add issue number to news item

.github/TEST_FAILURE_REPORT_TEMPLATE.md

@@ -0,0 +1,10 @@
+---
+title: "{{ env.TITLE }}"
+labels: [type::bug, type::testing]
+---
+
+The {{ workflow }} workflow failed on {{ date | date("YYYY-MM-DD HH:mm") }} UTC
+
+Full run: https://github.com/conda/constructor/actions/runs/{{ env.RUN_ID }}
+
+(This post will be updated if another test fails, as long as this issue remains open.)

.github/workflows/main.yml

@@ -145,6 +145,16 @@ jobs:
         run: |
           python scripts/make_docs.py
           git diff --exit-code
+      - name: Report failures
+        if: always() && github.event_name == 'push'
+        uses: JasonEtco/create-an-issue@v2
+        env:
+          GITHUB_TOKEN: ${{ secrets.CONSTRUCTOR_ISSUES }}
+          RUN_ID: ${{ github.run_id }}
+          TITLE: "Constructor tests failed"
+        with:
+          filename: .github/TEST_FAILURE_REPORT_TEMPLATE.md
+          update_existing: true
       - name: Upload the example installers as artifacts
         if: github.event_name == 'pull_request' && matrix.python-version == '3.9'
         uses: actions/upload-artifact@v3

news/776-automatically-create-issue-on-test-failure-after-merging-to-main

@@ -0,0 +1,19 @@
+### Enhancements
+
+* <news item>
+
+### Bug fixes
+
+* <news item>
+
+### Deprecations
+
+* <news item>
+
+### Docs
+
+* <news item>
+
+### Other
+
+* Automatically create issues when tests fail after pushing to main or creating tags. (#775 via #776)