Upgrade Cypress to v13 with GitHub Action integration

.github/copilot-instructions.md

@@ -0,0 +1,307 @@
+# Geotrek-admin Development Instructions
+
+Geotrek-admin is a Django-based geospatial web application for managing trekking, outdoor tourism data and geographic information. It uses PostGIS for spatial data, Redis for caching, and provides both a web admin interface and comprehensive APIs.
+
+**Always reference these instructions first and fallback to search or bash commands only when you encounter unexpected information that does not match the info here.**
+
+## Working Effectively
+
+### Network Limitations - CRITICAL
+- **Docker build from source FAILS** due to firewall limitations preventing Python download from GitHub
+- Timeout occurs when downloading `cpython-3.10.18+20250828-x86_64-unknown-linux-gnu-install_only_stripped.tar.gz`
+- Build fails after exactly ~2 minutes with "operation timed out" error
+- **WORKAROUND**: Use pre-built official images: `docker pull geotrekce/admin:latest`
+- **Do not attempt** `docker compose build` - it will fail after ~2 minutes with network timeout
+- **Alternative**: Use Ubuntu package installation method for full functionality
+
+### Development Setup
+
+#### Recommended: Development Target (Full Environment)
+The `docker-compose.yml` at root is configured for development with `target: dev`. Use this for full development functionality:
+
+```bash
+# 1. Setup environment and permissions
+cp .env.dist .env
+mkdir -p var/{log,cache,media,static,tmp,conf}
+chmod -R 777 var
+echo "127.0.0.1 geotrek.local" | sudo tee -a /etc/hosts
+
+# 2. Build and start the development environment
+docker compose build  # NEVER CANCEL: Takes 5-10+ minutes, set timeout to 15+ minutes
+docker compose up -d   # NEVER CANCEL: Takes 2-3 minutes, set timeout to 10+ minutes
+
+# 3. Initialize the development environment
+docker compose run --rm web update.sh     # NEVER CANCEL: Takes 2-5 minutes, set timeout to 15+ minutes
+docker compose run --rm web load_data.sh  # NEVER CANCEL: Takes 5-15 minutes, set timeout to 30+ minutes
+```
+
+**TIMING**: Complete setup takes 15-30+ minutes. NEVER CANCEL during any step.
+
+#### Alternative: Network-Limited Environment
+If Docker build fails due to network restrictions, use the production image workaround:
+
+```bash
+# 1. Setup environment and permissions (same as above)
+cp .env.dist .env
+mkdir -p var/{log,cache,media,static,tmp,conf}
+chmod -R 777 var
+echo "127.0.0.1 geotrek.local" | sudo tee -a /etc/hosts
+
+# 2. Pull pre-built production image and tag for local use
+docker pull geotrekce/admin:latest
+docker tag geotrekce/admin:latest geotrek:latest
+
+# 3. Start supporting services only
+docker compose up postgres redis convertit screamshotter -d
+# Wait for postgres to be healthy (about 30 seconds)
+
+# Note: Web container may not start properly with production image due to missing dev dependencies
+```
+
+**TIMING**: Service startup takes ~30-45 seconds. NEVER CANCEL during startup phase.
+
+#### Alternative Installation Methods
+For full functionality when Docker is not suitable:
+
+1. **Ubuntu Package Installation** (Recommended for production-like setup):
+   ```bash
+   # Follow instructions from docs/installation-and-configuration/installation.rst
+   bash -c "$(curl -fsSL https://raw.githubusercontent.com/GeotrekCE/Geotrek-admin/master/tools/install.sh)"
+   ```
+
+## Testing
+
+### Django Tests
+**CRITICAL TIMING**: Django tests take 15-30+ minutes. **NEVER CANCEL.** Set timeout to 45+ minutes minimum.
+
+```bash
+# Full test suite with coverage (LONG RUNNING - 20-30 minutes)
+make coverage  # NEVER CANCEL: Takes 20-30 minutes. Set timeout to 45+ minutes
+
+# Specific test environments  
+make test      # NEVER CANCEL: Standard tests, ~15 minutes, set timeout to 30+ minutes
+make test_nds  # NEVER CANCEL: Non-dynamic segmentation tests, ~15 minutes, set timeout to 30+ minutes  
+make tests     # NEVER CANCEL: Both test and test_nds, ~30 minutes, set timeout to 60+ minutes
+```
+
+**Note**: Tests work with the development target (`target: dev` in docker-compose.yml). They may not work with the production image workaround due to missing development dependencies.
+
+### Code Quality 
+```bash
+make quality   # ✅ Works with development target (dev), ❌ Fails with production image
+make lint      # ✅ Works with development target (dev), ❌ Fails with production image  
+make format    # ✅ Works with development target (dev), ❌ Fails with production image
+```
+
+**Note**: Quality commands work with the development target (`target: dev` in docker-compose.yml) which includes ruff and other dev tools. They fail with the production image workaround due to missing development dependencies.
+
+### End-to-End Tests (Cypress)
+**CRITICAL**: Requires complete setup with loaded data. Takes 10-15 minutes. **NEVER CANCEL.**
+
+```bash
+# Setup test data first (NEVER CANCEL each step)
+make load_data              # NEVER CANCEL: ~5-10 minutes, set timeout to 20+ minutes
+make load_test_integration  # NEVER CANCEL: ~2-5 minutes, set timeout to 15+ minutes
+
+# Run Cypress tests (NEVER CANCEL)
+cd cypress
+npm ci                      # NEVER CANCEL: ~2-3 minutes first time, set timeout to 10+ minutes
+./node_modules/.bin/cypress run  # NEVER CANCEL: ~5-10 minutes, set timeout to 20+ minutes
+```
+
+**Warning**: These commands require working development environment setup.
+
+## Key Development Commands
+
+### Management Commands (After successful setup)
+```bash
+# Database operations
+docker compose run --rm web ./manage.py migrate
+docker compose run --rm web ./manage.py createsuperuser
+docker compose run --rm web ./manage.py collectstatic --clear --noinput
+
+# Translations
+make messages           # Extract translatable strings
+make compilemessages   # Compile translations
+
+# Dependencies (requires network access)
+make deps              # Update all requirements files, ~2-3 minutes
+```
+
+### Running the Application
+```bash
+# Development server (if working environment)
+docker compose up  # Access at http://geotrek.local:8000
+# or
+make serve
+```
+
+## Validation Scenarios
+
+**Always test these workflows after making changes:**
+
+### 1. Basic Django Functionality
+```bash
+# Verify Django starts without errors
+docker compose run --rm web ./manage.py check
+
+# Test basic management commands  
+docker compose run --rm web ./manage.py help
+```
+
+### 2. Database Operations
+```bash
+# Test database connectivity
+docker compose run --rm web ./manage.py dbshell -c "SELECT version();"
+
+# Verify migrations
+docker compose run --rm web ./manage.py showmigrations
+```
+
+### 3. API Endpoint Testing
+```bash
+# Test API availability (if server running)
+curl -f http://geotrek.local:8000/api/settings.json
+```
+
+## What Actually Works in Network-Limited Environments
+
+### ✅ Working Commands (Development Target)
+```bash
+# Full development environment (if network allows)
+docker compose build                      # Works when network allows GitHub downloads
+docker compose up -d                     # Full development environment 
+docker compose run --rm web update.sh    # Works with dev target
+make test                                # Works with dev target
+make lint                                # Works with dev target (includes ruff)
+make quality                             # Works with dev target (includes ruff)
+```
+
+### ✅ Working Commands (Network-Limited Environments)  
+```bash
+# Service management
+docker compose up postgres redis convertit screamshotter -d
+docker compose down
+docker compose ps
+
+# Production image workaround
+docker pull geotrekce/admin:latest
+docker tag geotrekce/admin:latest geotrek:latest
+
+# File system operations
+cp .env.dist .env
+mkdir -p var/{log,cache,media,static,tmp,conf}
+chmod -R 777 var
+
+# Basic validation
+curl -I https://raw.githubusercontent.com/GeotrekCE/Geotrek-admin/master/tools/install.sh
+```
+
+### ❌ Known Failing Commands (Network-Limited)
+```bash
+# Development environment setup when network is restricted
+docker compose build                    # Network timeout during Python download
+docker compose run --rm web update.sh   # Only works with dev target, not production image
+make test                               # Only works with dev target 
+make lint                               # Only works with dev target (missing ruff in production image)
+```
+
+### 🔄 Recommended Workflow for Coding Agents
+
+1. **Try development target first**: Use `docker compose build` and `docker compose up` for full development environment with all tools (linting, testing, dev dependencies)
+2. **Fall back to production image workaround** if network restrictions prevent Docker builds from source
+3. **Use Ubuntu package installation** for production-like setup when Docker is not suitable
+4. **Focus on file-based changes** that don't require running the full application when development environment is not available
+5. **Test with full development environment** when possible for comprehensive validation
+
+## Verified Command Timings
+
+**Based on actual testing - use these timeout values:**
+
+| Command | Duration | Recommended Timeout | With Dev Target | With Prod Image |
+|---------|----------|-------------------|-----------------|-----------------|
+| `docker compose build` | ~5-10 minutes | 900+ seconds | ✅ Works (if network allows) | ❌ Not applicable |
+| `docker compose up postgres` | ~30 seconds | 120 seconds | ✅ Works | ✅ Works |
+| `docker pull geotrekce/admin:latest` | ~2-3 minutes | 600 seconds | Not needed | ✅ Works |
+| `make quality` | ~30 seconds | 120 seconds | ✅ Works | ❌ Missing ruff |
+| `make lint` | ~15 seconds | 60 seconds | ✅ Works | ❌ Missing ruff |
+| `make format` | ~10 seconds | 60 seconds | ✅ Works | ❌ Missing ruff |
+| `make test` | ~15+ minutes | 1800+ seconds | ✅ Works | ❌ Needs dev env |
+| `make coverage` | ~20-30 minutes | 2700+ seconds | ✅ Works | ❌ Needs dev env |
+| Cypress tests | ~10-15 minutes | 1200+ seconds | ✅ Works | ❌ Needs dev env |
+
+**Key**: ✅ = Verified working, ❌ = Known to fail or missing dependencies
+
+## Common Tasks
+
+### Repository Structure
+```
+/home/runner/work/Geotrek-admin/Geotrek-admin/
+├── geotrek/           # Main Django application
+│   ├── settings/      # Django settings
+│   ├── api/          # REST API
+│   ├── trekking/     # Core trekking models
+│   ├── tourism/      # Tourism models  
+│   └── ...           # Other Django apps
+├── docker/           # Docker configuration
+│   └── Dockerfile    # Multi-stage build with dev/prod targets
+├── docs/             # Sphinx documentation
+├── cypress/          # E2E tests
+├── requirements.txt  # Python dependencies
+├── requirements-dev.txt  # Development dependencies (ruff, testing tools)
+├── Makefile         # Build shortcuts
+└── docker-compose.yml  # ⭐ Configured for development (target: dev)
+```
+
+### Key Files to Monitor
+- `geotrek/settings/` - Django configuration
+- `requirements.txt` / `requirements-dev.txt` - Dependencies
+- `Makefile` - Build and test commands
+- `.env` - Environment configuration
+- `docker-compose.yml` - Service definitions
+
+### Configuration Files
+- `ruff.toml` - Code quality configuration
+- `setup.py` - Package definition and dependencies
+- `.env.dist` - Environment template
+
+## Troubleshooting
+
+### Known Issues
+1. **Docker build fails**: Use pre-built images as documented above
+2. **Permission errors**: Ensure `var/` directory has proper permissions (777)
+3. **Network timeouts**: All downloads from GitHub may fail in restricted environments
+4. **Database connection**: Ensure PostgreSQL container is healthy before running commands
+
+### Log Locations
+- Application logs: `var/log/`
+- Docker logs: `docker compose logs [service]`
+- Test results: Console output, Cypress videos in `cypress/videos/`
+
+### Performance Notes
+- Database queries can be slow due to complex geometric operations
+- PDF generation requires proper domain setup (geotrek.local)
+- Map tiles and static files need proper permissions
+
+## CI/CD Integration
+
+The repository includes GitHub Actions workflows:
+- `.github/workflows/test.yml` - Comprehensive test matrix
+- `.github/workflows/lint.yml` - Code quality checks
+- `.github/workflows/doc.yml` - Documentation builds
+
+**Always run** `make quality` before committing to match CI requirements.
+
+## Required System Resources
+- 4+ CPU cores (for complex geometric operations)
+- 8+ GB RAM (PostGIS operations are memory-intensive)  
+- 50+ GB disk space (including media files)
+- Docker with at least 4GB memory allocation
+
+## Important Notes
+- **NEVER CANCEL** long-running operations (builds, tests) - they may take 30+ minutes
+- Always use timeout values of 45+ minutes for build operations
+- Always use timeout values of 30+ minutes for test operations
+- Always validate changes with both Django and Cypress tests when possible
+- Geographic operations are CPU-bound and take significant time
+- The application serves as the backend for Geotrek-rando (public website) and Geotrek-mobile apps

.github/workflows/dependencies.yml

@@ -5,7 +5,7 @@ on:
     paths:
       - setup.py
       - requirements.txt
-      - ../../requirements-dev.txt
+      - requirements-dev.txt
       - docs/requirements.txt
       - .github/workflows/dependencies.yml
 
@@ -21,10 +21,23 @@ jobs:
         os: ['ubuntu-latest']
         python-version: ['3.10']
 
+    permissions:
+      contents: write
+      actions: write
+
     steps:
-      - uses: actions/checkout@v4
+      - uses: actions/checkout@v6
+        if: github.event.pull_request.head.repo.full_name != github.repository
+        with:
+          ref: ${{ github.head_ref }}
+
+      - uses: actions/checkout@v6
+        if: github.event.pull_request.head.repo.full_name == github.repository
+        with:
+          token: ${{ secrets.PAT }}
+          ref: ${{ github.head_ref }}
 
-      - uses: astral-sh/setup-uv@v6
+      - uses: astral-sh/setup-uv@v7
         with:
           version: "latest"
           python-version: ${{ matrix.python-version }}
@@ -33,7 +46,7 @@ jobs:
         run: |
           uv pip compile setup.py -o requirements.txt
           uv pip compile requirements-dev.in -o requirements-dev.txt
-          cd docs/ && uv pip compile requirements.in -o requirements.txt
+          cd docs/ && uv pip compile -c ../requirements.txt -c ../requirements-dev.txt requirements.in -o requirements.txt
 
       - name: Verify dependency graph is ok
         uses: tj-actions/verify-changed-files@v20
@@ -49,4 +62,12 @@ jobs:
         run: |
           echo "Dependency file(s) changed: ${{ steps.verify-changed-files.outputs.changed_files }}"
           git diff
-          core.setFailed('Please add your new dependencies in setup.py and/or requirements-dev.in then run pip-compile to add them in requirements. (see docs/contribute/development)')
+          # core.setFailed('Please add your new dependencies in setup.py and/or requirements-dev.in then run pip-compile to add them in requirements. (see docs/contribute/development)')
+
+      - name: Commit files changed
+        uses: stefanzweifel/git-auto-commit-action@v7
+        if: steps.verify-changed-files.outputs.files_changed == 'true'
+        with:
+            # Optional. Commit message for the created commit.
+            # Defaults to "Apply automatic changes"
+            commit_message: "Fix deps"

.github/workflows/doc.yml

@@ -1,6 +1,7 @@
 name: Documentation
 
 on:
+  workflow_dispatch:
   push:
     branches:
       - master
@@ -23,8 +24,8 @@ jobs:
     name: Documentation
     runs-on: ubuntu-latest
     steps:
-      - uses: actions/checkout@v4
-      - uses: astral-sh/setup-uv@v6
+      - uses: actions/checkout@v6
+      - uses: astral-sh/setup-uv@v7
         with:
             version: "latest"
             python-version: "3.10"
@@ -36,4 +37,4 @@ jobs:
         run: |
           cd docs/
           uv pip install -r requirements.txt
-          make html SPHINXOPTS="-W"
+          make html SPHINXOPTS="-W"