Make inverting the call tree fast, by computing inverted call nodes lazily #4900
firefoxci-taskcluster / Decision Task
succeeded
Feb 13, 2025 in 12s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2025-02-13T23:15:43.398Z
Resolved: 2025-02-13T23:15:53.983Z
Task Execution Time: 10 seconds, 585 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/actions.json
- public/docker-contexts/linux.tar.gz
- public/fetch-content
- public/full-task-graph.json
- public/label-to-taskid.json
- public/logs/live_backing.log
- public/logs/live.log
- public/parameters.yml
- public/runnable-jobs.json
- public/run-task
- public/target-tasks.json
- public/task-graph.json
[taskcluster 2025-02-13 23:15:43.513Z] Task ID: H4bCX13HS0iAKO7EL-Luhw
[taskcluster 2025-02-13 23:15:43.513Z] Worker ID: 6592575017765290683
[taskcluster 2025-02-13 23:15:43.513Z] Worker Group: us-central1-b
[taskcluster 2025-02-13 23:15:43.513Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2025-02-13 23:15:43.513Z] Worker Pool: mozilla-1/decision-gcp
[taskcluster 2025-02-13 23:15:43.513Z] Worker Version: 38.0.5
[taskcluster 2025-02-13 23:15:43.513Z] Public IP: 34.60.84.173
[taskcluster 2025-02-13 23:15:43.513Z] Hostname: mozilla-1-decision-gcp-zoandvlmsn2pgron0-cjeq
[taskcluster 2025-02-13 23:15:43.513Z] using cache "mozilla-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
[taskcluster 2025-02-13 23:15:44.139Z] === Task Starting ===
[setup 2025-02-13T23:15:44.557Z] run-task started in /
[vcs 2025-02-13T23:15:44.559Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2025-02-13T23:15:44.559Z] running as worker:worker
[vcs 2025-02-13T23:15:44.559Z] executing ['git', 'fetch', '--tags', 'https://github.com/mstange/perf.html', 'fast-invert4']
[vcs 2025-02-13T23:15:44.909Z] From https://github.com/mstange/perf.html
[vcs 2025-02-13T23:15:44.909Z] * branch fast-invert4 -> FETCH_HEAD
[vcs 2025-02-13T23:15:44.916Z] executing ['git', 'checkout', '-f', 'c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2']
[vcs 2025-02-13T23:15:45.046Z] Warning: you are leaving 6 commits behind, not connected to
[vcs 2025-02-13T23:15:45.046Z] any of your branches:
[vcs 2025-02-13T23:15:45.046Z]
[vcs 2025-02-13T23:15:45.046Z] 2d573dd3e Fix parentDoopNode typo.
[vcs 2025-02-13T23:15:45.048Z] c70ce11e5 Clarify the comment about ordering the inverted children by func.
[vcs 2025-02-13T23:15:45.048Z] 0165ac750 Adjust the comment above _createNonRootNode as requested by julien.
[vcs 2025-02-13T23:15:45.048Z] 587537dad Move _getChildWithFunc and improve its comments.
[vcs 2025-02-13T23:15:45.048Z] ... and 2 more.
[vcs 2025-02-13T23:15:45.048Z]
[vcs 2025-02-13T23:15:45.048Z] If you want to keep them by creating a new branch, this may be a good time
[vcs 2025-02-13T23:15:45.048Z] to do so with:
[vcs 2025-02-13T23:15:45.048Z]
[vcs 2025-02-13T23:15:45.048Z] git branch <new-branch-name> 2d573dd3e
[vcs 2025-02-13T23:15:45.048Z]
[vcs 2025-02-13T23:15:45.048Z] HEAD is now at c80f34a5e Fix parentDoopNode typo.
[vcs 2025-02-13T23:15:45.048Z] executing ['git', 'clean', '-xdff']
[vcs 2025-02-13T23:15:45.054Z] Removing artifacts
[vcs 2025-02-13T23:15:45.054Z] Removing docker-contexts/
[vcs 2025-02-13T23:15:45.055Z] Removing taskcluster/firefox_profiler_taskgraph/transforms/__pycache__/hello.cpython-38.pyc
[vcs 2025-02-13T23:15:45.058Z] TinderboxPrint:<a href='https://github.com/mstange/perf.html/commit/c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2' title='Built from perf.html commit c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2'>c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2</a>
[pip-install 2025-02-13T23:15:45.058Z] executing ['/usr/bin/python3', '-mpip', 'install', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2025-02-13T23:15:45.763Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2025-02-13T23:15:45.845Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2025-02-13T23:15:45.956Z] Collecting arrow==1.2.3
[pip-install 2025-02-13T23:15:46.017Z] Downloading arrow-1.2.3-py3-none-any.whl (66 kB)
[pip-install 2025-02-13T23:15:46.057Z] Collecting binaryornot==0.4.4
[pip-install 2025-02-13T23:15:46.071Z] Downloading binaryornot-0.4.4-py2.py3-none-any.whl (9.0 kB)
[pip-install 2025-02-13T23:15:46.139Z] Collecting certifi==2024.7.4
[pip-install 2025-02-13T23:15:46.153Z] Downloading certifi-2024.7.4-py3-none-any.whl (162 kB)
[pip-install 2025-02-13T23:15:46.194Z] Collecting chardet==5.2.0
[pip-install 2025-02-13T23:15:46.207Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2025-02-13T23:15:46.598Z] Collecting charset-normalizer==3.2.0
[pip-install 2025-02-13T23:15:46.617Z] Downloading charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
[pip-install 2025-02-13T23:15:46.675Z] Collecting click==8.1.7
[pip-install 2025-02-13T23:15:46.689Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2025-02-13T23:15:46.732Z] Collecting cookiecutter==2.3.0
[pip-install 2025-02-13T23:15:46.746Z] Downloading cookiecutter-2.3.0-py3-none-any.whl (39 kB)
[pip-install 2025-02-13T23:15:46.774Z] Collecting giturlparse==0.11.1
[pip-install 2025-02-13T23:15:46.789Z] Downloading giturlparse-0.11.1-py2.py3-none-any.whl (15 kB)
[pip-install 2025-02-13T23:15:46.826Z] Collecting idna==3.7
[pip-install 2025-02-13T23:15:46.839Z] Downloading idna-3.7-py3-none-any.whl (66 kB)
[pip-install 2025-02-13T23:15:46.887Z] Collecting jinja2==3.1.5
[pip-install 2025-02-13T23:15:46.900Z] Downloading jinja2-3.1.5-py3-none-any.whl (134 kB)
[pip-install 2025-02-13T23:15:46.933Z] Collecting json-e==4.5.3
[pip-install 2025-02-13T23:15:46.947Z] Downloading json_e-4.5.3-py3-none-any.whl (13 kB)
[pip-install 2025-02-13T23:15:46.999Z] Collecting markdown-it-py==3.0.0
[pip-install 2025-02-13T23:15:47.013Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2025-02-13T23:15:47.291Z] Collecting markupsafe==2.1.3
[pip-install 2025-02-13T23:15:47.305Z] Downloading MarkupSafe-2.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[pip-install 2025-02-13T23:15:47.330Z] Collecting mdurl==0.1.2
[pip-install 2025-02-13T23:15:47.343Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2025-02-13T23:15:47.367Z] Collecting mozilla-repo-urls==0.1.1
[pip-install 2025-02-13T23:15:47.382Z] Downloading mozilla_repo_urls-0.1.1-py3-none-any.whl (6.2 kB)
[pip-install 2025-02-13T23:15:47.447Z] Collecting pygments==2.16.1
[pip-install 2025-02-13T23:15:47.461Z] Downloading Pygments-2.16.1-py3-none-any.whl (1.2 MB)
[pip-install 2025-02-13T23:15:47.525Z] Collecting python-dateutil==2.8.2
[pip-install 2025-02-13T23:15:47.538Z] Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
[pip-install 2025-02-13T23:15:47.582Z] Collecting python-slugify==8.0.1
[pip-install 2025-02-13T23:15:47.595Z] Downloading python_slugify-8.0.1-py2.py3-none-any.whl (9.7 kB)
[pip-install 2025-02-13T23:15:47.770Z] Collecting pyyaml==6.0.1
[pip-install 2025-02-13T23:15:47.784Z] Downloading PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
[pip-install 2025-02-13T23:15:47.797Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 248)) (2.0.4)
[pip-install 2025-02-13T23:15:47.878Z] Collecting requests==2.32.0
[pip-install 2025-02-13T23:15:47.891Z] Downloading requests-2.32.0-py3-none-any.whl (63 kB)
[pip-install 2025-02-13T23:15:47.896Z] Requirement already satisfied: requests-unixsocket==0.3.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 259)) (0.3.0)
[pip-install 2025-02-13T23:15:48.075Z] Collecting rich==13.5.2
[pip-install 2025-02-13T23:15:48.090Z] Downloading rich-13.5.2-py3-none-any.whl (239 kB)
[pip-install 2025-02-13T23:15:48.129Z] Collecting six==1.16.0
[pip-install 2025-02-13T23:15:48.143Z] Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[pip-install 2025-02-13T23:15:48.147Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 271)) (2.0.0)
[pip-install 2025-02-13T23:15:48.216Z] Collecting taskcluster-taskgraph==6.2.0
[pip-install 2025-02-13T23:15:48.230Z] Downloading taskcluster_taskgraph-6.2.0-py3-none-any.whl (187 kB)
[pip-install 2025-02-13T23:15:48.237Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 279)) (13.0.1)
[pip-install 2025-02-13T23:15:48.257Z] Collecting text-unidecode==1.3
[pip-install 2025-02-13T23:15:48.270Z] Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
[pip-install 2025-02-13T23:15:48.346Z] Collecting typing-extensions==4.7.1
[pip-install 2025-02-13T23:15:48.360Z] Downloading typing_extensions-4.7.1-py3-none-any.whl (33 kB)
[pip-install 2025-02-13T23:15:48.455Z] Collecting urllib3==2.2.2
[pip-install 2025-02-13T23:15:48.469Z] Downloading urllib3-2.2.2-py3-none-any.whl (121 kB)
[pip-install 2025-02-13T23:15:48.508Z] Collecting voluptuous==0.13.1
[pip-install 2025-02-13T23:15:48.524Z] Downloading voluptuous-0.13.1-py3-none-any.whl (29 kB)
[pip-install 2025-02-13T23:15:48.786Z] WARNING: The candidate selected for download or install is a yanked version: 'requests' candidate (version 2.32.0 at https://files.pythonhosted.org/packages/24/e8/09e8d662a9675a4e4f5dd7a8e6127b463a091d2703ed931a64aa66d00065/requests-2.32.0-py3-none-any.whl#sha256=f2c3881dddb70d056c5bd7600a4fae312b2a300e39be6a118d30b90bd27262b5 (from https://pypi.org/simple/requests/) (requires-python:>=3.8))
[pip-install 2025-02-13T23:15:48.788Z] Reason for being yanked: Yanked due to conflicts with CVE-2024-35195 mitigation
[pip-install 2025-02-13T23:15:48.921Z] Installing collected packages: six, mdurl, urllib3, typing-extensions, text-unidecode, python-dateutil, pygments, markupsafe, markdown-it-py, idna, charset-normalizer, chardet, certifi, rich, requests, pyyaml, python-slugify, jinja2, giturlparse, click, binaryornot, arrow, voluptuous, mozilla-repo-urls, json-e, cookiecutter, taskcluster-taskgraph
[pip-install 2025-02-13T23:15:49.658Z] WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:49.658Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:49.733Z] WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:49.733Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:49.853Z] WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:49.854Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:50.026Z] WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:50.026Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:50.289Z] WARNING: The script slugify is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:50.290Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:50.551Z] WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:50.551Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:50.647Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2025-02-13T23:15:50.647Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2025-02-13T23:15:50.659Z] Successfully installed arrow-1.2.3 binaryornot-0.4.4 certifi-2024.7.4 chardet-5.2.0 charset-normalizer-3.2.0 click-8.1.7 cookiecutter-2.3.0 giturlparse-0.11.1 idna-3.7 jinja2-3.1.5 json-e-4.5.3 markdown-it-py-3.0.0 markupsafe-2.1.3 mdurl-0.1.2 mozilla-repo-urls-0.1.1 pygments-2.16.1 python-dateutil-2.8.2 python-slugify-8.0.1 pyyaml-6.0.1 requests-2.32.0 rich-13.5.2 six-1.16.0 taskcluster-taskgraph-6.2.0 text-unidecode-1.3 typing-extensions-4.7.1 urllib3-2.2.2 voluptuous-0.13.1
[pip-install 2025-02-13T23:15:50.817Z] WARNING: You are using pip version 21.1.3; however, version 25.0.1 is available.
[pip-install 2025-02-13T23:15:50.819Z] You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
[task 2025-02-13T23:15:50.903Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-profiler' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/firefox-devtools/profiler' --base-ref='main' --base-rev='3e62ca18a02e9ec2bb550e1685ddc84b1055e6c0' --head-repository='https://github.com/mstange/perf.html' --head-ref='fast-invert4' --head-rev='c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2' \n"]
[task 2025-02-13T23:15:50.906Z] + cd /builds/worker/checkouts/src
[task 2025-02-13T23:15:50.907Z] + ln -s /builds/worker/artifacts artifacts
[task 2025-02-13T23:15:50.908Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-profiler [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/firefox-devtools/profiler --base-ref=main --base-rev=3e62ca18a02e9ec2bb550e1685ddc84b1055e6c0 --head-repository=https://github.com/mstange/perf.html --head-ref=fast-invert4 --head-rev=c80f34a5eef643ea541d9db5d6906a8b2f1e7cf2
[task 2025-02-13T23:15:51.150Z] 2025-02-13 23:15:51,150 - INFO - Loading graph configuration.
[task 2025-02-13T23:15:51.163Z] 2025-02-13 23:15:51,163 - WARNING - using default project parameters; add firefox-profiler to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.8/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2025-02-13T23:15:51.164Z] 2025-02-13 23:15:51,164 - INFO - Using Parameters(id=837695566ec7) (from defaults)
[task 2025-02-13T23:15:51.173Z] 2025-02-13 23:15:51,164 - INFO - writing artifact file `parameters.yml`
[task 2025-02-13T23:15:51.175Z] 2025-02-13 23:15:51,175 - INFO - writing artifact file `actions.json`
[task 2025-02-13T23:15:51.177Z] 2025-02-13 23:15:51,177 - INFO - Loading kinds
[task 2025-02-13T23:15:51.181Z] 2025-02-13 23:15:51,181 - INFO - Generating full task set
[task 2025-02-13T23:15:51.191Z] 2025-02-13 23:15:51,191 - INFO - Writing docker-contexts/linux.tar.gz for docker image linux
[task 2025-02-13T23:15:51.209Z] 2025-02-13 23:15:51,209 - INFO - Generated 1 tasks for kind docker-image
[task 2025-02-13T23:15:51.221Z] 2025-02-13 23:15:51,220 - INFO - Generated 1 tasks for kind hello
[task 2025-02-13T23:15:51.221Z] 2025-02-13 23:15:51,221 - INFO - Generating full task graph
[task 2025-02-13T23:15:51.221Z] 2025-02-13 23:15:51,221 - INFO - Full task graph contains 2 tasks and 1 dependencies
[task 2025-02-13T23:15:51.221Z] 2025-02-13 23:15:51,221 - INFO - writing artifact file `full-task-graph.json`
[task 2025-02-13T23:15:51.222Z] 2025-02-13 23:15:51,222 - INFO - writing artifact file `runnable-jobs.json`
[task 2025-02-13T23:15:51.222Z] 2025-02-13 23:15:51,222 - INFO - Generating target task set
[task 2025-02-13T23:15:51.223Z] 2025-02-13 23:15:51,223 - INFO - Filter filter_target_tasks pruned 1 tasks (1 remain)
[task 2025-02-13T23:15:51.223Z] 2025-02-13 23:15:51,223 - INFO - writing artifact file `target-tasks.json`
[task 2025-02-13T23:15:51.223Z] 2025-02-13 23:15:51,223 - INFO - Generating target task graph
[task 2025-02-13T23:15:51.223Z] 2025-02-13 23:15:51,223 - INFO - Adding 1 tasks with `always_target` attribute
[task 2025-02-13T23:15:51.223Z] 2025-02-13 23:15:51,223 - INFO - Generating optimized task graph
[task 2025-02-13T23:15:51.224Z] 2025-02-13 23:15:51,224 - INFO - No tasks removed during optimization
[task 2025-02-13T23:15:51.288Z] 2025-02-13 23:15:51,287 - INFO - No tasks replaced during optimization
[task 2025-02-13T23:15:51.289Z] 2025-02-13 23:15:51,289 - INFO - writing artifact file `task-graph.json`
[task 2025-02-13T23:15:51.290Z] 2025-02-13 23:15:51,290 - INFO - writing artifact file `label-to-taskid.json`
[task 2025-02-13T23:15:51.292Z] 2025-02-13 23:15:51,292 - INFO - Creating task with taskId De5D-zC4TkmMkZjcuAVHMg for build-docker-image-linux
[task 2025-02-13T23:15:51.422Z] 2025-02-13 23:15:51,422 - INFO - Creating task with taskId FvX7JGw2RfydgArA3GBC9w for hello-world
[taskcluster 2025-02-13 23:15:51.748Z] === Task Finished ===
[taskcluster 2025-02-13 23:15:53.539Z] Successful task run with exit code: 0 completed in 10.028 seconds
Loading