ci: add jazzy docker build process in current ci pipeline #6453

liuXinGangChina · 2025-09-09T06:51:47Z

Description

in order to prepare a ci pipeline for core jazzy support issue link
we have to create a jazzy-core-common-devel docker image for core‘s ci
thus we made these modification

How was this PR tested?

in my local env i successfully creat a jazzy related docker image using ' docker buildx bake --file docker/xxx xxx --progress=plain '

Notes for reviewers

None.
this pr only focus on core-jazzy ci pipeline not contain

pipeline for cuda related docker image
pipeline for arm64 arch, since nvidia jetpack has not support jazzy officially

Effects on system behavior

None.
i made modification with jazzy-condition switch to ensure original humble docker pipeline not be affacted

github-actions · 2025-09-09T06:51:55Z

Thank you for contributing to the Autoware project!

🚧 If your pull request is in progress, switch it to draft mode.

Please ensure:

You've checked our contribution guidelines.
Your PR follows our pull request guidelines.
All required CI checks pass before marking the PR ready for review.

liuXinGangChina · 2025-09-16T07:41:51Z

hi fatih san @xmfcx
can you help push the pipeline forward , as it need maintainers' approve

liuXinGangChina · 2025-09-30T10:50:51Z

mits san @mitsudome-r
it seems that ci pipeline pending at docker build step for a long time. do you know why?

xmfcx · 2025-09-30T11:01:30Z

run:health-check label was missing, I've added it now.

mitsudome-r · 2025-10-06T11:18:35Z

setup-dev-env.sh

 if ! (python3 -m pipx --version >/dev/null 2>&1); then
    sudo apt-get -y update
-    python3 -m pip install --user pipx
+    python3 -m pip install --user pipx --break-system-packages


adding --break-system-packages would cause error in Ubuntu22.04 with the following error message:

no such option: --break-system-packages

Instead, we can set PIP_BREAK_SYSTEM_PACKAGES=1.
Same applies to all the other places.

Suggested change

python3 -m pip install --user pipx --break-system-packages

PIP_BREAK_SYSTEM_PACKAGES=1 python3 -m pip install --user pipx

https://pipx.pypa.io/stable/installation/

On Linux:
Ubuntu 23.04 or above
sudo apt update
sudo apt install pipx
pipx ensurepath

Breaking system packages is a very bad idea, we should avoid this by either utilizing apt packages or a virtualized python env like miniconda or venv.

Okay, then I think we can use apt install

Suggested change

python3 -m pip install --user pipx --break-system-packages

sudo apt install pipx

Suggested change

python3 -m pip install --user pipx --break-system-packages

UBUNTU_VERSION=$(lsb_release -rs)

echo "Detected Ubuntu version: $UBUNTU_VERSION"

if [[ "$UBUNTU_VERSION" == "22.04" ]]; then

echo "Installing pipx using pip (for Ubuntu 22.04)..."

python3 -m pip install --user pipx

else

echo "Installing pipx using apt (for Ubuntu > 22.04)..."

sudo apt update

sudo apt install -y pipx

fi

To keep compatibility with older version.

Do we need to keep the old one? We should be able to install pipx with apt for Ubuntu22.04 as well.

I have double check that ubuntu 22.04 support apt install pipx,
I will update this file to use sudo apt install pipx for both ubuntu version

xmfcx · 2025-10-06T15:12:02Z

setup-dev-env.sh

    echo "  --download-artifacts"
    echo "                  Download artifacts"
    echo "  --module        Specify the module (default: all)"
+    echo "  --ros-distro    Specify ROS distribution (humble or jazzy, default: humble)"


Where is this argument used?

I don't think we currently use this option, but we might need it in order to specify correct environment variables to use as I commented here: https://github.com/autowarefoundation/autoware/pull/6453/files#r2409550184

thanks for your review mits san and fatih san

1.ros-distro here is used to indicate which env file to use
1.1 when doing automatic github action , the pipe will give setup-dev-env.sh the right ros-distro to choose specific env file
1.2 when developer manully config their local env , they have to use ./setup-dev-env.sh --ros-distro jazzy to tell the script which env file to read

mitsudome-r · 2025-10-07T06:35:43Z

amd64.env

@@ -1,8 +1,17 @@
-rosdistro=humble
+# ROS distribution (humble or jazzy)
+rosdistro=${ROS_DISTRO:-humble}


ROS_DISTRO is usually set after we install ROS, but this file is actually used to install ROS with ansible script.
We could consider having amd64.jazzy.env instead for this file.

thanks for your review mits san
1.i have added the amd64.jazzy.env according to your comment
2.ros-distro here is used to indicate which env file to use

mitsudome-r · 2025-10-07T06:59:35Z

I've also noticed that we have to update universe playbook to have the following modifications:

update Verify OS pre_task to allow Ubuntu 24.04
skip agnocast and pacmod roles when rosdistro!=humble

I had to update ansible version as well.

liuXinGangChina · 2025-10-12T07:55:19Z

I've also noticed that we have to update universe playbook to have the following modifications:
* update Verify OS pre_task to allow Ubuntu 24.04

* skip agnocast and pacmod roles when rosdistro!=humble
I had to update ansible version as well.
already modify this file including

add ubuntu 24.04 for os check
disable pacmod and agocast for version except for humble

liuXinGangChina · 2025-10-12T08:19:59Z

there are still some ci issue, i wil fix them one by one ASAP

Signed-off-by: liuXinGangChina <[email protected]>

…d file system, using existing files rather than adding new files Signed-off-by: liuXinGangChina <[email protected]>

…d file system, add docker build pipe line to github action Signed-off-by: liuXinGangChina <[email protected]>

Signed-off-by: liuXinGangChina <[email protected]>

… universe playbook in ansible Signed-off-by: liuXinGangChina <[email protected]>

liuXinGangChina requested review from isamu-takagi, mitsudome-r, oguzkaganozt, xmfcx and youtalk as code owners September 9, 2025 06:51

liuXinGangChina self-assigned this Sep 9, 2025

liuXinGangChina added the type:ci Continuous Integration (CI) processes and testing. label Sep 9, 2025

liuXinGangChina added this to Software Working Group Sep 9, 2025

github-project-automation bot moved this to To Triage in Software Working Group Sep 9, 2025

liuXinGangChina moved this from To Triage to In Progress in Software Working Group Sep 9, 2025

liuXinGangChina changed the title ~~feature::ci::add jazzy docker build process in current ci pipeline~~ ci::add jazzy docker build process in current ci pipeline Sep 9, 2025

liuXinGangChina changed the title ~~ci::add jazzy docker build process in current ci pipeline~~ ci: add jazzy docker build process in current ci pipeline Sep 9, 2025

liuXinGangChina force-pushed the add-jazzy-docker-ci branch from 6c7952e to fd9d888 Compare September 12, 2025 06:50

liuXinGangChina mentioned this pull request Sep 12, 2025

feat: jazzy-porting, add jazzy distro condition for jazzy related compiling autowarefoundation/autoware_cmake#35

Merged

liuXinGangChina force-pushed the add-jazzy-docker-ci branch from fd9d888 to cb4d77c Compare September 16, 2025 07:05

liuXinGangChina mentioned this pull request Sep 16, 2025

chore: jazzy-porting : Add Jazzy Support to GitHub Actions Workflows (Excluding ARM64) autowarefoundation/autoware_core#636

Open

liuXinGangChina force-pushed the add-jazzy-docker-ci branch from 69e7de5 to 8b735dd Compare September 17, 2025 06:23

liuXinGangChina marked this pull request as draft September 20, 2025 03:42

This was referenced Sep 20, 2025

chore: add build option -Wno-error=maybe-uninitialized autowarefoundation/autoware_lanelet2_extension#79

Merged

chore: jazzy-porting, autoware_trajectory, add array size assignment to solve compile failure autowarefoundation/autoware_core#644

Open

liuXinGangChina force-pushed the add-jazzy-docker-ci branch 5 times, most recently from c46aaf6 to 4283e8b Compare September 27, 2025 13:15

liuXinGangChina marked this pull request as ready for review September 28, 2025 02:00

This was referenced Sep 29, 2025

feat: localization related packages support jazzy autowarefoundation/autoware_universe#11419

Open

feat: simulation related packages support jazzy autowarefoundation/autoware_universe#11424

Open

liuXinGangChina force-pushed the add-jazzy-docker-ci branch 2 times, most recently from b26bfcc to c9026cc Compare September 30, 2025 06:58

xmfcx added the run:health-check Run health-check label Sep 30, 2025

mitsudome-r reviewed Oct 6, 2025

View reviewed changes

xmfcx reviewed Oct 6, 2025

View reviewed changes

mitsudome-r reviewed Oct 7, 2025

View reviewed changes

liuXinGangChina force-pushed the add-jazzy-docker-ci branch 2 times, most recently from c59058d to 2380e2c Compare October 12, 2025 07:53

liuXinGangChina force-pushed the add-jazzy-docker-ci branch 2 times, most recently from d46c9a9 to 062cc2e Compare October 12, 2025 08:17

mitsudome-r mentioned this pull request Oct 14, 2025

feat: update Autoware base image for Jazzy #6518

Merged

liuXinGangChina force-pushed the add-jazzy-docker-ci branch from 062cc2e to f6d75b6 Compare October 15, 2025 05:39

liuXinGangChina added 5 commits October 15, 2025 13:56

feature::ci::add jazzy docker build process in current ci pipeline

9ae3218

Signed-off-by: liuXinGangChina <[email protected]>

feature::docker::add jazzy docker build option in current docker buil…

adf4c87

…d file system, using existing files rather than adding new files Signed-off-by: liuXinGangChina <[email protected]>

feature::docker::add jazzy docker build option in current docker buil…

f8df0ca

…d file system, add docker build pipe line to github action Signed-off-by: liuXinGangChina <[email protected]>

feature::docker::add amd64.jazzy.env for env params

4bce104

Signed-off-by: liuXinGangChina <[email protected]>

feature::docker:: add ubuntu 24 support and remove agocast&pacmod for…

698681a

… universe playbook in ansible Signed-off-by: liuXinGangChina <[email protected]>

liuXinGangChina force-pushed the add-jazzy-docker-ci branch from f6d75b6 to 698681a Compare October 15, 2025 06:35

style(pre-commit): autofix

8df451a

This was referenced Oct 25, 2025

chore: jazzy-porting, autoware_lanelet2_utils, add missing link dependency yaml-cpp autowarefoundation/autoware_core#686

Open

feat: control : fix contol packages compile error when using ros2 jazzy autowarefoundation/autoware_universe#11556

Open

	python3 -m pip install --user pipx --break-system-packages
	PIP_BREAK_SYSTEM_PACKAGES=1 python3 -m pip install --user pipx

	python3 -m pip install --user pipx --break-system-packages
	sudo apt install pipx

-    python3 -m pip install --user pipx --break-system-packages
+    UBUNTU_VERSION=$(lsb_release -rs)
+    echo "Detected Ubuntu version: $UBUNTU_VERSION"
+    if [[ "$UBUNTU_VERSION" == "22.04" ]]; then
+        echo "Installing pipx using pip (for Ubuntu 22.04)..."
+        python3 -m pip install --user pipx
+    else
+        echo "Installing pipx using apt (for Ubuntu > 22.04)..."
+        sudo apt update
+        sudo apt install -y pipx
+    fi

ci: add jazzy docker build process in current ci pipeline #6453

Are you sure you want to change the base?

ci: add jazzy docker build process in current ci pipeline #6453

Uh oh!

Conversation

liuXinGangChina commented Sep 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

How was this PR tested?

Notes for reviewers

Effects on system behavior

Uh oh!

github-actions bot commented Sep 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

liuXinGangChina commented Sep 16, 2025

Uh oh!

liuXinGangChina commented Sep 30, 2025

Uh oh!

xmfcx commented Sep 30, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

liuXinGangChina Oct 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mitsudome-r commented Oct 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

liuXinGangChina commented Oct 12, 2025

Uh oh!

liuXinGangChina commented Oct 12, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

liuXinGangChina commented Sep 9, 2025 •

edited

Loading

github-actions bot commented Sep 9, 2025 •

edited

Loading

liuXinGangChina Oct 12, 2025 •

edited

Loading

mitsudome-r commented Oct 7, 2025 •

edited

Loading