Skip to content

Conversation

@Ikuni17
Copy link
Contributor

@Ikuni17 Ikuni17 commented Sep 12, 2025

Summary

  • Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
  • Closes Speed up storybook builds #176500
  • Parallelize Storybook build
  • Migrate gsutil to gcloud storage cp

Testing

I tried a few machine sizes to compare the build times:

Machine Time Reduction
n2-standard-32 9m 32s 82%
n2-standard-16 15m 43s 69%
n2-standard-8 19m 32s 62%
n2-standard-4 38m 39s 24%
Sync n2-standard-8 50m 40s -

For now we can stick with n2-standard-8 since 20 minutes will be well under the FTR times and gives a minor decrease in CI costs since we're using the machine for less time.

@Ikuni17 Ikuni17 self-assigned this Sep 12, 2025
@Ikuni17 Ikuni17 added Team:Operations Kibana-Operations Team release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting ci:build-storybooks labels Sep 12, 2025
@Ikuni17 Ikuni17 force-pushed the fix/storybook-parallel-build branch from 6bf4cf3 to 132d91d Compare September 12, 2025 19:36
@Ikuni17 Ikuni17 force-pushed the fix/storybook-parallel-build branch from 132d91d to a573fb4 Compare September 12, 2025 19:38
@Ikuni17 Ikuni17 marked this pull request as ready for review September 15, 2025 18:30
@Ikuni17 Ikuni17 requested a review from a team as a code owner September 15, 2025 18:30
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@Ikuni17 Ikuni17 requested a review from jbudz September 17, 2025 04:47
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

cc @Ikuni17

@Ikuni17 Ikuni17 added backport:version Backport to applied version labels v8.19.5 v9.0.8 v9.1.5 and removed backport:skip This PR does not require backporting labels Sep 17, 2025
@Ikuni17 Ikuni17 merged commit 29d189f into elastic:main Sep 17, 2025
22 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.19, 9.0, 9.1

https://github.com/elastic/kibana/actions/runs/17813296595

@Ikuni17 Ikuni17 deleted the fix/storybook-parallel-build branch September 17, 2025 23:28
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Sep 17, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes elastic#176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.

(cherry picked from commit 29d189f)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Sep 17, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes elastic#176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.

(cherry picked from commit 29d189f)
@kibanamachine
Copy link
Contributor

💔 Some backports could not be created

Status Branch Result
8.19 Backport failed because of merge conflicts
9.0
9.1

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 234841

Questions ?

Please refer to the Backport tool documentation

@Ikuni17
Copy link
Contributor Author

Ikuni17 commented Sep 17, 2025

💚 All backports created successfully

Status Branch Result
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

Ikuni17 added a commit to Ikuni17/kibana that referenced this pull request Sep 17, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes elastic#176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.

(cherry picked from commit 29d189f)

# Conflicts:
#	.buildkite/scripts/steps/storybooks/build_and_upload.ts
Ikuni17 added a commit that referenced this pull request Sep 18, 2025
# Backport

This will backport the following commits from `main` to `9.1`:
- [[CI] Storybook parallel build
(#234841)](#234841)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-09-17T23:26:47Z","message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Team:Operations","release_note:skip","ci:build-storybooks","backport:version","v9.2.0","v8.19.5","v9.0.8","v9.1.5"],"title":"[CI]
Storybook parallel
build","number":234841,"url":"https://github.com/elastic/kibana/pull/234841","mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},"sourceBranch":"main","suggestedTargetBranches":["8.19","9.0","9.1"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/234841","number":234841,"mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},{"branch":"8.19","label":"v8.19.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.0","label":"v9.0.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <[email protected]>
Ikuni17 added a commit that referenced this pull request Sep 18, 2025
# Backport

This will backport the following commits from `main` to `9.0`:
- [[CI] Storybook parallel build
(#234841)](#234841)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-09-17T23:26:47Z","message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Team:Operations","release_note:skip","ci:build-storybooks","backport:version","v9.2.0","v8.19.5","v9.0.8","v9.1.5"],"title":"[CI]
Storybook parallel
build","number":234841,"url":"https://github.com/elastic/kibana/pull/234841","mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},"sourceBranch":"main","suggestedTargetBranches":["8.19","9.0","9.1"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/234841","number":234841,"mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},{"branch":"8.19","label":"v8.19.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.0","label":"v9.0.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <[email protected]>
Ikuni17 added a commit that referenced this pull request Sep 18, 2025
# Backport

This will backport the following commits from `main` to `8.19`:
- [[CI] Storybook parallel build
(#234841)](#234841)
- [Remove build hash from Storybook upload
(#206687)](#206687)

<!--- Backport version: 10.0.2 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-09-17T23:26:47Z","message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Team:Operations","release_note:skip","ci:build-storybooks","backport:version","v9.2.0","v8.19.5","v9.0.8","v9.1.5"],"title":"[CI]
Storybook parallel
build","number":234841,"url":"https://github.com/elastic/kibana/pull/234841","mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},"sourceBranch":"main","suggestedTargetBranches":["8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/234841","number":234841,"mergeCommit":{"message":"[CI]
Storybook parallel build (#234841)\n\n## Summary\n\n- Part of
elastic/kibana-operations#346 & elastic/kibana-operations#347\n- Closes
#176500\n- Parallelize Storybook build\n- Migrate `gsutil` to `gcloud
storage cp`\n\n### Testing\nI tried a few machine sizes to compare the
build times:\n\n| Machine | Time | Reduction
|\n|--------------|--------------|---------|\n| `n2-standard-32` | 9m
32s | 82% |\n| `n2-standard-16` | 15m 43s | 69% |\n| `n2-standard-8` |
19m 32s | 62% |\n| `n2-standard-4` | 38m 39s | 24% |\n| Sync
`n2-standard-8` | 50m 40s | - |\n\nFor now we can stick with
`n2-standard-8` since 20 minutes will be well\nunder the FTR times and
gives a minor decrease in CI costs since we're\nusing the machine for
less
time.","sha":"29d189ff7df46d791d503311fff6c06f77c7a271"}},{"branch":"8.19","label":"v8.19.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.0","label":"v9.0.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/235436","number":235436,"state":"OPEN"},{"branch":"9.1","label":"v9.1.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/235437","number":235437,"state":"OPEN"}]}]
BACKPORT-->
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Sep 24, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes elastic#176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.
niros1 pushed a commit that referenced this pull request Sep 30, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes #176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.
rylnd pushed a commit to rylnd/kibana that referenced this pull request Oct 17, 2025
## Summary

- Part of elastic/kibana-operations#346 & elastic/kibana-operations#347
- Closes elastic#176500
- Parallelize Storybook build
- Migrate `gsutil` to `gcloud storage cp`

### Testing
I tried a few machine sizes to compare the build times:

| Machine | Time | Reduction |
|--------------|--------------|---------|
| `n2-standard-32` | 9m 32s | 82% |
| `n2-standard-16` | 15m 43s | 69% |
| `n2-standard-8` | 19m 32s | 62% |
| `n2-standard-4` | 38m 39s | 24% |
| Sync `n2-standard-8` | 50m 40s | - |

For now we can stick with `n2-standard-8` since 20 minutes will be well
under the FTR times and gives a minor decrease in CI costs since we're
using the machine for less time.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels ci:build-storybooks release_note:skip Skip the PR/issue when compiling release notes Team:Operations Kibana-Operations Team v8.19.4 v8.19.5 v9.0.7 v9.0.8 v9.1.4 v9.1.5 v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Speed up storybook builds

4 participants