Skip to content

Commit 53c326b

Browse files
committed
[SPARK-51255][INFRA] Install dependencies related to docs in release image
### What changes were proposed in this pull request? This PR partially reverts #49886 to recover dependencies related to documentation build in release image. ### Why are the changes needed? To make the release build successful with documentation build ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? Manual test. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #50001 from HyukjinKwon/SPARK-51255. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
1 parent 2c62899 commit 53c326b

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

dev/create-release/spark-rm/Dockerfile

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -125,6 +125,16 @@ RUN python3.9 -m pip install --force $BASIC_PIP_PKGS unittest-xml-reporting $CON
125125
python3.9 -m pip install torcheval && \
126126
python3.9 -m pip cache purge
127127

128+
# Should unpin 'sphinxcontrib-*' after upgrading sphinx>5
129+
# See 'ipython_genutils' in SPARK-38517
130+
# See 'docutils<0.18.0' in SPARK-39421
131+
RUN python3.9 -m pip install 'sphinx==4.5.0' mkdocs 'pydata_sphinx_theme>=0.13' sphinx-copybutton nbsphinx numpydoc jinja2 markupsafe 'pyzmq<24.0.0' \
132+
ipython ipython_genutils sphinx_plotly_directive 'numpy>=1.20.0' pyarrow pandas 'plotly>=4.8' 'docutils<0.18.0' \
133+
'flake8==3.9.0' 'mypy==1.8.0' 'pytest==7.1.3' 'pytest-mypy-plugins==1.9.3' 'black==23.12.1' \
134+
'pandas-stubs==1.2.0.53' 'grpcio==1.67.0' 'grpc-stubs==1.24.11' 'googleapis-common-protos-stubs==2.2.0' \
135+
'sphinxcontrib-applehelp==1.0.4' 'sphinxcontrib-devhelp==1.0.2' 'sphinxcontrib-htmlhelp==2.0.1' 'sphinxcontrib-qthelp==1.0.3' 'sphinxcontrib-serializinghtml==1.1.5'
136+
RUN python3.9 -m pip list
137+
128138
RUN gem install --no-document "bundler:2.4.22"
129139
RUN ln -s "$(which python3.9)" "/usr/local/bin/python"
130140
RUN ln -s "$(which python3.9)" "/usr/local/bin/python3"

0 commit comments

Comments
 (0)