Skip to content

Commit

Permalink
[SPARK-51200][BUILD] Add SparkR deprecation info to README.md and `…
Browse files Browse the repository at this point in the history
…make-distribution.sh` help

### What changes were proposed in this pull request?

This PR aims to add `SparkR` deprecation info additionally to the following for developers.
- `README.md`
- `make-distribution.sh` help message

### Why are the changes needed?

`SparkR` is deprecated properly by the following.
- #47842

This PR adds a little more because `README.md` and `make-distribution.sh` are the starting point for downstream Spark distribution developers.

### Does this PR introduce _any_ user-facing change?

No behavior change. Only the documentation and help message of developer script.

### How was this patch tested?

Manual review.

```
$ dev/make-distribution.sh --help 2> /dev/null
make-distribution.sh - tool for making binary distributions of Spark

usage:
make-distribution.sh [--name] [--tgz] [--pip] [--r] [--connect] [--mvn <mvn-command>] <maven build options>
See Spark's "Building Spark" doc for correct Maven options.
SparkR is deprecated from Apache Spark 4.0.0 and will be removed in a future version.
```

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #49931 from dongjoon-hyun/SPARK-51200.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
  • Loading branch information
dongjoon-hyun authored and yaooqinn committed Feb 13, 2025
1 parent 920486d commit 80fb9d0
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Apache Spark

Spark is a unified analytics engine for large-scale data processing. It provides
high-level APIs in Scala, Java, Python, and R, and an optimized engine that
high-level APIs in Scala, Java, Python, and R (Deprecated), and an optimized engine that
supports general computation graphs for data analysis. It also supports a
rich set of higher-level tools including Spark SQL for SQL and DataFrames,
pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing,
Expand Down
1 change: 1 addition & 0 deletions dev/make-distribution.sh
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@ function exit_with_usage {
cl_options="[--name] [--tgz] [--pip] [--r] [--connect] [--mvn <mvn-command>]"
echo "make-distribution.sh $cl_options <maven build options>"
echo "See Spark's \"Building Spark\" doc for correct Maven options."
echo "SparkR is deprecated from Apache Spark 4.0.0 and will be removed in a future version."
echo ""
exit 1
}
Expand Down

0 comments on commit 80fb9d0

Please sign in to comment.