Skip to content

Pull requests: apache/spark

New pull request New
192 Open 49,725 Closed
192 Open 49,725 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[SPARK-51178][CONNECT][PYTHON] Raise proper PySpark error instead of SparkConnectGrpcException CONNECT DOCS PYTHON SQL
#49953 opened Feb 14, 2025 by itholic Loading…
[SPARK-51216][BUILD] Remove the useless bigtop-dist profile and the related outdated files BUILD
#49952 opened Feb 14, 2025 by LuciferYang Loading…
5
[SPARK-51215][ML][PYTHON][CONNECT] Add a helper function to invoke helper model attr ML PYTHON
#49951 opened Feb 14, 2025 by zhengruifeng Loading…
[SPARK-51214][ML][PYTHON][CONNECT] Don't eagerly remove the cached models for fit_transform CONNECT ML PYTHON SQL
#49948 opened Feb 14, 2025 by zhengruifeng Loading…
1
[SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default BUILD CONNECT CORE DOCS INFRA PYTHON SQL
#49946 opened Feb 14, 2025 by ueshin Loading…
1
[WIP][DO-NOT-MERGE][SPARK-51211][SS] Rename the option of readChangeFeed to readChangeLog in state store reader DOCS PYTHON SQL STRUCTURED STREAMING
#49945 opened Feb 13, 2025 by HeartSaVioR • Draft
1
[SPARK-51206][PYTHON][CONNECT] Move Arrow conversion helpers out of Spark Connect CONNECT PYTHON SQL
#49941 opened Feb 13, 2025 by wengh Loading…
[SPARK-51046][SQL][TEST] Reduce numCols in withFilter() to prevent SubExprEliminationBenchmark from failing due to a Codegen error SQL
#49938 opened Feb 13, 2025 by wayneguow Loading…
8
[SPARK-51203][SQL] Enhance force optimize skewed join SQL
#49936 opened Feb 13, 2025 by wForget • Draft
[SPARK-49479][CORE] Cancel the Timer non-daemon thread on stopping the BarrierCoordinator CORE
#49934 opened Feb 13, 2025 by bcheena Loading…
[SPARK-51202][ML][PYTHON] Pass the session in meta algorithm python writers ML PYTHON
#49932 opened Feb 13, 2025 by zhengruifeng Loading…
1
[SPARK-51146][SQL][FOLLOWUP] Respect system env SPARK_CONNECT_MODE in places that access the api mode config PYTHON SQL
#49930 opened Feb 13, 2025 by cloud-fan Loading…
5
[SPARK-51182][SQL] DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified R SQL
#49928 opened Feb 13, 2025 by vrozov Loading…
2
[SPARK-51176][PYTHON][CONNECT] Meet consistency for unexpected errors PySpark Connect <> Classic PYTHON
#49926 opened Feb 13, 2025 by itholic Loading…
[SPARK-51192][CONNECT] Expose processWithoutResponseObserverForTesting in SparkConnectPlanner CONNECT SQL
#49921 opened Feb 13, 2025 by vicennial Loading…
[WIP] TransformWithState docs DOCS
#49914 opened Feb 13, 2025 by ericm-db Loading…
[SPARK-51183][SQL] Link to Parquet spec in Variant docs DOCS SQL
#49910 opened Feb 12, 2025 by cashmand Loading…
16
[WIP][SPARK-51180][BUILD] Upgrade Arrow to 19.0.0 BUILD
#49909 opened Feb 12, 2025 by aimtsou Loading…
5
[SPARK-51179][SQL] Refactor SupportsOrderingWithinGroup so that centralized check SQL
#49908 opened Feb 12, 2025 by beliefer Loading…
1
[SPARK-42746][SQL][FOLLOWUP] Improve the code for SupportsOrderingWithinGroup and Mode SQL
#49907 opened Feb 12, 2025 by beliefer Loading…
7
[SPARK-51172][SS][3.5] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan SQL
#49905 opened Feb 12, 2025 by HeartSaVioR Loading…
18
Log exception on Python runner termination CORE PYTHON
#49890 opened Feb 11, 2025 by antban Loading…
[SPARK-51156][CONNECT] Provide a basic authentication token when running Spark Connect server locally CONNECT PYTHON SQL
#49880 opened Feb 11, 2025 by HyukjinKwon Loading…
36
[SPARK-51152][Python][SQL] Add usage examples for the get_json_object function PYTHON SQL
#49875 opened Feb 11, 2025 by fusheng9399 Loading…
12
[SPARK-51149][CORE] Log classpath in SparkSubmit on ClassNotFoundException CORE
#49870 opened Feb 11, 2025 by vrozov Loading…
4
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.