- 
                Notifications
    
You must be signed in to change notification settings  - Fork 28.9k
 
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
      [SPARK-54175][Geo][CONNECT] Add Geography and Geometry types to Spark Connect proto
        
              
                CONNECT
              
                PYTHON
              
                SQL
        
      
    
        
          #52872
            opened Nov 4, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-53998] Add addition E2E tests for RTM
        
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52870
            opened Nov 4, 2025  by
            jerrypeng
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54172][SQL] Merge Into Schema Evolution should only add referenced columns
        
              
                SQL
        
      
    
        
          #52866
            opened Nov 4, 2025  by
            szehon-ho
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54170] Use StructuredLogging message in Scala side
        
              
                CORE
              
                PYTHON
        
      
    
      
  
        
          #52864
            opened Nov 4, 2025  by
            ueshin
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54169][Geo][CONNECT] Introduce Geography and Geometry types in Arrow writer
        
              
                CONNECT
              
                SQL
        
      
    
      
  
        
          #52863
            opened Nov 3, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54156][PROTOBUF] Classify errors for ProtobufOptions casting failure
        
              
                PROTOBUF
              
                SQL
        
      
    
        
          #52862
            opened Nov 3, 2025  by
            nyaapa
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54160][Geo][SQL] Implement the ST_SetSrid expression in SQL
        
              
                SQL
        
      
    
      
  
        
          #52858
            opened Nov 3, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54159][INFRA] Fix 
    
      
  pip install commands to use proper quotation marks
        
              
                BUILD
              
                INFRA
        
      
        
          #52857
            opened Nov 3, 2025  by
            dongjoon-hyun
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54153][PYTHON] Support profiling iterator based Python UDFs
        
              
                CORE
              
                PYTHON
              
                SQL
        
      
    
      
  
        
          #52853
            opened Nov 3, 2025  by
            Kimahriman
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54165][CONNECT]Add BatchExecutePlan RPC and reattach support
        
              
                CONNECT
              
                PYTHON
              
                SQL
        
      
    
      
  
        
          #52852
            opened Nov 3, 2025  by
            grundprinzip
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      XSS: Ensure the application name in historypage get escaped
        
              
                WEB UI
        
      
    
      
  
        
          #52851
            opened Nov 3, 2025  by
            Chhida
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54147][SQL] Set OMP_NUM_THREADS to spark.task.cpus by default in BaseScriptTransformationExec
        
              
                SQL
        
      
    
      
  
        
          #52850
            opened Nov 3, 2025  by
            TongWei1105
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54149][SQL][SS][CONNECT] Enable tail-recursion wherever possible
        
              
                CONNECT
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52847
            opened Nov 3, 2025  by
            LuciferYang
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54162][Geo][SQL] Allow casting from GeographyType to GeometryType
        
              
                SQL
        
      
    
      
  
        
          #52839
            opened Nov 2, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54136][SQL] Extract plan merging logic from 
    
      
  MergeScalarSubqueries to PlanMerger
        
              
                SQL
        
      
        
          #52835
            opened Nov 2, 2025  by
            peter-toth
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SDP][SPARK-52463] Add support for cluster_by in Python Pipelines APIs
        
              
                CONNECT
              
                PYTHON
              
                SQL
        
      
    
        
          #52831
            opened Nov 2, 2025  by
            sryza
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54106][SS] Recheckin State store row checksum implementation
        
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52829
            opened Nov 1, 2025  by
            micheal-o
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54130][SQL] Add detailed error messages for catalog assertion failures
        
              
                SQL
        
      
    
        
          #52826
            opened Nov 1, 2025  by
            ganeshashree
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54122] Implement TwsTester
        
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
        
          #52824
            opened Nov 1, 2025  by
            fedimser
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54117][SS] Throw better error to indicate that TWS is only supported with RocksDB state store provider
        
              
                PYTHON
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52822
            opened Oct 31, 2025  by
            fedimser
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54121][SS] Automatic Snapshot Repair for State store
        
              
                CONNECT
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52821
            opened Oct 31, 2025  by
            micheal-o
            
        
        
            
    
  
    Loading…
 
        
        
      
    Previous Next
  
  
  ProTip!
  Filter pull requests by the default branch with base:master.