Support for Spark built with Scala 2.13

[guangyu-yang-rokt]

Describe the bug
We have recently upgrade our spark 3.5.2 image to use scala 2.13. However this cause a compatibility issue comes from datahub's event listener:

Exception in thread "spark-listener-group-shared" java.lang.NoSuchMethodError: 'scala.collection.Seq org.apache.spark.scheduler.SparkListenerJobStart.stageIds()'
at io.openlineage.spark.agent.OpenLineageSparkListener.onJobStart(OpenLineageSparkListener.java:169)
at datahub.spark.DatahubSparkListener.onJobStart(DatahubSparkListener.java:311)

Seems the lineage jar's build.gradle has a lot of hardcoded dependencies use spark jars with scala 2.12:

datahub/metadata-integration/java/acryl-spark-lineage/build.gradle

Lines 58 to 67 in 54cccc7

	implementation "io.openlineage:openlineage-spark_2.12:$openLineageVersion"
	compileOnly "org.apache.iceberg:iceberg-spark3-runtime:0.12.1"
	compileOnly("org.apache.spark:spark-sql_2.12:3.1.3") {
	exclude group: 'org.eclipse.jetty', module: 'jetty-servlet'
	exclude group: 'org.eclipse.jetty', module: 'jetty-server'
	exclude group: 'org.eclipse.jetty', module: 'jetty-util'
	exclude group: 'org.eclipse.jetty', module: 'jetty-webapp'
	exclude group: 'org.eclipse.jetty', module: 'jetty-security'
	}
	compileOnly "io.github.spark-redshift-community:spark-redshift_2.12:6.2.0-spark_3.5"

To Reproduce
Steps to reproduce the behavior:

1. integrate datahub spark-lineage jar to spark image built with scala 2.13 https://repo1.maven.org/maven2/io/acryl/acryl-spark-lineage/0.2.7/

Expected behavior
datahub jar can support scala 2.13