Repositories list

• sparkMeasure

  Public
  This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics.

  Scala

  •

  Apache License 2.0

  •3•16•0•0•Updated Oct 3, 2025Oct 3, 2025

• pyspark-root-datasource

  Public
  Python DataSource for Apache Spark 4 to read ROOT files (High Energy Physics) as DataFrames, powered by uproot, awkward, and PyArrow.

  Python

  •

  Apache License 2.0

  •0•1•0•0•Updated Oct 2, 2025Oct 2, 2025

• grafana-mimir-cardinality-dashboards

  Public
  Grafana Mimir dashboards used for cardinality exploration

  Apache License 2.0

  •9•57•1•0•Updated Sep 17, 2025Sep 17, 2025

• spark-dashboard

  Public
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

  dockerkubernetesspark+ 4monitoringhelmgrafanagrafana-dashboard

  Dockerfile

  •

  Apache License 2.0

  •20•129•0•0•Updated Aug 29, 2025Aug 29, 2025

• SparkTraining

  Public
  Material for the course "Introduction to Apache Spark APIs for Data Processing" https://sparktraining.web.cern.ch/

  pythontrainingspark+ 2jupyter-notebookpyspark

  Jupyter Notebook

  •

  Creative Commons Attribution 4.0 International

  •6•17•0•0•Updated May 13, 2025May 13, 2025

• SparkPlugins

  Public
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

  kubernetesscalaspark+ 1monitoring

  Scala

  •

  Apache License 2.0

  •14•93•3•0•Updated May 9, 2025May 9, 2025

• SparkExecutorPlugins2.4

  Public archive
  Spark Executor Plugins Examples for Spark 2.4

  Java

  •

  Apache License 2.0

  •2•6•0•0•Updated May 7, 2025May 7, 2025

• opentelemetry-collector-contrib

  Public
  Contrib repository for the OpenTelemetry Collector

  Go

  •

  Apache License 2.0

  •3.1k•0•0•0•Updated Apr 12, 2025Apr 12, 2025

• hadoop-xrootd

  Public
  Mirror of CERN db/hadoop-xrootd. Hadoop-XRootD Filesystem Connector

  Java

  •

  Apache License 2.0

  •3•6•3•1•Updated Sep 25, 2024Sep 25, 2024

• SparkDLTrigger

  Public
  Code and links to the data for the article "Machine Learning Pipelines with Modern Big DataTools for High Energy Physics"

  machine-learningsparkdeep-learning+ 3tensorflowkeraspyspark

  Jupyter Notebook

  •

  Apache License 2.0

  •14•31•0•0•Updated Jun 11, 2024Jun 11, 2024

• argo-helm

  Public
  ArgoProj Helm Charts

  Mustache

  •

  Apache License 2.0

  •2k•0•0•0•Updated May 28, 2024May 28, 2024

• NotebooksExamples

  Public
  This repository contains Jupyter notebook examples, intended to be linked with the SWAN Gallery

  Jupyter Notebook

  •

  Apache License 2.0

  •1•1•0•0•Updated May 16, 2024May 16, 2024

• jdbc-connector-for-apache-kafka

  Public
  Aiven's JDBC Sink and Source Connectors for Apache Kafka®

  Java

  •

  Apache License 2.0

  •58•0•0•0•Updated Nov 8, 2023Nov 8, 2023

• zkpolicy

  Public
  Zookeeper Policy Audit Tool (aka zkPolicy) for checking and enforcing ACLs on ZNodes.

  javaclirpm+ 3zookeeperpolicycern

  Java

  •

  MIT License

  •1•7•1•0•Updated Oct 25, 2023Oct 25, 2023

• dbod-api

  Public
  DB On Demand API

  Python

  •

  GNU General Public License v3.0

  •3•4•9•2•Updated Aug 14, 2023Aug 14, 2023

• tf-spawner

  Public
  TF-Spawner is an experimental tool for running TensorFlow distributed training on Kubernetes clusters.

  Python

  •

  Apache License 2.0

  •2•8•0•0•Updated Mar 22, 2023Mar 22, 2023

• storage-api

  Public
  Unified RESTful interface for managing CERNs data storage back-ends

  Python

  •

  GNU General Public License v3.0

  •2•7•1•2•Updated Jan 31, 2022Jan 31, 2022

• cern-sso-python

  Public
  Python Re-implementation of the cern-get-sso-cookie functionality

  Python

  •6•11•1•0•Updated Jan 11, 2022Jan 11, 2022

• hbase-packet-inspector

  Public
  Analyzes network traffic of HBase RegionServers

  Clojure

  •

  Apache License 2.0

  •5•1•0•0•Updated Nov 5, 2021Nov 5, 2021

• netapp-api-python

  Public
  A re-implementation of (parts of) NetApp's ZAPI in idiomatic Python using Requests

  Python

  •

  GNU General Public License v3.0

  •1•3•0•0•Updated Sep 13, 2021Sep 13, 2021

• binderhub

  Public
  Run your code in the cloud, with technology so advanced, it feels like magic!

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •398•0•0•0•Updated Aug 19, 2021Aug 19, 2021

• dbod-webapp

  Public
  Java

  •

  GNU General Public License v3.0

  •0•3•5•0•Updated Mar 12, 2021Mar 12, 2021

• tomcat-sso-integration-components

  Public
  Set of valves classes that helps CERN applications with the integration in the CERN Authentication

  Java

  •

  GNU General Public License v3.0

  •0•2•0•0•Updated Oct 22, 2020Oct 22, 2020

• ords-config-image

  Public
  This image generates configuration and war files for Oracle Rest DataServices based on data provided by dadEdit3 database.

  Python

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Sep 4, 2020Sep 4, 2020

• dbod-web

  Public
  Future DB On Demand Web Interface implementation

  TypeScript

  •

  MIT License

  •3•5•15•2•Updated Aug 28, 2020Aug 28, 2020

• dbod-core

  Public
  DB On Demand management infrastructure core library

  Perl

  •

  GNU General Public License v3.0

  •0•5•20•0•Updated Apr 1, 2020Apr 1, 2020

• open-days-registration-application-back-end

  Public
  Java

  •

  GNU General Public License v3.0

  •0•0•0•1•Updated Mar 5, 2020Mar 5, 2020

• open-days-registration-application-front-end

  Public
  TypeScript

  •

  GNU General Public License v3.0

  •1•0•0•0•Updated Feb 20, 2020Feb 20, 2020

• oci-hdfs-connector

  Public
  HDFS Connector for Oracle Cloud Infrastructure

  Java

  •

  Other

  •27•0•0•0•Updated Jan 20, 2020Jan 20, 2020

• rundeck-nomad-plugin

  Public
  Rundeck plugin running jobs on Nomad cluster.

  Java

  •

  MIT License

  •6•0•0•0•Updated Aug 9, 2019Aug 9, 2019