Skip to content

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

License

Notifications You must be signed in to change notification settings

bruin-data/bruin

Repository files navigation

Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL & Python, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.

Bruin CLI - Demo

Bruin is packed with features:

  • 📥 ingest data with ingestr / Python
  • ✨ run SQL & Python transformations on many platforms
  • 📐 table/view materializations, incremental tables
  • 🐍 run Python in isolated environments using uv
  • 💅 built-in data quality checks
  • 🚀 Jinja templating to avoid repetition
  • ✅ validate pipelines end-to-end via dry-run
  • 👷 run on your local machine, an EC2 instance, or GitHub Actions
  • 🔒 secrets injection via environment variables
  • VS Code extension for a better developer experience
  • ⚡ written in Golang
  • 📦 easy to install and use

Installation

Please see the installation instructions here.

Community

Join our Slack community here.

Quickstart

Take a look at our quickstart guide here.