Skip to content

fosk06/dagster-sqlmesh

Repository files navigation

dg-sqlmesh

PyPI version Current Version Tests Documentation License Python

A Dagster integration for SQLMesh that provides seamless orchestration of SQLMesh models, schedules, and assets within Dagster workflows.

🚀 Quick Start

# Install the package
pip install dg-sqlmesh

# Or install from source
pip install -e .

📚 Documentation

📖 Full Documentation →

Our comprehensive documentation includes:

  • Getting Started - Installation and setup guides
  • User Guide - Core concepts and architecture
  • Examples - Practical usage patterns
  • Development - Contributing guidelines

🎯 Key Features

  • SQLMesh Integration - Native support for SQLMesh models and schedules
  • Asset Management - Automatic asset creation from SQLMesh models
  • Scheduling - Adaptive scheduling with Dagster's scheduling system
  • Audit Integration - Built-in audit checks and validation
  • Environment Management - Multi-environment support

🏗️ Architecture

dg-sqlmesh provides a clean abstraction layer between Dagster and SQLMesh:

  • SQLMeshResource - Manages SQLMesh context and execution
  • SQLMeshTranslator - Converts SQLMesh concepts to Dagster assets
  • Factory Functions - Easy setup and configuration

🔧 Installation

From PyPI

pip install dg-sqlmesh

From Source

git clone https://github.com/fosk06/dagster-sqlmesh.git
cd dagster-sqlmesh
pip install -e .

📖 Examples

See our examples directory and documentation for comprehensive usage examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🔗 Links

About

Create data pipeline with sqlmesh orchestrated by dagster

Resources

License

Contributing

Stars

Watchers

Forks

Packages

 
 
 

Contributors