Highlights
- Pro
Stars
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
🌐 Make websites accessible for AI agents. Automate tasks online with ease.
Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Serverless multi-protocol + multi-destination event collection system.
DuckDB-powered Postgres for high performance apps & analytics.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, P…
Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
Compare tables within or across databases
A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service …
🔧 pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fas…
lakeview is a visibility tool for S3 based data lakes
lakeFS - Data version control for your data lake | Git for data
🔥 Blazing fast bulk data transfers between any cloud 🔥
Go cli to check Cloud services (Azure for now) prices on the fly
Go-blueprint allows users to spin up a quick Go project using a popular framework
This is a repo with links to everything you'd ever want to learn about data engineering