SDF is an advanced build system for data infrastructure that brings together data contracts, queries, and policies to create code-level, time-level, and access-level dependencies. It offers several key features and benefits:
Scalability: SDF is the first build system for data infrastructure that can handle large-scale projects effectively.
Local execution: SDF allows for SQL development to be done locally, providing intelligent workflows and data governance in a compact 60MB package built on Rust.
Data governance: SDF provides detailed analysis of data lineage at the column level, allowing for the creation of a comprehensive data catalog.
User-friendly: SDF is a user-friendly platform for data development, empowering organizations of all sizes to make the most of their data while adhering to relevant policies and protections.
Cloud-based: SDF operates its engine in the cloud, making it easy to deploy and manage workflows with real-time policy enforcement.
SDF can be used in a variety of data-related scenarios, including:
Creating dependencies at different levels (code, time, and access) for data infrastructure.
Streamlining SQL development by compiling data contracts, queries, and policies together.
Generating a comprehensive data catalog with detailed column-level lineage analysis.
Empowering organizations of any size to effectively utilize their data while upholding relevant policies and protections.
Scheduling workflows with real-time policy enforcement.
