Dremio Lakehouse Examples & Usage Guide

Welcome to the ultimate Dremio Lakehouse resource.

This repository contains over 240+ industry-specific SQL scenarios, tailored to demonstrate the power of Dremio's Medallion Architecture (Bronze -> Silver -> Gold). It also serves as a comprehensive reference for Dremio's integrations with the broader data ecosystem.

🗂️ Example Libraries

1. Standard Industry Examples

Contains standard vertical use cases including:

• Healthcare (Clinical, Claims, Operations)
• Finance (Banking, Trading, Risk)
• Government (Public Safety, Infrastructure)
• Retail & Supply Chain (Logistics, Customer 360)

2. Emerging Tech & Specialized

Contains new (2025-2026) scenarios focusing on:

• IoT & Sustainability (Hydroponics, EV Battery, Green Hydrogen)
• Advanced Tech (Orbital Debris, Drone Airspace, CRISPR)
• Modern Economy (Gig Economy, Esports, Influencer ROI)

3. Raw & Messy Data (AI Agent Training)

Contains "dirty" datasets designed to challenge AI Agents to propose cleaning strategies and architecture:

• Messy Scenarios: Legacy Banking, IoT Duplicates, Regex Nightmares, JSON Extraction.
• Goal: Use Dremio AI Agents to auto-generate Bronze -> Silver cleaning logic.

---

🛠️ Technical Resources

SQL Reference

• SQL Functions: Math, String, Date, Window, and Aggregates.
• AI Functions: Sentiment analysis and data transformation with LLMs.
• Admin & Maintenance: RBAC, Reflections, Vacuum, and Optimization.
• System Tables: Job analytics and audit logs.
• Ingestion & DML: COPY INTO, MERGE, and Auto-ingest.
• Iceberg Metadata: Querying snapshots, manifests, and partitions.

Integrations & Connectivity

• Dremio Interfaces: Python (Flight, ODBC/JDBC, REST API).
• Other Engines: Connecting Spark, Flink, Trino, and others to Dremio's Catalog.

GenAI & Agents

• Sample Prompts: Templates for SQL generation and Agent skills.

Additional Scenarios

• Customer 360: Unified customer views.
• Hybrid Supply Chain: Federation across clouds.
• More Examples: Autonomous vehicle fleets and other misc scenarios.

---

🏛️ Architecture & Best Practices

All examples follow the Medallion Architecture:

• 🥉 Bronze: Raw ingestion tables.
• 🥈 Silver: Cleaned, verified views.
• 🥇 Gold: Business-level aggregates.

Key Guides:

• View & Reflection Strategy: How to layer views and accelerate queries.
• Masking & Security: Implementing Row-Level Security (RLS) and Column Masking.
• Privilege Management: Managing access control via RBAC.

🔬 Niche, Scientific & Non-Profit Domains (Phase 3)

Scenario	Description	Key Features	File
Wildlife Conservation	Tracking animal tagging data to identify poaching risks.	Geospatial, Medallion	wildlife_conservation_tracking.sql
Ocean Plastic Cleanup	Optimizing vessel routes based on satellite density maps.	RouteOptimization	ocean_plastic_cleanup.sql
Digital Archaeology	Automating artifact dating via stratigraphic analysis.	Stratigraphy	digital_archaeology_site.sql
Ski Resort Ops	Balancing lift wait times with snow grooming quality.	UtilizationMetric	ski_resort_operations.sql
Refugee Aid Dist.	Forecasting food/water gaps for camp demographics.	GapAnalysis	humanitarian_aid_distribution.sql
Nuclear Waste Monitor	Tracking thermal decay and pressure for safety alerts.	ThresholdDetection	nuclear_waste_monitoring.sql
Urban Noise Pollution	Mapping sensor decibels to zoning for compliance.	GeospatialCompliance	urban_noise_pollution.sql
Patent Portfolio Mgmt	Valuing IP assets via forward citation graph analysis.	GraphAnalysis	legal_patent_portfolio.sql
Radio Astronomy	Filtering RFI interference to detect pulsars/FRBs.	SignalProcessing	astronomy_radio_telescope.sql
Luxury Counterfeit	Detecting cloned tags via impossible travel time logic.	AntiCounterfeit	luxury_counterfeit_detection.sql