Databricks - 11-14 Windmill Street, W1T 2JG London
Join the Databricks team and our long-term partner, DATAPAO, for a focused discussion on How to build and run an end-to-end data pipeline.
This session offers practical insights and hands-on experience to supercharge your data architecture.Through a mix of live demos, hands-on coding, presentations and Q&A, we’ll address key topics, including:
- End-to-end pipeline setup demo
- Ingest data continuously from Volume and other Delta tables using DLT
- Create and manage data assets using Unity Catalog
- Enhance data with DLT and explore: Streaming tables, Materialized views, quality control using Expectations, and publishing our result datasets
- Using DLT Event Logs to observe and review pipeline metrics
- Utilize Genie spaces to interact with and explore our data
- Explore custom generative AI capabilities to enrich the results using ai_query()
- Develop AI/BI collaborative dashboards to display the ingested and processed data and extract relevant insights
- Cost control overview
This is an opportunity to expand your knowledge and network with fellow professionals. We look forward to welcoming you to an enriching and collaborative environment.
Register now to save your space!
Agenda