There is no a single standard airlock. Sensitive data, whether patient records or financial information, requires control governing the sharing of that data. These controls must conform with the common common law concept of confidentiality, data protection laws (primarily UK GDPR and the Data Protection Act 2018) and variance across organisational governance. Specifically the variant… Continue reading In Space No Two Airlocks Are The Same
Federating Data Between Snowflake and Databricks with DuckDB and Apache Iceberg If you're running both Snowflake and Databricks — and most enterprises I work with are — you've probably hit the federation problem. Data lives in both platforms, analysts need to query across them, and the obvious solutions (ETL everything into one place, or pay… Continue reading Ducks on Icebergs
Faster Insight, Better Reuse, and Scalable Data Foundations Healthcare organisations face growing demand for better use of data: improving operational performance, supporting population health management, enabling AI, and accelerating research. Yet many still rely on fragmented pipelines, duplicated transformations, and slow bespoke data requests. At the same time, the economics of technology have changed. Modern… Continue reading Explaining Medallion Data Architectures in Healthcare
API Crazy 