Federating Data Between Snowflake and Databricks with DuckDB and Apache Iceberg If you're running both Snowflake and Databricks — and most enterprises I work with are — you've probably hit the federation problem. Data lives in both platforms, analysts need to query across them, and the obvious solutions (ETL everything into one place, or pay… Continue reading Ducks on Icebergs
The rule of law is a fundamental principle from the Mesopotanian Code Ur-Nammu, through Magna Carta to International Criminal Court's decisiion to ditch Microsoft Office for European open source alternatives. Data sovereignty requires certainty that services will never be terminated or at the mastery of a governmental body. For this reason I find it useful… Continue reading EU Sovereign Cloud List
Faster Insight, Better Reuse, and Scalable Data Foundations Healthcare organisations face growing demand for better use of data: improving operational performance, supporting population health management, enabling AI, and accelerating research. Yet many still rely on fragmented pipelines, duplicated transformations, and slow bespoke data requests. At the same time, the economics of technology have changed. Modern… Continue reading Explaining Medallion Data Architectures in Healthcare
Medical data ownership needs to pass from the trust to the patient to enable ML diagnostics and better research collaboration. The best way of achieving this without being compelled by the hyper-scalers is to move to a persistent container based architecture.
As a Google Cloud Platform certified architect I really should blog some more about my actual usage of GCP. One of my favourite tools is Dataproc as it provides a managed Spark & Hadoop environment and enables a lambda architecture suitable for complex network event processing and function remediation. A mobile radio network is a… Continue reading Google Cloud managed Spark & Hadoop for Mobile Network Performance
Implementing a successful 5G deployment means moving to a micro-service architecture. To support the major technical use case of 5G it is important to decouple the micro-service architecture from the data fabric. This article describes some of the key 5G use cases requiring a data fabric.
Monitoring and observability across hybrid clouds is complex and requires avoid stove pipes by working in a multi-cluster environment.
This is a fantastic list of Cloud Native networking technologies. Because it is curated it is updated frequently. It is making my life much easier. https://jimmysong.io/awesome-cloud-native/ And the tutorial list for old guys is especially useful
I try and fit components together logically so that they can make the most of what the technology offers. I work predominantly in the OSS world on new access technologies like 5G and implementations like the Internet of Things. I want to achieve not just the deployment of these capabilities but to also to let… Continue reading Bringing IT (OSS) all together
The GSM Association (GSMA) put the M2M market size at $1.2tn revenue with 12 billion connected mobile devices by 2020. These numbers alone are enough to excite the most conservative of operators and wobble the subscriber-centric business models that currently prevail. The existing model adopted by MNOs that the more subscribers it has, the more successful and… Continue reading M2M ARPU Requires A Reference Architecture