Speaker

James O'Brien

Principal Engineer · Halcyon Systems

ObservabilityReliability

James is a principal engineer at Halcyon Systems specializing in data observability and reliability — keeping mission-critical pipelines healthy and on-call engineers asleep.

Talks

Data Engineering

Observability for Data Pipelines

Lineage, freshness, and anomaly detection — the telemetry that keeps data products reliable.

Atlanta

Jul 13, 2022 · 10:30 AM

Published papers

Data Quality Scorecards: Quantifying Freshness and Completeness at Scale

W. Liu, J. O'Brien

Data Engineering · 2022 · 94 citations