Data Engineering
Thinkers posting on this topic
No compiled wiki article for this topic yet. Raw entries below are the source material — a wiki article can be generated on demand from /admin/triggers.
All entries on this topic (1)
Scalable Cloud-Native ETL Pipeline Powers AI Air Quality Monitoring Across 400+ Low-Cost Sensors in Africa
AirQo implements a modular, cloud-native ETL pipeline using Apache Airflow, Kafka, and Google BigQuery to process heterogeneous air quality data from low-cost sensors, weather APIs, and reference monitors in resource-constrained African urban areas. It supports real-time and batch processing with au…