Pinterest launched a next-generation CDC-based database ingestion framework using Kafka, Flink, Spark, and Iceberg. The system reduces data availability latency from 24+ hours to 15 minutes, processes ...
When people come together and talk about really interesting topics, great questions spark better understanding and opportunities for new ideas to form. On The Spark from WITF, host Asia Tabb starts ...