Batch as a Special Case of Streaming
YOW! Data 2017
In this talk I will share my teams gruelling journey in attempting to migrate a batch like system into a streaming framework.
Walking through the various solutions that we tested using Flink, I'll be discussing each ones performance characteristics and bringing to light misconceptions in their designs.
Big Data Engineer
I spend most of my time building machine learning pipelines in Spark and Flink.
I am quite fond of functional programming.
I'm currently working obsessively on an async machine learning api.
I have also contributed heavily to Scoozie which is a Scala DSL for Oozie.