SLG-9616 Beyond the DSL—Unlocking the power of Kafka Streams with the Processor API | Devoxx

Devoxx Belgium 2018
from Monday 12 November to Friday 16 November 2018.

   Beyond the DSL—Unlocking the power of Kafka Streams with the Processor API


Big Data & Machine Learning
Big Data & Machine Learning
Intermediate level
Room 9 Thursday from 16:30 til 17:20

Kafka Streams is a flexible and powerful framework. The Domain Specific Language (DSL) is an obvious place from which to start, but not all requirements fit the DSL model.

Many people are unaware of the Processor API (PAPI) - or are intimidated by it because of sinks, sources, edges and stores - oh my! But most of the power of the PAPI can be leveraged, simply through the DSL #process method, which lets you attach the general building block Processor interface to your -easy to use- DSL topology, to combine the best of both worlds.

In this talk you’ll get a look at the flexibility of the DSL’s process method and the possibilities it opens up. We’ll use real world use-cases borne from extensive experience in the field with multiple customers to explore power of direct write access to the state stores and how to perform range sub-selects. We’ll also see the options that punctuators bring to the table, as well as opportunities for major latency optimisations.

Key takeaways:

  • Understanding of how to combine DSL and Processors
  • Capabilities and benefits of Processors
  • Real-world uses of Processors

Kafka   Apache Kafka Streams   Reactive Streams   Big Data   Real life cases  
Subscribe to Devoxx on YouTube
Antony Stubbs
Antony Stubbs
From Confluent Inc

Antony is a Solution Architect for Confluent in Europe and spends most of his working hours talking to customers all around the world about their Kafka usage, his favourite being aspect being funky Kafka Streams use cases.

Make sure to download the Android or iOS mobile schedule.