I recently created a new integration guide for an Apache project called Flink. In the words of the Flink site itself, “Flink is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications.” You can get a slightly deeper introduction to Flink here, but in summary Flink Streaming supports high-throughput, fault-tolerant stream processing of live data streams for continuous processing of unbounded datasets.
The Flink Streaming generic SourceFunction is a simple interface that allows third party applications to push data into Flink in an efficient manner. This integration guide includes a simple example JMS consumer library with basic
SourceFunction<OUT> instances for JMS queues and topics. It’s called flink-jms-connector code it’s totally spec-compliant so you could use it with other JMS providers, unlike many of the oddly vendor-specific open source “JMS” modules you’ll find. The library lets you plug in your own function to translate inbound JMS Message objects to a target type consumed by Flink, which is all of the code you’ll need to use this library.… Read the rest