From Main Street to Wall Street and their international equivalents around the world, financial institutions of all kinds are working hard to improve efficiency, regulatory compliance and customer experience.
The financial services sector is remarkably diverse, and some of the challenges faced by different kinds of banks, capital market participants, insurance companies and payment processors vary, they all face the need to get real-time data flowing between back-office, front-office and customer-facing systems across geographies and operating environments.
In recent years many of them have turned to Apache Kafka – an open source tool initially built by LinkedIn’s engineers to log data about activity within their platform. The functionality has evolved somewhat since then, to the degree that many try to use it as the foundation of their event streaming. That’s not always the right path though…
“Apache Kafka is not designed to be an enterprise message broker acting as the central nervous system for streaming event data throughout your organization.” – David Menninger, SVP and Research Director, Ventana Research
I’ll explain here the four common challenges enterprise IT teams face when implementing Kafka, how you could address them, and how you should address them.
There’s an old saying “If the only tool you have is a hammer, you will start treating all your problems like a nail.”
Longtime Sun Microsystems CEO Scott McNealy once said “Open source is free like a puppy is free,” and many find that applies in spades to Kafka.
Any IT pro worth their salt knows that open source tools aren’t really “free” when they’re being used to meet real-world enterprise computing requirements. You know already (or will soon realize) you can’t DIY it and might look for a “managed” flavor. While cloud providers come with the obvious risk of “lock-in”, a public-listed Managed Kafka provider creates unnecessary bloat in your infrastructure. Here is an example of how that looks for size and price.
The bottom line is that it’s difficult and expensive to get Kafka to meet the scalability and management needs of most enterprises. As such it can quickly evolve from being an enabler of efficiency and innovation to being a burden that hampers your ability to innovate, make smarter decisions, and better service your customers.
Solace has the tools and experience to help you avoid these pains, so consider Solace PubSub+ Platform to leave your Kafka-rooted challenges behind and innovate faster and better.
Contact us to book a consultation and start to evaluate your Kafka estate so you can chart a path to Kafka right-sizing at your business.
An engineer by education and a marketer by profession, Gaurav was a senior manager in Product Marketing at Solace until 2021. He developed product strategies, campaigns and content that helped customers appreciate the differentiating functionality and business benefits of Solace’s event streaming and event management products.[position] => [url] => https://solace.com/blog/author/gauravsuman/ ) )