Explaining "Big Data on the Move"

Home > Blog > Explaining “Big Data on the Move”

At the recent QCon conference in San Francisco, I gave a talk called “Big Data on the Move” in which I introduced the audience to some of the unique challenges, techniques and technologies associated with enabling the distribution of “big data” volumes of information. The room was full and my talk seemed to hold the attention of the notoriously tough QCon audience.

Special thanks to the fine folks at QCon for letting me share video of this talk. I hope you find it informative. I’ve included an index of some key points below the video.

00:52   What’s missing from the current big data landscape
05:16   The three key types of “Big Data in Motion”
06:25   Big data capture and collection
09:22   Scaling horizontally vs vertically
12:56   Dealing with traffic volume spikes
14:56   Dealing with the “long fat pipe”
17:25   Alerting and streaming events
20:22   Fanning out data to a huge audience
22:35   Dealing with slow subscribers
26:12   Real-time data analytics
27:30   The role of in memory data grids or CEP engines
28:30   Real world use cases
28:55   Transportation sensor network
32:27   Homeland security
35:09   Trade automation
36:30   Telco customer service
38:25   Open Q&A

Solace

Solace helps large enterprises become modern and real-time by giving them everything they need to make their business operations and customer interactions event-driven. With PubSub+, the market’s first and only event management platform, the company provides a comprehensive way to create, document, discover and stream events from where they are produced to where they need to be consumed – securely, reliably, quickly, and guaranteed.

Behind Solace technology is the world’s leading group of data movement experts, with nearly 20 years of experience helping global enterprises solve some of the most demanding challenges in a variety of industries – from capital markets, retail, and gaming to space, aviation, and automotive.

Established enterprises such as SAP, Barclays and the Royal Bank of Canada, multinational automobile manufacturers such as Renault and Groupe PSA, and industry disruptors such as Jio use Solace’s advanced event broker technologies to modernize legacy applications, deploy modern microservices, and build an event mesh to support their hybrid cloud, multi-cloud and IoT architectures.

See all posts written by Solace