Design Patterns for Large-Scale Data Movement

Home > Blog > Design Patterns for Large-Scale Data Movement

There is no “best” way to distribute data within applications. If you ask an experienced architect for advice you’ll get a litany of followup questions before they’re willing to make recommendations: LAN or WAN? Large blocks of data or small? How many updates per second? They’ll also want to know how “real-time” you need it to be (i.e. what kind of latency you can tolerate), how many recipients each update needs to go to and what level of delivery or transaction guarantee you need. They’ll want to understand your network environment – private, public, cloud, etc. – and any requirements related to archival, regulatory compliance, uptime and disaster recovery. Each of those factors affects the protocols you may choose and manner of implementation decisions.

In this presentation, Solace systems engineer Ken Overton described popular data movement design patterns, discussed the myriad of deployment considerations that impact manageability and high availability, and illustrated the impact of such decisions with real world examples.

(Can’t watch YouTube?)

Solace

Solace helps large enterprises become modern and real-time by giving them everything they need to make their business operations and customer interactions event-driven. With PubSub+, the market’s first and only event management platform, the company provides a comprehensive way to create, document, discover and stream events from where they are produced to where they need to be consumed – securely, reliably, quickly, and guaranteed.

Behind Solace technology is the world’s leading group of data movement experts, with nearly 20 years of experience helping global enterprises solve some of the most demanding challenges in a variety of industries – from capital markets, retail, and gaming to space, aviation, and automotive.

Established enterprises such as SAP, Barclays and the Royal Bank of Canada, multinational automobile manufacturers such as Renault and Groupe PSA, and industry disruptors such as Jio use Solace’s advanced event broker technologies to modernize legacy applications, deploy modern microservices, and build an event mesh to support their hybrid cloud, multi-cloud and IoT architectures.

See all posts written by Solace