Cashing in on Rock Stars & Data Scientists

iStock_000002812542XSmallThe Rolling Stones are just now embarking on their new “50 & Counting” tour, named for the number of years they’ve been a band. That’s newsworthy in its own right, but they’re also making headlines for the record-setting price of tickets to their shows. The specific prices vary by city, but range between $150 for the cheap seats to $600 for the good ones. That may seem outrageous to anyone who paid $10 to see them 30 years ago, but that’s supply and demand for you — there are only four Rolling Stones, they come as a package deal, and they can pretty much set their own price.

Just a few minutes after reading about that example of capitalism at work, I read a Yahoo! Finance article titled Hottest Job of the 21st Century? Bet on This. It makes the case that data scientists are the new rock stars of the corporate world, and cites a May 2013 McKinsey study that estimates that by 2018 the U.S.… Read the rest

Solace Systems Appliances to Collect and Distribute Sensor Data as Part of Public Infrastructure Monitoring Initiative in Japan

Led by Japan’s Ministry of Economy, Trade and Industry, the initiative aims to accelerate response to and recovery from natural disasters

OTTAWA, Ontario, April 29, 2013 – The University of Aizu has selected Solace’s messaging solution to collect and distribute sensor data as part of a system that will monitor roads, bridges and buildings across Japan.
The platform, called “Public Cloud System for Monitoring and Maintaining Public Infrastructure, ” led by the Ministry of Economy, Trade and Industry (METI) of the Government of Japan, has been developed to support the reconstruction of the region that was devastated by the earthquake that hit eastern Japan on March 11, 2011. The project was carried out in Fukushima jointly by government, industries and academia including the University of Aizu during the period of March 2012 to March 2013.

The project aimed to build and evaluate a machine-to-machine (M2M) network system named “Co-creative Cloud System” that collects data from sensors installed within the public infrastructure (such as roads, bridges, buildings, etc.) and delivers it to relevant parties (such as government agencies, public services, academic researchers, etc.).… Read the rest

The Growth of Middleware Appliances and Preparing for the Zombie Apocalypse

SearchSOA had an article yesterday on the rapid growth in SOA and middleware appliances, a subject near and dear to our hearts here at Solace. Obviously we agree with the observations, given that we are the leading supplier of messaging middleware appliances globally, and have experienced 1512% growth of our own over the past 5 years.

bigdata-paperAs the megatrends of big-data-scale applications and the move from batch to real-time business processes merge, far more information than ever before is on the move. The resulting data volumes and increases in complexity are the key drivers behind the growing adoption of easier to manage and higher capacity application infrastructures.

In fact, we just prepared a fun little piece of visual collateral highlighting the crazy growth in data rates in virtually every industry and the changing requirements that growth places on your middleware  (…and yes, it also addresses what to do if zombies take over your datacenter).… Read the rest

Scaling Data Movement when Planning for Big Data

iStock_000017401820Medium-300x253Wikipedia defines big data as “a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools.” In the majority of cases, that same big data storage requirement comes with a big data movement challenge. Just as companies turn to new data management approaches to capture, store and analyze their very largest data sets, they need to look at new technologies for moving data at big data scale. The prior generation of enterprise messaging middleware such as MQ or JMS simply can’t keep up with the volumes that come with big data requirements.

Solace and Big Data

That requirement is at the core of Solace’s founding vision. More than 10 years ago, we saw that three long term trends  would lead to the need to move and manage an increasingly massive volume of data:

  • Globalization of business, driven by the internet
  • Rapid expansion of computing endpoints, driven by mobile and machine-to-machine (M2M) connections
  • Exponential growth of data volumes driven by business process automation, complex event processing and decision making tools.
Read the rest

Gartner Cranks up the Hype (Cycles)

Once a year, industry analyst firm Gartner publishes wide sweeping set of reports they call Hype Cycles. Each one of these reports takes a typical area of IT investment, for example Big Data, and provides commentary on that topic, as well as the various technologies, IT methodologies and management disciplines that comprise that topic. Hype Cycles highlight overhyped areas and estimate how long technologies and trends will take to reach maturity. The “hype” in hype cycle largely refers to the media’s short attention span – the majority of IT press is focused on new and emerging technologies  while tried and true technologies are deemed passé (as a news story). It’s the same reason that Justin Bieber gets more headlines than Neil Diamond.

In this year’s edition of these reports, Solace is listed as a sample vendor for two important technology trends:

  • Event-driven architecture – Event-driven architecture (EDA) is a design paradigm in which a software component executes in response to receiving one or more event notifications.
Read the rest

Solace Upgrades Middleware Appliances to Tackle Exponential Growth in Distributed Data Applications

Product Improvements Target Front, Middle & Back-Office Acceleration, Big Data Deployments and Cloud Computing

OTTAWA, May 22, 2012 Solace Systems today announced a series of upgrades to its market leading family of middleware appliances to deliver high-capacity application infrastructure in support of the most demanding distributed computing architectures. Solace’s latest hardware innovation helps companies handle more data at lower cost and with less effort than ever before.

“The volume of data handled by business applications continues to grow at 40% per year with no sign of slowing*. This trend affects a wide spectrum of applications such as trading platforms in capital markets, big data systems and cloud environments where data from many systems is merged into a single shared infrastructure, ” said Dan Sholler, research VP at Gartner, “We expect this trend to accelerate as more information from mobile apps, social media and operational systems is incorporated into the IT landscape.… Read the rest

Is the real-time web streaming data in the wrong direction?

Determined SalmonExamples of web streaming have become rather predictable and yawn-worthy. It’s always some variation of streaming real-time stock market data, news and status updates from the cloud to your browser, tablet or phone – classic filtered fan-out data distribution. Sure, there are a few upstream bits like the character inputs used for real-time keyword search completion, or chat applications, but the upstream data is a trickle compared to the fire hose coming downstream. However this model is beginning to flip directions and applications are more frequently streaming large volumes of upstream data with a downstream trickle.

Consider how most Big Data is being collected at the server side today. Click streams, log data, activity streams, search queries – they are all pouring into Kafka, Scribe, or Flume and ending up in a variety of big data repositories. As users increasingly run thicker smartphone, tablet or desktop apps the view from the web server becomes less and less complete.… Read the rest

The Journal on three world-changing tech trends

There is an excellent article in today’s Wall Street Journal that details the technology-driven, macro shifts that are happening right now in the world of business. The three mega-trends they cite:

  • Big data – for anyone in IT this is a “no kidding Sherlock” inclusion, but it is remarkable to step back and appreciate how quickly big data is changing the landscape and its long term implications.
  • Smart manufacturing – The next wave in manufacturing – engineering from the molecular level to manufacture products using methods more like the ones we use to print documents. The emphasis shifts to design and IP, and away from cheap labor and physical factories.
  • The wireless revolution – The extension of internet access to more than a billion of the world’s people, paired with a new generation of applications and services, is fundamentally changing the way the world connects, socializes and engages in commerce.

The author does a little flag waving around America being an epicenter for these three trends, but the more important point is that all three are underway now and are good bets to literally change the world.… Read the rest

Capturing data streams at "big data" scale

trafficBefore you can break into a cold sweat about tackling the design of a system that analyzes big data volumes, you first need to be able to capture the data. More often than not, the design parameters feel like a traffic engineering problem — there are simply too many cars and not enough road.

Certainly, LAN and WAN network technology introduces many limits and the largest commercial databases (e.g. Netezza, Teradata) or open source big data stores (e.g. Hadoop, Splunk) can only store data so fast. Even in memory data grids are limited by how many in-memory writes can be performed per second. Managing the distributed information is usually some kind of middleware, once again, usually a commercial product (e.g. JMS or MQ) or open source code (e.g. Kafka or Qpid).

Even at full speed, a single instance of the middleware layer runs at far less capacity than the network, in-memory grid, or data store can process, making it the weakest link.… Read the rest

Handling data growth as digital information doubles every 18-24 months

Various studies have claimed that the amount of digital information in the world doubles every 18 to 24 months. Using the conservative 2 year estimate, that means there is 32 times as much digital data today as there was in 2001. Some of that growth is from all those cute cat videos and embarrassing Facebook photos, but much of it is valuable business data generated by automated processes within and between businesses.

Today we announced a new partnership integrating our message routers with the B2B and Managed File Transfer (MFT) components of SEEBURGER’s Business Integration Server platform. The big “why” behind this partnership is captured in the “growth of global data” factoid above. SEEBURGER is a powerhouse in the B2B and MFT spaces, and does a lot more application integration (A2A/EAI) than people think.

Today, the growth in data generated by these systems puts stress on the enterprise services bus underneath their software, but with Solace integrated into BIS and MFT, SEEBURGER customers get worry-free capacity for their distributed information requirements in an easy-to-use appliance form factor.… Read the rest