Apache Spark
Download
Asset Type:
Micro-Integration
Provider:
Provider: Solace
Category:
Analytics & Stream Processing
Endpoint:
Target
Support:
Solace – Support Available
Platform:
External Embedded
Contact Us

Apache Spark

The Solace Spark connector supports ingest of events from PubSub+ brokers using the Spark DataSource v2 API.

The connector features:

  • Processing of messages in batches
  • Message are acknowledged to the source broker once Spark triggers commit.
  • Message IDs are persisted in checkpoint location once commit is successful. This helps in deduplication of messages and guaranteed processing.
  • Support for various Spark version 3.x runtimes.

 

Show more

Still have questions?

Explore Other Connectors Get in Touch