Hazelcast IMDG

Why Hazelcast Jet?

Hazelcast Jet is the 3rd Generation Big Data Processing Engine. It is an application embeddable, distributed computing platform for fast processing of big data sets. The Hazelcast Jet architecture is high performance and low latency driven, based on a parallel, streaming core engine which enables data-intensive applications to operate at near real-time speeds.

Hazelcast Jet includes the Pipeline API for general purpose programming of batch and stream processing, and exactly-once fault tolerance using snapshotting with the integrated Hazelcast IMDG. The overall focus is to increase developer productivity via an extremely simple and intuitive programming interface and deployment. Jet is a single library with no dependencies which is therefore easily embedded and deployed, removing the need for multiple systems.

Hazelcast Jet is built on top of Hazelcast IMDG, the leading open source in-memory data grid with tens of thousands of installed clusters. Hazelcast Jet processing jobs may take full advantage of an elastic, in-memory storage capability of Hazelcast IMDG. The high-performance IMDG connectors work in both batch and streaming way.

Differentiators:

High Performance

Productive

  • Distributed computing platform for fast processing of big data
  • Parallel and low-latency core engine that allows data-intensive applications to operate at near real-time speeds
  • Cooperative multi-threading architecture allows operation of thousands of simultaneous jobs
  • Scales both vertically and horizontally
  • One solution for batch and stream processing
  • Based on Hazelcast legendary ease-of-use
  • Variety of connectors enable easy integration into data processing pipeline
  • Scaling, failure handling and recovery are all automated for ease of operational management
  • Exactly-Once or At-least Once guarantees
  • Jet team provides quick response to new feature requests

Flexible Integration

Enterprise Grade Storage

  • Operates as shared application infrastructure or is embedded directly in applications as a JAR- making big data processing an application concern
  • Ideal for microservices with light-weight footprint –each Jet processing job is launched within its own cluster maximizing service isolation
  • Light-weight makes manipulation with Jet easy for both developers and DevOps
  • Cloud and container ready. Pivotal Cloud Foundry, OpenShift, Docker, Azure, AWS, Kubernetes
  • Embeds Hazelcast IMDG as an operational storage for enterprise-grade reliability and resilience
  • Most widely deployed IMDG with tens of thousands of deployments in production worldwide
  • High-Performance integration eliminates network transit latency penalties from moving data back and forth
  • Eliminates the integration issues between processing and storage

Hazelcast.com

Menu