Apache Ignite Documentation

GridGain Developer Hub - Apache Ignitetm

Welcome to the Apache Ignite developer hub run by GridGain. Here you'll find comprehensive guides and documentation to help you start working with Apache Ignite as quickly as possible, as well as support if you get stuck.

 

GridGain also provides Community Edition which is a distribution of Apache Ignite made available by GridGain. It is the fastest and easiest way to get started with Apache Ignite. The Community Edition is generally more stable than the Apache Ignite release available from the Apache Ignite website and may contain extra bug fixes and features that have not made it yet into the release on the Apache website.

 

Let's jump right in!

 

Documentation     Ask a Question     Download

 

Javadoc     Scaladoc     Examples

Data Loading & Streaming

Load and stream large volumes of data into Ignite

Ignite data loading and streaming capabilities allow ingesting large finite as well as never-ending volumes of data in a scalable and fault-tolerant way into the cluster. The rate at which data can be injected into Ignite is very high and easily exceeds millions of events per second on a moderately sized cluster.

Data Loading

Data loading into Ignite from a 3rd party database is covered on dedicated data loading page. The same page explains how to preload initial data into the cluster having Ignite native persistence enabled.

How Streaming Works

  1. Client nodes inject finite or continuous streams of data into Ignite caches using Ignite Data Streamers.
  2. Data is automatically partitioned between Ignite data nodes, and each node gets equal amount of data.
  3. Streamed data can be concurrently processed directly on the Ignite data nodes in collocated fashion.
  4. Clients can also perform concurrent SQL queries on the streamed data.

Data Streamers

Data streamers are defined by IgniteDataStreamer API and are built to inject large amounts of continuous streams of data into Ignite stream caches. Data streamers are built in a scalable and fault-tolerant fashion and provide at-least-once-guarantee semantics for all the data streamed into Ignite.

Read more

Querying Data

You can use a full set of Ignite data indexing capabilities, together with Ignite SQL, TEXT, and Predicate based cache queries, to query into the streaming data.

Read more

Integrations

Apache Ignite integrates with major streaming technologies and frameworks such as Kafka, Camel, Storm or JMS to bring even more advanced streaming capabilities to Ignite-based architectures: