Welcome Guest! Log in
Stambia versions 2.x, 3.x, S17, S18, S19 and S20 are reaching End of Support January, 15th, 2024. Please consider upgrading to the supported Semarchy xDI versions. See Global Policy Support and the Semarchy Documentation.

The Stambia User Community is moving to Semarchy! All the applicable resources have already been moved or are currently being moved to their new location. Read more…


Stambia Data Integration allows to work with Kafka.

The Stambia Kafka connector allows both producing and consuming messages to and from a Kafka topic.

Prerequisites:
  • Stambia DI Designer 19.0.21 or higher
  • Java 1.7 or higher

Note:

Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.

If you have any question, any feature request or any issue, do not hesitate to contact us.

This component may require a dedicated license.

Please contact the Stambia support team if you have any doubt and if you need to use it in a production environment.

 

Download

You can find below the necessary resources to work with this Component in Stambia DI

Name Description Download
Component resources You can find in download section the Component resources. Component resources download

 

Supported features

You can find below an overview of what Stambia DI can do with Kafka.

Name Description
Metadata

Kafka producers and consumers can be designed in Metadata.

Consume messages

The connector supports reading messages from Kafka using Kafka consumers.

The following common features are supported:

  • Reading messages keys
  • Reading messages values
  • Reading messages headers

The following advanced features are supported

  • Reading messages properties such as the topic it is coming from, the corresponding partition, offset, ...
  • Reading messages from multiple topics at the same time
  • Reading multiple messages in parallel
  • Transactional mode to read messages in a transaction

When reading messages, you can write the received messages in any database, file, ...

Produce messages

The connector supports writing data into Kafka using Kafka Producers.

 The following common features are supported when producing messages:

  • Defining message key
  • Defining message value
  • Defining message headers

The following advanced features are supported when producing messages:

  • Defining message partition
  • Producing messages in multiple topics at the same time
  • Producing multiple messages in parallel
  • Transactional mode to produce messages in a transaction

You can produce messages from any database, file, ...

Data consultation The connector supports consulting and consuming messages directly from Stambia DI Designer UI.
Kafka versions

Supported Kafka versions:

  • 0.x
  • 1.x
  • 2.x

 

 

Articles

Suggest a new Article!