Welcome Guest! Log in
Stambia versions 2.x, 3.x, S17, S18, S19 and S20 are reaching End of Support January, 15th, 2024. Please consider upgrading to the supported Semarchy xDI versions. See Global Policy Support and the Semarchy Documentation.

The Stambia User Community is moving to Semarchy! All the applicable resources have already been moved or are currently being moved to their new location. Read more…


As indicated in the Stambia DI and Kafka Article, it is possible to connect to Kafka from Stambia.

If you never used it yet in Stambia, or if you need a little remind on how to install and use it, you are at the good place.

You'll find in this article the basics, from the installation to the first Mapping, with some explanations on the reverse by the way.

 

Prerequisites:
  • Stambia DI Designer 19.0.21 or higher
  • Java 1.7 or higher

 

Note:

A demonstration project featuring examples and samples can be found in the presentation article.

Note:

Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.

If you have any question, any feature request or any issue, do not hesitate to contact us.

 

Installation

Connector Installation

The first step consists of installing the Stambia kafka connector into the Designer.

For this, we let you take a look at this article that explains how to install plugins into the Designer.

The download section for the connector can be found in the presentation article.

 

Template installation

The next step consists of importing generic templates and Kafka templates into your workspace.

After having downloaded them from the presentation article or download page, simply import them as usual. 

 

Kafka Metadata

There is a dedictad Kafka metadata :
Kafka MD

You have to defined the host :
Kafka MD host2

Then you can create the Topics :
Kafka MD Topic

On the topics, one value must be created, with a type :
Kafka MD Topic Value2

Then you can create the consumer. Consumers must subscribe to the topics to read the messages.
Kafka MD Consumer

On the consumers, one value must be created, with a type, like on the topics.

On the Topics and the Consumers, you can created Headers and Propertyes.

 

Use in a mapping

Now we can use the metadata in mappings.

A example of a produce mapping :
Kafka Map Envoi

An example of a consume mappping :
Kafka Map Read

 

Templates

If the Kafka Server is not running, your mapping will run infinily, without message
The timeout of the template Kafka To Rdbms is parameter to 5 seconds. If you want use Kafka for streaming, you must increase the parameter.

 kafka template

Articles

Suggest a new Article!