This article describes the principal changes of Hadoop Component.
If you need further information, please consult the full changelog.
The plugin download section can be found at this page.
Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.
If you have any question, any feature request or any issue, do not hesitate to contact us.
This article is dedicated to Stambia DI 2020 (S20) or higher.
If you are using Stambia DI S17, S18 and S19 please refer to this article.
New Template Load Salesforce to Hive
A new dedicated Template to Load data from Salesforce to Hive has been added.
It will provide a better support and optimization than the generic Templates, and handle Hive specificities when loading data from Salesforce.
HDFS File Connect Tool
When a connection issue happens on the "HDFS File Connect Tool", a session variable named "HDFS Error" is now published to provide a better error message.
Change Data Capture (CDC)
Multiple improvements have been performed to homogenize the usage of Change Data Capture (CDC) in the various Components.
Parameters have been homogenized, so that all Templates should now have the same CDC Parameters, with the same support of features.
Multiple fixes have also been performed to correct CDC issues. Refer to the changelog for the exact list of changes.
The complete changelog with the list of improvements and fixed issues can be found at the following location.
The component example project can now be imported directly in the "New" menu of the Project Explorer.
Adding a new tool: Tool HDFS File Get Properties, which allows to retrieve information about files.
For this first version it allows to retrieve the size of a remote file.
The size will be stored in the process variable “HDFS_BYTES”.
Fixed issue about WebHDFS mode and files with space character
There was an issue when trying to manage HDFS files through WebHDFS mode, when the files has a space character in file name.
This is now fixed.