This article describes the principal changes of Hadoop Component.
If you need further information, please consult the full changelog.
The plugin download section can be found at this page.
Note:
Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.
If you have any question, any feature request or any issue, do not hesitate to contact us.
This article is dedicated to Stambia DI 2020 (S20) or higher.
If you are using Stambia DI S17, S18 and S19 please refer to this article.
Component.Hadoop.2.2.1
Minor improvements and fixed issues
This version contains some minor improvements and fixed issues, which can be found in the complete changelog.
Complete changelog
The complete changelog with the list of improvements and fixed issues can be found at the following location.
Component.Hadoop.2.2.0
Complete changelog
The complete changelog with the list of improvements and fixed issues can be found at the following location.
Component.Hadoop.2.1.1
This component version is dedicated to Stambia DI S20.4.1 or higher.
Support of Stambia SQL Editor
The SQL Editor has been replaced by a tool named "Stambia Query Editor", some improvements have been made in Hadoop component to support this Stambia Query Editor.
Component.Hadoop.2.1.0
Support of EMF Compare
Several improvements have been made to support EMF Compare.
Component.Hadoop.2.0.5
Minor improvements and fixed issues
This version contains some minor improvements and fixed issues, which can be found in the complete changelog.
Complete changelog
The complete changelog with the list of improvements and fixed issues can be found at the following location.
Component.Hadoop.2.0.4
Minor improvements and fixed issues
This version contains some minor improvements and fixed issues, which can be found in the complete changelog.
Complete changelog
The complete changelog with the list of improvements and fixed issues can be found at the following location.
Component.Hadoop.2.0.3
New Template Load Salesforce to Hive
A new dedicated Template to Load data from Salesforce to Hive has been added.
It will provide a better support and optimization than the generic Templates, and handle Hive specificities when loading data from Salesforce.
HDFS File Connect Tool
When a connection issue happens on the "HDFS File Connect Tool", a session variable named "HDFS Error" is now published to provide a better error message.
Change Data Capture (CDC)
Multiple improvements have been performed to homogenize the usage of Change Data Capture (CDC) in the various Components.
Parameters have been homogenized, so that all Templates should now have the same CDC Parameters, with the same support of features.
Multiple fixes have also been performed to correct CDC issues. Refer to the changelog for the exact list of changes.
Complete changelog
The complete changelog with the list of improvements and fixed issues can be found at the following location.
Component.Hadoop.2.0.2
Sample project
The component example project can now be imported directly in the "New" menu of the Project Explorer.
Component.Hadoop.2.0.1
HDFS Tool
Adding a new tool: Tool HDFS File Get Properties, which allows to retrieve information about files.
For this first version it allows to retrieve the size of a remote file.
The size will be stored in the process variable “HDFS_BYTES”.
Fixed issue about WebHDFS mode and files with space character
There was an issue when trying to manage HDFS files through WebHDFS mode, when the files has a space character in file name.
This is now fixed.