This article describes the principal changes of Google BigQuery Templates.
Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.
If you have any question, any feature request or any issue, do not hesitate to contact us.
Recycling of previous rejects fixed
When using the option to recycle the rejects of previous execution an extra step is executed to add those previous rejects in the integration flow.
Possible duplicates while retrieving those rejects are now filtered using DISTINCT keyword.
Two new Templates have been added:
- LOAD Rdbms to BigQuery
- INTEGRATION BigQuery
They offer the possibility to perform a load step before integrating data into BigQuery, and to perform direct BigQuery to BigQuery integrations.
INTEGRATION Rdbms to BigQuery Template is still included and preferred when wanting to integrate data directly into BigQuery without creating temporary tables.
The two new Templates simply allows to load data first into a temporary table if wanting to perform transformations, staging, ...
Other Templates have been updated to:
- Support using Standard SQL mode which is used by default from Google BigQuery Connector version 1.0.1
- Automatically add delimiters around the dataset and project name, which may contain special characters
- Automatically add delimiters around columns when their name correspond to a reserved keyword
This new Template version requires to use Google BigQuery Connector 1.0.1 or higher