Can you please show what error you get ?
Which step of the generated process fails ?
Note : you may have to map the target fields on the Staging Area, because they have SQL expressions which ned to be executed on a rdbms. They are currently set on Source.
This message is raised by Postgresql because the COPY utility tries to load data from the file but it contains extra data after the last column.
For this load to work, the file must have the same structure on every one.
Or you can create a multi-record metadata file if the lines have different structures.
The source data is a file.
On the current versions of Stambia, transformations and filters cannot be applied directly on files. The file has to be loaded into a database table first, entirely.
Your mapping is correctly set : the filter is set on the Staging Area.
What you need to find out is why the COPY fails.
What is the code in the "Load into target" action ("Step details" view) ?
What is the File structure in the medata ?
Can you provide the first lines of data ?
the structure in my metadata is:
the first line in the file must be insert in Date_form and Date_to and it must be repeated as much as I have Data ( I will create 2 mappings; one for Dates and the other for the other data and I ll create a process to repeat the first mapping.That is my idea )
here the first lines :
HEAD12/22/2014 To 01/28/2015
AED,UAE dirham,per USD,3.67304,4.34976
ARS,Argentine peso,per USD,8.57102,10.15014
for example here as output I must have:
12/22/2014 01/28/2015 AED UAE dirham per USD 3.67304 4.34976
12/22/2014 01/28/2015 ARS Argentine peso per USD 8.57102 10.15014
This file is interesting; It looks simple but the structure is complex :
- The first line has a POSITIONAL structure
- The lines of data are DELIMITED, and they have a different structure from the first line
The solution in Stambia is to use a "multi-record file" metadata. This kind of metadata will help you read from either the first line, or the data lines.
Here is an example of Metadata file + sample file, which will help you understand how it can be used.
The file is described in 2 records: the Head record, for the first line, and the Data record, for the rest of the file (see the Filters in the metadata).
The mapping has a cross join between these two records.
The target fields are mapped on the Staging Area.
Please compile this process, and open the steps to see how it works. This will help you understand.
I hope this helps.
This message has attachments files. Please log in or register to see it.