Stambia versions 2.x, 3.x, S17, S18, S19 and S20 are reaching End of Support January, 15th, 2024. Please consider upgrading to the supported Semarchy xDI versions. See Global Policy Support and the Semarchy Documentation.

The Stambia User Community is moving to Semarchy! All the applicable resources have already been moved or are currently being moved to their new location. Read more…

Question Handling heavy file in stambia

Start
Prev
1
Next
End

Prashant.Sangle
Topic Author
Offline

06 Oct 2017 12:43 #1 by Prashant.Sangle

Handling heavy file in stambia was created by Prashant.Sangle

Hello All,

Need your suggestion. I have csv file which size is 26 GB having more than 50,000,000 Rows.
which template is preferable i mean which load i.e. RDMBS or bulk load?

currently I am using RDBMS template to load file but it is taking so much time as I have to do same operation on 3 more file.

Please let me know if any query.

Regards,
Prashant Sangle

Thomas BLETON
Offline

19 Oct 2017 17:07 #2 by Thomas BLETON

Replied by Thomas BLETON on topic Handling heavy file in stambia

Hi Prashant

Usually, the database specific loaders such as BULK load are a good solution for handling big files.
How does it go with this solution ?

Start
Prev
1
Next
End