Optimal parameters for Data Transfer

[vilipche]

Hi everyone,

I am frequently using the Data Transfer to copy data from one to another database.
Recently I was wondering how could I improve its performance.

I've been setting the fetch size to 10,000 and commit after 100,000 rows. It takes around an hour to perform this for around 4 GB of data.

Then I tried setting up the Multiple queries instead of Single queries and set the segment size to 100,000. But the fetches started growing, the export was slower.

I was wondering if there are any optimal values for fetch size or commit after X rows that I could set up to speed the data transfer.

Thanks.

[LonwoLonwo]

Hello.
You can read about data load settings more here: https://github.com/dbeaver/dbeaver/wiki/Data-migration#step-5-data-load-settings
You can use bulk load if you have PostgreSQL, as example