Is there any way to pull the data from Source to Destination faster ? I have two servers. One for source and other for destination. These two servers are at dif开发者_运维技巧ferent countries. Not my region. I created a package to pull data from source to destination. There are more than 2 lakhs of data. If I connect with servers in my region, data pulling works fast. But when at different regions, its bit slow to pull data and insert to destination. Its taking around 6 hours to complete the pulling process of 2 lakhs data. Is there any other solution to make data transfer faster ?
You might get some better throughput (given that your network isn't working at max speed already) if you split the Data flow tasks in two and parallelize them.
If you now get double the speed you split again to three, four, or more flows going at the same time, until your network is saturated. You have then reached the limit of how fast you can fetch data.
However, you -might- also load data faster if you export it and compress it on remote sites, then move the data to your local site, then unpack and load this.
精彩评论