sql - How to optimize the downloading of data to the server in SSIS -


good day. need records oracle database database in sql server. data source type (odbc) performed using sql command, taking possible indices according requirement. process runs fine, problem takes long time , need quick. process can not performed lookup, requires merge or merge join, load table oracle sql under conditions.

thank help

check limiting factor. there 3 points check:

  1. remote server slow. source db can run low on memory, read speed or free cpu. substitute query straight select statement no where clause or joins , see if ssis package runs faster.

  2. target db. may have indexes enabled, high write latency on hdd or not enough cpu. run insert target table , see how longer takes.

  3. problem may in middle: transfer between 2 servers. network main bottleneck. ssis hosted on same server sql server? have 2 network connections + possible hardware bottleneck on dedicated ssis machine.

depending on bottleneck there different solutions.

if have network capacity , bottleneck 1 cpu per query on oracle, can partition data horisontally (ids 1 100, 101 200 etc); establish multiple connections oracle , load data in several streams. number of streams 1 less number of cpus on oracle, ssis or sql server (which ever smaller).


Comments

Popular posts from this blog

Payment information shows nothing in one page checkout page magento -

tcpdump - How to check if server received packet (acknowledged) -