Henk's tech blog

a weblog about IT optimization

Sedat Yogurtcuoglu noticed that’s it’s possible to increase the throughput of a pipeline by splitting Synchronous Transformations into Multiple Tasks in the same synchronous execution tree; we ran a series of tests with various number of Derived Column tasks and found out that it’s possible to more than double the throughput.

If you want to change more than one column in a data flow by using a Derived Column task, there is a performance benefit to splitting that transformation into multiple Derived Column tasks in the same execution tree: 

  versus:    

Read all about it at the SQLCAT site:

http://sqlcat.com/technicalnotes/archive/2010/08/18/increasing-throughput-of-pipelines-by-splitting-synchronous-transformations-into-multiple-tasks.aspx

Enjoy!

Henk