I've made some improvements to my QueryIO reader built in Python. The new version allows you to sort the output in either ascending or descending order. Prior to V2., the only output option was the output that was available in the statistics io text file fed into the program. If there are any other features/enhancements you'd like to see, please let me know. You can download it here. Enjoy!
I have text file that contains data for a given fiscal period. In this particular file there are around 2 million records. The file needs to be split into two distinct output paths from the same source, which means this should all happen within a given DataFlow component. One of the paths simply sums the data via a specific set of columns, nothing unusual. The other path required that if the fiscal period was not valid, then no data was to be written. This sounded simple enough, except the validation routine was a stored procedure.
I was asked by some attendees of my PASS 2013 Session, Unseen Minions : Improving parallel processing in SSIS, if I had any sample code or examples of some of the ways my framework could be used. I have put together 3 samples along with supporting sql code. You will find a link to that zip file here: Example Package.
I'm speaking at SSWUG Summer Camp! Thankfully, I can be at home, in my pool AND be at summer camp (oh, how I love modern technology!). If you have the time, come listen to me blather on about SSIS. http://www.sswug.org/vc
I am honored to say that have been selected to present this year. I'll be giving a talk on my threading framework for SSIS. Unseen Minions : Improving parallel processing in SSIS. I am very excited and hope to see you there!