I am relatively new to the world of SQL Server Integration Services (SSIS). I knew sort of what it was and that it existed, but I didn’t start working with it and learning how to use it until about 3 years ago.
I started by following through the Stairway to Integration Services. This is a great way to jump start if you are just starting out. This program assumes you know absolutely nothing about SSIS and walks you through from beginner to a solid intermediate.
It was shortly after completing the Stairway that I began my first consulting job and was heavily working with SSIS. At this job, I was designing and maintaining packages that would grab FTP files, put the information from the files into a table, and push that information to production. Sometimes, they would also grab data from the database, place it in a flat file, and send that file via FTP or SFTP to a client.
This job was also a great way to start with SSIS. I wasn’t doing anything too complicated, and if I ever hit a snag, a quick google search would most likely bring me to a resolution.
It was also in this job, that I met my first “monolith” package. This was a package that was running for over 4 hours at a time and then timing out. The job was to move data from a MSSQL data source into a MySQL data source housed in AWS. My Dad and I worked together on this package and we were able to break it down into smaller chunks – 1 controller package, and a package for each step that needed to run. When we were finished, the whole project ran successfully in less than 18 minutes!