Post reply

multiple extraction

  • June 10, 2008 at 12:07 pm

    #125812

    Hello ,

    I am new to SSIS, sorry for stupid or simple question.

    Here is the scenario,

    Everyday 20 files need to be extracted from source(txt) to staging table ( SQL) everyday. Initial name of the source remains same every day but final part changes. For eg: for today , product.1234.txt but tomorrow it might be product23456.txt. Most probably column name is always same. I already created 20 staging table.

    Here are my question ( any output would really appreciated)

    1. Do I need to make 20 different package to load each file? Then after making 20 package can i combine them in Master package? Or is there any other way?

    2. Since final part of the source name keeps on changing , how to handle this situation when defining source?

    3. After sucessful extraction, I want to insert count of no of rows for source and destination in audit table. I am able to insert no of rows for source by using row count information but how to insert no of rows for destination. ( I am using execute SQL task).

    4. I want to run master package after we received file, Can I use WMI watcher for this , or is there any other way?

    5. What should I do not to fail package even if we didn't receive certain files certain day?

    6. Is there any method of knowing , if Coulmn name changes in files? and sent notification.

    Thanks

  • June 10, 2008 at 8:28 pm

    #827037

    If the files are all in the same folder, you can use a for each loop to process them one at a time. It lets you put the file name in a variable so your flat file connection can point to it.

    Once the file name is in a variable, you can extract parts of it if you wish such as the part name.

    Do all the files have the same format?

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply