what are the ways to do incremental loading

  • hi everyone..

    I want to do incremental loading,we have millions of records,so lookup ,conditional split may take long time,is there any better way to do incremental loading,performance should be good.please give better solutions,it will be helpful to me.waiting for your replies..

    regards..

    anil

    Regards..
    guru12

  • [font="Comic Sans MS"]

    This will help you. See here![/url]

    [/font]

    [font="Comic Sans MS"]--
    Sabya[/font]

  • Hi Sabya..

    Thank you for your suggestion,and i have another query.

    How to do incremental loading for each table,source and destiantion i can configure but what about the lookup table.

    Is there any better way not using diffetent data flow task for each table.please suggest it will be helpful

    Regards..

    Anil...

    Regards..
    guru12

  • Anil,

    Unfortunately, you will require a seperate DFT for each of your transformation.

    Raunak J

  • hi raunak..

    Thanks for your help

    Regards..

    Anil...

    Regards..
    guru12

  • Anil,

    Just to decrease the overload of multi-package execution you ay choose to Set the RetainSameConnection to True for your OLEDB/ADO.NET connection to increase performance, considerably.

    Hope this helps!!!:-):-):-)

    Raunak J

  • Hi Anil,

    The MD5 checksum will look after that..because if any alteration is made the checksum value will be changed.

    Raunak J

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply