creating several Files for one table based on ROwCount with SSIS Package
-
Hi Experts!
I have a SSIS Package which is creating a flat file from a table in my db. and it works great.
but I have over 360,000 records in it. so the size of the file is 84M. I want to read from this file in my C# application and because of the size it gives me timeout. so I wonder if I can change my package to create more files with smaller size for one table.
any help would be appreciated.
Maryam
-
[font="Comic Sans MS"]
You can use conditional split to limit the recordset.
If you are using any surrogate key - like starting from 1..3000000 .. you can use that
or you have some other enumerated values on a column you can use that too..
[/font]
[font="Comic Sans MS"]--
Sabya[/font] -
maryam7756 (1/19/2010)
Hi Experts!I have a SSIS Package which is creating a flat file from a table in my db. and it works great.
but I have over 360,000 records in it. so the size of the file is 84M. I want to read from this file in my C# application and because of the size it gives me timeout. so I wonder if I can change my package to create more files with smaller size for one table.
any help would be appreciated.
Maryam
Can you post the code you use to read the file? If you are not reading the complete file in-memory then you should not have any issues reading this file.
---
SSIS Tasks Components Scripts Services | http://www.cozyroc.com/
-
This might help
http://consultingblogs.emc.com/jamiethomson/archive/2005/12/04/2458.aspx
-------------------------------------------------------------------------
Normal chaos will be resumed as soon as possible. :crazy:
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply