Post reply

Multicast for Variable Number of Output Files

  • November 14, 2007 at 10:52 pm

    #119472

    Hi there,

    I'm interested to get your thoughts on how one would go about splitting a data file into several separate data files, where the number of separate data files changes each time.

    For example, we have a data set containing all our referral companies. We need to send a separate file to each referral company detailing which records they have referred each month. As the referral companies go up and down each month, so too will then number of output files that need to be generated.

    Does this make sense?

  • November 23, 2007 at 7:01 pm

    #753721

    I suggest you try using the Export Column component. You will need to construct a single Derived Column of type Text containing the output rows + CR/LF delimiters, another Derived Column containing the output file name, which would include the Company Name/ID from the source row. Also set Allow Append to True. This component will then write the Derived Text column to the different files.

    Export Column is really intended for exporting blobs & unstructured text from the pipeline, but it can also do what you are looking for.

    Cheers

    Filet

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply