Variable(Dynamic) Header & Trailer in Flat File

Hi,
I am looking to create Header and trailer in flat file; What I am looking for is the best approach that is flexible to handle dynamic/variable header and footer for multiple systems needing header and footer (in different formats).
Thanks
Tushar

Package parameter indicating the environment and a DerivedColumn transform that generates a column with T or P depending on the parameter value.

Similar Messages

Dynamic Header Values in Flat File Destination

Hi,
I have to put 'T' or 'P' as part of a header in a flat file destination. The header is sourced via a work table which defines what the header looks like. One of the columns should contain 'T' for test or 'P' for production. When the package is executed in
the test environment, 'T' should appear as part of the header. When the package is executed in the production environment, 'P' should appear as part of the header.
Any ideas on how to achieve this is very much welcome.
Thanks,
AJ

Package parameter indicating the environment and a DerivedColumn transform that generates a column with T or P depending on the parameter value.

SSIS : How to create Column Header dynamically using expression in Flat File Source

Hi Team,
I need to keep configured Header Names for columns, Is there is any way to set each column name from expression? or is there is any other way?

Nope
But you could add a dummy row to your source to include column headers and then use options column headers in first row in flat file connection manager.
So suppose you've three columns column0,coulmn1,column2 and you want to make it as ID,Name,Datethen make source query as
SELECT 'ID' AS Col1,'Name' AS Col2,'Date' AS Col3, 0 AS ord
UNION ALL
SELECT Column1,Column2,Column3,1
FROM YourTable
ORDER BY Ord
then choose column headers in first row option
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Dynamic Column Names in Flat File Destination

Hello,
Inside a Data Flow Task, I have an ADO.Net data source which executes a stored procedure that provides results in 5 columns.
The requirement is to have it connect to a flat file destination, such that the column names is dependent on what data was pulled by the data source. There is a variable indicator which identifies the data that was pulled. For example:
If the indicator is 0, then the columns names will be A,B,C,D,E. Otherwise, if the indicator is 1, then column names will be V,W,X,Y,Z.
Any suggestions will be of great help.
AJ

If you only have two variations then use a branched execution (based on precedence constraints) and direct it to one DFT or another based on the result returned by the stored procedure.
Otherwise use .net
code to create one package or another dynamically.
PS: I suggest not to bother using SSIS for such a simplistic scenario.
Arthur My Blog

Variable Substitution for IDOC-XML-Flat File

Hello
I have a scenario where I need to populate the Idoc number into my file name. the Source is an Idoc and the Target is XML but the target is then converted to an Flatfile via a module in the processing sequence. When I try to use the variable sub method it errors out as the final target structure is a flat file and not the XML structure that I hav used in the graphical mapping. Any help on how I can go abut doing this will be greatly appreciate.
Thanks
Lavanya

IF I remove my adapter that converts the XML file to Flat file from the module sequence this works perfectly. So is there a way for me to now read the xml file for the target file name in variable sub. but still have the Flat file structure derived for the processing seq.

TO IGNORE A HEADER IN A FLAT FILE (SENDER) XI

Developing a solution XI in file-jdbc cenario and
the file is a flat file with header line and various
detail lines. I need to write the jdbc table ignoring
the header line of the flat file. How can We do this?
Someone can help me?
Thanks and regards,
Midervilson.

Hi Midervilson,
If you are using a content conversion based on key fields in the sender file adapter and if your header and details are differentiated by a key field then you can ignore them in content conversion itself. i.e say if your header is identified by a key field value '1' and details are identified by a key field value '2' then just configure your file content conversion details alone and your header will be automatically ignored.
Otherway you can achive this is using mapping. while mapping do not map your header from source to JDBC structure.
hope this helps...
Regards
Anand
Message was edited by: Anand Torgal

Dynamic header lins in downloaded file.

hello gurus,
i have Report. i am using that to download data from standard tables and custom tables. here i maitained fieldtables name as headerlines in downlaod files.
that means each file is downloading with fielad lables as like this
name age     place
a        20      Bangalore
b        21      Hyderabad
for above format i used GUI_DOWNLOAD FM in my report.I used perametes filename, fieldnames, datatab in that FM.
now my client is asking that the header lines should be generated dynamically
and english speaking colleague should get english headers a german speaking colleague the german headers.
That is my problem, please help me it is very urgent

Hello Hymavathi ,
this code i am using to doanload data with headers,now my client is asking that header should be generated dynamically.one more thing is english speaking colleague should get english headers a german speaking colleague the german headers.
Code here i used for download data into file 4.
c_path = p_path.
concatenate c_path 'STOER_4' into c_path separated by '\'.
            itab_headbemerk-LABLE = 'Meldung'.
             APPEND itab_headbemerk.
            itab_headbemerk-LABLE = 'Format'.
             APPEND itab_headbemerk.
             itab_headbemerk-LABLE = 'Bemerk'.
              APPEND itab_headbemerk.
          CALL FUNCTION 'GUI_DOWNLOAD'
            EXPORTING
            BIN_FILESIZE                    =
              FILENAME                        = c_path
             FILETYPE                        = 'DAT'
            APPEND                          = ' '
            WRITE_FIELD_SEPARATOR           = 'X '
            HEADER                          = '00'
            TRUNC_TRAILING_BLANKS           = ' '
            WRITE_LF                        = 'X'
            COL_SELECT                      = ' '
            COL_SELECT_MASK                 = ' '
            DAT_MODE                        = ' '
            CONFIRM_OVERWRITE               = ' '
            NO_AUTH_CHECK                   = ' '
            CODEPAGE                        = ' '
            IGNORE_CERR                     = ABAP_TRUE
            REPLACEMENT                     = '#'
            WRITE_BOM                       = ' '
            TRUNC_TRAILING_BLANKS_EOL       = 'X'
            WK1_N_FORMAT                    = ' '
            WK1_N_SIZE                      = ' '
            WK1_T_FORMAT                    = ' '
            WK1_T_SIZE                      = ' '
            WRITE_EOL                       = ABAP_TRUE
          IMPORTING
            FILELENGTH                      =
            TABLES
              DATA_TAB                        = itab_bemerkung[]
             FIELDNAMES                       = itab_headbemerk[]
Regards
Mahesh

Multiple Header Lines in Flat-File read by FileSenderAdapter

Hello XI and File Sender Adapter Species
We have the following file with fixed file lengths:
#H1 F1
#H2 F1
#H3 F1
#H4 F1
#H5 F1
#H6 F1
#D1 Field1 - Fieldn
#D2 Field1 - Fieldm
#D2 Field1 - Fieldm
#D1 Field1 - Fieldn
#D2 Field1 - Fieldm
#D2 Field1 - Fieldm
#F F1
Concrete example as follows:
#H1 150
#H2 ECH150_20070709_026745152.dat
#H3 20070709_1600
#H4 9.0
#H5 8712423010208
#H6 8712423009202
#MDDTD3 146307732 146202845 871687940006178374E70871687910000219120200707090032B 040235031             Noordkant               28         SINT ANTHONIS           5845EW                                   8716879000004871242300920287124230091962007070909550113533533                 8716948000010501000L
#MDDTD4 59664          E10
#MDDTD4 30180          E11
#MDDTD3 146309776 146202839 871694840030212726E70871694830000000309200707090031B 0411   8              Flierakkers             21         VROOMSHOOP              7681XV                                   8716948000003871242300920287124230091962007070909590113533515                 8716948000010503000L
#MDDTD4 3562           E10
#MDDTD4 2422           E11
#F6
This File Should be read via the File Sender Adapter and afterwards mapped into the following idoc structure:
IDOC-Type
ZUECH_010
Header Segment: H1, H2, H3, H4 , H5 ,H6
Detail1Segment: Field1, Field2 . Fieldn
Detail2Segment: Field1, Field2 . Fieldm
Detail2Segment: Field1, Field2 . Fieldm
Detail1Segment: Field1, Field2 . Fieldn
Detail2Segment: Field1, Field2 . Fieldm
Detail2Segment: Field1, Field2 . Fieldm
FooterSegment: Field1
Now my Questions:
1.     As far as I know it is not possible to configure in the filesender adapter 2 different Record sets? We need two record sets, one for the header lines whose occurrences are once per File and one for the detail lines? Does anybody know if this is possible?
2.     Any other ideas for a simple solution?
Thanks for a soon answer.
Regards Marlies

Thanks all very much for your answers:
The hint from Praveen was very helpful.
If possible we need a solution with the graphical mapping tool and as far as possible without UDF, because at the moment there is no java developer.
The file adapter now produces the following xml structure:
<ZUECH_0150>
<recordset>
    <H1>
     <KH1>#H1</KH1>
     <H1>150</H1>
    </H1>
    <H2>
     <KH2>#H2</KH2>
                   <H2>ECH150_20070709_026745152.dat</H2>
          </H2>
          <H3>
               <KH3>#H3</KH3>
               <H3>20070709_1600</H3>
          </H3>
          <H4>
               <KH4>#H4</KH4>
               <H4>9.0</H4>
          </H4>
          <H5>
               <KH5>#H5</KH5>
               <H5>8712423010208</H5>
          </H5>
          <H6>
               <KH6>#H6</KH6>
               <H6>8712423009202</H6>
          </H6>
          <MDDTD3>
               <KMDDTD3>#MDDTD3</KMDDTD3>
               <MDDTD3>146307732 146202845 </MDDTD3>
          </MDDTD3>
          <MDDTD4>
               <KMDDTD4>#MDDTD4</KMDDTD4>
               <MDDTD4>59664          E10</MDDTD4>
          </MDDTD4>
          <MDDTD4>
               <KMDDTD4>#MDDTD4</KMDDTD4>
               <MDDTD4>30180          E11</MDDTD4>
          </MDDTD4>
     </recordset>
</ ZUECH_0150>
I would prefer the following structure, because it fits exactly to the structure of the idoc.
That means the mapping is very simple:
<ZUECH_0150>
      <HEADER>
              <H1>150</H1>
              <H2> ECH150_20070709_026745152.dat</H1>
      </HEADER>
      <MDDTD3>
             <KMDDTD3></KMDDTD3>
             <MDDTD3>146307732 146202845</MDDTD3>
                <MDDTD4>
               <KMDDTD4>#MDDTD4</KMDDTD4>
               <MDDTD4>59664          E10</MDDTD4>
          </MDDTD4>
          <MDDTD4>
               <KMDDTD4>#MDDTD4</KMDDTD4>
               <MDDTD4>30180          E11</MDDTD4>
          </MDDTD4>
      </MDDTD3>
</ZUECH_0150>
Now my new questions:
1.     Is it possible to configure the file adapter to produce a xml structure which afterwards can be mapped with a simple graphical mapping into the idoc structure?
(I can live with the suggestion from Praveen, that the header information is in each recordset but only has content in the first one.)
2.     What about the MDDTD4? It is a substructure from MDDTD3. Is it possible to configure this in the file adapter?
Thanks a lot for your help and a soon answer.
Regards Marlies
Message was edited by:
        Marlies Nowotka
Message was edited by:
        Marlies Nowotka

How to create a dynamic SSIS package for multiple flat file destinations

Hi,
I have to create a ssis package which has single data flow task and inside that I have 23 source (sql- select * from - statements)- destination (flat files, 23 distinct) connection.
Now for each product I have to create separate SSIS package (i.e. if prod=abc then these read select * from abc_tables and 23 abc_ txt files)
I want to do it dynamically, means only single package and inside that variables will take select * values for each source-dest connection (so i believe 23 variables) and same for destination flat files.
Let me know. :)
ANK HIT - if reply helps, please mark it as ANSWER or helpful post

Sorry It seems you're contradicting yourself. you say I know my source and dest structure and the you're
asking all I want is to have a dynamic structure
what does that mean?
and reading your next sentence
I want to run a package for 5 products, instead of creating 5 ssis packages with 23 source- dest connection, I would
like to have one with only 23 source- dest connections
What I feel is what you're looking for is to have a looping structure to loop through each of the 5
products.
In that case what you could do is this
1. Create a object variable in SSIS
2. Use a Execute SQL Task to populate the variable with all available products (I think you'll have a master table for that). Set ResultSet property to Full ResultSet and then in ResultSet tab map Object variable to 0 th index
3. use a ForEachLoop container with ADO .NET recordset enumerator and map to object variable. Create a variable of datatype same as that of Product identifier field to get individual values out
4. Inside loop create your data flow task with 23 source destination connection. In the query part use a parameter for product field and map it to the variable containing product value to get only data for the product.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Header in flat file destination (ssis)

Hi
I am creating a header in the flat file destination which has some hard coded values and record count which will get its value from a variable assisgned to a row count transformation in the package.
There is no problem in hard coded value but when i try to get the value of record count, i always get zero.
This is how i am doing it.
In the flat file destination, when we open flat file destination editor, i hard code the values which i want in the HEADER itself right there in the editor.
For the record count, i go properties of the flat file and select expression. In the expression editor, in property, i am selecting 'HeaderRowDelimiter' and drag that variable in the expression box.
Let me know if there is any suggestion.
Thanks

The value of the rowcount is only known AFTER the Data Flow Task is completely finished... and there header is writen before that.
Here are some examples:
http://agilebi.com/jwelch/2008/02/08/adding-headers-and-footers-to-flat-files/
http://social.msdn.microsoft.com/Search/en-US/sqlserver?query=add%20header%20and%20footer%20ssis&rq=meta:Search.MSForums.ForumID(00e50af7-5f43-43ad-af05-d98b73c1f760)+site:microsoft.com&rn=SQL+Server+Integration+Services+Forum
Please mark the post as answered if it answers your question | My SSIS Blog:
http://microsoft-ssis.blogspot.com

How to split column wise into separate flat files in ssis

IN SSIS...
1.---->I have a sales table country wise regions like (india, usa, srilanka) ....
india usa
srilanka
a b
c
d e
f
so i want output like in
flat file1.txt has india flat file2.txt has usa flat file3.txt has srilanka
a b
c
d e
f
2.----->i dont know how many regions in my table....dynamically split into separate flat files ....
pls help me.....thank u

I think what you can do is this
1. Do a query based on UNPIVOT to get the data as rows instead of columns
For that you can use a query like this
IF OBJECT_ID('temp') IS NOT NULL DROP TABLE temp
CREATE TABLE temp
Country varchar(100),
Val decimal(25,5)
DECLARE @CountryList varchar(3000),@SQL varchar(max)
SELECT @CountryList = STUFF((SELECT ',[' + Column_Name + ']' FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME = '<SalesTableNameHere>' FOR XML PATH('')),1,1,'')
SET @SQL= 'SELECT * FROM <SalesTableNameHere> t UNPIVOT (Val FOR Country IN (' + @CountryList + '))p'
INSERT temp
EXEC (@SQL)
Once this is done you'll get data unpivoted to table
Then you can use a execute sql task with query like above
SELECT DISTINCT Country FROM Temp
Use resultset option as full resultset and store the result to an object variable
Then add a ForEach loop container with ADO enumerator and map to the object variable created above. Have variables inside loop to get inidvidual country values out.
Inside loop place a data flow task. Use a variable to store source query , make EvaluateAsExpression true for it and set Expression as below
"SELECT Val FROM Temp WHERE Country = " + @[User::LoopVariable]
Where LoopVariable is variable created inside loop for getting iterated values
Inside data flow task place a oledb source, choose option as SQL command from variable and map to the above query variable.
Link this to flat file destination create a flat file connection manager. Set a dynamic flat file connection using expression builder. Make it based on a variable and set variable to increment based on loop iteration
The core logic looks similar to this
http://visakhm.blogspot.ae/2013/09/exporting-sqlserver-data-to-multiple.html
dynamic file naming can be seen here
http://jahaines.blogspot.ae/2009/07/ssis-dynamically-naming-destination.html
Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue
Visakh
My Wiki User Page
My MSDN Page
My Personal Blog
My Facebook Page

How can I add a header to a text file without mapping? [Using only ID]

Hi Experts,
I am doing a scenario in which I want to add a dynamic header to a text file, due to the complications related to the structure, I dont want to create a message type, data type etc so I cant use mapping.
I want to do all the manipuations in Integration Directory itself.
Can you all please help me out in this?
Thanks in advance
Thomas

Hi Experts,
I am new to XI, so only elaborate answers would help me
This is the specific requirement i want;
There is a 'source text file' which is a collection of 1000+ records, I want to make a 'target file' which is a combination of 2 fields, one field will be the dynamically generated name [for the target file] and the other field will be the whole 'source file' content.
From the last response for my question, I understand the dynamic file generation part can be done using java mapping.
Is there anyway by which I can get in the whole content of the source file into a field in the target file?
Thanks in Advance
Thomas

Section Break conflicts with Dynamic Header in RTF which loads XML data

Hi,
I have dynamic header in my rtf file which loads data from XML generated by rdf file.
I have section break on start group of body. but it does not display dynamic header value. If i remove section break then it display dynamic header.
I have to display dynamic header and section break is also required there.
Please give me solution of this issue.
Regards
Farooq
Edited by: user8849418 on Jun 27, 2012 12:05 AM

flyeminent wrote:
However in my particular case, the dynamic list is not known until the user choose to view a table. Then move the call from the getter to the bean's action method.

Flat file formats

What are the flat files formats accepted for import and export in mdm?
How MDM recognize the document type/mapping to perform of incoming file (file name, folder) ?
What are the flat file format for export (delimited, structured, XML) ?
Does MDM handle Header in a flat file (import and export) ?
Does MDM handle several line definition in a flat file (import and export) ?

Hi Joesph,
Here are answers to your questions:
<b>Ans 1--></b> As previously told by adhappan ,you can import data using import manager from the following formats:
Access--Means From microsoft access
Excel -- From an excel file
ODBC--this is generally used to import data from a flat file.BY flat file i mean to say a tab comma seperated "csv " file or a ".txt "file.
Port--to import data from a port .In mdm, port actually refers to a directrory
XML--from an xml file
XML Schema-- this is used when you try to import data from a file whosr structure you have predefined in console using an xsd file.
<b>Ans 2--></b> we specify the file format while connecting to source by mentioning it in the <b>type</b> properties.and mapping is performed in the import manager in the map value tab.
<b>Ans 3--></b>When you import or export a flat file then data in the first line of file is considered as header.
<b>Ans 4 --></b> As i previously told ,MDM will handle header.
<b> Ans 5 --></b>MDM does not handle several line definition of header.
Hope it will help you.<b> Please remark if it really helped you</b>.
Thanks,
<b>Shiv Prashant Dixit</b>

Unix Flat File: Remove header and trailer and put in another file.

Hi,
I have Source Flat File placed on Unix Box with header and trailer.
I want to remove Header and Trailer and put in some other file and Data in another file.
I tried following command in unix its working.But not getting Header and Trailer in another file.
sed '1d;$d' input_source.txt > output_data.txt
also How will i use OS command for it in ODI.
Guide me.
Thanks
Ashwini

Hi Ashwini,
You can run OS commands in a package using an ODI Tool: OdiOSCommand.
It is also possible to execute OS commands in an ODI procedure using the Operating System or Jython technologies.
There should be some articles about this on metalink (http://metalink.oracle.com).
Thanks,
Julien

Variable(Dynamic) Header & Trailer in Flat File

Similar Messages

Maybe you are looking for