SSIS ETL Import XML into SQL Tables

HI,
I am trying to import the below shown sample file data into sql tables using SSIS. Could you please guide on how to import data 
Metadata={A=@RefID, B=CH_ERT_ID, C=CH_DATE_ADDED, D=CH_DATE_DELETED, E=CH_SOURCE_TABLE, F=CH_SOURCE_ID, G=CH_FIRST_NAME, H=CH_MIDDLE_NAME, I=CH_LAST_NAME, J=CH_NAME_SUFFIX, K=CH_BIRTH_DATE, L=CH_BIRTH_ORDER, M=CH_DEATH_DATE, N=CH_STREET_ADDRESS, O=CH_CITY,
P=CH_STATE, Q=CH_ZIP, R=CH_PHONE, S=CH_MOTHERS_MAIDEN_LAST, T=CH_MOTHERS_MAIDEN_FIRST, U=CH_GENDER}
Initial RefID CoDoSA Identity
ITBSQUVY3UD7M89W OysterID: ITBSQUVY3UD7M89W
Creation Date: null
Size: 1
CType: N
Persistant: false
Record 0: @RefID=source1.2, CH_DATE_ADDED=2014-05-27 12:05:00.87, CH_SOURCE_TABLE=sample, CH_SOURCE_ID=151001, CH_FIRST_NAME=xx, CH_LAST_NAME=xx, CH_BIRTH_DATE=2003-07-05 00:00:00.0, CH_STREET_ADDRESS=2478 S 13th st, CH_CITY=xx, CH_STATE=xx, CH_ZIP=xx CH_GENDER=F,
Input record: false, Current Traces: OID: ITBSQUVY3UD7M89W, RunID: 1, Rule: [@], Previous Traces: []
Merges: {}
StrToStr: []
NegStrToStr: []
T6RGLWXTUL7JT4LK OysterID: T6RGLWXTUL7JT4LK
Creation Date: null
Size: 1
CType: N
Persistant: false
Record 0: @RefID=source1.5, CH_DATE_ADDED=2014-05-27 12:05:00.87, CH_SOURCE_TABLE=sample, CH_SOURCE_ID=151015, CH_FIRST_NAME=xx, CH_MIDDLE_NAME=I, CH_LAST_NAME=xx, CH_BIRTH_DATE=2003-06-21 00:00:00.0, CH_STREET_ADDRESS=N128 W20158 HOLY HILL RD, CH_CITY=x, CH_STATE=x,
CH_ZIP=x, CH_GENDER=M, Input record: false, Current Traces: OID: T6RGLWXTUL7JT4LK, RunID: 1, Rule: [@], Previous Traces: []
Merges: {}
StrToStr: []
NegStrToStr: []

In your case the file needs to be transposed (rows to columns), likely you'll need to transform the data using a pre-processing step outside SSIS.
I suspect another option could be to load the file as a whole using a Flat File Source that defines a single large column (typically a DT_STR set to its max size, if the file sure fits in completely) and then you can use a Conditional Split Transform. to
take each row (based on lengths if fixed) and write to another file this time in tabular format.
Arthur
MyBlog
Twitter

Similar Messages

  • How to import XML into SQL Table

    Dear all,
    There are a lot of books about exporting data into XML format.
    Actually, how to use XML Documents? Sorry I am new that I ask such a question.
    What i think may be exchange or save data using xml. If so, How to import into MS SQL table? Do it need to do any mapping?
    Appreciate for your hints

    Are you sure you want to use XML with tables for this? No doubt importing XML into tables is useful for some specialized tasks, such as importing formatting information inside the XML itself, but for most of the familiar tasks that XML excels at, tables are neither necessary nor useful.
    In my (limited) experience, if the XML elements are well-differentiated, by which I mean different types of data have their own distinctive tags, then the special powers of XML can be exploited more fully using the more familiar tagged text, nested tags etc. in ordinary text frames using paragraph breaks, tab characters, etc. to achieve a suitably "tabular" finished appearance.
    If you must import XML into tables, I recommend Adobe's own PDF "Adobe InDesign CS3 and XML: A Technical Reference" availabe here:
    http://www.adobe.com/designcenter/indesign/articles/indcs3ip_xmlrules.pdf
    It sounds very daunting -- the words "technical reference" make me shudder -- but actually it's very readable and not very technical at all. Some nice pics and everything!
    Jeremy

  • Howto import XML into Excel table ?

    Hi,
    I asked this before in the Excel forums but received the suggestion that I ask here instead.  The question precis : How to ungrey the "Append new data to existing XML lists" checkbox so I can select it when importing XML data into an Excel
    spreadsheet.
    I have a local server which provides data in XML form and need to import successive reloads of the XML page into successive lines in an Excel spreadsheet.  I found the Excel help page entitled "How to use XML in Excel 2003" at http://office.microsoft.com/en-gb/excel-help/how-to-use-xml-in-excel-2003-HA001101964.aspx?CTT=1&origin=EC001022986
    which was useful in so far as permitting me to import the data using the XML Source task pane and mapping the elements I need from the XML source to columns in the spreadsheet.
    In order to append successive lines from the XML source page, as I understand it from the link I quoted,  I need to change the XML Map properties to "Append new data to existing XML lists".  However this checkbox is greyed out in the
    XML Map properties dialog box so I can't select it.
    Any ideas how I can achieve my aims here ?
    Thanks in advance,
    Mike

    Hi Mike,
    Thank you for contacting Office IT Pro General Discussions Services. 
    From your description, I understand that you tried to import XML into Excel table. You selected “Use the XML Source
    task pane” when opening the XML file, then you tried to check the option in the
    Map Properties window: "Append new data to existing XML lists". 
    However, this option is grayed out. If there is any misunderstanding, please feel free to let me know.
    I have checked the issue on my side but could not reproduce this issue. I suggest download the sample XML file as suggested on the page and test the
    issue again:
    http://www.microsoft.com/downloads/details.aspx?FamilyId=B4BD3283-AD0B-408D-9CE7-AB9C3537BBBB&displaylang=en
    If the problem does not occur with the sample XML file, this issue might occur as there are some problems with the XML you were using.
    If the problem also occurs in with the sample XML file, this issue might be related to some third-party software conflicts. I suggest checking this
    issue by starting Excel in the safe mode.
    Start the Office program in safe mode
    ==============
    1.      
    Click Start, point to All Programs, and then point to
    Microsoft Office.
    2.       
    Press and hold the CTRL key, and then click
    Microsoft Excel.
    If the problem does not occur in the safe mode, this issue might be related to some third-party add-ins in the Excel program, we can try to disable
    them. Normally, you could do the following to disable the conflict add-ins in your Excel program:
    Disable add-ins
    Click
    Tools > Options > 
    Add-in, click Go button in the Manage:
    Com-in Add.
    Check if there are any add-ins,
    clear the checkbox to disable them.
    Close the Office program and
    restart it.
    Add one check back each time to the list of Add-In,
    restart the Office program, and repeat the above procedure. Once the issue reappears again, we can determine which add-in causes this problem and then disable it.
    Please take your time to try the suggestions and let me know the results at your earliest convenience. If anything is unclear or if there is anything
    I can do for you, please feel free to let me know.
    Best Regards,
    Sally Tang

  • Can't Figure Out How To Import XML into a Table?

    HELP!
    I've been using InDesign for several years now... but everything Ive ever done has been basic one off layout concepts.
    I am working on a website for a musical theater actress and for her resume, Id like to make a PDF which lists in table format the show, theatre and role she had for each job.
    I could do this manually... but Id really like to learn how to just reuse the same XML data that I have for her website and import it into InDesign.
    I have looked at Adobe's help file, I have scoured the internet, and I still can't figure it out... I have done like the adobe support file says... and I cant seem to get the values I create in her resume xml file to show up in a table I create in InDesign.
    I even tried to simplify it for the learning process and did something as basic as an XML file that has 5 colors... couldnt even get that working.
    So could someone explain it to me like Im a 5 year old... how to take a XML file, import it, place it in a table and have the data actually show up in the table.
    thanks,
    brian

    Are you sure you want to use XML with tables for this? No doubt importing XML into tables is useful for some specialized tasks, such as importing formatting information inside the XML itself, but for most of the familiar tasks that XML excels at, tables are neither necessary nor useful.
    In my (limited) experience, if the XML elements are well-differentiated, by which I mean different types of data have their own distinctive tags, then the special powers of XML can be exploited more fully using the more familiar tagged text, nested tags etc. in ordinary text frames using paragraph breaks, tab characters, etc. to achieve a suitably "tabular" finished appearance.
    If you must import XML into tables, I recommend Adobe's own PDF "Adobe InDesign CS3 and XML: A Technical Reference" availabe here:
    http://www.adobe.com/designcenter/indesign/articles/indcs3ip_xmlrules.pdf
    It sounds very daunting -- the words "technical reference" make me shudder -- but actually it's very readable and not very technical at all. Some nice pics and everything!
    Jeremy

  • Importing Data into Sql Server 2012 from Excel Data

    Hi,
    I got errors like this when i am doing import data into sql server from excel Data. Can you please help us?
    - Executing (Error)
    Messages
    Error 0xc020901c: Data Flow Task 1: There was an error with Source - demotable$.Outputs[Excel Source Output].Columns[Comment] on Source - demotable$.Outputs[Excel Source Output]. The column status returned was: "Text was truncated or one
    or more characters had no match in the target code page.".
     (SQL Server Import and Export Wizard)
    Error 0xc020902a: Data Flow Task 1: The "Source - demotable$.Outputs[Excel Source Output].Columns[Comment]" failed because truncation occurred, and the truncation row disposition on "Source - demotable$.Outputs[Excel Source Output].Columns[Comment]"
    specifies failure on truncation. A truncation error occurred on the specified object of the specified component.
     (SQL Server Import and Export Wizard)
    Error 0xc0047038: Data Flow Task 1: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on Source - demotable$ returned error code 0xC020902A.  The component returned a failure code when the pipeline engine called PrimeOutput().
    The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
     (SQL Server Import and Export Wizard)

    Are you attempting to import into a newly made table or into an existing table? It looks like it's trying to insert data where it cannot be inserted (invalid column or lack of data size in your column).
    Try the following:
    1). In your excel sheet, highlight the whole sheet and make sure the cells are in 'text' form and try re-importing
    2). save the document as ms dos TEXT and import as a text document.
    3). double check your columns are correct for the data, for example if you have a column that has a string of 100 characters and your column is 'NvarChar(90)' - that might cause the error? Or just correct data type in your column
    3). If that doesn't work and you're inserting into a new table, try importing it as string first and writing a query to insert columns that should be float/integer or whatever. You may want to convert float texts to a 'bigint' first rather than string
    > float as that can cause problems if I remember correctly.

  • QUERY FOR INSERT INTO  SQL TABLE

    Hi all,
    i want to insert some records into SQL table but not SAP database table. This table is only present in SQL database &
    not present in SAP database.
      i want to write a program in SAP to update the SQL table(not present in SAP database). is it possible?
       if yes, plz give me the query for inserting records into SQL table.
    Regards

    Hello,
    working on the same issue:
    Try this:
    DATA : Begin Of XY Occurs 1000,
            id(15)    TYPE C,
            Name(50)  TYPE C,
            ArtNr(50) TYPE C,
            lieferant TYPE I,
         End Of XY.
    Fill this internal Table with the SAP-Table
    START Connection to your Database
      EXEC SQL.
          Connect TO 'TEST_FH'
      ENDEXEC.
      IF SY-SUBRC EQ 0.
        EXEC SQL.
        Set Connection 'TEST_FH'     " <-- this is defines with TCode dbco
        ENDEXEC.
        IF SY-SUBRC EQ 0.
        Else.
          " OUT_Msg = '... won't connect'.
          Exit.
        EndIf.  " Else IF SY-SUBRC EQ 0
      Else.
        " OUT_Msg =  'Error at Set Connection Test_FH'.
        Exit.
      EndIf.  " IF SY-SUBRC EQ 0
    ENDE  Connection to your Database
    START Insert your table XY to an external database
        Loop AT XY.
          Try.
           EXEC SQL.
               INSERT INTO stoff
               (id, name , artnr, lieferant)
               VALUES
               ( :XY-ID,  :XY-Name, :XY-ArtNr, :XY-Lieferant )
           ENDEXEC.
           COMMIT WORK AND WAIT.     " <=== Maybe VERY important
          CATCH cx_sy_native_sql_error INTO exc_ref.
              error_text = exc_ref->get_text( ).
              Concatenate 'Table-INSERT: ' error_text Into error_text.
              MESSAGE error_text TYPE 'I'.
          ENDTRY.
        ENDLoop.     " Loop AT XY     
    END   Insert your table XY to an external database
    START: Clear Connection
        EXEC SQL.
          DISCONNECT 'TEST_FH'
        ENDEXEC.
    END : Clear Connection
    Hope it works
    Best wishes
    Frank

  • Import XML into Essbase?

    Is it possible to import XML into Essbase or are we limited to flat files or Excel files? If XML is an option, can someone point me to some documentation?
    Thx!

    Essbase supports the following types of data sources only
    Text files (flat files) from text backups or external sources
    SQL data sources
    Essbase export files (export files do not need a rules file to load)
    Microsoft Excel files with the .XLS extension, Version 4.0 and higher
    Microsoft Excel files, Version 5.0 and higher (loaded only as client artifacts or files in the file system)
    Spreadsheet audit log files

  • How to delete the Table Contents before inserting records into SQL table ?

    Hello Experts,
            I have a scenario where in I have to Pick up some records from SAP RFC & insert into SQL table.
            i know how to do this scenario but the proble with this is before inserting we first have to ZAP the SQL table & insert a new records. One more twist is The Triggering is happening from SAP side with Sender RFC. If this would have been from SQL Side i could have written a Stored Procedure/ Trigger & could have called this before the SENDER JDBC communciation channel picks up the Triggering event from SQL side.
    So how to do this scenarioin XI, First deleting all the Records of SQL table & then inserting the new reocrds. without using the BPM.
    Regards,
    Umesh

    hi umesh,
    you can achieve this by writing SQL query in message mapping level..
    refer this link:
    http://help.sap.com/saphelp_nw04/helpdata/en/b0/676b3c255b1475e10000000a114084/frameset.htm
    regards.

  • I want to use the SQL Toolkit of NI and SQL Server as my databasis on a server. Do I need to install a client in each computer I want to handle the data into SQL tables or I need only a ODBC driver?

    I want to use the SQL Toolkit of NI and SQL Server as my databasis on a server. Do I need to install a client in each computer I want to handle the data into SQL tables or I need only a ODBC driver?

    You only need the ODBC driver on each computer. If you are distributing the SQL Toolkit app as an executable and do not install the whole toolkit on each computer, you'll need the SQL Toolkit support files. This is about a dozen files. You can get the list at http://digital.ni.com/public.nsf/websearch/b814be005f9da9258625658700550c75?OpenDocument.

  • Adding a link to an external file into SQL table

    I would like to add a link to an external file (picture stored on my local hard drive) into SQL table. Then use C# to query data from SQL table and export to Excel.  I got everything working ok except the link to external file. I would like to export
    this link to Excel and user can click on the link to open the file. How can I accomplish this? Thank you very much in advance for your help!

    In that case the Filetable feature could be of interest to you. With this feature the file can be part of the database, and still be accessible from tools outside SQL Server.
    I don't really have any good examples handy, but if anyone knows of a good blog post that could help Nhan, please feel free to add.
    Here is a link to the description in Books Online:
    http://msdn.microsoft.com/en-us/library/ff929144.aspx
    Erland Sommarskog, SQL Server MVP, [email protected]

  • Is it possible to import xml into Adobe Muse to populate content similar to InDesign?

    Is it possible to import xml into Adobe Muse to populate content similar to InDesign?

    The only way I see this would be possible is through using JS that you can insert using the Object -> Insert HTML option, you may grab the XML to HTML code from here - http://www.w3schools.com/xml/xml_to_html.asp
    In order to test this out, simply download the sample XML file from the following location - http://www.w3schools.com/xml/cd_catalog.xml and save it somewhere locally. Now add this file to your Muse project using File -> Add Files for Upload option, it would then appear within the Assets panel.
    Add the code to your page and update the path referencing the file cd_catalog.xml to assets/cd_catalog.xml. Now on previewing the page in browser, you should see the populated HTML from the XML.
    Thanks,
    Vinayak

  • Java error when importing info into a table

    Hi I am trying to import data into a table from a csv file. I Log into the Database via Oracle Enterprise Manager 10G. I then goto Administration and Import user file. I then give the username and password of the user on the Server. I choose my csv file and click next. I then Choose my Table and click next, this is when I get an error..
    500 Internal Server Error
    java.lang.ArrayIndexOutOfBoundsException: -128
         at oracle.sysman.emo.util.UIXDataSource.initialize(UIXDataSource.java:322)
         at oracle.sysman.emo.util.UIXDataSource.<init>(UIXDataSource.java:188)
         at oracle.sysman.emo.util.data.LoadPreviewDataDS.<init>(LoadPreviewDataDS.java:58)
         at oracle.sysman.emo.util.data.LoadBean.initPreviewDataTable(LoadBean.java:3002)
         at oracle.sysman.emo.util.data.LoadBean.validateFileFormatPage(LoadBean.java:1920)
         at oracle.sysman.db.util.data.LoadController.validatePage(LoadController.java:757)
         at oracle.sysman.db.util.data.LoadController.onSubmitForm(LoadController.java:707)
         at oracle.sysman.db.util.data.LoadController.handleGoto(LoadController.java:779)
         at oracle.sysman.db.util.DBJobController.handleEvent(DBJobController.java:821)
         at oracle.sysman.emSDK.svlt.PageHandler.handleRequest(PageHandler.java:376)
         at oracle.sysman.db.adm.RootController.handleRequest(RootController.java:169)
         at oracle.sysman.db.util.UtilControllerResolver.handleRequest(UtilControllerResolver.java:128)
         at oracle.sysman.emSDK.svlt.EMServlet.myDoGet(EMServlet.java:688)
         at oracle.sysman.emSDK.svlt.EMServlet.doGet(EMServlet.java:291)
         at oracle.sysman.eml.app.Console.doGet(Console.java:285)
         at oracle.cabo.servlet.UIXServlet.doPost(Unknown Source)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.ResourceFilterChain.doFilter(ResourceFilterChain.java:65)
         at oracle.sysman.emSDK.svlt.EMRedirectFilter.doFilter(EMRedirectFilter.java:101)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.EvermindFilterChain.doFilter(EvermindFilterChain.java:16)
         at oracle.sysman.db.adm.inst.HandleRepDownFilter.doFilter(HandleRepDownFilter.java:138)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.EvermindFilterChain.doFilter(EvermindFilterChain.java:20)
         at oracle.sysman.eml.app.ContextInitFilter.doFilter(ContextInitFilter.java:269)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:600)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:317)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:793)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.HttpRequestHandler.run(HttpRequestHandler.java:270)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].server.http.HttpRequestHandler.run(HttpRequestHandler.java:112)
         at com.evermind[Oracle Application Server Containers for J2EE 10g (9.0.4.1.0)].util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
         at java.lang.Thread.run(Thread.java:534)
    I do not get this error with other tables and this file only with this table. Any help would be greatly appreciated, let me know if more info is needed.

    Thanks that did work out for me. However, I am still curious why I am getting that message in the Enterprise Manager. Well I was able to upload my info into the database and it was a better solution too.

  • Having a problem importing xml into an indesign template.

    I am having a problem importing xml into an indesign template. The xml data is there and will populate the columns on the document but I am having problems matching styles, removing data that should not be mapped and importing repeated same fields but differnet data.
    Message me if this is something you can do quickly for a fee.

    Also you can check the following link
    [Reporting|http://devlibrary.businessobjects.com/BusinessObjectsXIR2/en/devsuite.htm]
    Regards,
    Tej

  • How to import data into taxonomy tables

    Hi ALL,
    Can anybody suggest to import data into taxonomy tables.Please send me any documentation related this.
    Regards,
    Ravi.

    Hi,
    I hope following URL may help you.
    Taxonomy Import:
    http://help.sap.com/saphelp_mdm550/helpdata/en/09/322ad42c864bf79892af2123525b6f/content.htm
    Importing Hierarchy:
    http://help.sap.com/saphelp_mdm550/helpdata/en/36/c4c97f96484f438c2d5c96171cdd6f/content.htm
    Importing Attributes:
    http://help.sap.com/saphelp_mdm550/helpdata/en/bd/f768fd70d945ee873712304127493b/content.htm
    Importing Attribute text Values:
    http://help.sap.com/saphelp_mdm550/helpdata/en/52/2086075c584d96be102512036b9c0c/content.htm
    Importing Attribute Links:
    http://help.sap.com/saphelp_mdm550/helpdata/en/26/17f916867344afbdfcf7d629035c83/content.htm
    Regards
    Nisha

  • How to import data into taxonomy tables and qualified tables

    Hi ALL,
    Can anybody suggest to import data into taxonomy tables and qualified tables, when is value mapping neccessary and  what is partitioning? and what is the use of that partioning?

    Hello rehman
    even i am facing same issue regading import of data in taxonomy table
    . can we do it through import manager.
    please provide me some details i will be very very thankful to u
    my email - [email protected]
    Thanks & regards
    Himanshu

Maybe you are looking for

  • Down or otherwise inactive web services

    I am using Weblogic 8.1 to generate a web services client that accesses a Microsoft .Net based web service. As you can imagine, the .Net webservice goes down all the time(we nicknamed it "Jerry Cooney"). When its down, the client app goes into a long

  • MW R12 - key upgrade steps clarification

    OS: RHEL4 x86 DB: 11.2.0.3 EBS Upgrade: 11.5.10.2 -> R12.1.1 MW: 2.20 <-> Process Step: Upg to Rel 12.1.1 <---> Product Family: Perform the Upgrade <-----> Task: Apply Preinstall Patches <------->Step 1-Check for critical pre-upgrade patches for Fina

  • Customize the Export option as ONLY in CSV format

    I designed the detail report which has 17585 rows and 52 columns, If I export the report in excel its taking long to download (7-10 Mins 148 MB Size with all formatting properties), where as in DATA CSV format its taking less than a min and the file

  • Screen is permanently black on my iMac 2011, need help

    Hi guys, I have an iMac 2011 21" and it works really great, I have bootcamped it for some games which also works great. But today I when I was rebooting to Windows after I had updated the Mac a problem occured. As the computer shut down in Mac mode t

  • How do I delete a custom function in SSHR?

    I have duplicated the seeded SS Vehicle Repository function and renamed it. I amended the OAFunc= in the HTML call to reflect the new name and pCalledFrom= parameter. Unfortunately, this is throwing up an error. Ideally, I would like to delete the fu