Read package (xml) data

Hi, I am looking for help to read package data that is stored in xml format. I want to read (DTS:Property,DTS:ConnectionManager,DTS:Configuration,DTS:LogProvider,DTS:Variable,DTS:LoggingOptions) data into table, and package stored in c:\test.dtsx
Table columns - CREATE TABLE [dbo].[SSIS_Data] (
[packagename] varchar(50) NULL,
[taskname] varchar(50) NULL,
[tasktype] varchar(50) NULL,
[propertyname] varchar(50) NULL,
[propertyvalue] varchar(50) NULL,
[xml] varchar(1000) NULL, parentnodename varchar(50) NULL,childnodename varchar(50) NULL,level int )
level - It means task at which level.

Hi,
here you go , you might need to make some changes according to your requirements
http://sqlage.blogspot.com/2013/07/ssis-read-ssis-package-filedtsx-for.html
http://sqlage.blogspot.com/2013/12/ssis-how-to-get-error-column-name-in.html
thank you
Aamir
http://sqlage.blogspot.com/

Similar Messages

I'm trying to read some XML data from temperature logger over my network. I'm using LabView version 2009 sp1. I'm using the URL Get Document Vi. It works fine when using Internet sites like google or foxnews etc...

I'm trying to read some XML data from temperature logger over my network. I'm using LabView version 2009 sp1. I'm using the URL Get Document Vi. It works fine when using Internet sites like google or foxnews etc...
When I use it with my temperature logger most of the time I get an Error 66...but some times it does work and actually retrieves the document.
I can use the same address "http://172.22.21.68/XMLfeed.rb" (Internet Explorer or Google Chrome) in my browser and get a response every time. When accessing from my browser the server in the temperature logger does take around 6 seconds to respond, but it does respond every time.
Is the URL Get Document Vi exceeding a timeout? If so, where can I set it to wait longer?
Attachments:
Error 66.jpg ‏183 KB

It looks like the TCP Buffered Read has a 2.5 sec timeout, I believe that is where I had trouble as well. Try creating your own URL Get HTTP Doc vi in which you call URL Get Document in normal mode, with an appropriate number of characters to fetch (enough characters so that you capture all the important data in the XML file).
Attachments:
ex1.PNG ‏33 KB

How could we read the XML data from a table using BODS.

Hi Guys,
My requirement is , As the OLTP system consists of a table called person which consists of a column demographics. so how could i read this XML data which is in one column of an SQL table called persons. As this XML data will populate the remaining fields in my target using BODS.
Regards,
Amjad.

Hi Amjad,
I am afraid there ain't any direct method to extract XML field from a data base.
Indirect way could be converting the whole table (instead of one field) into XML format and then extract one field from it!!
Regards,
Mubashir Hussain

Read/get xml data (string)

Hi
I have a XML string that I get from a TCP transfer, I have attached a received string.
I have no experience in reading XML data, I have tried looking in the forums and some of the examples in LV, but I cannot get it to work, so I hope that someone could help me out. All I need to get from the XML data are the names e.g. Station1 and Station2 perhaps putted into a string array. If so it wouldn't hurt to get all the rest parameters and attributes as well. I thought about doing some string searches to get what I need, but thought again that it might be easier/better in some way to take advantage of the data being arranged as XML.
Hope that someone can help.
Thanks in advance
Best regards
Simon
LabVIEW 8.6 / 2009 / 2010
Vision Development Module 8.6 / 2009 / 2010
VBAI 3.6 / 2010
Attachments:
testmap.txt ‏1 KB

Hi all
falkpl wrote:
The easy way is if you know that this string is not changing much you treat it as a formated string and parse it using simple string functuions
ie first parse %s and %s The two slashes will cancle the escape clause of the string parser. Repete this process to get each station and attributes.
The harder way is to use an activeX or .net XML parser.
Paul
I am not sure what you mean about the parser, well I get the concept, but is there a specific string function that can do that for me?
I got something working with the Match Pattern vi, please the attached. This actually works for my current needs, but I still would be able to get data from more complex XML data.
Hi A.K. and J.K.
Thank you for the link.
EasyXML looks like a nice and handy tool for handling XML data. I ran in too some problems though when running the VI Package Manger. When I check the network for new packages it says that there was an error, please check the network connection or settings. I have internet connection (I am writing this post ) and I am not using a proxy server. What could be wrong and how do I install EasyXML then, is there another way?
Best regards
Simon
LabVIEW 8.6 / 2009 / 2010
Vision Development Module 8.6 / 2009 / 2010
VBAI 3.6 / 2010
Attachments:
my_get_xml_data.vi ‏15 KB

Read/write xml data from/to adobe livecycle forms (pdf)

Hello,
I need some help reading xml data from pdfs created by Adobe LiveCycle and also writing xml data back to the form.
The forms have been created using PROD LC 8.2 and in the future they will be created using PROD LC 9.5.
I am using Visual Basic .NET to access the data programatically.
Can anyone help me with some hints? A library, SDK? Any information would be very helpful.
I am quite new with this Electronic Forms issue and I do not even know where to start.
Thank you,
Ionel

Hi lonel,
Do you want an online solution?
I mean, it follows this workflow:
1. The user will open the PDF by clicking a link, and a server-side program will generate the PDF and prepopulate it with data from some data sources, and render the PDF to the client (Browser),
2. The user will fill the PDF.
3. The user will click a Submit button and save the PDF and Data on the server.
4. If the user wants to edit the Submitted Form, he will click a link to open the save PDF and possibly prepopulate some fields with data from other data sources, and complete the cycle of filling and saved the PDF and Data on the server.
5. While the user is filling the PDF (inside a Browser), there might be a need to perform some lookup on the server, and update the form parts accordingly as a result of the lookup process.
For 1-4 above, I have developed a complete base library using ASP.NET which helps you to perform the above.
You can goto my Google Workspace and you will find a bunch of documents, sample PDFs, collections and VB Classes. To best view them, login using some Google Account.
For point 4 above, one way to perform this effect, is to regenerate the required XML Data (which has the saved data before and the new lookup data), remerge the entire XML result with and empty PDF Form, and render the XFA (PDF Form) back to the client. But, if the PDF has one or more signatures, it will not work. So, in this case, you can update the Form Fields of a Saved PDF Form with new Data from the server, but the net effect is that you will have to loose all the signatures that were added on the PDF before.
For 5 (above) there are 3 methods:
1. Using a Web Service as a Data Connection. This is very easy if you have a traditional Web Service. I have used this method several times and will use it again if the need be. But, there is a problem. If the result of the Web Service is an Array of some Data, and you want to remerge the XFA to get the required effect after executing the web service ... and ... if there are some Drop-Down-List (DDL) fields, the bindings of the DDL Items of those fields will be lost. But, you can rebuild them (on enter event of the DDL Field) if you have saved them in the embedded XML Data.
2. You can update few (not many) fields while the PDF is opened (under the Browser via IFRAME) by passing the new field values using the URL Query String method. I have not done this, but I like this method, and I think it is cool. You need to write a server side code to ensure the the new filed values are passed back to the client using the correct URL with the Query String, and you need to write some javascript code inside the PDF to parse the URL and get the new field values and update them accordingly. See this as an example:
http://www.halnesbitt.com/pages/pdfqs.php
3. This method is very advanced and uses message communication ques between the Browser and the PDF (which is opened inside IFRAME element) using HostContainer object. This method will enable 2-way communication between the Browser and the PDF on the client side using javascript. I'd love to use this method one day. See example here:
http://www.windjack.com/WindJack/Browser2PDF/brwsr2acroJS.htm
I hope this will be of help to you.
Tarek.

Adobe Reader importing XML data using command line reference

Financial Gonverment in Poland prepared new VAT declarations, which are protected from changing.
Restrictions summary is as follows: Printing, Commenting, Filling of form fields: Allowed; other restrictions are not allowed.
I am able to export xml data, using Acrobat Reader, change it to have desired data and than import it and everything works fine. In ERP program I need to fill this document with data from the system. Normally we were doing this using FDF printing channel, but for this document it shows an error with bad user password. We were talking with people from government and only answer was that it is not possible to change document restrictions... We find out the way to create xml document, but we want it now to open from the command line (UNIX commands). But we only find the way to open pdf file with specified fdf file... But when I'm trying to open PDF document with specified fdf URL (url is linked to xml file... i don't know if it is proper... if not than how to create fdf file with desired xml?)
Is there any possible to open a pdf with specified xml url to load to that PDF?

I found the mistakes I made and I corrected them. The newly revised/corrected code is:
USE OPENXMLtesting1
GO
With XmlFile (Contents) AS (
SELECT CONVERT (XML, BulkColumn)
FROM OPENROWSET (BULK 'C:\Temp\books.xml', SINGLE_BLOB) AS XmlData
SELECT *
FROM XmlFile
GO
It worked: Results
Contents
1 <catalog><book.id="bk101"><author>Gambardella.M...
If I clicked on this, I got a listing of the whole book.xml!! I don't know what it means. Please comment and respond.
Thanks,
Scott Chang

Reading Large XML Data

We have a requirement where we need to read XML data sent from 3rd Party System and display in our OAF/ADF/Forms Page. Since there will be huge amount of XML data will be sent, we are looking for a convenient way of sending and receiving the data, by taking Performance under consideration.
Please suggest us, if you have worked on the similar lines.
Thanks,
Sowmya.

The only option is to use sax parser to parse xml file to fetch the data and then correspondigly, add it to your VO, which can then be used to display/posting data in DB.
If there is huge data, definately this process will have an impact on performance , but that you have to test, say you are showing 20 records on each page the performance may be ok,so u can show 20 records and then show next button to show next 20 records, this figure u can get.... once u test.
--Mukul

FM to read proxy xml data

Hi All,
Is there any FM or class-method to read XML proxy message for a given message id?
Scenario: An inbound interface coming from XI to ECC system using ABAP proxy method.While processing this inbound proxy it will trigger create another response outbound proxy message - where this should read inbound message and map few data back in outbound.
Question is -
How to read XML proxy message using message id? I would like to read this inbound proxy message data to map them back to outbound interface.
Hope am clear - let me know if you need further details.
Thanks
Manohar

Not very clear for me, but maybe it's because I don't know XI. I don't understand because in ABAP, the term "proxy" is an image of a web service, this image is created in the system from where we want to access the web service.
You use proxy and message terms too many times, I don't see where is what, where is the inbound, where is the outbound. What is a "message id" for you? (XI notion?)

SSIS XML Data Source - worked in BIDS, can't read XML in SSDT

I have an SSIS 2008 package built in BIDS (2008) that uses a series of XML locations (similar to
http://corpslocks.usace.army.mil/lpwb/xml.tonnage?in_river=AG&in_lock=42&in_mon_yr=092013) to get tonnage information and load it into a SQL Server 2008 R2 database. This has been running daily without error for over 60 days. I am now migrating
this to SSIS 2012 using SQL Server Data Tools and I am having difficulty reading the XML into the database.
The package does the following (it is pretty simple):
1. read the URLs (there are 200) from a database view into a variable object
2. a for each loop container that loops through the variable object, gets the data from each URL (the XML URL is stored as a variable) and loads it into the database
The BIDS package still works great. I first used the converter to migrate to 2012. I then recreated a package with exactly the same settings as BIDS. No dice either way. I also tried using a local xsd file, then using one inline. SSDT will recognize all
of the columns correctly when I use inline, but neither method is capable of reading the data into a table.
I know the package is going to the addresses, all of the URLs show up in the error logs. The error messages are as follows: "[Load data from tonnage url [47]] Error: The file "http://corpslocks.usace.army.mil/lpwb/xml.tonnage?in_river=AG&in_lock=42&in_mon_yr=092013"
was not found. Please verify the file path and try again."
Has anyone run into this and solved it? I think I have tried every possible setting available, with no luck. Any ideas or suggestions are appreciated. Thanks!

I have an update on this issue. I believe it is a connectivity issue or possibly a setting in SSDT.
I can access the remote XML file location through my browser. I have downloaded the XML from the remote location and my package runs using the local XML file perfectly. I have BIDS 2008 installed on the same machine and it works without a problem (using
the remote XML location). This last piece makes me think there is a network setting or something in SSDT.
Does anyone have any additional troubleshooting advice or other suggestions? My error output is included below.
Thanks!
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Error: 0xC020F440 at Data Flow Task, XML Source [31]: The file "http://corpslocks.usace.army.mil/lpwb/xml.lockqueue?in_river=GI&in_lock=01" was not found. Please verify the file path and try again.
Error: 0xC02090D0 at Data Flow Task, XML Source [31]: The XML Source was unable to read the XML data.
Error: 0xC0047019 at Data Flow Task, SSIS.Pipeline: XML Source failed the prepare phase and returned error code 0xC02090D0.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "ADO NET Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task

IXML - Checking if a specific node exists in XML data

Hi,
I´m reading XML data by using iXML classes. One XML file I´m reading contains header and
item data.
Right now I´m starting with reading the header attributes and then read all nested nodes and their attribute data. That works all fine, but now I had the error, that the XML file wrongly didn´t contain the items.
My XML reading method then ended up in a dump because the node was null:
l_node = l_iterator->get_next( ).
Can anybody give me an advice, how to check at the beginning of reading my xml data, if a specific node (in my case the node for items) exists in the XML data? If not, I want to stop with an error message. I want to check that at the beginning, before reading all element data, to keep my method structured.
Thank you very much!

Hi,
You can create a filter and set that filter to the iterator. If this is done the iterator returns you only the node with a specific node name or node ID.
You can also check the parsing in the following WIKI code gallery
https://wiki.sdn.sap.com/wiki/x/JoDmAQ
Subroutines create_set_filter_attribute and parse_xml_file would be helpful.

XML data output file in a directory needs to be published as a pdf report

Hi,
I have already got an XML output file in a directory.
I want to display it using RTF template using a concurrent program or some sort of java api in a pdf format to be able to print it.
How do I do it? Do I have to write another file output command to read the xml data line by line and output to BI publisher first?

Hi,
Hmm, one way is to just utl_file read the file and fnd_file.put_line(fnd_file.output) then close the file. Setup conc prog, rtf template, data definition and you're done.
But the main thing is that you get the XML file to $APPLCSF/$APPLOUT/oXXXXX.out where XXXXX is the request id. You could just setup host concurrent program and copy the file there!
Regards,
Gareth
Blog: http://garethroberts.blogspot.com/
Message was edited by:
gareth.roberts
Message was edited by:
gareth.roberts

Different xml data sources possible?

Ok, after searching the forum and google a lot, i figured out, that i can specify a data file in the formproperties. When i create some sample data, i get the structure the data has to look like (does it always have to look like these, or is it possible to change these things?).
But, what i'm still tryin' to figure out:
Is there a way, to get data for special items(textfields, tables, dropdownlists, ... ) from other sources, that i (perhaps) parse or read in an initialize event of of the items? I read a lot about a javascript DOMParser and the dataObject, but before i start try'n'error-coding these, i'd like to know if its worth the time?
Or is there any other way, i'm able to read any xml data (from a file) from within an event?
any help appreciated

today i tried the:
xfa.host.importData("./data.xml", false);
i get a "general exception" at this point, which tells me that the number of arguments is wrong. If i leave out the second argument (the "false" one), i get a "NotAllowedError" exception, which tells me that security preferences deny my attempt to use that function. Where can i configure this or what am i doing wrong?
(because this one is developing away from my original problem, i opened another thread ( http://forums.adobe.com/thread/514822 ) which describes my original issue more in detail)

Issue with creation of SSIS package - reading from XML

Good Morning,
having a slight difficulty here and more than this, am afraid solution is pretty straight forward. I am trying to read an XML-file and save the rows to a CSV file (late ron it should be sent to SQL-database).
Am having this input XML
<?xml version="1.0" encoding="utf-16"?>
<DataSet>
<xs:schema id="NewDataSet" xmlns="" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
<xs:element name="NewDataSet" msdata:IsDataSet="true" msdata:UseCurrentLocale="true">
<xs:complexType>
<xs:choice minOccurs="0" maxOccurs="unbounded">
<xs:element name="ROW">
<xs:complexType>
<xs:sequence>
<xs:element name="COLUMN" type="xs:short" minOccurs="0" />
</xs:sequence>
</xs:complexType>
</xs:element>
</xs:choice>
</xs:complexType>
</xs:element>
</xs:schema>
<diffgr:diffgram xmlns:msdata="urn:schemas-microsoft-com:xml-msdata" xmlns:diffgr="urn:schemas-microsoft-com:xml-diffgram-v1">
<NewDataSet>
<ROW diffgr:id="ROW1" msdata:rowOrder="0">
<COLUMN>1</COLUMN>
</ROW>
<ROW diffgr:id="ROW2" msdata:rowOrder="1">
<COLUMN>2</COLUMN>
</ROW>
</NewDataSet>
</diffgr:diffgram>
</DataSet>
but when running the SSIS-package, I get this
no errors are shown, but also no rows are written/processed.
Why is nothing read here?

by the way, when I split the schema and the XML data, having those 2 files
data.xml
<?xml version="1.0" encoding="utf-8"?>
<NewDataSet>
<ROW >
<COLUMN>1</COLUMN>
</ROW>
<ROW >
<COLUMN>2</COLUMN>
</ROW>
</NewDataSet>
schema.xsd
<?xml version="1.0"?>
<xs:schema attributeFormDefault="unqualified" elementFormDefault="qualified" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
<xs:element name="NewDataSet">
<xs:complexType>
<xs:sequence>
<xs:element minOccurs="0" maxOccurs="unbounded" name="ROW">
<xs:complexType>
<xs:sequence>
<xs:element minOccurs="0" name="COLUMN" type="xs:string" />
</xs:sequence>
</xs:complexType>
</xs:element>
</xs:sequence>
</xs:complexType>
</xs:element>
</xs:schema>
then result is fine

How to read XML data stored in CLOB in Concurrent prog Output

Hi All,
I'm trying to Generate the XML Data as concurrent Program output. I have a PL/SQL package which generated the XML data by using SQL/XML functions. I'm storing the generated XML data in a CLOB variable. But when i try to read the data using fnd_file.put_line(fnd_file.OUTPUT,XML_Data) it doesn't display data more than 32767 bytes.
Please help me out to understand what could be done to read the data in chunks. I have tried many logic's to print chunks of data but the output tags are either chopped off and errors out saying Tag not found.
My logic is as below:
v_handler:= DBMS_XMLGEN.newContext(v_xml_query);
--Sets NULL handling options
DBMS_XMLGen.SetNullHandling(v_handler, dbms_xmlgen.EMPTY_TAG ) ;
--Set special character handling
DBMS_XMLGEN.setConvertSpecialChars(v_handler, TRUE);
-- Specified whether to use an XML attribute to indicate NULLness of particular entity in the XML document
DBMS_XMLGen.useNullAttributeIndicator(v_handler,TRUE);
-- set Checking invalid chars
DBMS_XMLGEN.setCheckInvalidChars(v_handler, TRUE);
-- get the xml data as required
v_xml_data:= DBMS_XMLGEN.getXMLtype(v_handler);
SELECT XMLROOT(v_xml_data.extract('/*'),VERSION '1.0').getClobVal() into v_new_xml_Data from dual;
-- get the length of the xml generated
v_clob_len := dbms_lob.getlength(v_new_xml_Data);
FND_FILE.PUT_LINE(FND_FILE.LOG,'The Clob length is :'|| v_clob_len);
-- logic to process string more than 32767 Processing by each character
v_offset :=1;
while (v_offset <= v_clob_len)
LOOP
v_char := dbms_lob.substr(v_new_xml_Data, 1, v_offset);
IF (v_char = CHR(10))
then
fnd_file.new_line(fnd_file.output, 1);
else
fnd_file.put(fnd_file.output, v_char);
end if;
v_offset := v_offset + 1;
END LOOP;
FND_FILE.PUT_LINE(FND_FILE.LOG,'The offset is :'|| v_offset);
FND_FILE.NEW_LINE(FND_FILE.OUTPUT, 1);
THe above logic is for character by character which is a performance burden? Please let me know if there is any other work around for this

Hi,
Thanks for Replying. I have refered http://blog.oraclecontractors.com/?p=69 and then i added that piece of code. Basically, i'm trying to generate a report using XML publisher. To generate the XML data i'm writing a pl/sql package with SQl/XML functions. DBMS_XMLGEN would help me convert the XML Data as is. When the concurrent program runs this XML data will merge with RTF layout and generate required report. I'm able to generate the Report for data less then 32767 bytes. More than the limit i need to pass chunks of XML data to read as output. That's the reason i'm using fnd_file.output. But it reads only 32767 size at a time.
WHen i use the given logic, it works perfectly fine, but it loops for each character, for example if you have 30,000 characters it loops the same, which is peformance burden.
So i tried to write the logic of chunks but still i get the error that XML tag is not found or missing. I'm hoping this is very common issue, but after all my trails, i didn't find the right solution.
the other logic i tried was :
v_new_xml_data varchar2(32767)
v_iterations := CEIL(v_clob_len/v_chunk_length); -- v_chunk_length is 32767 and v_clob_length is length of the XML data stored inthe clob variable
For i in 0..v_iterations
LOOP
FND_FILE.put_line (fnd_file.log,'the loops v_pos :'||i||' and v_clob_length :'||v_clob_len);
v_new_xml_data := DBMS_LOB.SUBSTR ( V_XML_DATA,v_chunk_length,(i*v_chunk_length)+1);
FND_FILE.PUT_LINE (FND_FILE.OUTPUT,v_new_xml_data); -- read the output for every 32767 chunks
FND_FILE.PUT_LINE(FND_FILE.LOG, 'Chunk length is :'||((i*v_chunk_length)+1));
END LOOP;
FND_FILE.put_line (fnd_file.log,'out of loop');
FND_FILE.put_line (fnd_file.log,'length of new xml is '||v_clob_len);
Please, let me know if you need Further clarifications on the same.

Reading an XML file from package .....

I m trying to read an xml file from a package. The XML file is located on desktop (not on unix system). if i mention the path of the file in a package, is it sufficient ???. OR do i need to CREATE DIRECTORY in oracle and mention the file path in this directory ???
If not any suggestion or advice is great ???

Depends upon the version of Oracle being used. Going from memory, I think it started with 10g that you had to CREATE DIRECTORY and then use that object in references to disk. It could have been 9i as I skipped that version. If you look at the documentation for whatever provided procedure you are calling it will tell you what it expects.
As the code runs on the server the DB resides on, the data file will need to be network accessible from there in order for your code to read the file.

Read package (xml) data

Similar Messages

Maybe you are looking for