Data Flow | XML Source | Very Slow with big files (over 1/2 a gig)

hi
I am trying to load a few XML files to a database. one of our proprietary systems load the file in 3-4 minutes however with ssis XML source file it takes over an hour.
can anyone know the reason/help with this?
I tried the delayValidation set to true with no success.
thanks
eddy
eddy.a

Parsing XML files as data sources in SSIS is not the most efficient. Remember that you have define a WSDL (aka structure of the input file) and once the XML source starts parsing the input file, it has to read every node at every level and make sure it conforms
to the structure defined in the WSDL file before it can start streaming the data out to the downstream components in your workflow.
A half-gig XML file with 150 nodes to parse is going to need some heavy-lifting behind the scenes before you start seeing the rows streamed out. I'd rather recommend that you use either inbuilt .Net classes for XML to parse and extract the data or leverage
SQL scripting to accomplish that. Alternatively, if your upstream system can instead drop the data feed in a flat file format, that'd be more preferable. And if you could hook into their data streaming APIs/end-points directly, that'll work too.
Hope this gets you started in finding the right approach.
- Muqadder.

Similar Messages

CS3 Still Very Slow with psd files

I'm still having terrible performance issues with CS3 and imported CMYK psd files containing spot colours. I have a 9MB psd file with two spot colours imported into a layer in Illustrator, with some illustrator line work on top. Just zooming in give me a 5 second screen redraw, everything is very sluggish and occasionally I get a crash. I still get these weird alert box saying "Generating Pixels" now and again when importing the psd files.
G5 Dual 2.0GHz, 2.5GB RAM, OSX 10.4.11, Illustrator 13.02, Photoshop 10.0.1.
I'm not having these issues on a different mac running CS2.

I'm thinking it might be RAM, I have Photoshop and Illustrator open at the same time. I have around 100GB of scratch disk space.
But weirdly the slowness is not apparent using CS2. Things are just dead slow with a Photoshop file placed in Illustrator CS3. These files are only 30MB, but contain 3 spot channels + CMYK. Even with preview mode switched off, it's still very slow and I mean everything slows down.
There is a lot of disk activity going on, so maybe my hard disks on this 3 year old mac are just getting too long in the tooth.
What drives me nuts is I remember doing the same kind of work in Illustrator 8 on a G4 running System 9 and everything was MUCH faster.
Oh, and I'd better not mention how fast Freehand was for this kind of work...

Query running very slow with db file sequential read waits which all indexes would be recommended

My query is doing lot of db file sequential reads I want to create few indexes and extended stats please help me with your suggestions.
Can anybody suggest I am unable to paste my query here -don't know why it's not getting pasted--is it not permitted ?
thank you.

The simplest way to find it out is using Oracle Enterprise Manager. Just locate the SQL ID for the SQL and run "SQL tuning advisor". This will exactly pinpoint where do you need to create indexes etc. Another option is manually running explain plan for the SQL and finding out which predicate is causing full scans with high i/o
Regards
Tushar

Quicktime very slow to load files over local network

I've had this issue before and managed to resolve it, but recently it's cropped back up and I've been unable to fix it.
If I attempt to load a movie file with Quicktime over my local network, Quicktime stops responding... it will eventually spring to life and open the video after a few minutes.
Before, I was recommended to install Perian and did so. That solved that issue immediately. However, in more recent releases of Quicktime, the issue has reappeared and even reinstalling Perian has done nothing.
Any insight?

BT FON is an open network that does not use wireless encryption, so it will be slightly faster anyway, however as your problem seems to be with your main SSID, its possible that there is some incompatibility between your wireless card, and the home hub.
Try changing the wireless encyption on the home hub to WPA only, and not WPA/WPA2. Some wireless cards do not like mixed mode encryption.
There may be an update to your wireless card drivers.
There are some useful help pages here, for BT Broadband customers only, on my personal website.
BT Broadband customers - help with broadband, WiFi, networking, e-mail and phones.

Tell me what is ******* going on!!!????! The time and date issues!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Every times I went to Apple store, the phone automatically works good time, but when I came back, my phone is working very slow with wrong time!

The time and date issues!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Every times I went to Apple store, the phone automatically works good time, but when I came back, my phone is working very slow with wrong time!
I want to get a new iPhone to replace this defective phone. I am gonna be crazzzzzzzyyyyyyyy with anger,!!!,!,,,! I takes2 hours to go to Regent street apple stores for three times!!!!!. It is a lot of transport fees !
PLz tell me why! How to deal with it !

Unless it's confirmed officially that your phone is defective, then you can ask for a replacement. Or you have to live with you. However you can trade it for a new one if you don't care the price drop.

My macbook pro is running very slow with some strange mouse and window movements. The trackpad is very unresponsive and when responding the cursor moves on its own and/or very erratically. When on safari the window suddenly zooms in or highlights words.

My macbook pro is running very slow with some strange mouse and window movements. The trackpad is very unresponsive and when responding the cursor moves on its own and/or very erratically. When on safari the window suddenly zooms in or highlights words and looks them up via dictionary. I currently have a wireless mouse connected and I am still having the same problems.
I fee like I may have a virus or my laptop is perhaps being accessed remotely. All of the sharing options are unchecked.
HELP PLEASE
Very worried!!

Try these in order testing your system after each to see if it's back to normal:
1. a. Resetting your Mac's PRAM and NVRAM
    b. Intel-based Macs: Resetting the System Management Controller (SMC)
2. Restart the computer in Safe Mode, then restart again, normally. If this doesn't help, then:
     Boot to the Recovery HD: Restart the computer and after the chime press and hold down the
     COMMAND and R keys until the Utilities menu screen appears. Alternatively, restart the computer and
     after the chime press and hold down the OPTION key until the boot manager screen appears.
     Select the Recovery HD and click on the downward pointing arrow button.
3. Repair the Hard Drive and Permissions: Upon startup select Disk Utility from the Utilities menu. Repair the Hard Drive and Permissions as follows.
When the recovery menu appears select Disk Utility. After DU loads select your hard drive entry (mfgr.'s ID and drive size) from the the left side list. In the DU status area you will see an entry for the S.M.A.R.T. status of the hard drive. If it does not say "Verified" then the hard drive is failing or failed. (SMART status is not reported on external Firewire or USB drives.) If the drive is "Verified" then select your OS X volume from the list on the left (sub-entry below the drive entry,) click on the First Aid tab, then click on the Repair Disk button. If DU reports any errors that have been fixed, then re-run Repair Disk until no errors are reported. If no errors are reported click on the Repair Permissions button. Wait until the operation completes, then quit DU and return to the main menu. Select Restart from the Apple menu.
     Reinstall the 10.9.2 update: OS X Mavericks 10.9.2 Update (Combo).
4. Reinstall Lion/Mountain Lion, Mavericks: Reboot from the Recovery HD. Select Reinstall Lion/Mountain Lion, Mavericks from the Utilities menu, and click on the Continue button.
Note: You will need an active Internet connection. I suggest using Ethernet if possible because it is three times faster than wireless.
Reinstall the 10.9.2 update: OS X Mavericks 10.9.2 Update (Combo).

Reading the data from XML Source

Hi
i want to read the data from XML source file, and update the transaction information to another XML file. how we can do this in ADF, please help
Thanks
nidhi

you may use normal Java API to do that
http://www.javablogging.com/read-and-write-xml/

Imac is very slow with downloading mail

My imac is the ast weeks very slow with downlaoading mail.
I am using mail 5.3 from apple
Nothing has recently been chanched in my internet setting or internet speed
Anybody an idea what can be wrong?

Hi, I worked out what you recommended, but I do not see any difference at speed.
Mail starts normal, though that is also somewhat slow,
Before it has finished downloading mail (even is there os no mail!) it takes sometimes 2 minutes!
Also there was no"boing"when starting up, with following your procedure, is it normal?

Facebook loading is very slow with nearly no images , i'm using mac

facebook loading is very slow with nearly no images , i'm using mac os x 10.8

i did it many times and the same problem exists

AE CS6 very slow with footage

Hi guys,
I am using AE Effects CS6 (11.0.4.2) on a new Macbook Pro with these specs:
2.8 GHz Intel Core i5
16 GB MHz DDR3
Intel Iris 1536 MB
The problem I am having is that when imported footage is visible as footage or a layer, AE becomes very slow with every click of the mouse on either the timeline or the footage in the viewer itself causing the color wheel to appear, often for 30 seconds at a time. Strangely, dealing with the composition has no issues.
Any ideas guys?
Thanks in advance

Try transcoding the footage to a production codec and see if that makes a difference.
Like, use the Adobe Media Encoder to make them something like QuickTime with the PhotoJPEG codec.
See if that helps with the performance.

I installed yesterday iCloud , since the performance the system is very slow with pinwheel at every clic

I installed iCloud yesterday, since the system is very slow, with pin wheel at every click
What can I do?

I would ask in the dedicated iCloud forum. Good luck. https://discussions.apple.com/community/icloud

Ftp.belnet.be mirror very slow with updates

The mirror that is closest to my location, ftp.belnet.be , seems to be very slow with updates for AL.
XFCE4 was updated to 4.2.3 around nov 10 on archlinux.org.
11 days later xfce4 4.2.2 is still on belnet , and not replaced by the new version.
Since it's also a fast and reliable server, i don't mind waiting a few days, but more than a week is TOO long.
What's the use of a bleeding edge distribution when you can't get updates that have been available for more than a week ?
For now, i have fallen back on archlinux.org , but will look for another european server.

In contrast with the name, that server doesn't seem to have ANY arch packages anymore.
:: Synchronizing package databases...
--00:34:46-- ftp://ftp.archlinux.de/pub/archlinux/cu … .db.tar.gz
=> `current.db.tar.gz.part'
Resolving ftp.archlinux.de... 134.109.132.98
Connecting to ftp.archlinux.de|134.109.132.98|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /pub/archlinux/current/os/i686 ...
No such directory `pub/archlinux/current/os/i686'.
failed to synchronize current
--00:34:47-- ftp://ftp.archlinux.de/pub/archlinux/ex … .db.tar.gz
=> `extra.db.tar.gz.part'
Resolving ftp.archlinux.de... 134.109.132.98
Connecting to ftp.archlinux.de|134.109.132.98|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /pub/archlinux/extra/os/i686 ...
No such directory `pub/archlinux/extra/os/i686'.
failed to synchronize extra
searching the site from the www page for pacman gave many results, but none of them were for AL's pacman.

Suddenly everything VERY slow with spinning rainbow. How to Fix ?

Suddenly everything VERY slow with spinning rainbow. How to Fix ?

Useful article here on the causes of the Spinning Beach Ball and how to troubleshoot it:
http://www.computerworld.com/s/article/9177479/Troubleshoot_the_spinning_beach_b all?taxonomyId=89&pageNumber=1
and also this:
http://www.thexlab.com/faqs/sbbod.html

TC VERY SLOW with backup

Suddenly, TC is VERY SLOW with backup. In fact, I went in and discovered that it had not completed a backup since July 19th. I started one last night and when I checked this morning (about 10 hours later) it was 70MB into a 2GB backup. An hour and a half later it was at 100MB and an hour after that it was at 125MB. At this rate, it's going to take a couple of days so I cancelled the backup (it then went into it's housekeeping routine of "cleaning up"). BTW, I had quit all applications before I started the backup and TC said I had 454GB of free space. I'm not running any AV software and I have OS 10.6.8 I'm on an Ethernet network to the TC (I also have Airport active - could that be an issue? It never was in the past)
Any ideas would be appreciated.

So...I may have panicked when I saw all of those empty folders in my Document folder...however, when stopping the backup to TC (the 'cleaning up' process of stopping took more than 2 hours), my folder contents showed up. I guess that process takes the file index pointers offline or something so I couldn't see file contents during the process. I then did a permissions repair and a verify on my hard drive.
But the bad news is that my Time Machine is still showing EMPTY! I currently running disc utility 'verify' on my TM backup volume (it says the projected time to complete is 3 days!!!) The disc utility says that there are 4,000,000 files in the backup volume - I just can't see them. When I ran Time Machine, it only has 'today' - no prior backups - even though Time Machine Preferences reports that the oldest backup is August 1, 2010 (one year ago) and that the last backup was July 19, 2011. They are not there.
I've seen some other posts like this, so I don't think I'm alone with this problem.
The good news is that all of my folders and files on my computer appear to be intact. The bad news is that previous Time Machine backups are not there (or they can't be seen - even though the 1TB backup volume is in fact half full).

My Ipad 2 is accessing is very slow with iOS 8.2

My Ipad 2 is accessing is very slow with iOS 8.2 . I am looking forward to see the best solution from apple.
<Re-Titled By Host>

8.1 is reportedly being released Monday. With any luck, that may resolve some issues.

Data Flow | XML Source | Very Slow with big files (over 1/2 a gig)

Similar Messages

Maybe you are looking for