How to recover from Large Volume Table Insert

We are inserting 1 Million rows into table using ODI IKM Append. If half the way thru the job fails because of tablespace or other issue, how to recover? Does 50% rows are commited to db? What is the best way to handle this type of situation?

You can have different options for this.. You can commit them in every 1000 rows in the KM.You can also set the dml operation into one transaction and commit the same at the end of step.
Try to follow load plan for better restart options. If you cann't provide more undo table space then try loading less amount of records lets say 1 to 100,000 and then 100,001 to 200,000 like this which is little bit complex but you have to sacrifice something to overcome the issue.
I believe you must have data in C$ and I$ step. Hence you process these data instead of loading again from original source. So it depends on you, how you are going to design the total process. You can better judge it. Talk with your dba about this issues as well.
Thanks
http://bhabaniranjan.com/

Similar Messages

How to query from the xml table a single, specified element.

I'm quite new in Xml Db. Pleas, can anybody tell me how to query from the xml table below a single element (i.e. the element 'rapportoparentela = NIPOTE' related to the element 'codicefiscale = CRRVNC76R52G337R', or the element 'rapportoparentela = FIGLIO' related to the element 'codicefiscale = CRRRNT51L23G337Q')?
- <dati xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<codiceinterno />
<codicefiscaleassistito>CRRMNL81R31G337H</codicefiscaleassistito>
- <famigliare>
<codicefiscale>CRRVNC76R52G337R</codicefiscale>
<rapportoparentela>NIPOTE</rapportoparentela>
</famigliare>
- <famigliare>
<codicefiscale>CRRRNT51L23G337Q</codicefiscale>
<rapportoparentela>FIGLIO</rapportoparentela>
</famigliare>
- <famigliare>
<codicefiscale>CBRPRN15S65E080W</codicefiscale>
<rapportoparentela>I.S.</rapportoparentela>
</famigliare>
- <famigliare>
<codicefiscale>CRRMNL81R31G337H</codicefiscale>
<rapportoparentela>NIPOTE</rapportoparentela>
</famigliare>
- <famigliare>
<codicefiscale>BCCCML54C50I845G</codicefiscale>
<rapportoparentela>NUORA</rapportoparentela>
</famigliare>
</dati>
Using SELECT extractValue(value(t),'/rapportoparentela') into result FROM NF_XMLT X,
TABLE ( xmlsequence (extract(value(X),'/dati/famigliare/rapportoparentela'))) t
I get all the elements 'rapportoparentela' and I want to get only one specified.
Regards.
Piero

Piero,
you can add the condition "CRRVNC76R52G337R" to your xpath-expression like:
SELECT extractValue(value(t),'/rapportoparentela')
FROM NF_XMLT x
,TABLE ( xmlsequence (extract(value(X),'/dati/famigliare[rapportoparentela="CRRVNC76R52G337R"]'))) tto select only those famigliare-elements that have a child-element rapportoparentela with value "CRRVNC76R52G337R".
When you stored your XML in an XMLType column in the table, i think the following queries are better:
SELECT extractValue(x.your_XMLType_column,'/dati/famigliare/rapportoparentela')
FROM NF_XMLT x
WHERE extractValue(x.your_XMLType_column,'/dati/famigliare/codicefiscale')
= 'CRRVNC76R52G337R'or
SELECT extractValue(x.your_XMLType_column,'/dati/famigliare/rapportoparentela')
FROM NF_XMLT x
WHERE existsNode(x.your_XMLType_column,'/dati/famigliare[codicefiscale="CRRVNC76R52G337R"]')
!= 0

How to recover from bad development of masterhead or layout or nav panel

Hi all:
I begin to modify framework of our portal, but I am new to it, my question is how to recover from bad development of masterhead or layout or nav panel, there is error in my development.
thank you very much for your reply

Hi,
ARe you able to access Content admin and system admin from your portal now?
What is the error its occuring.
Try to modify the rule collection to point to default desktop.
Best Wishes
Idhaya R

How to recover from disapled ipad

how to recover from locked ipad after wrong passwored trile

If you cannot remember the passcode, you will need to restore your device using the computer with which you last synced it. This allows you to reset your passcode and resync the data from the device (or restore from a backup).
If you restore on a different computer that was never synced with the device, you will be able to unlock the device for use and remove the passcode, but your data will not be present.
You may have to force iPad into Recovery Mode
http://support.apple.com/kb/ht1808

Large volume tables in SAP

Hello All,
Does any1 have the list of all large volume tables(Tables which might create a problem in select queries) present in SAP ?

Hi Nirav,
There is no as such specific list. But irrespective of the data in the table if you are providing all the primary key in the select query there will be no issue with SELECT.
Still if you want the highest size table check transaction DB02.
Regards,
Atish

How to recover from a bad upgrade due to a blackout, stuck in the recovery itunes screen on the iphone

how to recover from a bad upgrade, due to a blackout. stuck in the recovery itunes screen on the iphone

Bjpolinda,
Do you have a recent iCloud or iTunes backup? If so, just plug your phone into iTunes, restore the phone and bring your backup back by following the prompts on the phone.
If you didn't back up your phone before attempting to update, you may have lost all your photos and other data on your phone. If you restore the phone through iTunes, it will most definitely wipe your phone of all data and reset it to factory settings.
Emmons

How to convert from SQL Server table to Flat file (txt file)

I need To ask question how convert from SQL Server table to Flat file txt file

Hi
1. Import/Export wizened
2. Bcp utility
3. SSIS
1.Import/Export Wizard
First and very manual technique is the import wizard. This is great for ad-hoc and just to slam it in tasks.
In SSMS right click the database you want to import into. Scroll to Tasks and select Import Data…
For the data source we want out zips.txt file. Browse for it and select it. You should notice the wizard tries to fill in the blanks for you. One key thing here with this file I picked is there are “ “ qualifiers. So we need to make
sure we add “ into the text qualifier field. The wizard will not do this for you.
Go through the remaining pages to view everything. No further changes should be needed though
Hit next after checking the pages out and select your destination. This in our case will be DBA.dbo.zips.
Following the destination step, go into the edit mappings section to ensure we look good on the types and counts.
Hit next and then finish. Once completed you will see the count of rows transferred and the success or failure rate
Import wizard completed and you have the data!
bcp utility
Method two is bcp with a format file http://msdn.microsoft.com/en-us/library/ms162802.aspx
This is probably going to win for speed on most occasions but is limited to the formatting of the file being imported. For this file it actually works well with a small format file to show the contents and mappings to SQL Server.
To create a format file all we really need is the type and the count of columns for the most basic files. In our case the qualifier makes it a bit difficult but there is a trick to ignoring them. The trick is to basically throw a field into the
format file that will reference it but basically ignore it in the import process.
Given that our format file in this case would appear like this
9.0
9
1 SQLCHAR 0 0 """ 0 dummy1 ""
2 SQLCHAR 0 50 "","" 1 Field1 ""
3 SQLCHAR 0 50 "","" 2 Field2 ""
4 SQLCHAR 0 50 "","" 3 Field3 ""
5 SQLCHAR 0 50 ""," 4 Field4 ""
6 SQLCHAR 0 50 "," 5 Field5 ""
7 SQLCHAR 0 50 "," 6 Field6 ""
8 SQLCHAR 0 50 "," 7 Field7 ""
9 SQLCHAR 0 50 "n" 8 Field8 ""
The bcp call would be as follows
C:Program FilesMicrosoft SQL Server90ToolsBinn>bcp DBA..zips in “C:zips.txt” -f “c:zip_format_file.txt” -S LKFW0133 -T
Given a successful run you should see this in command prompt after executing the statement
Starting copy...
1000 rows sent to SQL Server. Total sent: 1000
1000 rows sent to SQL Server. Total sent: 2000
1000 rows sent to SQL Server. Total sent: 3000
1000 rows sent to SQL Server. Total sent: 4000
1000 rows sent to SQL Server. Total sent: 5000
1000 rows sent to SQL Server. Total sent: 6000
1000 rows sent to SQL Server. Total sent: 7000
1000 rows sent to SQL Server. Total sent: 8000
1000 rows sent to SQL Server. Total sent: 9000
1000 rows sent to SQL Server. Total sent: 10000
1000 rows sent to SQL Server. Total sent: 11000
1000 rows sent to SQL Server. Total sent: 12000
1000 rows sent to SQL Server. Total sent: 13000
1000 rows sent to SQL Server. Total sent: 14000
1000 rows sent to SQL Server. Total sent: 15000
1000 rows sent to SQL Server. Total sent: 16000
1000 rows sent to SQL Server. Total sent: 17000
1000 rows sent to SQL Server. Total sent: 18000
1000 rows sent to SQL Server. Total sent: 19000
1000 rows sent to SQL Server. Total sent: 20000
1000 rows sent to SQL Server. Total sent: 21000
1000 rows sent to SQL Server. Total sent: 22000
1000 rows sent to SQL Server. Total sent: 23000
1000 rows sent to SQL Server. Total sent: 24000
1000 rows sent to SQL Server. Total sent: 25000
1000 rows sent to SQL Server. Total sent: 26000
1000 rows sent to SQL Server. Total sent: 27000
1000 rows sent to SQL Server. Total sent: 28000
1000 rows sent to SQL Server. Total sent: 29000
bcp import completed!
BULK INSERT
Next, we have BULK INSERT given the same format file from bcp
CREATE TABLE zips (
Col1 nvarchar(50),
Col2 nvarchar(50),
Col3 nvarchar(50),
Col4 nvarchar(50),
Col5 nvarchar(50),
Col6 nvarchar(50),
Col7 nvarchar(50),
Col8 nvarchar(50)
GO
INSERT INTO zips
SELECT *
FROM OPENROWSET(BULK 'C:Documents and SettingstkruegerMy Documentsblogcenzuszipcodeszips.txt',
FORMATFILE='C:Documents and SettingstkruegerMy Documentsblogzip_format_file.txt'
) as t1 ;
GO
That was simple enough given the work on the format file that we already did. Bulk insert isn’t as fast as bcp but gives you some freedom from within TSQL and SSMS to add functionality to the import.
SSIS
Next is my favorite playground in SSIS
We can do many methods in SSIS to get data from point A, to point B. I’ll show you data flow task and the SSIS version of BULK INSERT
First create a new integrated services project.
Create a new flat file connection by right clicking the connection managers area. This will be used in both methods
Bulk insert
You can use format file here as well which is beneficial to moving methods around. This essentially is calling the same processes with format file usage. Drag over a bulk insert task and double click it to go into the editor.
Fill in the information starting with connection. This will populate much as the wizard did.
Example of format file usage
Or specify your own details
Execute this and again, we have some data
Data Flow method
Bring over a data flow task and double click it to go into the data flow tab.
Bring over a flat file source and SQL Server destination. Edit the flat file source to use the connection manager “The file” we already created. Connect the two once they are there
Double click the SQL Server Destination task to open the editor. Enter in the connection manager information and select the table to import into.
Go into the mappings and connect the dots per say
Typical issue of type conversions is Unicode to non-unicode.
We fix this with a Data conversion or explicit conversion in the editor. Data conversion tasks are usually the route I take. Drag over a data conversation task and place it between the connection from the flat file source to the SQL Server destination.
New look in the mappings
And after execution…
SqlBulkCopy Method
Sense we’re in the SSIS package we can use that awesome “script task” to show SlqBulkCopy. Not only fast but also handy for those really “unique” file formats we receive so often
Bring over a script task into the control flow
Double click the task and go to the script page. Click the Design script to open up the code behind
Ref.
Ahsan Kabir Please remember to click Mark as Answer and Vote as Helpful on posts that help you. This can be beneficial to other community members reading the thread. http://www.aktechforum.blogspot.com/

How to recover from datasource.getConnection hangover

Hi,
We have a standalone J2EE application wherein the app tries to restart itself in case of FATAL errors like connection loss etc.
Database: Oracle10g
Driver: oracle.jdbc.driver.OracleDriver
Issue: On error, the service tries to restart itself dueing which it aborts the connection and recreates the connection with datasource.getConnection().
In some cases during Soak testing, if the database goes down then the application seems to hang on datasource.getConnection() for almost 3 hours and greater.
Options we tried :
1. Use OracleDataSource and setLoginTimeout as 10 secs.
There seems to be no effect on the code. Not sure whether the datasource actually uses the timeout interval.
2. Use CONNECT_TIMEOUT_LISTENER=10 in listener.ora on the database server.
Does not seem to resolve the issue. getConnection still hangs.
Any suggestions what would be the best way to recover from this issue?

Hi,
The same should be available in the source system (DEV), Surprising how / why the same is available in BW system.
I checked the SAP ERP source system to which I have an access and the same is not available in the source system not in the BW system
My sugession is to go for a generic datasource after identifying the table with the help of functional consultant.
Regards
Venkata Devaraj

Select count from large fact tables with bitmap indexes on them

Hi..
I have several large fact tables with bitmap indexes on them, and when I do a select count from these tables, I get a different result than when I do a select count, column one from the table, group by column one. I don't have any null values in these columns. Is there a patch or a one-off that can rectify this.
Thx

You may have corruption in the index if the queries ...
Select /*+ full(t) */ count(*) from my_table t
... and ...
Select /*+ index_combine(t my_index) */ count(*) from my_table t;
... give different results.
Look at metalink for patches, and in the meantime drop-and-recreate the indexes or make them unusable then rebuild them.

How to read from an internal table with multiple key fields.

Hi All!!
I want to read from an internal table having keys as k1,k2,k3.
How can I use read statement to read an entry having this as the key fields.
Thanks in adavance..
Prabhas Jha

hi there
use:
sort itab by K1 K2 K3.
read table itab into wa with key K1 = value 1
                                              K2 = value2
                                              K3 = value 3
                                               BINARY SEARCH.
where:
itab is ur internal table
wa is the work area with the same line type as the itab
cheers
shivika

How to recover from a Crash

Hi,
I had the misfortune yesterday of having my OS X Lion operating system have a complete meltdown and become unrecoverable. Luckily, I had a time machine backup from the previous evening, so the sequence went something like this:
Boot with Command-R option to bring up the recovery options, selected recovery from time machine
Wait approx 2 hours....
All back - or is it???
Aperture's library is not backed up by Time Machine (I'm using referenced, so the images are fine). Luckily, I have a vault...
Point Aperture to the Vault
Recover recover recover.... waiting waiting....
Finished!
But wait! All the images now have a red stripe icon at the bottom right. Blast - I now have to locate referenced files. It appears that Aperture lost the links or doesn't recognise the locations because of the complete wipe and recover from backup
Locate referenced files, find a match, "Reconnect All". Done.
OH noes.... some didn't appear to reconnect. Checking - aha! THe vault is a couple of months old, and I did a big cull of useless images after updating the vault - the remaining unconnected images can safely be deleted from Aperture as they no longer exist.
Now to re-do the processing of the 30 images I was working on last night... (sigh...)
Lessons Learned:
1. Make sure Time Machine is working
2. Update your Vault regularly onto an external hard disk

I seem to recall that it was a recommended approach to stop huge Time Machine updates every time you touched Aperture.
Time machine now makes incremental backups of the Aperture Library - unless the library is in use by Aperture while Time Machine is running. It suffices to quit Aperture before backing up. That is what I do on my MBP.
Something else to note for the record: when you do a recovery and reinstall from Time Machine, Aperture perceives your reconstructed boot volume as a new volume, even though it has the same name and everything.
Exactly, but thankfully reconnecting is easy.
To restore a system I usually restore from a bootable clone. I regularly clone the system as a secondary backup.
Cheers
Léonie

How to recover from Oracle XA Error Native Error 24776?

Hello,
I believe that I have a connection leak somewhere and that an Oracle
connection is hung.
I get the following error when trying to access the data source
getConnection method.
How can I recover from this? The WL Server console shows 0 connections
to the connection pool, but obviously some are in there.
Thanks,
java.sql.SQLException: XA error: XAER_RMERR : A resource manager error
has occur
ed in the transaction branch start() failed on resource 'Oracle Connection
Pool': XAER_RMERR : A resource manager error has occured in the
transaction bra
nch
javax.transaction.xa.XAException: [BEA][Oracle JDBC Driver]Oracle XA
Error Occur
red. Native Error: 24776
at
weblogic.jdbcx.oracle.OracleImplXAResource.checkError(Unknown Source)
at weblogic.jdbcx.oracle.OracleImplXAResource.start(Unknown Source)
at weblogic.jdbcx.base.BaseXAResource.start(Unknown Source)
at weblogic.jdbc.jta.DataSource.start(DataSource.java:617)
at
weblogic.transaction.internal.XAServerResourceInfo.start(XAServerReso
urceInfo.java:1075)
at
weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerRe
sourceInfo.java:1007)
at
weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerRes
ourceInfo.java:203)
at
weblogic.transaction.internal.ServerTransactionImpl.enlistResource(Se
rverTransactionImpl.java:419)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1287)
at
weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1
250)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:385)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:343)
at
weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSour
ce.java:305)

Steven ,
It's already been answered:
http://groups.google.com/groups?hl=en&lr=&ie=UTF-8&c2coff=1&threadm=4009ccc9%241%40newsgroups.bea.com&rnum=1&prev=/groups%3Fq%3D24776%2520OracleImplXAResource%26hl%3Den%26lr%3D%26ie%3DUTF-8%26c2coff%3D1%26sa%3DN%26tab%3Dwg
Regards,
Slava Imeshev
"Steven Ostrowski" <[email protected]> wrote in message news:40ce1480$1@mktnews1...
Hello,
I believe that I have a connection leak somewhere and that an Oracle
connection is hung.
I get the following error when trying to access the data source
getConnection method.
How can I recover from this? The WL Server console shows 0 connections
to the connection pool, but obviously some are in there.
Thanks,
java.sql.SQLException: XA error: XAER_RMERR : A resource manager error
has occur
ed in the transaction branch start() failed on resource 'Oracle Connection
Pool': XAER_RMERR : A resource manager error has occured in the
transaction bra
nch
javax.transaction.xa.XAException: [BEA][Oracle JDBC Driver]Oracle XA
Error Occur
red. Native Error: 24776
at
weblogic.jdbcx.oracle.OracleImplXAResource.checkError(Unknown Source)
at weblogic.jdbcx.oracle.OracleImplXAResource.start(Unknown Source)
at weblogic.jdbcx.base.BaseXAResource.start(Unknown Source)
at weblogic.jdbc.jta.DataSource.start(DataSource.java:617)
at
weblogic.transaction.internal.XAServerResourceInfo.start(XAServerReso
urceInfo.java:1075)
at
weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerRe
sourceInfo.java:1007)
at
weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerRes
ourceInfo.java:203)
at
weblogic.transaction.internal.ServerTransactionImpl.enlistResource(Se
rverTransactionImpl.java:419)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1287)
at
weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1
250)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:385)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:343)
at
weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSour
ce.java:305)
[att1.html]

How to recover from RTSA71-55P6AU-XD003G-60UM03

Hello -
How do I recover from this 'Start Up' error:
RTSA71-55P6AU-XD003G-60UM03
When starting up normally or in Safe Mode, it stops frozen and hangs until a hard shutdown is implemented.
In safe mode start-up, the process stops at 'atipcie.sys'.
Any ideas?
- Dub
Compaq Presario CQ62-220US Notebook
This question was solved.
View Solution.

Hi,
For software damages, we may be able to recover data but for hardware damages, sometimes very hard to recover data and many times we can't recover at all.
Regards.
BH
**Click the KUDOS thumb up on the left to say 'Thanks'**
Make it easier for other people to find solutions by marking a Reply 'Accept as Solution' if it solves your problem.

How to recover from deletion of JSF Run-Time Support Library

While using the library manager to add a new library, we accidentally deleted the JSF Run-Time Support library. This was a big mistake as nothing works after doing this. Is there any way to recover from this gracefully and manually reconfigure this library back into the library manager? We have experimented with it on another system and found that we have to completely delete the user's preferences and then re-install JSC2 thus losing all the developer's environment which is quite a loss. We are sure it will happen again but we would like to find a more graceful recovery solution. This is a Windows environment.

You can recreate the library definition, but doing it using the library manager tool is not possible.
Close Creator. Inside your Creator user directory, create a file "jsfsupport-runtime.xml" in the directory
.Creator\2_0\config\org-netbeans-api-project-libraries\Libraries
Add the following content to the new file:
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE library PUBLIC "-//NetBeans//DTD Library Declaration 1.0//EN" "http://www.netbeans.org/dtds/library-declaration-1_0.dtd">
<library version="1.0">
    <name>jsfsupport-runtime</name>
    <type>j2se</type>
    <localizing-bundle>com.sun.rave.api.jsf.project.libraries.Bundle</localizing-bundle>
    <volume>
        <type>classpath</type>
        <resource>jar:nbinst:///modules/ext/jsfcl.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/jsf-impl.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/jsf-api.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/commons-beanutils.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/commons-collections.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/commons-digester.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/commons-logging-1.0.4.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/dataprovider.jar!/</resource>
        <resource>jar:nbinst:///modules/ext/appbase.jar!/</resource>
    </volume>
</library>Restart Creator. Note however that if you delete your .Creator directory, you will loose the library definition.
// Gregory

How to recover from network port configuration deletion (airport)

a couple of years ago, i accidently deleted the network port configuration for AirPort in the Show pop-up menu. No big deal, i thought at the time. I don't have an AirPort card and I won't be using AirPort in this computer. Ok, I now have an old-style AirPort card (powerbook G3 firewire, 10.2.8) and the AirPort utility doesn't see that it's installed. I realized right away, the network doesn't have a port... so the system doesn't see it, right? So, how do I get this port back? Do I have to reload a new System entirely and not save previous network settings... or is there an easier way to recover from my blunder?

Thanks Rob,
Glad to be here. Yeah, 10.2 works the same as 10.4. The problem with what you suggest is that I can no longer get airport as an option in Network port configs... so when I go to the new button all the other options are there EXCEPT AirPort. This is what I need to restore. I haven't checked, but I'm assuming I've nuked the pref panel out of the master library. So, I've messed up big time. I was looking for a way to recover that didn't involve reloading the whole system. This isn't like OS 9 and older where you can go and pick a little piece and stick it back into your system folder... I think. Thanks for the reply.

How to recover from Large Volume Table Insert

Similar Messages

Maybe you are looking for