Roll back data load
Hi All,
I am using essbase 7.1.5. Is there any way to rollback the database in case if it finds any error. For example if source file (Flat file) contains 1000 records where at 501 record essbase found an error and has rejected that record (501) and aborted the load. In this case is there a way to rollback the database before loading the 500 records.If so where should i do those settings?? Please advice.
Thanks in advance.
Hari
A 6 Hour data load? I've never heard of such a thing. It sounds like the data should be sorted for a more optimum dataload to me.
As for the two stage approach, this assumes that you are loading variances (delta's) to the existing values, rather than replacing the data itself. It further assumes that you can create an input level cube to handle the conversion. You have your base data in one scenario, and your variances/delta's in another. You can reload your delta's (as absolutes) any time, and derive the absolutes from the sum of the base and variance values.
- Scenario
-- Base (+) <--- this get's recalculated when the Delta's are considered "good"
-- Delta (+) <--- this get's loaded for changes only, and reset to zero when the base is recalculated.
You export the modified data from this cube to your existing/consolidation cube. If you can "pre-load" the changes (outside of your calc window for the main cube), you can optimize the calculation window -- although if it takes 6 hours to load the database your calc window is probably shot no matter what you do.
However, if you mean that the load AND calc takes 6 hours, and it takes a relatively short time to load the data alone, this can be a performance enhancement because you can recalc this "input cube" in seconds from a new/complete load relative to the "in place" reset and reload changes approach (in your existing cube).
You are simply redirecting your data into a staging table, essentially, and the staging table handles the conversion of variances to absolutes so you can make the process more efficient over all (it is often more efficient to break the process up into smaller pieces).
Similar Messages
-
Time taken to roll back a failed transaction
One of our customers has reported that a batch transaction, which takes about 3 hours to complete, failed after 2 hours and took 14/16 hours to roll back.
Is there a rule of thumb guideline available which can predict the time taken to roll back. Does it depend upon time the transaction was running before it failed and the size of roll back data created in rollback segment.
Thanks
CheemaThis is supplement to the original question.
Will there be a significant difference between time taken to roll back in the following two situations :
1) failure is detected by the transaction and an explicit rollback statement is issued by the stored procedure performing the transaction.
2) Connection to oracle is lost and DBA kills the session
Cheema -
Data Services job rolling back Inserts but not Deletes or Updates
I have a fairly simple CDC job that I'm trying to put together. My source table has a record type code of "I" for Inserts, "D" for deletes, "UB" for Update Before and "UP" for Update After. I use a Map_CDC_Operation transform to update the destination table based on those codes.
I am not using the Transaction Control feature (because it just throws an error when I use it)
My issue is as follows.
Let's say I have a set of 10,000 Insert records in my source table. Record number 4000 happens to be a duplicate of record number 1. The job will process the records in order starting with record 1 and begin happily inserting records into the destination table. Once it gets to record 4000 however it runs into a duplicate key issue and then my try/catch block catches the error and the dataflow will exit. All records that were inserted prior to the error will be rolled back in the destination.
But the same is not true for updates or deletes. If I have 10000 deletes and 1 insert in the middle that happens to be an insert of a duplicate key, any deletes processed before the insert will not be rolled back. This is also the case for updates.
And again, I am not using Transaction Control, so I'm not sure why the Inserts are being rolled back, but more curiously Updates and Deletes are not being rolled back. I'm not sure why there isn't a consistent result regardless of type of operation. Does anyone know what's going on here or what I'm doing wrong/what my misconception may be?
Environment information: both source and destination are SQL Server 2008 databases and the Data Services version we use is 14.1.1.460.
If you require more information, please let me know.Hi Michael,
Thanks for your reply. Here are all the options on my source table:
My Rows per commit on the table is 10,000.
Delete data table before loading is not checked.
Column comparison - Compare by name
Number of loaders - 1
Use overflow file - No
Use input keys - Yes
Update key columns - No
Auto correct load - No
Include in transaction - No
The rest were set to Not Applicable.
How can I see the size of the commits for each opcode? If they are in fact different from my Rows per commit (10,000) that may solve my issue.
I'm new to Data Services so I'm not sure how I would implement my own transaction control logic using a control column and script. Is there a guide somewhere I can follow?
I can also try using the Auto correct load feature. I'm guessing "upsert" was a typo for insert? Where is that option?
Thank you very much!
Riley -
I have an older iPhone (3gs) and need to upgrade to a newer phone (4S). I need to get my NOTES, CALENDAR, CONTACTS, PICTURES, etc backed up on iTunes so I can get that data loaded onto the new phone. But not sure how to do that. When I open iTunes it has a button that say "Back Up iPhone", but I'm not sure what that does. When I go into the sync options it say I have another user account and asks me if I want to merge of replace. I'm assuming it's trying to tell me I have an older iTunes Library, but don't know that. Geez, maybe people over 60 shouldn't have iPhones, iTunes just bafles me.
http://manuals.info.apple.com/en_US/iphone_user_guide.pdf
-
After updating my Apple TV, it will no longer load movies from my iTunes library. Music works, but no movies. I've turned this puppy every which way but loose, but no joy. Is there a way to roll back an update?
Greetings,
I've never seen this issue, and I handle many iPads, of all versions. WiFi issues are generally local to the WiFi router - they are not all of the same quality, range, immunity to interference, etc. You have distance, building construction, and the biggie - interference.
At home, I use Apple routers, and have no issues with any of my WiFi enabled devices, computers, mobile devices, etc - even the lowly PeeCees. I have locations where I have Juniper Networks, as well as Aruba, and a few Netgears - all of them work as they should.
The cheaper routers, Linksys, D-Link, Seimens home units, and many other no name devices have caused issues of various kinds, and even connectivity.
I have no idea what Starbucks uses, but I always have a good connection, and I go there nearly every morning and get some work done, as well as play.
You could try changing channels, 2.4 to 5 Gigs, changing locations of the router. I have had to do all of these at one time or another over the many years that I have been a Network Engineer.
Good Luck - Cheers,
M. -
Error message after downloading and install rolled back (using up data limit)
error message after completing install of trial. then program was rolled back. I do not appreciate using up data allotment unnecesarily, people.Thanks for any assistance.
Rhumsike which Adobe software or service are you trying to install? Also which operating system are you using? Finally what is the error message which you are receiving?
-
DATA LOAD ISSUE /NO ROLL UP MEMORY
Hello Team,
I have this master data load failure for FIS_BELNR. The problem which I think that everytime it tries to load it runs out of internal table space in the backend. I really don't know what it means. This data is been failing everyday because of the same problem.
I have attached all the screen shots and ABAP short dump analysis screen shots as well. One can read in details why is it failing it tells exactly what the problem is , but how to fix it.
Any more details needed please let me know.
ABAP runtime errors TSV_TNEW_BLOCKS_NO_ROLL_MEMORY
Occurred on 25.10.2007 at 02:53:55
>> Short dump has not been completely stored. It is too big.
No roll storage space of length 2097424 available for internal storage.
What happened?
Each transaction requires some main memory space to process
application data. If the operating system cannot provide any more
space, the transaction is terminated.
What can you do?
Try to find out (e.g. by targetted data selection) whether the
transaction will run with less main memory.
If there is a temporary bottleneck, execute the transaction again.
If the error persists, ask your system administrator to check the
following profile parameters:
o ztta/roll_area (1.000.000 - 15.000.000)
Classic roll area per user and internal mode
usual amount of roll area per user and internal mode
o ztta/roll_extension (10.000.000 - 500.000.000)
Amount of memory per user in extended memory (EM)
o abap/heap_area_total (100.000.000 - 1.500.000.000)
Amount of memory (malloc) for all users of an application
server. If several background processes are running on
one server, temporary bottlenecks may occur.
Of course, the amount of memory (in bytes) must also be
available on the machine (main memory or file system swap).
Caution:
The operating system must be set up so that there is also
enough memory for each process. Usually, the maximum address
space is too small.
Ask your hardware manufacturer or your competence center
about this.
In this case, consult your hardware vendor
abap/heap_area_dia: (10.000.000 - 1.000.000.000)
Restriction of memory allocated to the heap with malloc
for each dialog process.
Parameters for background processes:
hat can you do?
ry to find out (e.g. by targetted data selection) whether the
ransaction will run with less main memory.
f there is a temporary bottleneck, execute the transaction again.
f the error persists, ask your system administrator to check the
ollowing profile parameters:
ztta/roll_area (1.000.000 - 15.000.000)
Classic roll area per user and internal mode
usual amount of roll area per user and internal mode
ztta/roll_extension (10.000.000 - 500.000.000)
Amount of memory per user in extended memory (EM)
abap/heap_area_total (100.000.000 - 1.500.000.000)
Amount of memory (malloc) for all users of an application
server. If several background processes are running on
one server, temporary bottlenecks may occur.
Of course, the amount of memory (in bytes) must also be
available on the machine (main memory or file system swap).
Caution:
The operating system must be set up so that there is also
enough memory for each process. Usually, the maximum address
space is too small.
Ask your hardware manufacturer or your competence center
about this.
In this case, consult your hardware vendor
bap/heap_area_dia: (10.000.000 - 1.000.000.000)
Restriction of memory allocated to the heap with malloc
for each dialog process.
arameters for background processes:
Error analysis
The internal table "IT_62" could not be enlarged further.
You attempted to create a block table of length 2097424 for the internal
table "IT_62". This happens whenever the OCCURS area of the internal table
is exceeded. The requested storage space was not available in the roll
area.
The amount of memory requested is no longer available.
How to correct the error
Please try to decide by analysis whether this request is
reasonable or whether there is a program error. You should pay
particular attention to the internal table entries listed below.
The amount of storage space (in bytes) filled at termination time was:
Roll area...................... 2595024
Extended memory (EM)........... 2001898416
Assigned memory (HEAP)......... 1886409776
Short area..................... 16639
Paging area.................... 24576
Maximum address space.......... "-1"
If the error occurred in a non-modified SAP program, you may be
able to find a solution in the SAP note system.
If you have access to the note system yourself, use the following
search criteria:
"TSV_TNEW_BLOCKS_NO_ROLL_MEMORY"
"SAPLZ_BW_EXTRACTORS " or "LZ_BW_EXTRACTORSU24 "
"Z_BW_AP_GL_BELNR"
If you cannot solve the problem yourself, please send the
following documents to SAP:
1. A hard copy print describing the problem.
To obtain this, select the "Print" function on the current screen.
ThanksHello,
The memory of your internal table wants beyond the system configured threshold.
Decrease your package size or extend the mentioned parameters (basis task):
ztta/roll_area (1.000.000 - 15.000.000)
Classic roll area per user and internal mode
usual amount of roll area per user and internal mode
ztta/roll_extension (10.000.000 - 500.000.000)
Amount of memory per user in extended memory (EM)
abap/heap_area_total (100.000.000 - 1.500.000.000)
Regards, Patrick Rieken -
2.1 EA1: Unable to roll back changes in Data tab [fixed EA2]
Hi,
With "Post edits on row change" set, any changes made in a table's Data tab cannot be rolled back.
When trying to do so, the screen flashes briefly, which would indicate reloading, but the changes are still there. The tab's title is also still cursive and you're prompted to save the changes on closing the tab. When answering no, the tab is closed, but on reopening the changes are still there and sqldev doesn't recognize them anymore as posted!
The only way to get the original contents back is to exit and restart sqldev all together.
Please confirm and log as bug,
K.1. Have post-on-row-changes ON. Set-Auto-commit-ON OFF
2. Update data in a cell, tab to the next row, the change is posted (update stmt issued)
3. Hit rollback button. The data is brought back to "original".
But the grid editor is shown dirty (the tab name is cursive) - this is the bug.
But I don't have a problem seeing the "original" data after rollback.
Plz validate.
-Raghu -
iTunes 12.1.050 - Rollback: Updated from 12.01, now I cant't change track numbers and add additional data fields. How can I roll back to the previous version? @Apple, I want a $100 gift card for the inconvenience.
- it's all said in the title. I can't understand why the developers turn things bad ... risking loosing Apples valuable customers.
More examples needed? (check out the communities and the reviews)
- OSX: Maverick to Yosemite = not recommended (check it out > http://roaringapps.com/apps)
- iPad: older versions as iPad2 should not upgrade to iOS7/8 (it's not supporting its hardware accordingly, it's designed for the latest hardware)
- iTunes (it's possible to rollback to 10.7 - 11.4, but you need to breech OSX system security framework)
- Pages (was a real alternative for many of us, each update reduced features and created incompatibility to older work files)
The list could easily extend to ...You can offer Apple feedback here: http://www.apple.com/feedback/
as for "
"@Apple, I want a $100 gift card for the inconvenience"
dream on. -
Data cancellation / roll back
Hi,
We have a scenario wherein SAP PI posts certain number say 10 Material Master Data to SAP from external system, so during process if first five materials out of 10 are posted and error appears for sixth material, then is it possible to cancel all previous 5 postings also.
Please suggest
Thanks in advance.Divya,
Thanks that was very helpful.....that will definitely work if you are pushing data to SAP which is independant of each other.
But in our case, I will further explain our situation...
in our scenario we have to create 10 materials say A1,A2 .... A10 , and 2 Boms say A9 and A10
A9 BOM contains items A1,A2..A6
and A10 BOM contains items A7,A8,A9
Now when i trigger upload say 10 materials are created, then BOM for A9 is also created
but if while creating BOM for A10 some error happens, so in that scenario requirement is all 10 materials and BOM for A9 which was created should be rolled back/removed from system.
Please suggest
Thanks in advance -
Photo Elements 11 fails to load and rolls back when it starts 'installing shared services'
Photoshop Elements 11 fails to load and rolls back as soon as it switches to 'installing shared services'. How can I overcome this? Premier Elements is already loaded and works fine including the Organiser. Photo Elements 10 is still on the system and also works fine.
System - Windows 7 OS1Hello
I have tried that previously, it didn’t work then and it doesn’t now.
What I have just done is run the installation until it came up with the error message and killed the set-up file & windows installer. Photoshop elements seems to be almost installed. Organiser works for both Premier & Photoshop. What files etc would have been loaded from the point of the error message? The installation worked on a borrowed laptop (on 30 day trial). Hopefully all I need to do is copy the missing files across if you could advise what they are.
Regards
Bryan -
Can a Rejection in an Approval Step roll back the data from table
Hi All
We are using the BPC 7.5 MS Version SP 4 for Quantity & Sales Planning.
The main drive dimenion is the Material Dimenion whiich is having almost 65000 member id's and increasing.
I have a situation where the a High Level Planner Input some quantity and it allocated down at Material Level.
When the Surbodinate Planner under the High Level Planner looking at the allocated value, he has the option to change the quantity.
But after he make the changes to quantity and send the data to the data base, the High Level Planner can accept the Change or Reject the change.
If the High Level Planner Reject the change, make by the Subordinate Planner, the Data will Roll Back to its original value, meaning the Data Submitted by Subordinate Planner will be deleted from the table and the earlier Value from the High Level Planner will show.
Is this kind of facility available in BPC 7.5 MS Version of Rolling Back the Data already comiited to the data base.
Looking forward to hear from you all on the same.
Regards
KrishOne idea will be that you have to insert the users like dimension into BPC. This will be probably the way how you have to design your application.
In this way probably you will be able to simulate this behaviour.
Any way I will come back to your request.
Why the roll back it wil help?
May be the reject is just for planning of one material why do we have to roll back everything planned for other materials?
Other idea for implementation is related to what means the approval and reject. Are we speaking about work status or are we speaking about another type of approval.
It is not a simple discussion. We have to speak about detailed reguirements and function by that it can be easy achieved this behavour requested.
Regards
Sorin Radulescu -
Trigger based on data load from sqlldr
I am trying to trigger an event based on when data is loaded to a table. This load is done via sqlldr with the following:
LOAD DATA
TRUNCATE
INTO TABLE cushis
FIELDS TERMINATED BY "|"
(chdiv_id,
chdiv_no,
chcust ,
period_no ,
csaln ,
csupv ,
DOC ,
DOP ,
OCY ,
OCY_ytd ,
OPY ,
OPY_ytd ,
CHEDRPDBKC ,
CHEDRPDBKC_ytd ,
CHEDRPDBKP ,
CHEDRPDBKP_ytd)
I didn't write this but I'm trying to work with it. The trigger I created doesn't fire off.
Is there a way to create a trigger that fires off once the data has been inserted into the table?
Here is my trigger code:
create or replace trigger cushis_trg
after insert or update on cushis
BEGIN
-- runs a stored procedure to create a flat file.
dso_sales();
-- this is just a test to see if it worked at all.
insert into temp_table(message) values('flat file created');
END;
Thanks.And why do you need Oracle for that? You can do it directly in Unix. But yes it is possible, however email is not trunsactional. Most likely it does not apply to your case, but session can roll back the changes but not the email. Another issue is SQL*Loader commit point. Again, it does not apply to your case since bdf output has very small number of lines, but I want to show you issues you might run into in general. As I said, I'd do it completely in Unix. Shell script can load the table and then start SQL*Plus and execute simple PL/SQL block to check whatever you need to check and send email when needed. Another approach would be do it completely in Oracle. E.g. create java based SP to execute OS command. Then create SP that executes your shell script, checks whatever you need to check and send email when needed.
SY. -
JTA transaction unexpectedly rolled back
I have a Spring Java web app deployed on OC4J 10.1.3.3 using Toplink as the container managed persistence. When my app is launched a named query is executed that uses JPQL to load up collections of objects. It is failing with the subject line exception.
org.springframework.transaction.UnexpectedRollbackException: JTA transaction unexpectedly rolled back (maybe due to a timeout); nested exception is javax.transaction.RollbackException: Timed out
If, however, I then modify the URL and force an action that will re-execute the same query, it works fine.
Any ideas on which configuration settings I should investigage/change to enable this to work the first time through?
I am not dealing with large collections here. At this point, there are 11 main objects that have children/parents. Re-execution of the query happens very fast.
Thank you!
GinniHello,
It sounds like its not the query itself that is taking too long, but all the processing done before the query in the same transaction scope. The error is that the transaction is timing out, so you should start by checking when the transaction is started and if the timeout value needs to be increased to cover the time this process is taking, or if the transaction can be made smaller or broken up into smaller peices. Or, if the query is just returning data that isn't going to be modified, if a transaction is required at all.
Best Regards,
Chris -
Is it possible to roll back Mountain Lion, I am having real problems with this OS and it has virtually brought my 2008 iMac to stand still. Subsequently loaded Adobe Elements 11 and it simply will not work wat all now. Any assistance gratefully received!
Then copy off whatever data you created post ML and erase the disk and restore from TM.
http://support.apple.com/kb/HT1427
Restoring data from Time Machine backups> restore entire system.
Maybe you are looking for
-
Hi, I have scenarion in that we will receive IDOC from external system (SAP system) in XI i.e. IDOC- XI -IDOC scenrio. from my Understanding ,to configure the scenario I have to do ALE from sender side and IDOC receiver channel in receiving side. Ext
-
HT201317 My photos in photo stream automatically are shared with other people?
Are my photos in photo stream when the option of shared photo streams is on, are they shared with other people automatically?
-
Different caller ID for different countries
Hi, Is it possible to use a different caller ID depending on the country called? I have a UK and a German Skype Number, and I'd like to use the UK number as default caller ID and the German one only for calls to Germany. Cheers, Tobias
-
'Change your password' error when log to designer using SAP Authentication
Hi All, Here is the scenario. I want to create a universe on BW. 1. I try to log into designer using SAP authentication (by choosing SAP as the authentication option) 2. In the system name its the name of the CMS 3. The username and password that I e
-
Is there any system object can save the cost time of package?
Guys, i have one question. Usually I get the execute update time of package in JAVA to know the performance, but there is time lost in the network, right? So I suppose to get the cost time in DB and cost time in Weblogic, two parameters together. In