Data archival and purging for OLTP database

Hi All,
Need your suggestion regarding data archival and purging solution for OLTP db.
currently, we are planning to generate flat files from table..before purging the inactive data and move them to tapes/disks for archiving then purge the data from system. we have many retention requirements and conditions before archival of data. so partition alone is not sufficient.
Is there any better approach for archival and purging other than this flat file approach..
thank you.
regards,
vara

user11261773 wrote:
Hi All,
Need your suggestion regarding data archival and purging solution for OLTP db.
currently, we are planning to generate flat files from table..before purging the inactive data and move them to tapes/disks for archiving then purge the data from system. we have many retention requirements and conditions before archival of data. so partition alone is not sufficient.
Is there any better approach for archival and purging other than this flat file approach..
thank you.
regards,
varaFBDA is the better option option .Check the below link :
http://www.oracle.com/pls/db111/search?remark=quick_search&word=flashback+data+archive
Good luck
--neeraj

Similar Messages

Archival and Purge for Workflow Approvals

I am looking for a way to archive at least 10 years worth of Workflow Approvals for Oracle R12 EBS Financials environment. I cannot find any good notes on My Oracle Support or whitepapers other than a basic paper on general archival and purge programs for Oracle R12 EBS. Any tips on how to setup an archival process for Oracle R12 EBS Workflow approvals would be appreciated.
Thanks
Ben

1. SHould have automatic schedules that run to purge/archivePlease see this link -- https://forums.oracle.com/forums/search.jspa?threadID=&q=data+AND+archival+AND+tool&objID=c3&dateRange=all&userID=&numResults=15&rankBy=10001
2. Keep log of data that is archived/PurgedPlease see this link -- https://forums.oracle.com/forums/search.jspa?threadID=&q=data+AND+archival&objID=c3&dateRange=all&userID=&numResults=15&rankBy=10001
Thanks,
Hussein

Archive and Purge provisions in GRC suite

Hi,
I'm trying to understand the Archive and Purge options provided / offered by GRC suite but have very skeletal information. Can somebody help me on that front?
Balaji K

In a nutshell,purging is removal of data from a system or storage device with the intent that the data can not be reconstructed by any known technique. In GRC Suite purging has similar concept to purge incident stored after a long period of tie and storage (AACG). You can also purge snapshop or change tracking definitions in CCG. General rule of thumb, ensure you follow your company policies with regards to data archive and purging and access to these functionalities within the GRC Control Suite should be restricted.

Recommended Third Party Archive and Purging Software for Oracle Database (Oracle CC&B)

Hi,
We are currently exploring third party archive and purging software for Oracle Database specifically used by an Oracle Customer Care and Billing implementation. Our current data is growing that we think archiving and purging is a now a viable option. Thanks.
Regards,
Dennis

According to the fine Oracle® Utilities Application Framework Administration Guide Chapter 17, "Archiving and Purging" is readily available to CC&B.

Archive and Purge in Oracle Financials (verions 11.0.3, database 8.0.5)

Hi all,
I am going to purge balances and journals data by using function 'Archive and Purge' in Oracle Financials.
I want to calculate the space that can free up finally.
i.e. calculate the difference before and after data purging.
How to get this information?
Thanks for your kind response.

Assuming you have the source data in access97.
Create tables in Oracle exactly the same as access tables.
Create links from access ODBC drivers to Oracle tables.
Export the data from access.
If you want to keep the sources data in access and update the data everyday, you can use append queries.
YOu can refresh the data by truncating the destination tables and export fresh.
Another option is sql*loader. It depends what your situation is.
null

How to Archive and Purge SLA data?

We are looking for a solution to archive and purge SLA tables. I have opened an SR with Oracle and they suggested to work with third party who specialized in archiving and purging data. I would like to see if any of the clients have developed a custom solution for this and if so what is the criteria that has been used for this
Thanks in advance,
Prathibha

Hi,
Thanks for the information.
But this traditional way of doing is archiving is for maintenance and backup operations.
We want to have this process online, without taking db offline. In this case will this approach work?
In our case, the rules can be like -
1. For table 'A', if rows exceed 10Million, then start archiving of the data for that table.
2. For table 'B', if data is older than 6 motnhs start archiving of the data for that table.
3. Archiving should be on for 15 minutes only after that should pause, and should resume whenever user wants to resume.
4. Archiving should start on specified days only... ETC...

SQL ENTERPRISE: The edition of Reporting Services that you are using requires that you use local SQL Server relational databases for report data sources and the report server database

The error below makes absolutely no sense! I'm using Enterprise Core...yet I'm being told I can't use remote data sources:
w3wp!library!8!03/05/2015-19:08:48:: i INFO: Catalog SQL Server Edition = EnterpriseCore
w3wp!library!8!03/05/2015-19:08:48:: e ERROR: Throwing Microsoft.ReportingServices.Diagnostics.Utilities.OperationNotSupportedException: , Microsoft.ReportingServices.Diagnostics.Utilities.OperationNotSupportedException: The feature: "The edition of Reporting
Services that you are using requires that you use local SQL Server relational databases for report data sources and the report server database." is not supported in this edition of Reporting Services.;
Really? This totally contradicts the documentation found here:
https://msdn.microsoft.com/en-us/library/ms157285(v=sql.110).aspx
That article says remote connections are completely supported.
ARGH! Why does this have to be so difficult to setup?!?

Hi jeffoliver1000,
According to your description, you are using Enterprise Core edition and you are prompted that you can’t use remote data sources.
In your scenario, we neither ignore your point nor be doubt with what you say. But actually we have met the case before that even though the SQL Server engine is Enterprise but the reporting services is still standard. So I would recommend you to find the
actual edition of reporting services you are using. You can find Reporting Services starting SKU in the Reporting Service logs ( default location: C:\Program Files\Microsoft SQL Server\<instance name>\Reporting Services\LogFiles). For more information,
please refer to the similar thread below:
https://social.technet.microsoft.com/Forums/en-US/f98c2f3e-1a30-4993-ab41-acbc5014f92e/data-driven-subscription-button-not-displayed?forum=sqlreportingservices
By the way, have you installed the other SQL Server edition before?
Best regards,
Qiuyun Yu
Qiuyun Yu
TechNet Community Support

Teleservices - Archive and Purge Closed SR,SR Related Tasks and Notes

Hi All,
The business wants to archive and purge..
1) All the closed Service Requests which are older than an year.
2) SR Related Tasks which are older than an year
3) SR Related Notes which are older than an year
Is there any API or way to archive and purge the above three requirements in Oracle Teleservices.
We are on 11.5.10.2 and database version is 10.2.0.4.0.
Thanks in Advance,
S

Hi,
11.5.10.2 does not have any API/utilities for any of these. In R12, Service Requests data can be purged using SERVICE REQUEST DATA PURGE program.
Check Metalink Note#454515.1 for details.
Regards,
Sujoy

CC&B Archiving and Purging

Hello,
Our project is currently exploring the implementation of CC&B's Archiving and Purging Functionality. I have some questions regarding this functionality.
1. Is there any company or organization that has successfully implemented CC&B’s Archiving and Purging solution?
     a. Was the solution able to effectively control/manage the growth of information (database size)?
     b. Was it able to improve the performance of the production environment?
2. What are the common challenges when implementing CC&B’s archiving and purging solution?
3. What is the difference between configuring the archive database to be in the same Oracle instance or separate Oracle instance? Which one is recommended?
     c. If the archived database is configured in the same Oracle instance, does the environment registration utility only creates a schema? During archive, can this reduce the production database size?
4. What is the impact to ETL (Extract, Transform, Load – Data Warehousing)? (currently using OWB – Oracle Warehouse Builder)
Thank you,
Dennis

http://docs.oracle.com/cd/E18001_02/pdf/E17991_02.pdf

Goldengate Extracts reads slow during Table Data Archiving and Index Rebuilding Operations.

We have configured OGG on a near-DR server. The extracts are configured to work in ALO Mode.
During the day, extracts work as expected and are in sync. But during any dialy maintenance task, the extracts starts lagging, and read the same archives very slow.
This usually happens during Table Data Archiving (DELETE from prod tables, INSERT into history tables) and during Index Rebuilding on those tables.
Points to be noted:
1) The Tables on which Archiving is done and whose Indexes are rebuilt are not captured by GoldenGate Extract.
2) The extracts are configured to capture DML opeartions. Only INSERT and UPDATE operations are captured, DELETES are ignored by the extracts. Also DDL extraction is not configured.
3) There is no connection to PROD or DR Database
4) System functions normally all the time, but just during table data archiving and index rebuild it starts lagging.
Q 1. As mentioned above, even though the tables are not a part of capture, the extracts lags ? What are the possible reasons for the lag ?
Q 2. I understand that Index Rebuild is a DDL operation, then too it induces a lag into the system. how ?
Q 3. We have been trying to find a way to overcome the lag, which ideally shouldn't have arised. Is there any extract parameter or some work around for this situation ?

Hi Nick.W,
The amount of redo logs generated is huge. Approximately 200-250 GB in 45-60 minutes.
I agree that the extract has to parse the extra object-id's. During the day, there is a redo switch every 2-3 minutes. The source is a 3-Node RAC. So approximately, 80-90 archives generated in an hour.
The reason to mention this was, that while reading these archives also, the extract would be parsing extra Object ID's, as we are capturing data only for 3 tables. The effect of parsing extract object id's should have been seen during the day also. The reason being archive size is same, amount of data is same, the number of records to be scanned is same.
The extract slows down and read at half the speed. If normally it would take 45-50 secs to read an archive log of normal day functioning, then it would take approx 90-100 secs to read the archives of the mentioned activities.
Regarding the 3rd point,
a. The extract is a classic extract, the archived logs are on local file system. No ASM, NO SAN/NAS.
b. We have added "TRANLOGOPTIONS BUFSIZE" parameter in our extract. We'll update as soon as we see any kind of improvements.

Difference between " COMPRESS FOR ALL OPERATIONS" and "COMPRESS FOR OLTP"?

I was looking through Oracle's OLTP Table Compression (11g onwards) documentation as well as online resources to find the syntax and came across two different versions:
COMPRESS FOR ALL OPERATIONS
and
COMPRESS FOR OLTP
The documentation I looked through didn't mention any alternative syntax, so i was wondering if anyone here might know the difference.
Thank you!

Table Compression Enhancements in Oracle Database 11G Rel1 as as follows:
The compression clause can be specified at the tablespace, table or partition level with the following options:
•NOCOMPRESS - The table or partition is not compressed. This is the default action when no compression clause is specified.
•COMPRESS - This option is considered suitable for data warehouse systems. Compression is enabled on the table or partition during direct-path inserts only.
•COMPRESS FOR DIRECT_LOAD OPERATIONS - This option has the same affect as the simple COMPRESS keyword.
•COMPRESS FOR ALL OPERATIONS - This option is considered suitable for OLTP systems. As the name implies, this option enables compression for all operations, including regular DML statements. This option requires the COMPATIBLE initialization parameter to be set to 11.1.0 or higher.

What is data archiving and DMS(Data Management System) in SAP

what is data archiving and DMS(Data Management System) in SAP
Welcome to SCN. Before posting questions please search for available information here and in the web. Please also read the Rules of Engagement before further posting.
Edited by: kishan P on Aug 31, 2010 1:06 PM

Hi,
Filtering at the IDoc Level
Identify the filter object (BD59)
Modify the distribution model
Segment Filtering
specify the segments to be filtered (BD56)
The Reduced IDoc Type
Analyze the data.
Reduce the IDoc type (BD53)
Thanks and regards.

Data archiving and data cleansing

hi experts,
Can any one tell me step by step guide for Data archiving and Data cleansing of SAP-ISU Object.
what is the difference between Data archiving and Data cleansing .
Thanx & Rgds

Data Archiving: So many objects are there you can look some of them..........
ISU_BBP IS-U Archiving: Budget Billing Plan
ISU_BCONT Business Partner Contacts (Contract A/R + A/P)
ISU_BILL IS-U Archiving: Billing Document Header
ISU_BILLZ IS-U Archiving: Billing Line Item
ISU_EABL IS-U Archiving: Meter Reading Results
ISU_EORDER IS-U Archiving: Waste Disposal Order
ISU_EUFASS Archiving of Usage Factors
ISU_FACTS Installation Facts
ISU_INSPEC IS-U Archiving: Campaigns for Inspection List
ISU_PPM Prepayment Documents
ISU_PRDOCH IS-U Archiving: Print Document Header
ISU_PRDOCL IS-U Archiving: Print Document Line Item
ISU_PROFV IS-U Archiving: EDM Profile Values
ISU_ROUTE IS-U Archiving: Waste Disposal Route
ISU_SETTLB Settlement Document
ISU_SWTDOC Archive Switch Document
Go to SARA t-code and enter the object CA_BUPA for business partner then Press F6 you will get step by step documentation. please follow the procedure for all the objects.
Regards,
Siva

How to use same Data Type and Length for two fields

How to use same data type and length for two fields when using 'FOR ALL ENTRIES IN' in a select statement? For instance the select queries are :
SELECT bukrs gjahr belnr lifnr budat bldat zlspr dmbtr waers shkzg
FROM bsik
INTO TABLE it_bsik
WHERE bukrs = p_bukrs
AND lifnr IN s_lifnr.
IF it_bsik IS NOT INITIAL.
SELECT belnr gjahr awkey awtyp
FROM bkpf
INTO TABLE it_bkpf
FOR ALL ENTRIES IN it_bsik
WHERE belnr = it_bsik-belnr
AND gjahr = it_bsik-gjahr.
IF it_bkpf IS NOT INITIAL.
SELECT belnr gjahr lifnr xblnr
FROM rbkp
INTO TABLE it_rbkp
FOR ALL ENTRIES IN it_bkpf
WHERE belnr = it_bkpf-awkey+0(10)
AND gjahr = it_bkpf-awkey+10(4).
ENDIF.
ENDIF.
Here it gives an error in the 3rd select query that 'When you use the addition "FOR ALL ENTRIES IN itab", the fields "GJAHR" and "IT_BKPF2-AWKEY+10(4)" must have the same type and the same length.'
Kindly clarify.

Hi Saurabh,
Please see the example code that I have developed for you. It will help you solve the problem.
REPORT ZTEST_3 .
tables : BKPF.
data : begin of it_bkpf occurs 1,
         belnr type RE_BELNR,
         awkey type awkey,
         awtyp type awtyp,
         gjahr type GJAHR,
       end of it_bkpf.
data : begin of it_bkpf1 occurs 1,
         belnr type RE_BELNR,
         awkey type gjahr,              " change the data type
         awtyp type awtyp,
         gjahr type GJAHR,
       end of it_bkpf1.
data : begin of it_rbkp occurs 1,
         belnr type BELNR_D,
         gjahr type gjahr,
         lifnr type LIFRE,
         xblnr type XBLNR,
       end of it_rbkp.
select belnr
       awkey
       awtyp
       gjahr
       from bkpf
       into table it_bkpf
       where BUKRS = 'TELH'.
loop at it_bkpf.
it_bkpf1-belnr = it_bkpf-belnr.
it_bkpf1-awkey = it_bkpf-awkey+10(4).           "Here only append the required length.
it_bkpf1-awtyp = it_bkpf-awtyp.
it_bkpf1-gjahr = it_bkpf-gjahr.
append it_bkpf1.
clear it_bkpf1.
endloop.
select belnr
        gjahr
        lifnr
        xblnr
        from RBKP
        into table it_rbkp
        for all entries in it_bkpf1
        where belnr = it_bkpf1-belnr
This is just an example. Change the fields according to your requirement.
Regards
Abhii
Edited by: Abhii on Mar 9, 2011 9:08 AM

What should i do to implement Data Archiving and Data Reporting

we want to implement Data Archiving and Data Reporting in our product. Can someone tell me what techniques or approaches people take in general to implement Data Archiving and Data reporting.
i am currently looking into DataWarehousing. is this the right apporach ? i have no idea as where i should start on this. can someone give me a good direction as a starting point.
thank you,
Puja

Did you setup Find My Mac before it was stolen?

Data archival and purging for OLTP database

Similar Messages

Maybe you are looking for