Long Term Storage ideas for Data in an Oracle Database

We have data that we no longer need access to and want to archive it on tapes for long term storage.
We want to save the data using datapump or rman from time to time and and store the exports/backups on tapes. The issue we don't want to face in the future is , if Oracle deprecates the methodology we used to save the data in 2012, we no longer have a way to retrieve the data into a database 10 years from now.
This may sound crazy, but hear me out. Before datapump existed everyone was using vanilla exp to export the data. Now we have datapump as exp's upgrade and we have rman too. What if in 2012 we took an export using datapump or a backup using rman and save it off on a tape. 10 years go by and in 2022 management wants to look at the 2012 data. Lets say by this time Oracle's mothodology changes and they have a much more efficient/robust export/backup method. One way for us to keep the old backups up to date is to import the data back before the method we used in 2012 is deprecated and then export/backup the data using the new method to keep the exports/tapes in sync with then current technology.
My question is, what methods of saving large amounts of data do you recommend/use to save data to a tape so that you don't have to worry about changing times.
An idea I heard is to save the data as insert statements. This would work for most of the data except for blobs.
Any help would be appreciated.
Thanks in advance.

>
Won't an intelligent compression algorithm take care of a lot of the overhead for that?
>
That's certainly a valid point to make and one that the OP can test. And because the duplicated metadata is identical and in the same physical row location there may be compression algorithms that can reduce it to just one set.
There were two points I was trying to make.
1. Don't just save the data - save the metadata also.
2. The metadata for each row will be the same so if you use an INSERT format that duplicates it for every row you are potentially wasting a lot of space.
Your other point was probably more important than these or anything previously mentioned.
>
perform restores of the entire database every couple of years or so to make sure that your
database isn't degrading
>
Regardless of the format and media used to backup the data it is important to verify the integrity of the backup periodically.
There are a lot of ways to do this. One way is a simple MD5 (or other) checksum of data at some level of granularity and then periodically read the data and confirm you still get the same checksum.
In my opinion the more generic the format that the data is saved in the better the odds that you can recover the data later no matter how technology may have changed.

Similar Messages

Syntax for Data Pump in Oracle Database 11g

Hi, thanks to all. i myself clarifying many doubts by refering the POSTS in this Forum.
I need the syntax for the Data Pump in Oracle 11g.
Could you post the syntax plese.
Thanks & Regards..

Hello,
You may have all the options in Datapump by typing the statements belows:
expdp help=y
impdp help=yElse, you'll have much more details and examples in the Utilities book from Oracle 11g documentation on the link below:
http://www.comp.dit.ie/btierney/Oracle11gDoc/server.111/b28319/part_dp.htm#i436481
Hope this help.
Best regards,
Jean-Valentin
Edited by: Lubiez Jean-Valentin on Apr 19, 2010 11:07 PM

Using "Deleted Items" folder for long term storage.

I have a user that is using the "Deleted Items" folder in Outlook for long-term storage. He has unchecked the box in the options which would remove the items in the Deleted Items folder at shutdown
and is having problems with his Outlook freezing up several times a day. He was using a Microsoft Surface as his primary computer and has since changed to a Dell Latitude, but Outlook still freezes up. He has an Office 365 Pro Plus license.
I have been looking for articles to explain all the reasons for not using "Deleted Items" for storage, but in order to get him to change, This is not a .pst, it is the Outlook default “Deleted Items”.
. I really need some "ammunition" to let him know the consequences of keep that much mail in Deleted Items.
Could you tell me when Outlook starts, does it enumerate the Deleted Items folder as it does the Inbox?

I have to agree with Robert's point here. The question of whether or not the user should be doing this answers itself: of course he shouldn't. On a lighter note there's a Dilbert cartoon from 2003 which covers this very point:
http://dilbert.com/strips/comic/2003-11-13/
I'd suggest you ask him to create a sub-folder of his inbox and get him to move everything over, then he still has his history and can use deleted items the way it was intended.
The question I would ask is are you sure that this has any bearing on his Outlook freezing issue? I have encountered people who never empty their recycle bin and I have encountered issues with Outlook freezing, but I don't recall ever having the two together.
If you still have issues after he's moved everything then it's a general Outlook freezing issue, so you have to look at those sort of things. For a start, is it bang up to date with Microsoft Updates? If so how big is his mailbox? Presumably he has an ost
file, so how big and fragmented is that? I'd probably try creating a new Outlook profile. If not then what add-ins does he have, could they all be disabled for a while to see if it's one of them, then add them back one at a time? If not is it worth running
a repair in Office? I've had that fix a fair few issues.
Just a few thoughts. I don't know if any of them will help.

Best method for converting 8 mm cassettes for long term storage

I have approximately one hundred 8 mm video cassette tapes that I would like to convert to another format for long term storage. I captured my first tape today from my camera Sony DCR VTR 520 which is a digital 8 mm camera. I was not planning to convert the files to DVDs at this time but just keep the avi file on the computer.   The video was just over 2 hours long but the file ends up being 27 GB.   I expecting it to be around 8 GB like a 2 hr DVD but I guess its not the same.
The 8 mm tape I converted was from an very old 8 mm camera which I no longer have (1990). The camera used to capture from is a VTR 520 which is actually a Sony digital 8 mm, which can play back standard 8 mm. I used CS3 on my old computer with standard project settings for DV NTSC 29.97 f/s.   I currently use PE10 so I could use either program.
What do other people use to convert and store videos on??
If I want to keep them as avi files will I have to live with these large file sizes?
I did a search on the forum and found titles that talk about this subject from a couple of years ago but when I click on them they don't come up.   How do you see these older threads?
Any help would be appreciated.

JMJarige,
The only potential problems with this workflow are:
DVR units (I have a Panasonic, but this is pretty much across the board) seldom produce a 100% DVD-compliant disc, and as most add a rudimentary Menu & navigation system to the disc, produce a first VOB (where the Menus & navigation are located), that is tough, if not impossible to directly Import.
In the production to DVD, there is MPEG2 compression applied. If one edits that material, and then they output to any compressed CODEC, the quality loss is easily seen
When I convert from VHS for a client, I create a DVR DVD disc, for their archives (in case the tapes die), but then Capture to DV-AVI to be edited to a DVD-Video. The client gets two sets of discs - one that is produced by the DRV, and then one that is the finished edit of their tapes. For me, it's a two step process, but gives them a backup, plus a finished product.
Good luck,
Hunt

Long Term Storage with VTL (Firestreamer)

Hi All
I'm currently in the planning stages of DPM 2012 R2 and am looking at eliminating tapes for long term/archival purposes by using a VTL solution. I have a trial of Firestreamer and am testing it out. The thought is that we would output to to file media and
then somehow replicate this offsite to a 3rd party for long term storage.
The thinking around removing physical tapes from daily life would save manual labour, tape transfers and the general chore of physical media but I'm wary of the virtual side of things becoming a time consuming monster to manage.
The "tape" management side of it would need to be very carefully thought out to keep things under control and relatively simple. Things like max media size would need to be kept fairly low compared to modern LTO capacities to allow easy WAN transfer
but at the same time I'm wary of ending up with a myriad of files from one large backup let alone months/years worth.
For those "tapes" that will need to rotate (say weeklies on a 5 week rotation) we could simply reuse the tape files and then allow them to overwrite at the offsite end to preserve space and keep things simple.
I'm backing up around 12TB pre compression using traditional tape methods currently and this is set to rise steeply with the onset of new projects, so depending on the compression rate the transfer of full backups over the wire could be large.
There is the added issue that DPM either compresses or encrypts and Firestreamer only compresses. The issue here is that I have a requirement for encrypted backups so therefore encryption will have to be performed at DPM level negating any form of compression
from there on.
Does anyone have any experience of this, or any other VTL's or non tape practices, if so I'd be very interested in how you did it.
Thanks

Hi,
I would say it depends - DPM encrypts the data in chunks before writing the data to the tape. If most of the chunks are the same for each version of the backup, then the disk dedupe would be efficient. If data was inserted or removed from files in
such a way that the chunks are no longer aligned, then the encrypted data would not match previous chunks and would not be deduped since it didn't match previous backup data. But overall, I think you have a pretty good chance of getting some
fairly decent dedupe saving over time.
You may want to inquiry about that with the OEM to see if they have any test results using DPM backup with software encryption enabled.
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT]
This posting is provided "AS IS" with no warranties, and confers no rights.

Long term Storage

I have to put some iPod Touches in long term storage (1+ years). Any recommendations on what should be done to prepare them for this?

Might it not be better to sell them now and buy something newer (and better) in a year or so?

G5 - Long Term Storage Hints

Any tips for long term storage & overseas shipping of my G5 ?
All advise much appreciated
Thanks in advance

P.s
It was rather tricky to remove the PRAM battery - as I encountered some difficulty in getting access with my hand into such a tight space, without touching the logic board !!

Can I delete renders and previews when putting projects into long term storage?

I want to shrink the size of my longe term storage folders. Would it be ok to just delete the previews and renders?
Any project opened in the future is going to rebuild them anyway..
Thanks

I agree with Joe (nothing unusual there), and, as stated, how you do the mechanics might well depend on how you establish your folder structure, when you start the Project. I keep everything (including copies of any Assets), in a folder structure below the Project's name. This article goes into more detail: http://forums.adobe.com/message/4028199#4028199
With such a structure, it is easy to Delete, say Media Cache files, etc., before using Project Manager, or just setting it to NOT copy those files over. It also makes a final Deleting easy.
I do sacrifice a bit of performance, by not spreading, say my Render files, my Audio and my Video, over separate physical drives, but then, when the Project is done, tracking down everything is easy, as I just Delete the root folder, [Project Name], and everything goes with that.
Good luck, and glad that you asked, before archiving a bunch of Projects, or Deleting a bunch of files.
Hunt

T399D - Long-term planning allowed for a plant

Hi gurus,
I was checking the table T399D and it has the "Long-term planning allowed for a plant" field (T399D-SIMPL), but, I do not know where I can customise this!
I was checking OMI8 and OPPQ (Parameters for DS section) transactions, but, I cannot find this field.
Could you help me in order to know where I can customise this?
Kind regards,
Sandra

Hi Sandra,
As it is correctly said that there is not much configuration required to Run LTP, but what you basically need to maintain/configure is as follows-
To carry out an annual planning or a rolling quarterly planning run you require information on the
future stock and requirements situation. This means you need to know how sales and operations
planning influence resources(conceptually)-
In long-term planning you can also plan materials that usually require very little planning in
operative planning, such as, materials planned using reorder point planning, bulk material, and
materials planned using KANBAN. In long-term planning, you can plan these materials as you
would MRP materials. This provides you with an overview of how these materials influence the
demand program.
The materials you want to plan in long-term planning must have already been planned in
operative MRP.Apart from above conceptual knowledge what else you require to configure /maintain is-
Planning Scenario(If you are running wity reference to it)-MS31
And run it through MS02(with reference to planning scenario) where you have to put mandatory MRP Control Parameters according to your business process eg.Processing key,create MRP list,planning mode,scheduling,firming planned orders.
Hope it fulfils your purpose at some extent.
Regards
Chandra

What is the best way to put LabVIEW DSC data into an Oracle database?

I have been collecting data using LabVIEW DSC 7.0 for several years and have always accessed the data from the Citadel database via the Historical Data Viewer. I would now like to begin putting this data into an Oracle database. My company stores all their data in Oracle and it would provide me all the benefits of their existing infrastructure such as automated backups, data mining tools, etc.
My initial thought is to use "Read Trace.vi" in LabVIEW to pull historical data from the citadel database at regular intervals (e.g. 1 minute) and insert this data into Oracle via ODBC. In this way, I do not need to track the value changes in order to know when to write to Oracle. I also considered replicating the citadel database using some other method, but I recall that the tables used by citadel are somewhat complicated. I only need a simple table with columns for channel, timestamp, and data. The "Read Trace.vi" will provide me data in this format.
I do not need to update the Oracle database in real time, a few minute delay is acceptable. If anyone has a better idea or additional insight please let me know. Thanks.

In terms of connectivity, you want to use ADO, not ODBC. Beyond that, it all depends on the structure of the data and what you are going to want to do with it. This is a very big question that you need to be getting some in-depth assistance.
Mike...
Certified Professional Instructor
Certified LabVIEW Architect
LabVIEW Champion
"... after all, He's not a tame lion..."
Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps

How to find out the date when an oracle database is upgraded

Hi,
I would like to know the date when an oracle database is upgraded (for example 10.2.0.4 to 11.2.0.3).
Can you help me to find out these details.
Thanks,
Sarayu

user13312943 wrote:
Hi Ed and SB,
Thanks for your replies. How about this option?
Let us assume I am interested in checking when my database is upgraded to any 11g version.
Will this query help?
select min(first_usage_date) from dba_feature_usage_statistics where version like '11%';
I understand this may not be a generic solution , but with this idea I may be able to build up a query to get the result.
Thanks,
Sarayu
How is it that you or nobody knows when the DB was upgraded?
I would have expected a formal testing & upgrade plan.
Does the organization practice safe software & utilize any source code repository?
Does everyone suffer from amnesia?
How could a MAJOR database upgrade slip by everyone who should care about such a detail?

Error while pulling data from an Oracle database. ORA-01858: a non-numeric character was found where a numeric was expected

I'm trying to pull data from an Oracle database using SSIS. When I try to select a few fields from the source table, it returns the following error message:
    [OLE DB Source [47]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E14.
    An OLE DB record is available. Source: "OraOLEDB" Hresult: 0x80040E14 Description: "ORA-01858: a non-numeric character was found where a numeric was expected".
    An OLE DB record is available. Source: "OraOLEDB" Hresult: 0x80004005 Description: "ORA-01858: a non-numeric character was found where a numeric was expected".
The source columns are a combination of numeric and texts, and I've also tried selecting one of them, which didn't work. I'm using the Oracle client 11.2.0.1, and it works fine with any other data sources I have connected to so far. How can I resolve this
error?

Hi H.James,
According to your description, the issue is a non-numeric character was found where a numeric was expected while pulling data from an Oracle database in SSIS.
Based on the error message, the issue should be you are comparing a number column to a non-number column in a query. Such as the query below (ConfID is a number, Sdate is a date):
where C.ConfID in (select C.Sdate
                   from Conference_C C
                   where C.Sdate < '1-July-12')
Besides, a default behavior for the Oracle OleDb Provider that change the NLS Date Format of the session to 'YYYY-MM-DD HH24:MI:SS can also cause the issue. For more details about this issue, please refer to the following blog:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2012/01/20/every-bug-is-a-microsoft-bug-until-proven-otherwise.aspx
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Different ways to download data into a Oracle database

Apart from the below are there any other ways to download data into an Oracle database ?
1. Import data using import/export features.
2. Oracle external tables.
3. Data Pump
4. SQL Loader.
5. PL/SQL => utl_file package.
6. Oracle SQL developer tool - it was a nice surprise this morning to know that this tool can be used to import data into Oracle database.
Thanks
Gony

I will be able to do that once I complete my transition into an Oracle DBA
Next Great DBA
I downloaded oracle to my laptop today.
I will become the next great DBA.
No need for education or taking a course,
I'll use the forum and learn by brute force.
The guru's won't mind, they know it all
They are so profound, their ego's enthrall.
They have it written by steps 1 through 10.
If I don't get it once, I'll just ask it again.
I won't write it down, seems simple enough
After all, I've used Access with SQL and stuff.
Why you upset? Why you tell me to read?
I've no time for a manual, No Sir, Indeed!
Why waste my time with a book or a link,
I have this forum, no need to think.
I have no work history, just out of college,
But I'm smarter than those who are three times my age.
I'll become certified with an OCP,
Have you the answers, just give them to me.
Then we'll be equal just wait and see!
But, Why are you paid 100K more than me?Edited by: sb92075 on Jul 12, 2009 7:57 AM

Problem finding data in an Oracle Database using CMP beans

I am having a problem retrieving data from an Oracle database that has a date as
part of the key. This data was loaded into my database via a batch process writing
in java using java.sql.Date to store the date information. When calling the findByPrimaryKey
method of a CMP Entity Bean I continued to get the FinderException. I know this
data is in my database because I can view the data via SQLPlus and Microsoft Access.
Has anyone ever experience problems with CMP beans accessing data from an Oracle
database that had a date as part if the key or with accessing data in the database
that insert via another method outside of your CMP bean. I desperately need some
answers.

Hi Dave,
You should probably post this type of question in the CMP or JDBC section
for best results. Chances are that the date is suffering from a rounding
problem (it could be a date/time in the database with a different time zone)
or is not the date that you think it is (wrong century or millenium). I've
seen both. You need to write a quick piece of code that loads in those
values as both Java timestamps and dates and makes sure that they are what
you think they are.
Peace,
Cameron Purdy
Tangosol Inc.
Tangosol Coherence: Clustered Coherent Cache for J2EE
Information at http://www.tangosol.com/
"Dave White" <[email protected]> wrote in message
news:3c1a4ac3$[email protected]..
>
I am having a problem retrieving data from an Oracle database that has adate as
part of the key. This data was loaded into my database via a batchprocess writing
in java using java.sql.Date to store the date information. When callingthe findByPrimaryKey
method of a CMP Entity Bean I continued to get the FinderException. Iknow this
data is in my database because I can view the data via SQLPlus andMicrosoft Access.
Has anyone ever experience problems with CMP beans accessing data from anOracle
database that had a date as part if the key or with accessing data in thedatabase
that insert via another method outside of your CMP bean. I desperatelyneed some
answers.

Data transfer from oracle database(external database) to sap database

Hi Abapers,
I have a requirment like excel data upload from oracle database(external database) to SAP database .Plz any one can help me how to create a bdc program for this requarment.
Advance thanks you.
Jnana

HI
use function module 'ASLM_EXCEL_TO_INTERNAL_TABLE' TO UPLOAD DATA FROM EXCEL SHEET TO INTERNAL TABLE. FROM THERE U CAN SAVE IT TO DATABASE USING BDC FUNCTION MODULES.

Long Term Storage ideas for Data in an Oracle Database

Similar Messages

Maybe you are looking for