Making data in tables online and offline - Backup and Recovery

Hi All,
I'm working on a project where the functionality is similar to 'Backup and Recovery' for database tables.
Lets say we have a set of 6 tables T1, T2.... T6. They do have relationship between them. The tables in questions are simple standard tables, which are not table partitioned.
- I want remove the records from live tables based on user entered date ranges and store it in some offline medium.
- I might want make the data online again from the offline medium; Application should be able use that data without any modifications.
- Different offline mediums can be
a) Flat file
b) Different table space
c) Any other secondary medium (like XML, tape..Etc,)
The total number of records will run in millions.
The proposed solution should consider,
1. Performance - Java solutions not feasible. Anything in SQL, PL/SQL or runs in DB itself(tools) are OK.
2. Reliability - Should be highly reliable, Data corruption simply unacceptable.
3. Security - Users should not be able to make out of the file.
Few options include:
1. Use partition
2. Use SQL*Loader
3. Export and import of tables.
My main targets:
1. Reduce space.
2. Increase performance for queries.
Please pass on your suggestions, any help is highly appreciated!
Thanks In Advance!

Few points to note:
1. I agree partition would be right solution, but as I mentioned in my earlier statement, 'The tables in questions are simple standard tables, which are not table partitioned.'. The tables right now are not partitioned and I believe we cannot add/modify partitions, if the table were not created with the partition option. One work around is to build a partitioned table and copying all the properties(indexes,rows,constraints) from the existing non-partitioned table. But I suspect this is highly riskier and we can't afford to it.
2. I need to support Oracle database versions starting from 8.0.6.
3. Flat file is mandatory, others are optional. I can restrict our discussion just for a file.
4. Considering the above points, the only option I could think of is I can move the records from the table to flat file and remove from tables. When required rollback the file data to the table and application would be able to use it. For export/import few options are: SQL*loader, exp/imp utilities, PL/SQL file UTL packages
Thanks In Advance

Similar Messages

  • Making data in tables online and offline - Backup/Recovery for tables.

    Hi All,
    I'm working on a project where the functionality is similar to 'Backup and Recovery' for database tables.
    Lets say we have a set of 6 tables T1, T2.... T6. They do have relationship between them. The tables in questions are simple standard tables, which are not table partitioned.
    - I want remove the records from live tables based on user entered date ranges and store it in some offline medium.
    - I might want make the data online again from the offline medium; Application should be able use that data without any modifications.
    - Different offline mediums can be
    a) Flat file
    b) Different table space
    c) Any other secondary medium (like XML, tape..Etc,)
    The total number of records will run in millions.
    The proposed solution should consider,
    1. Performance - Java solutions not feasible. Anything in SQL, PL/SQL or runs in DB itself(tools) are OK.
    2. Reliability - Should be highly reliable, Data corruption simply unacceptable.
    3. Security - Users should not be able to make out of the file.
    Few options include:
    1. Use partition
    2. Use SQL*Loader
    3. Export and import of tables.
    My main targets:
    1. Reduce space.
    2. Increase performance for queries.
    Please pass on your suggestions, any help is highly appreciated!
    Thanks In Advance!

    If you truely need to get the data out of the Oracle database into flat files, partitioning is pretty useless. Partitioning the table, though, strikes me as by far the most efficient, reliable, and secure solution.
    What sort of security do you need with the flat file? Do you need the data in the file to be encrypted, or is the binary file format of an Oracle export file sufficiently obfuscated?
    I'd stay away from UTL_FILE here, just because performance is rather poor.
    I always get pretty nervous about recoverability when people start moving data out of the database to flat files for long-term archival.
    - If you ever change the data model, even slightly, you may not be able to move the data back into the database without modifying your loader. A few years down the line, after a few data model changes, it can be almost impossible to find the documentation to make that change.
    - If you do things like change lookup tables over time, reloading data can cause major problems. When you load the data back in, your applications and reports may not treat the old codes properly.
    - Making sure that the flat files get stored and tagged properly can be a challenge. When the database gets moved to new system, you have to make sure that all the flat files also get moved around and the the loader scripts are modified appropriately.
    Justin
    Distributed Database Consulting, Inc.
    http://www.ddbcinc.com/askDDBC

  • HOW TO SAVE DATA FROM TABLE A AND TABLE B INTO TABLE C

    Hi,
    I have a table called EMPLOYEE , GROUP and EMPLOYEE_GROUP
    table EMPLOYEE contains emp_id, emp_name, emp_dep and emp_level
    table GROUP contains group_id and group_description
    table EMPLOYEE_GROUP contains emp_id and group_id (emp_id is a primary key)
    I want to assign each employee to a group based on their department and level..
    How can I assign many employees to one group?
    But each group have the limit number.
    My screen would be :
    1. search employees based on their department and level
    2. assign each employees to a group
    *3. save the data into table EMPLOYEE_GROUP (where the process should save the emp_id and group_id into table EMPLOYEE_GROUP)*
    Thank you in advance!

    Hi Rakesh,
    Thank you for your valuable information that you post...
    I made 1 to many relationship between employee and group.
    I want to assign each employee to a group...so one employee can only have one group but one group can contains many employees..
    When I run the application, I have an error when i try to save many employees into one group...
    master table is group, detail table is employee
    error : Too many objects match the primary key oracle.jbo.Key
    Hope that you could help me with this..
    Thank You.

  • Vendor Evaluation data in tables ELBM and ELBP

    Hello,
    Please can someone provide some direction for this issue we have with MM Vendor Evaluation in ECC5.0.
    Basically, I have set up SAP standard Vend Evaluation config for our companies Purchase Orgs in SPRO, however, tables ELBM, and ELBP are not storing any values. The config that I have maintained includes:
    -     Define the weighting keys in SM30 - V_T147J : set to equal weightings
    -     Define the criteria in SM30 - V_T147G: left as standard
    -     Define the scope of list in SM30 - V_T147M: left as standard
    -     Define Purchasing Organization data: left as standard but no Subcriterion maintained. Weightings set as equal weightings. Points scores also left as standard/
    Any ideas?
    Thank you.
    Dave
    FL,USA.

    Once you do all the config than you have to use ME61 than use ME6H transaction.

  • Reading data from tables SXMSCLUP and SXMSCLUR

    Hello!
    In BI 7.0, there is no Delta Q for loading XML data. We are using a functional module in ABAP proxy, to push data from XI directly into BI PSA.So in the PSA, we get the records which have successfully reached.
    But for the failed records, we can see them in XML format in the tcode :SXMB_MONI.
    Now, my requirement is to extract the primary key of the data in the payload and create a csv file, saying that this records have failed.
    For that, i found that the data is stored in tables SXMSCLUP and SXMSCLUR, but in Hexadecimal format, i.e. kind of encrypted.
    I was wondering how to extract and read this data... that too, only 1 field in the data?
    In SDN there is a post which gives some Java classes, but i was hoping if there is an easier way out, maybe in ABAP??
    Any help in this would be appreciated.

    HI,
    Please try to see the below links
    /people/kamaljeet.kharbanda/blog/2005/09/16/xi-bi-integration
    /people/sergio.locatelli2/blog/2006/10/15/integration-sap-bi-and-xi-a-critical-point-of-view
    /people/marian.harris/blog/2005/06/23/need-to-get-a-sap-netweaver-component-implemented-quickly-try-sap-best-practices
    /people/sravya.talanki2/blog/2006/12/08/business-case-integration-need-of-bi-and-sap-xi-episode1
    /people/ginger.gatling/blog/2005/12/02/innovative-ways-to-use-alerts
    /people/community.user/blog/2007/01/08/access-netweaver-how-to-guides-from-one-consolidated-page
    /people/sravya.talanki2/blog/2006/12/14/business-case-integration-need-of-bi-and-sap-xi-episode2
    See the michal's reply and other reply also how to see the blob fields data.
    In Which Database Table the Messages are Stored in XI
    Regards
    Chilla

  • Question on data in tables HRP1000 and HRP1001

    Hello,
    we are in the process of putting in the SAP HR module. I have been asked by th Business analyst about entries  already existing the HR OM space (HRP1000 and HRP1001).
    I was not involved when this was being created. I am thinking that we are using  org structures s for workflow notification purposes only.
    would there be anything thing else that we would be using this for?
    thanks

    Hello Timothy,
    there are a lot of applications from HR but also other components which use the tables HRP1000 and HRP1001. But there might be another source of the entries in the tables. All HR infotype tables are delivered as type C (customizing) tables. As a result sap delivers tons of garbage entries for these tables.
    There is sap note 547031 which describes that the HR tables have to be excluded when doing a client copy with ustomizing so these garbage entries are not copied. I have seen several systems where this note has not been applied especially if the HR modules were not in focus when setting up the system. As far as I have experienced you can identify such entries as they have the value "SAP" in the UNAME field of the infotype.
    Kind Regrads
    Roman

  • Reading the data from table control and write log.

    Hi all,
       In va01 trasaction i have table control 'All item'.
       I want to write value of some columns,( Article no, Order, plant ) so on into ecatt Log file after saving the trasction, for all rows which is having article no.
       Is there any possibility in eCATT with going to GETGUI function which is static to spacefic field.
    Regards,
    Sree

    Hi Sreedhar,
    There are two types of variable values you find in transactions, one system generated(generally the unique values) and then the static field values..
    When you want to go for the static field values you can use GETGUI. You can use the same GETGUI n number of times according to the situation(like in loops etc) and for the system generated messages we can handle them from the message blocks.
    MESSAGE.
    ENDMESSAGE.
    In the message block make a rule for the message that you are expecting like
    'E' MSGNR(the message number) and give a variable in the fields MSGV1/MSGV2 where ever you are getting the unique generated value(according to the log) and you can use that variable for LOG purpose..
    Confirm me whether you were looking for this or something else.
    Best regards,
    Harsha

  • Hello in which transactions do i get the data for tables COSS and COSP

    Hello i have these two tables. i need to know which transactions correspond to them .thx

    Hi Antish,
    try with transactions KOAO & KOAP
    Thanks,
    Syf

  • How to maintain  data in tables using maintenace view of the tables in ECC6

    Hi,
    I have  two table  SBUSPART (Business partner) and STRAVELAG (Travel agency).
    SBUSPART  is foreign key table while STRAVELAGE is a reference table.  The relationships is :
            SBUSPART-MANDANT          =     STRAVELAGE-CLIENT
            SBUSPART-BUSPARTNUM    =     STRAVELAGE-AGENCYNUM
    now, I create a maintenance view ZVI_HT_PARTNER in which SBUSPART is primary table and STRAVELAGE is secondary table. I have also created maintenace interfaces by generating maintenance modules in function group zht_fg. Authorization group is SUNI  and maintenance type is one-step, the number maintenace screen is 100.
    Now I want to maintain the data in tables SBUSPART and STRAVELAGE together in the maintenace view. If i want to enter a new partner dirctly I have to enter it in table SBUSPART first, only then could I enter the corresponding data in STRAVELAGE.
    in older version I easyly do this by the way: in maintenace screen of zvi_ht_partner ( in se11) I choose:  system/ services/table maintenace/Enhance.Tab.maintain.
    but in ECC6 when I choose:  system/ services/table maintenace, there is no Enhance.Tab.maintain instead there are two options Extended table maintenace and View cluster maintenace.
    So in this case I don't know how to tackle this problem, Please help me if you have a solution. 
    Thanks,

    Hi,
        I suppose 'Extended table maintenace ' would be same as 'Enhance.Tab.maintain'.
    Regards,
    Himanshu

  • Sender JDBC.....pick data from table view?

    Hi Experts,
    working on JDBC for first time, so have few questions.
    data base guys want to create a table view and we need to pick the data from table view.
    my question is can we import the structure form data view?
    if i am not able to import, so i need to create the structure same as in data base table view and is it case sensitive?
    they dont want to update the data base table view, very time the SQL query will pick all the records form data base.
    the records will be less then 10,000.
    my question is as we are not updating the table view, what we need to write in update query as it is mandatory?
    Regards,
    Chinna

    Hello,
    i hope below option help in update query
    In place of the SQL statement, you can also enter <TEST>. Once the data determined from Query SQL Statement has been successfully sent, the data in the database remains unaltered.
    This is recommended if the data has not only been read, but also changed by a stored procedure entered under Query SQL Statement.

  • No entry in table T512Q and T512P

    hi gurus , i'm facing a problem when i'm tryin to view HR Master data sheet (S_AHR_61016360)
    it saying there is no data in tables T512Q and T512P. But if you view the tables via transaction SE11 there is data
    . can you assist please.

    S_AHR_61016360 this report is related to your payslip or remuneration statement.....table T512Q is related to form Single fields data and T512P stores form line no.s.....goto se16 give the table T512Q and enetr country grouping and form name and check the data in table.
    Mohan

  • TABLES COEJ AND  COEP

    Hi,
    I am trying to develop an account based profitability analysis, with a PLANNED DATA VS ACTUAL DATA comparison.
    To my understanding COEP holds the actual data. And i think COEJ holds planned data.
    COEJ has all numeric fields.
    I was wondering where the CHARACTERISTIC DATA is for PLANNED DATA?
    How do i do a PLANNED DATA VS ACTUAL DATA comparison in BI?
    Thanks

    Hi Sam,
    Just so that I am clear I am planning in using one cube only for both. So data from Table COEJ and COEP will be taken into that cube.I am using the same key figures that is 0AMOUNT. The characteristics would be automatically displayed for planned data also just like it would show for the actual data.
    Also since both datas are going to be in one cube i do not need to bring in characteristic data from a seperate table into that cube.
    Please confirm
    Thanks

  • How to read data from table GLFUNCA quickly?

    Hello everybody!
         Recently,my colleague has programmed a report about reading data from table GLFUNCA,and its speed is very slowly and exceeded limited time sometimes .
    Excuse me?
    how to use INDEX and VIEW TO accelerate it?
    pls supply my helpful solutions.
    Thanks!
    Best wishes!

    Hi,
    Please check your SELECT statement to find out what are the columns being used in the WHERE clause. Then go to SE11 and find out if there are indexes on those columns.
    If Indexes don't exist then you can create indexes on those columns, which might improve the performance.
    However, there might be other areas also, where the performance can be improved. Do a run time analysis / trace and figure which part of the program is taking maximum time.
    Regards,
    Ravi
    Note : Please mark the helpful answers

  • Thinkvantage Rescue and Recovery - old backups still showing in R&R

    When I initially set up my network and installed Rescue and Recovery, I created a network share that I did my backup to.  I reconfigured my network and deleted the network share (and the subsequent backup data) outside of Rescue and Recovery and did not delete the backups from within Rescue and Recovery.   Now, my problem is that R&R still thinks that those backups are supposed to exist and when I do a Delete Backups, they show in the list, but I cannot delete them.  If this were the only issue (showing in the list) I would just write it off as an annoyance.  The issue I have is without that network share defined and active, when you start R&R it appears to hang for several minutes and does not appear to be starting - after a few minutes, it pops up a window asking to define the network path.
    Before I try uninstalling and re-installing (which I think I have done at least once), is there a way to clean up R&R and what it thinks about this network share and the subsequent backups?

    Please take a look at this thread. I'm not 100% sure it's exactly what you're looking for, but may point you at the right place to look.
    Andy  ______________________________________
    Please remember to come back and mark the post that you feel solved your question as the solution, it earns the member + points
    Did you find a post helpfull? You can thank the member by clicking on the star to the left awarding them Kudos Please add your type, model number and OS to your signature, it helps to help you. Forum Search Option T430 2347-G7U W8 x64, Yoga 10 HD+, Tablet 1838-2BG, T61p 6460-67G W7 x64, T43p 2668-G2G XP, T23 2647-9LG XP, plus a few more. FYI Unsolicited Personal Messages will be ignored.
      Deutsche Community     Comunidad en Español    English Community Русскоязычное Сообщество
    PepperonI blog 

  • Bit Locker Data retrieval forgot key and password

    Hi All,
    I am using Windows 7 utlimate version and unfortunately i forgot my password and key as a result of which i cannot retrieve my data .
    Can anyone please tell how to recover data without using password and recovery key

    Hello,
    As far as I know it will be difficult to achieve this.
    Indeed if there's another way to do this, it means that there's a security hole on this protection.
    Regards,
    Follow me on Twitter http://www.twitter.com/liontux | My Blog (French/English) :
    http://security.sakuranohana.fr/

Maybe you are looking for