BW on HANA, Archive data to Hadoop

Dear All,
We are planning to start a poc for one of our clients. Below is the scenario.
use BW on HANA for real time analytics and Hadoop as a cold storage.
Archive historical data to HAdoop
report on HANA and Hadoop.
Access Hadoop data using SDA
I request you to provide implementation steps if somebody have worked on similar scenario.
Thanks & Regards,
Rajeev Bikkani

Hi Rajeev Bikkani,
Currently NLS using HADOOP is not available by default and SAP highly recommends IQ for NLS.If you opt for IQ in longer run it will be easy to maintain and scaling up and also for better query performance.In longer run it will yield you better ROI. Initially HADOOP will be cost efective but amount of time user spends to get this solution will be challenging and later on maintaining it and scaling it up also be very challenging.. So SAP highly recommeds IQ for a NLS. SAP positions Hadoop to handle Big data along with HANA for mainly handling unstructured data and not for NLS. So please reconsider your option.
I went through the link and I dont agree with the point "Archiving was not an option, as they needed to report on all data for trending analysis. NLS required updating the info providers and bex queries to access NLS data. SAP offers Sybase IQ as a NLS option but it doesn't come cheap with a typical cost well over a quarter million dollars."
Because you can query on the archived data and it doesnt need data to be written back to providers, during runtime data will be picked from NLS and showcased.
If you still wanted to use HADOOP as NLS , then I can suggest you an process but I have not tried it personnaly.
1)Extract data selectively from your infoprovider via OHD and keep it in OHD table.
2)Write the data from the OHD table to Hbase table .(Check the link below for how to do it.)
3)Delete the data fron the OHD table.
4)Whatever data moved to OHD table should be deleted from the infoprovider by slective deletion.
5)Now Connect the HANA to HADOPP via SDA and virtualise teh table to which we have written the data.
6) Then build a view on top of this table and query on it.
7)HANA view historical data can be combined with BW provider data via open ODS or Composite provider or Transient provider
Reading and Writing to HADOOP HBASE with HANA XS
http://scn.sap.com/community/developer-center/hana/blog/2014/06/03/reading-and-writing-to-hadoop-hbase-with-hana-xs
Hope this helps..
Thanks & Regards
A.Dinesh

Similar Messages

Skip only Archiving data from ECC to HANA through SLT

Hello,
SLT is configured between ECC6 as source and HANA as target, real time replication is enabled. I have a situation, where I have to skip the replication for only those data which are deleted from the database after archived. But normal deletion process should replicate in HANA.
1st we are archiving some data in ECC6 and after archiving we are deleting those data or moving those data into content server. For this process those data also being deleted from HANA. How to restore those deleted archived data into HANA.
We cann't stop the server in the time of archiving.
Any help on this would be great help.
Thanks,
Shubhrajit C.

Hi Vikram,
are you using a "Side-Car" approach in your scenario?
If yes, I think the best solution is to use SLT for a 1:1 trigger based replication.
BODS is used more for the scenarios where you have to prepare your data (e.g. data cleansing).
Regards,
Florian

How Transformations or Routines will work for the NLS Archived data in BW on HANA?

Hi,
I have archived data from BW on HANA system into NLS IQ.
Now I'm creating a Transformation or Routines, in this case how the archived data will be read without writing any ABAP Code.
Thanks & Regards,
Ramana SBLSV.

Hi Ramana,
May be i will try to explain with 2 cases. hopefully one of this will be your case:-
DSO1 -> you have archived this DSO.
Case 1:-
Now you want to load from DSO 1 -> DSO2 (direct transformation)
so here , you question is while loading from DSO1 to DSO 2 ,will the archived data also be loaded to DSO 2?
if so, there is a infoprovider property you need to change for this
In extra-> infoprovider properties -> change-> Near line usage switched on (by default it is off).
so, the archived data also will be used in this case.
Case 2:-
you are loading from DSO 3 to DSO2. lookup on DSO1.
so in lookup DSO1, you need to use archived data as well?
In this case, you have to use the Read from DSO rule type. this will access from both active table and NLS data.
Let me know if this is not the case with you?
Regards,
Sakthi

Archiving data in ods

Hello out there
In our company we ara going to archive transactional data for the first time
I am going to create several ods:es . In those i am going to transfer data before archiving in r3.
Now my question. I will set a flag somewhere and if this is set i will be impossible to delete the data in the ods via rsa1 transaction
I hope this is possible but dont know how to do.
/7 Stisse

Hi dear and welcome on board!
Is your doubt related to some possible authorization settings in order to avoid potential (undesired) deletions of this data ?
I think you can move these ODSs in a dedicated Infoarea and then avoid to assign access into it to anyone...
Otherwise, you can archive data in BW too !
Let me know your specific requirements (do you have to do some reporting on this archived data ?)...
Bye,
Roberto

URGENT!!!! - Reading Archived Data from a Report.

Hi,
The data, prior to 15 months, of some tables (BSEG, BSAK),
used in the report YGF11347 has been archived.
Previously this report YGF11347 was run for vendor payment information for any time frame
through FBL1N. So any vendor line items from 2004, 2005, 2006 and current year,
all data elements were available to be extracted and displayed on the report.
Recently the Check Amount is missing when executing the report for payments made prior to
04/01/2006. This is because of archiving the data prior to 15 months.
My requirement is tht i need to display this archived data also in the report "YGF11347".
Can anyone please help me on this issue.
Regards,
Akrati

hi
good
check this link, hope this would help you to solve your problem.
http://www.ams.utoronto.ca/Assets/output/assets/ixos_637070.pdf.pdf
thanks
mrutyun^

Changing the default to location of Archiver data

Hi,
Is there any way that we can change the default location of the Archiver data. By default is goes to archives folder, i want it to goto some other folder.
Similarly when u take up the backup of site. i want it also to be stored in some other folder.
is it possible.???

For archiver see My Oracle Support Note
How can I move the archive directory? (Doc ID 449054.1)
Not sure what you mean by a back up. There is no built in Disaster recovery tool for UCM. Standard system back ups (file system and DB) for restore should be used.

In PL-SQL archive data from a table to a file

I am currently developing a vb app where I need to archive data from a table to a file. I was hoping to do this with a stored procedure. I will also need to be able to retrieve the data from the file for future use if necessary. What file types are available? Thanks in advance for any suggestions.

What about exporting in an oracle binary format? The export files cannot be modifiable. Is there a way to use the export and import utility in PL/SQL?
null

How to see archive data for Sales order

Hi all,
I am working on PS , network is created with sales order 10911. the components are added while sales order created, but after that someone deletes the sales order, because now it is showing oder does not found, where i get the entreis for sales order.
Regards,
Khushi.

Hi Khushi,
To see the archived data for sales order , go to transaction code SARA.
Choose object name as SD_VBAK.Click READ.
It will show a screen giving a name of program and option to execute in background or foreground.
It will help you to get information about archived sales order data.
Hope it helps you.
Thanks,
Sarita singh Rathour
Edited by: Sarita Rathour on Aug 28, 2009 7:46 AM

Archive data on an external hard drive

What is the best way to archive data on an external hard drive from a macbook pro in order to free up disk space?

Disk Space - Free Up
Disk Space – Free Up (2)
Disk Space Filling Up – OmniDiskSweeper
Disk Space Filling Up - WhatSize

Unable to access Archived data with an ABAP Query

I have an ABAP Query that uses Logical Database KDF (Vendor) for reporting.
KDF is Archive Enabled and I can access archived document via SAP standard programs that used the KDF Logical Database.
the query appears accessing the data but nothing shows on the report.
Has anyone successfully written and ABAP query and included access to the Archived data?
Any help is appreciated.

Hi Gena,
I'm facing exactly the same problem as you...
Since this post is an old one, I imagine that you may not remember, but I have to try...
Have you solved it? If yes, could you please tell me how?
I've tried to use CL_ABAP_GZIP and CL_ABAP_UNGZIP_BINARY_STREAM and I'm getting the same error 30 at the IctDecompressStream function.
Tks in advance,
Flavio.

How to View Archived Data

Dear all,
        Can anyone pls tell me how to view the Archived data like same what we see in data target.
     I have used ODS as data target ,after archiving i want to see the same data format what we see on ODS Active data.
      Pls tell me how the data will be saved during archive and what format will it be saved and how to view it from the archived files.
Thanks in Advance.
Thanks
Gomango

Hi
Use the following tables to suite your objectives
RSARCHIPROLOCSEL BW Archiving: Archived Data Area
RSARCHIPRO BW Archiving: General Archiving Properties
RSARCHIPROIOBJ BW Archiving: General Archiving Properties
RSARCHIPROLOC BW ARchiving: General Local Properties
RSARCHIPROPID BW Archiving: Program References of InfoProvider
RSARCHREQ BW Archiving: Archiving Request
RSARCHREQFILES BW Archiving: Verfified Archive Files
RSARCHREQSEL BW Archiving: Request-Selections
Santosh

Re: Retriving archived data

Hi,
Two tables related to FI(BSEG, BKPF) have been archived, so currently there is no data in the database table . Now I have to reload the archived data again into the database tables for further processing.
Can you please advise, if this is a correct method?
If yes ? How do we do it ?
The SAP version used is 30F.
Thanks in advance.
BR// SSRmary

Hi Srmary,
For fetching archieved data you need to use following function modules in same sequence:
1) AS_API_READ
2) ARCHIVE_READ_OBJECT
3) ARCHIVE_GET_NEXT_RECORD
4) ARCHIVE_CLOSE_FILE
You can insert data in database table once you fetch the successfully by a simple program.
Reward points if helpful answer.
Ashven

How to find Archive data In SAP

Hi experts ,
How to find Archive data in SAP throught the following tcodes FTWL & AS_afb.
Thnx
Venky

Hello,
Transaction FTWL is for the DART files (not actually archived data) that are stored in your archive server. In order to run a query, or browse the DART file, you would need to "Import from archive" from within FTWL and then browse the file.
I am not sure what you mean by AS_afb. Please provide more information.
Regards,
Karin Tillotson

How to get the functionality of FM 'RV_PRICE_PRINT_ITEM' for archived data

Hi All,
I am trying to print archived billing data using archiving object SD_VBRK. I am able to print all the related information except the pricing.
Apart from reading all the tables archived under the archiving object SD_VBRK, I also need to use the function module 'RV_PRICE_PRINT_ITEM' to print the pricing related information on the SAP form.
However this function module reads the data from standard tables KONV etc., which are archived. Due to this I can not use this function module for printing the pricing related information for archived billing document.
However I need to incorporate similar functionality for the archived data.
Can anyone help me in replacing the FM 'RV_PRICE_PRINT_ITEM' for the archived data.
Thanks and Regards,
Santhoshi

Please use this FM to read information from the Archived mode '/PBS/RV_PRICE_PRINT_ITEM'
Thanks,
Ranjith.

How to read Archive data??

Hi,
I am developing a program which requires me to retrive the <b>archive</b> data of table BSAK and then fill it into an itam then output the list.
I use T-code 'SARA' to find the object name is 'FI_DOCUMNT'. There u can find that BSAK is contained in it.
And i reference the DEMO programm 'SBOOKR' and coding as belows, but the error message always shows and F1 couldnt help.
[IMG]http://www.designoo.com/files/6678/incorrectInfo.jpg[/IMG]
My code:
* for Read Archive
DATA: handle                 LIKE sy-tabix,
      buffer                 TYPE arc_buffer,
      wa_arc_bsak               LIKE bsak,
      number_of_records_read TYPE i.
data: LE_DATA(8192) TYPE C,
      LE_STRUCTURE LIKE ARC_BUFFER-RNAME.
perform read_archive_bsak.
FORM read_archive_bsak.
* open existing archive files for BSAK
CALL FUNCTION 'ARCHIVE_OPEN_FOR_READ'
       EXPORTING
            object         = 'FI_DOCUMNT'
       IMPORTING
            archive_handle = handle
       EXCEPTIONS
            OTHERS         = 1.
* IF sy-subrc <> 0.
*    WRITE: / 'No file can be accessed'(001).
*    EXIT.
* ENDIF.
CLEAR number_of_records_read.
* loop to get the next data object from the archive file(s)
DO.
    CALL FUNCTION 'ARCHIVE_GET_NEXT_OBJECT'
         EXPORTING
              archive_handle = handle
         EXCEPTIONS
              end_of_file    = 1
              OTHERS         = 2.
    IF sy-subrc <> 0.
      EXIT.
    ENDIF.
* get data records from the data container
    DO.
      CALL FUNCTION 'ARCHIVE_GET_NEXT_RECORD'
           EXPORTING
                archive_handle   = handle
           IMPORTING
                record           = LE_DATA
                record_structure = LE_STRUCTURE
           EXCEPTIONS
                end_of_object    = 1
                OTHERS           = 2.
      IF sy-subrc <> 0.
        EXIT.
      ENDIF.
      CASE buffer-rname.
        WHEN 'BSAK'.
          wa_arc_bsak = LE_DATA.
          move-corresponding wa_arc_bsak to Tab_ARC_bsak.
            APPEND Tab_ARC_bsak.
            CLEAR: wa_arc_bsak, LE_DATA, Tab_ARC_bsak.
      ENDCASE.
      ADD 1 TO number_of_records_read.
    ENDDO.
ENDDO.
* close the archive session
CALL FUNCTION 'ARCHIVE_CLOSE_FILE'
       EXPORTING
            archive_handle = handle.
Move-corresponding tab_arc_bsak to tab_bsak.
append tab_bsak.
clear tab_bsak.
ENDFORM.                    " read_archive_bsak
Anyone helps??
Thanks in advance!!!
Hoo
Message was edited by:
        Hoo lala

Hi Aditya,
The error msg is 'Incorrect access to an archive.'
Thanks.
Hoo.

BW on HANA, Archive data to Hadoop

Similar Messages

Maybe you are looking for