Help and advice, hint Needed on data Extraction from RSS....

Hello Everyone,
Thanks a lot for all your help on all my posts.
I am posting this question here as I do not really know which forum my question really belongs to.. please bear with my silliness.
I am wondering if there is a way to extract data from a RSS/ATOM directly into a database ? to explain it further..
say there is a site called www.dummy.com and it provides RSS, now I want to extract all data from that RSS automatically into a database on a local site.
I do not know if it is really possible... If yes .... describe it a bit in detail Please.
Or please give me some information on where to look for more on this topic please.
I can handle the programming part but I do not know how to do it.. I will really appreciate your input please.
If I am in the wrong forum please let me know which forum I should post this question on.
Million Thanks in advance.

Really there is not much to it. Get a simple file that lists the URLs off the RSS feeds.
loop over the list and us Vlad Patryshev URLConnection class to get the XML
Check the last updated time against your current copy and if new update your database (see table structure given). Save the data as BASE64 to save formatting issues and unicode issues.
Then using the JDOM jar you can read the XML and produce any output you require.
Wanting: I would recommend scanning the output for an <script>, and special chars that might try to inject XSS code into your site. It's a little risky putputting RSS data directly to your site without checking it over first.
Personally I would manually check and approve all new RSS data but I am sad :)

Similar Messages

  • DATA EXTRACTION FROM ORACLE & SYBASE

    Hello members...
    Good day. This is my first posting in this site. I am new to Oracle and have a question regarding Data extraction from Oracle and Sybase.
    My project has two applications one having Oracle as the database and the other has Sybase as the database. On the proposed production schedule, there would be a interface data update from the Oracle database to the Sybase database.
    My aim is to check if the data update is in sync after the update. We plan to extract the data from the two databases (Oracle and Sybase) and compare in a Third Party tool. We have the tool to compare. Can any of you suggest a nice data extraction tool. I have to set this data extraction as a batch in the nightly batch schedule.
    Thanks in advance,
    Regards,
    Krishna Kumar...

    Sybase provides the best data extraction utility called BCP. You can load and extract data. It is very user friendly. From your unix prompt if you type in BCP ? you will all the switches and
    help messages you need to use. It is so simple.
    Oracle dosn't have such a utility to extract data from table.
    You need to write a Stored procedure and use UTF_FILE package to
    extract data from table and write into a file.

  • Hi, I need help and advice. Basically me and my ex partner both had iphones and synced it with the same computer under the same ID. We split i have a new laptop and now it keeps asking for the old ID or it'll erase my apps bought on theold account.

    Hi, I need help and advice. Basically me and my ex partner both had iphones and synced it with the same computer under the same ID. We split up and now im trying to get all my apps and info onto my new laptop with a new account but it keeps asking me for the old apple ID which she is still using and she changed the password. i tried backing it up but still nohing. When i try to back up purchased items being apps etc its keeps asking for the old one. help

    See Recover your iTunes library from your iPod or iOS device. But you'll still need the password.
    Once you have the computer authorized to use the account she could change the password again to stop you buying apps on her card (assuming it's not on yours!). It would lock you out of upgrading them too but they should work unless she uses the deathorize all feature.
    It depends on how amicable the split is...
    tt2

  • I am using InDesign CS5. I have a body of text which is ranged left with tabbed indents. My client now wants the copy to be justifed, keeping the tabbed indents. Help and advice needed please!

    I am using InDesign CS5. I have a body of text which is ranged left with tabbed indents. My client now wants the copy to be justifed, keeping the tabbed indents. Help and advice needed please!

    Hi
    That screen grab helps a lot. There’s a much easier way of doing what you’re doing.
    Remove all your tabs and set the text in justified paragraphs.
    I’ve typed in dummy text in the example I made below, but after “19.1” put in a space and put your blinking cursor after the space and before the ’N’ of ‘Notices'.
    Then hold down the Command key and hit Backspace (on Mac at least - it’s the key between the Inverted commas/ apostrophe key and the return key).
    The text will jump into place the way you want it to.
    Hope that helps
    Paul
    PS You can set a tab, instead of using a space, in the description I gave above. So, after 19.1 or 19.2 or 19.185 etc etc insert a tab, then hit the Command Backspace after every paragraph number and they'll all line up exactly together. You'll find that editing text within the paragraphs
    after you've set it will be LOADS easier this way.
    You can put the tab anywhere you want it to be using 'Command-ShiftT' and putting a 'left align' tab just after the number. Just type the Command Backspace after the paragraph number and it'll work

  • A very new user needs some help and advice....

    Hi,
    I have just taken the bold leap into Indesign and this is the first day of my 30 day trial.
    I need help and advice from you good poeple...please.
    I have been successfully creating A5 booklets (folded A4) using MS Word and printing to a desktop printer. MS Word sorted out my page order for me at printing time so the correct pages were put together.
    I have been reading as much information as I could find but I am still unable to do the same in Indesign.
    I'm looking forward to using the advanced layout features and having control over what I do but, I need to work out this basic step before I go any further.
    I hope what I have explained makes sense.
    Regards
    John

    So presumably you create a new document, A5 portrait, facing pages. Make sure your ducument page count is a multiple of 4.
    Create, type, tweak, ponder, edit, smile, save.
    To create you booklet using InDesign, from the file menu select Print Booklet.
    You will probably need to jump back and forth from the Print Settings button adjusting Paper Size, Orientation, Color, and from the Print Booklet tab set for 2-up Saddle Stitch.
    Much has been posted on this topic, these are the basics, Print Booklet is not the best module Adobe ever wrote, IMO

  • Data Mart and Data Extraction from an Infocube

    Can a data mart which is built on one Infocube in BW support delta extraction? We have two separate BW systems and are trying to extract data from one Infocube in one BW (Source) and load it to one Infocube in another BW(Target)?
    We have built a data mart on the source BW infocube and have successfully been able to extract and load the initial data load into the target BW infocube. I noticed that the field 0RECORDMODE was not on the datasource that was created to support this data mart so my gut feeling is that we will not be able to do delta data extractions from this data mart.  Any feedback or confirmation of this?

    Hi,
    The InfoCube that is used as an export-DataSource is first initialized , meaning that the current status is transferred into the target BW. When the next upload comes around only those requests will then be transferred that have come in since the time of initialization. Different target systems can also be supplied like this
    Since it is request based ..data mart on info cube supports delta.
    Hope its helpful,
    Anu.

  • Ho to automate data extraction from KSB1 and GR55 transaction code

    Hi All,
    Can you please let me know if their is a way to automate data extraction from transaction code KSB1 and GR55. I have to extract data from 5 different servers .i.e different server for each region and again i have different controlling area codes in each region. Following are the details which i use to extract the data. It takes too long for me to extract data from all this regions and controlling area codes using my parameters. It's very time consuming so i want to automate this process. I am end user so i don't have any admin rights. Please let me know any workable solution asap.
    Production areas : PNA for Americas, PSI for Asia Pacific and Japan, PGY for Germany, PIT for Italy and PEU for Europe
    Controlling area codes in PNA : CAR for Argentina, CBR for Brazil, CMX for Mexico and CUS for USA. Same way there so may other controlling area codes for all other production areas
    Period From 1 to 12
    Fiscal Year : 2009
    Cost Centre Group : G_6284
    Cost Element Group : 1742000000
    Please let me know in case you need more details.

    Hi,
    Here follows a translation from German:
    SAP GUI (client) for Windows enable
    Start SAP Logon and log on to the SAP server.
    Click the button on the toolbar to adjust for Local Layout.
    Click Options and then click the tab for the scripting.
    Select the Enable checkbox for scripting.
    Disable the checkbox for Notify when a script is assigned to an active GUI and the checkbox for Notify when a script opens a connection.
    Save the settings and restart the SAP GUI again.
    SAP-server enable
    With the following procedure, you can enable scripting by the SAP client temporarily. The specified value in this way is lost when you restart the server.
    Start SAP Logon and log on to the SAP server.
    Start a transaction RZ11.
    Enter sapgui / user_scripting in the window to manage the profile parameters.
    Click on ads.
    Click in the window to display the profile parameter attributes to change value.
    Enter TRUE in the field for a new value.
    Save the settings and log out from the SAP GUI.
    Quit the SAP Logon.
    Note:
    If the server administrator edited the application server profile of the SAP system to sapgui / user_scripting = TRUE to include the scripting is enabled when you restart the server by default.
    SAP provides an option to change the network connection mode at any server. The following two connection modes are available: high-speed connection (LAN) and connecting with a slow speed. Although Functional Tester works in both modes, the high-speed connection with a recorded script is played only in this mode. This also applies to other modes. They must reflect your SAP script in the same network connection mode, with which the script was recorded. It is recommended that the mode of "high-speed connection, as it offers a greater number of valid recognition properties.
    Regards,
    ScriptMan
    Edited by: ScriptMan on Apr 13, 2010 12:32 PM

  • I have an urgent question about my indesign. I had problems with the creative cloude app and then uninstalled it and then installed it again. Now it is not opening and I cannot download it again either. Pls give me help and advice if there is anything I c

    I have an urgent question about my indesign. I had problems with the creative cloude app and then uninstalled it and then installed it again. Now it is not opening and I cannot download it again either. Pls give me help and advice if there is anything I can do to repair it

    Please authorize ADE 3 with same credentials that you used with older version of ADE

  • Steps for Data extraction from SAP r/3

    Dear all,
    I am New to SAP Bw.
    I have done data extraction from Excel into SAP BW system.
    that is like
    Create info objects > info area> Catalog
                                                --> Character catalog
                                                --> Key catalog
    Create info source
    Upload data.
    create info cube
    I need similar steps for data extraction for SAP R/3
    1. when data is in Ztables ( using Views/Infosets/Function etc)
    2. When data is with Standard SAP using Business Content.
    Thanks and Regards,
    Gaurav Sood

    hi,
    chk the links
    Generic Extraction
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/84bf4d68-0601-0010-13b5-b062adbb3e33
    CO-PA
    http://help.sap.com/saphelp_46c/helpdata/en/7a/4c37ef4a0111d1894c0000e829fbbd/content.htm
    CO-PC
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/fb07ab90-0201-0010-c489-d527d39cc0c6
    iNVENTORY
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/f83be790-0201-0010-4fb0-98bd7c01e328
    Extractions in BI
    https://www.sdn.sap.com/irj/sdn/wiki
    LO Extraction:
    /people/sap.user72/blog/2004/12/16/logistic-cockpit-delta-mechanism--episode-one-v3-update-the-145serializer146
    /people/sap.user72/blog/2005/01/19/logistic-cockpit-delta-mechanism--episode-three-the-new-update-methods
    /people/sap.user72/blog/2005/02/14/logistic-cockpit--when-you-need-more--first-option-enhance-it
    /people/sap.user72/blog/2004/12/23/logistic-cockpit-delta-mechanism--episode-two-v3-update-when-some-problems-can-occur
    /people/sap.user72/blog/2005/04/19/logistic-cockpit-a-new-deal-overshadowed-by-the-old-fashioned-lis
    Remya

  • Data Extraction from CRM to BW

    Hi,
    I just need some information/help on BW Data Extraction from CRM, it would be great if some one could help out or mail some related help documents.
    Currently we are implementing the complaints module in CRM simultaneously on the BW side we have identified an info cube for complaints 0CSAL_C09, but this cube and its ODS source does not have all the required fields like (newly created text types, serial number etc), so how these tables and fields can be identified in the source system and added to extract structure in CRM. Also what is the table in which the CRM transaction data would be stored.
    Especially i require the newly added text types in CRM to appear in BW, there are around 5 new text types are added and user can enter free text, i need these information to be captured in reports. kindly mail me the steps to [email protected]
    Thanks
    Akila.R

    hi,
    try these links
    http://help.sap.com/bp_biv335/BI_EN/html/BW/SalesAnalysis.htm
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/f2910623-0c01-0010-de8f-d1926988a986
    http://help.sap.com/bp_biv135/html/bw.htm
    http://help.sap.com/bp_biv135/html/BW/SalesAnalysis.htm
    http://help.sap.com/bp_biv235/BI_EN/index.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/af/ed833b2ab3ae0ee10000000a11402f/frameset.htm
    this:
    http://help.sap.com/bp_biv235/BI_EN/index.htm
    http://help.sap.com/saphelp_nw2004s/helpdata/en/af/ed833b2ab3ae0ee10000000a11402f/frameset.htm
    regards,
    pankaj singh
    reward if helpful

  • Function module searched: Data extraction from BW to R/3?

    Hello everybody,
    has anyboday any idea on which function module or function group could be used for data extraction from BW to R/3?I have seen some threads,and found the function group RSAX which is actually for extraction from R/3 to BW,is it also suitable for the other direction(BW to R/3)?
    I have looked for this topic for a long time,but so far no success...
    Would you like to give me some hints?
    Regards,
    Liying
    Message was edited by: Liying Wang

    Hi,
    It's going to be an extraction to specific application in R/3 - couldn't be any universal extractor - applications have their own specific.
    But you can try application specific retractors, as examples look here:
    http://help.sap.com/saphelp_sem320bw/helpdata/en/99/97157967e3440a94d199538959cd0b/content.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/c4/b2af6569e64418a21bd0ab4d83be83/content.htm
    Open hub functionality is another option:
    http://help.sap.com/saphelp_sem40bw/helpdata/en/ce/c2463c6796e61ce10000000a114084/frameset.htm
    Best regards,
    Eugene

  • Master data extraction from SAP ECC

         Hi All,
    I am a newbie here and teaching myself SAP BI. I have looked through the forums regarding master data extraction from SAP ECC in all forums but could not answers for my question. Please help me out.
    I want to extract customer attributes from SAP ECC. i have identified the standard data source 0customer_attr and replicated in SAP BI. I have created infopackage for full update. I validated the extractor checker(RSA3) and found 2 records for 0customer_attr.
    When I run the info package, the info package remains in yellow state until it times out. Please let me know in case i am missing anything, Please let me know if there is any other process for master data extraction similar to transaction data extraction.

    Hi All,
    i did the below and afte clicking execute in the Simple job, it takes me back to the Monitor Infopackage screen.
    From your info pack monitor --> menu environment-->job overview--> job in the source system--> prompts for source system(ECC) user id and password, enter them, you will get your job at SM37(ECC), select job and click on log details icon. there you can see details about your error. please share that error screen shot.
    Please find the screenshots.
    I did an Environment -->Check connection and found the below,

  • Performance Tunning- data extraction from FMGLFLEXA table

    Hi,
      Need to fetch data from FMGLFLEXA table based on below condtion.
           WHERE rfund IN s_rfund
               AND rgrant_nbr IN s_rgnbr
               AND rbusa IN s_rbusa
               AND budat LE v_hbudat.
    Please tell me how can i optimize this extaraction b'coz in production system there are lacks of records.
    Regards,
    Shweta.

    create a index on these fields due to which data extraction from table will be fast.

  • Data Extraction from Informatica

    Hi BI Gurus,
    I want to extract the data from SQL server through informatica. I went through SDN, but  I am not able to found relevant information. Please share the steps (methods) or links or documents about data extraction from informatica.
    Regards,
    PRK

    Hi,
    Use UD connect procedure to extract the data from Informatica or SQL server. you just need to create a new source system with the parrameters that can connect and read the SQL sever.
    There is another way of extracting it through DB connect as well, but I recommend you to go through the UD connect procedure to extract the data.
    Check with your basis team to setup a source system for SQL server if you are not aware of how to as it is purely based on TCP/IP.
    you need to create a source system as trird pary and supply the parrameters to it. Create a TCP/IP connection in SM59 to that source system where it need por numbers, schemas, alias etc to connect to the SQL server.
    Browse for UD connect in WIKI, will guide you good docs.

  • Data extraction from Siebel to BW - use BC or not

    Hello
    I am doing data extraction from Siebel to BW. I can map just 15% of Siebel fields to SAP BC data sources. Do you still recommend me to use BC or forget it and create whole buch of new infoobjects and custom ods/cubes?

    Hi,
    If data is comming from out of SAP, then carefully select the infoObects, because SAP provided InfoObjects are more meaningful and better integration with other infoobjects(Compound Objects, Navigational and so on).If You are created any custom objects, You have to take care all of them in overall design and architecture.
    I am prefering first to choose existing BC Infoobjects, if not available and then create new objects. But here You need lot of functional knowledge also

Maybe you are looking for

  • Problem in e business suite

    Hi, I am installing E business suite12.1 that is downloaded from the oracle e-delivery. Some important things for my ebs installation - 1. OS-microsoft window server 2003 enterprise edition service pack-2 , 32bit 2. Supporting softwares - CYGWIN(beca

  • Trying to Copy Home Movie DVDs

    I create all of my company's training DVDs. Accordingly, a co-worker has asked me to copy some DVDs of home movies he has. To my knowledge there are no copyright issues. Is there a way I can copy these using FCE/IDVD or disk utlity?

  • Sync Personal IMAP E-mail

    On my iphone, all my e-mails would sync because it was imap. From what i understand, the way i set up my personal e-mail on my blackberry is imap. why is it that i only have e-mails displayed from the date that i set up the e-mail account on my black

  • How to use Graphics in swings?

    Hi, I would like to write a Graphics application in swings, Is it possibel? help me.

  • E66 Firmware update help

    Hi All, My name's Ty and I'm from new Zealand. Have a question to be helped please.  My Phone tells me I currently have the lastest firmware version. Problem is that I know there's been a new update to 200.something.somthing. Because of my product co