Get all html files from a url

Hi I am trying to do a website copyer and i don't know how get all the html from a url.
By example:
I want get all files html from http://forum.java.com/
aAnybody has an idea of how to do this?
Thanks

Not easy. First, you'll have to look at networking programming - how to make URL connections etc.. Then, you'll have to look at HTML parsers - how to extract links, images, etc. from an HTML page. Also, you'll have to know how to do file I/O in order to save the HTML files obtained.
I don't know of any Java-based web site copier open source projects that you can refer to, but you can take a look at the source code for projects such as HttpUnit and HtmlUnit. They contain code that'll help you with your web site copier.
Good luck!

Similar Messages

  • How to sinc two computers and get all the files from both

    Not sure if this is the right forum for the issue, but... I have a iMac G5 and a MacBook, and I use one or the other for my work. That way I get part of my work on one, and other part on the other Mac. Now, I would like to sinc both of them, so that I have all the files from iMac on the MB, vice versa. I know that I could go slowly and use an external hard drive, copy files from one computer, save on another, but is there any handier and faster way to do it?
    Thanks
    Zo

    http://docs.info.apple.com/article.html?path=Mac/10.4/en/mh664.html
    http://docs.info.apple.com/article.html?artnum=106461

  • How to get all image files from a folder to wwv_flow_files?

    Hi there!
    Is it possible in apex to show, in a report look-a-like, all image filenames from a folder in another machine (i enter in that machine by ip) and insert all files into wwv_flow_files?
    I want to see all files, then pick one and open a image...
    But it can't be by browse item... it has to show all filenames as a list...
    If it is possible, how can i do it?
    Thanks!
    Best regards,
    Luis Pires

    Hi,
    you can connect to the server using UTL_HTTP.
    Then for each files you copy the response into a BLOB to be able to show it or to store it in a table.
    A piece of code :
    begin
       -- initialize the BLOB.
       dbms_lob.createtemporary(l_blob, false);
       -- path to the file
       l_url := 'http://your_server/your_file.jpg';
       -- begin retrieving the target.
       l_req := utl_http.begin_request(l_url);
       -- identify ourselves (some sites serve special pages for particular browsers)
       utl_http.set_header(l_req, 'User-Agent', 'Mozilla/4.0');
       -- start receiving the response.
       l_resp := utl_http.get_response(l_req);
       -- copy the response into the BLOB.
       begin
          loop
             utl_http.read_raw(l_resp, l_raw, 32767);
             dbms_lob.writeappend (l_blob, utl_raw.length(l_raw), l_raw);
          end loop;
          -- stop when exception end_of_body is raised
       exception
          when utl_http.end_of_body then
             utl_http.end_response(l_resp);
       end;
    end;It's a minimal example, you may need authentication, check l_resp.status_code, etc...

  • How do I get all the files from the hard drive in non-working Compaq Presario CQ62-411NR

    Spilled iced tea into the keyboard of notebook and after drying out it will not power on. If I try a hard restart it is indicated that i would lose all the info in the memory and I can not afford to lose the photos of my mother that are on the hard drive. Is there a way of getting the hard drive to work in some other fashion so that I can get my photos and other files.
    This question was solved.
    View Solution.

    Very happy to help.Valued family photos are a treasure.
    ******Clicking the Thumbs-Up button is a way to say -Thanks!.******
    **Click Accept as Solution on a Reply that solves your issue to help others**

  • Cant get all my files from external hard drive onto my MBP

    I have a seagate external hard drive with music on it. When I drag files to my MBP, it does not copy all of them. I've tried everything, but some files just won't copy to my MBP. Any ideas how to resolve this?

    READ the article from which the question was posted and follow the explict instructions provided.

  • I was able to copy all my files from my Time Capsule, but that is all they are...files. How do I get my new Mac Mini to emulate my other Mac?

    I was able to copy all my files from my Time Capsule, but that is all they are...files. How do I get my new Mac Mini to emulate my other Mac?

    Doggiemommie,
    Copying files is not a good idea.
    The "other Mac" was backed up onto Time Capsule using the Time Machine. On your new Mac you should restore the old user - rather than copy files manually.
    This usually happens during the initial setup of the new computer or you can do it later using Migration Assistant.
    Please note, it is possible to damage backup file on the Time Capsule when you browse it and copy files manually.
    Hope this explains.
    TZ

  • Need to get all the files, well music and video, from my ipod touch 5th gen to my itunes libary.

    Need to get all the files, (well music and video), from my ipod touch 5th gen to my itunes libary. (So basically sync the other way to normal)
    Laptop hard drive broke so had to buy a new one and obviously now need to sort out my itunes.
    Did try downloading all my purchased stuff onto itunes but it has missed some things off, and there are some files I did not purchase from itunes so need a way of getting them back on there.
    Sure this question has been asked a million times but can't find anything to help me on here so thought I'd ask.
    -Did have a look at going onto the start menu and opening the hidden items thing but couldn't see any reference to ipod or device on it so wasn't sure how to do it that way.
    -On itunes under my device when its connected, the section about manually restoring and backing up, would that help me? Because that says it will manually back up my ipod to my computer then could restore that back up, obviously I don't want to accidnetally get rid of everything on my ipod so didn't want to try that just in case without checking.
    (And yes I have disabled auto sync to device when conncected!)
    Can anyone help me please? Sorry if i've overcomplicated this!
    Thanks:)
    Chris

    Backing up an iOS device will copy some data to a backup file within iTunes, but this excludes all media.  You can also transfer iTunes Store purchases from the iDevice to iTunes but, without using a third-party tool, nothing else.  As long as you do not sync the iPod with your new library, the media that's on it will remain ... for as long as it keeps functioning, is not lost, stolen, eaten by the dog, ...
    You may also have an option to recover your previous library from your old laptop; as long as its hard drive isn't fried, a computer repair store or technician may be able to extract the drive, mount it in an external enclosure, and copy your data to another PC.  Whatever you choose, there is no real alternative to having all your media on your computer, managed by iTunes, and regularly backed up to another device/location.

  • 2006 iMac running 10.4 OS. I copied files to ext. drive. Put in 10.6 disc and did a clean install (format) of 10.6. Copied data from ext. drive back to Mac. I didn't get all the files. CAN I REVERT BACK TO THE 10.4 OS SO I CAN COPY MY DATA PROPERLY?

    2006 iMac running 10.4 OS. I copied files to ext. drive. Put in 10.6 disc and did a clean install (format) of 10.6. Copied data from ext. drive back to Mac. I didn't get all the files. CAN I REVERT BACK TO THE 10.4 OS SO I CAN COPY MY DATA PROPERLY?

    How did you copy files to the external drive, and what files did you copy? Did you drag and drop in the Finder? Use a clone utility? What files did not successfully copy?
    If you reformatted the drive as part of your install, then you won't be able to recover any files from the drive. Reverting back to (reinstalling) 10.4 will not help you.
    Do you have a complete-drive backup of your old system?
    Matt

  • Got a new external hard drive. Transferred all files from old hard drive to new hard drive. Connected hard drive to macbook. How do I get all my files to be recognized by iTunes and my already made playlists??

    Got a new external hard drive. Transferred all files from old hard drive to new hard drive. Connected hard drive to macbook. How do I get all my files to be recognized by iTunes and my already made playlists??

    Trying to download photos from IPHONE, IPAD to IPHOTO in IMAC after installing new hard drive.
    How did you import the photos to iPad and iPhone?
    If the photos have been synced to the iPhone and iPad using iTunes, you cannot sync them back.
    See this document:  http://support.apple.com/kb/HT4236
    You can't reimport pictures synced from your computer to your device back to your computer. You can only import pictures in the Camera Roll or Saved Photos from your device to your computer. If you need to retrieve synced photos from your device:
    If your photos are not in the Camera Roll on your devices, save them to the Camera Roll, share them to the Photo Stream, mail the photos, or, if you have iPhoto on the devices, use iTunes Photo Sharing.
    http://help.apple.com/iphoto/iphone/2.0/?handbuch#blnkee26bc1
    Save photos to your computer using iTunes
    Connect your iOS device to your computer.
    Tap a photo, album, event, web journal, or slideshow and tap Share> iTunes.
    Tap Selected, or change the photos you want to save (if you are saving a slideshow skip to step 4):
    Select different photos: Tap Choose Photos, tap one or more photos, and tap Next.
    Select a range of photos: Tap Choose Photos, tap Range, tap the first and last photos in the range, and tap Next.
    Select all the photos in an album or event: Tap All.
    In iTunes, click the button for your device and click Apps at the top of the window.
    Below File Sharing, select iPhoto (in Apps).
    Select the Shared Photos folder under iPhoto Documents.
    Click Save To and select the location on your computer where you want to save the items.
    To view your photos, go to the Finder and look in the location you selected above.

  • Just got a new mac computer and none of the music from my old computer's itunes transfered when I transfered the contents of the hard drive.  Now I'm trying to transfer music from my ipod and can't get all the files....help?

    Just got a new  computer and none of the music from my old computer's itunes transfered when I transfered the contents of the old hard drive.  Now I'm trying to transfer music from my ipod and can't get all the files....help please?

    The iphone is not a storage/backup device.
    It has always been very basic to always maintain a backup copy of your computer for this very occasion.
    Have you failed to do this?
    If so, not good, then you can transfer itunes purchases:  File>Devices>Transfer Purchases
    You may be able to purchase a third partyn program to get the rest ( not supported by Apple)

  • If I restore My Mac OSX Snow Leopard can I get all my files back from a time machine backup made on a portable hard drive?

    I want to restore my MacBook Pro running Snow Lepoard, I made a time machine backup on a portable hard drive, can I get all the files back when resseting the OSX from the Hard Drive?

    If you're using the Mac App Store version, there is initially no clean install option unless you're running the installer on a different drive or partition; your existing data will remain as is. If you're doing it from Lion's recovery partition or using the USB flash drive after erasing the internal drive, yes.
    (64046)

  • Generate an HTML file from a Report in ABAP

    Good morning,
    How I could generate an HTML file from a report.
    Any Ideas... I have found the function WWW_ITAB_TO_HTML, but someone has the standar code and how use this function?
    Thanks a lot,
    Hernán Restrepo

    Hi,
    I am facing a similar problem.I did try using the function module WWW_ITAB_TO_HTML in the reoprt program, as I'm trying to generate a url from a report, but i'm not able to get the expected results. The code is given below. Could someone please try and help me resolve this issue.Thanks in advance.
    DATA:   emp_name                     TYPE char80.
    DATA:   it_itabex                    TYPE zdb_ex_tty,
            it_emp                       TYPE TABLE OF zis_emp,
            it_org                       TYPE TABLE OF zis_org,
            it_pos                       TYPE TABLE OF zis_pos,
            it_pos_alloc                 TYPE TABLE OF zis_pos_alloc,
            it_res                       TYPE TABLE OF zis_res,
            it_res_alloc                 TYPE TABLE OF zis_res_alloc,
            ls_itabex                    TYPE zdb_ex_s.
    DATA:   lv_filename                  TYPE string,
            lv_path                      TYPE string,
            lv_fullpath                  TYPE string,
            lv_replace                   TYPE i.
    DATA qstring LIKE it_itabex OCCURS 10.
    DATA: url(200), url2(200), url3(200), fullurl(200).
    FIELD-SYMBOLS: <fs_emp>              LIKE LINE OF it_emp,
                   <fs_org>              LIKE LINE OF it_org,
                   <fs_pos>              LIKE LINE OF it_pos,
                   <fs_pos_alloc>        LIKE LINE OF it_pos_alloc,
                   <fs_res>              LIKE LINE OF it_res,
                   <fs_res_alloc>        LIKE LINE OF it_res_alloc.
    Report Program to export data from database to Excel.
    Populate all the tables that have to be exported.
    SELECT * FROM zis_org       INTO TABLE it_org.
    SELECT * FROM zis_pos       INTO TABLE it_pos.
    SELECT * FROM zis_pos_alloc INTO TABLE it_pos_alloc.
    SELECT * FROM zis_emp       INTO TABLE it_emp.
    SELECT * FROM zis_res_alloc INTO TABLE it_res_alloc.
    SELECT * FROM zis_res       INTO TABLE it_res.
    Append the Column Header
    CLEAR ls_itabex.
    ls_itabex-ipp_pos_id            = 'IPP Pos ID'.
    ls_itabex-emp_name              = 'Name'.
    ls_itabex-dt_of_join            = 'JoinedOn'.
    ls_itabex-emp_status            = 'Status'.
    ls_itabex-org_name              = 'Org'.
    ls_itabex-prj_name              = 'Project'.
    ls_itabex-mgr_name              = 'Line'.
    ls_itabex-designation           = 'Designation'.
    ls_itabex-specialization        = 'Specialization'.
    APPEND ls_itabex TO it_itabex.
    Append all the tables into one internal table
    LOOP AT it_pos_alloc ASSIGNING <fs_pos_alloc>.
      CLEAR ls_itabex.
      ls_itabex-ipp_pos_id          = <fs_pos_alloc>-ipp_pos_id.
      READ TABLE it_emp ASSIGNING <fs_emp> WITH KEY emp_guid = <fs_pos_alloc>-emp_guid.
      IF sy-subrc = 0.
        CONCATENATE <fs_emp>-emp_fname <fs_emp>-emp_lname INTO ls_itabex-emp_name  SEPARATED BY space.
        ls_itabex-dt_of_join        = <fs_emp>-dt_of_join.
        ls_itabex-emp_status        = <fs_emp>-emp_status.
        ls_itabex-specialization    = <fs_emp>-specialization.
      ENDIF.
      READ TABLE it_pos ASSIGNING <fs_pos> WITH KEY ipp_pos_id = <fs_pos_alloc>-ipp_pos_id.
      IF sy-subrc = 0.
        ls_itabex-designation       = <fs_pos>-designation.
        READ TABLE it_org ASSIGNING <fs_org> WITH KEY  org_id = <fs_pos>-org_id.
        IF sy-subrc = 0.
          ls_itabex-org_name        = <fs_org>-org_name.
          ls_itabex-mgr_name        = <fs_org>-mgr_name.
        ENDIF.
      ENDIF.
      READ TABLE it_res ASSIGNING <fs_res> WITH KEY org_id = <fs_org>-org_id.
       ls_itabex-org_name         = <fs_org>-org_name.
      APPEND ls_itabex TO it_itabex.
    ENDLOOP.
    url = 'http://testweb/scripts/wgate/zvw10a/!?~language=en'.
    url2 = '&~OkCode(LGON)=LGON&login-login_user='.
    url3 = '&vbcom-vbeln='.
    CONCATENATE url url2 url3 INTO fullurl.
    WRITE: /'Staffing Excel'.
    CALL FUNCTION 'WWW_SET_URL'
      EXPORTING
        offset        = 12
        length        = 10
        func          = fullurl
      TABLES
        query_string  = qstring
      EXCEPTIONS
        invalid_table = 1
        OTHERS        = 2.
    Thanks & Regards,
    Preethi.

  • Get all the values from a multiple select in a multipart form

    Hi there!
    I am using a form with enctype="multipart/form-data" in order to upload files from the form.
    I have read this page: http://commons.apache.org/fileupload/using.html and everything works well for my form.
    The only problem is that I can't get all the values from a "multiple select" html object. I get only one value.
    Using servlets I have used this method:
    public java.lang.String[] getParameterValues(java.lang.String name) But now I have enctype="multipart/form-data" in my form and I can't use this way...
    Is there a way to get all the values of a multi-valued parameter?
    Thanks a lot!
    Stefano

    Hi
    I have got solution for this problem so, I am listing here logic
    assume tag name of html
    <select name="moption" multiple="multiple">
    iterate it in as
    String moption="";
    boolean cnt=true;
    while(itr.hasNext())
    FileItem fi=(FileItem)itr.next();
    if(fi.isFormField())
    if(fi.getFieldName().equals("moption"))
    if(cnt==true)
    moption=fi.getString();
    cnt=false;
    else
    moption=moption+","+fi.getString();
    If wants more help then mail me your problem
    at [email protected]
    Thanks!
    Anand Shankar
    Edited by: AnandShankar on 6 Nov, 2009 12:54 PM

  • Urgent- using adobe flash player 10 to view files from a URL (in javascript)

    Hello
    I am trying to cereate a video search engine that retrieves and then plays videos. I have decided to use adobe flash player to play the given files, howver with no luck. I am successful at actually hosting the player in my html code, however, when I provide the player with the following URL to retrieve the video frmo it, I am completely unsuccessful at getting the video to play in the player.
    http://developer.truveo.com/apps/home/index.php?method=truveo.videos.getVideos&query=id%3A 4186222390&play=1
    what am I doing wrong? this is extremely urgent that I get this donem running against a close deadline. Kindly, advise me what is the best way to play the files from such URL's after the search engnie has found them. The whole thing I am trying to acheive is playing a given searched video within my current html page. So i decided to host the player in my code.
    Please, do take some time to consider my request. Your time is greatly appreciated
    Best

    This seems to be a problem for everyone. A
    ny new downloads to fix this issue?
    Thanks,

  • Write HTML Files from java application

    Hello,
    i have to write HTML files from a java application.
    I am asking if anybody can give me a hint about a good simple solution (library) which can do some of the job for me.
    i know FOP for example is good to create pdf or html from xml, but i dont want to go via xml.
    the sites i need are really very simple presents emails.
    body and maybe a link for next and pervious.
    however, thank you in advance.
    a little hint will also help :)
    Sako.

    That, too, is my question.
    Be the "server" local or remote, wouldn't JSPs still
    be the easier solution? No. it will not. because you need a server. Server for a stand alone application is not esier. according to who said JSPs are easy?
    Its very very difficult.
    >
    When answering, please clarify. I'm a bit of a newbie
    here. :)To get sence about how hard is JSP, check Struts. this is very good open source Framework to simplify the JSPs. but it still complecated enough.
    or Tapestry my lovely open srouce Framework.
    its easier than Struts. but sill complecated because of the documentation.
    All in all, using JSP is the purpose of Java in the internet. but not for me. My application will not be available in the internet, i.e. no server, i.e. no need for JSP.
    i hope that helps a little.

Maybe you are looking for