Interact with web site

I'm programming a chatbot that will be able to get information from web site if it isnt in the script. Im at the stage where I want to use a web site's search engine, namely www.imdb.com/search to continue. The idea is I will send the search term on java program, the program connect to the web site, uses the search engine on the site and get the resulting web page. The program get the html code, process it and exact whatever user want to know.
Problem: I have no idea how to make a program that will be able connect to imdb, to do a search on imdb's search engine and get the html for further process. Can anyone advice me on how to interact with their's search engine and get the result?
The code i got so far can only exact the html code, however this will not work because imdb connection refuse.
     URL yahoo=new URL("http://www.imdb.com/");
     BufferedReader in = new BufferedReader( new InputStreamReader (yahoo.openStream()));
     String inputLine;
     while ((inputLine=in.readLine())!=null)
          System.out.println(inputLine);
          in.close();
          }

Thank for the direction and tips. Now I have more understanding of what I needed to do. However, I still cant come up with an solution for what I needed to do. I read the wiki page on
HttpClientPowered A list of applications that use HttpClient
Client HTTP Programming Primer
What I need to do is to use those API to perform search and get the resulting html code, with my limited understand of both Java and web technology, I can find which method I need to perform a search and get the resulting html code.
Can anyone give me more details please, I need to decide what I need to do within a week depend on if I can make that part of the program.
Thank
Also I tried some of those example code, I cant make them run cause im missing org/apache/commons/logging/LogFactory, cant find it on the download section. Im thinking of getting the html code from .Net now...can you show me what is the code to do it in .Net please? I know nothing in .Net btw.
Edited by: kent99 on Jan 26, 2009 3:25 PM

Similar Messages

Is there a way to have the iPad 2 "read" text from iBooks as with web sites or pages?

is there a way to have the iPad 2 "read" text from iBooks as with web sites or pages? A different App perhaps?

Isn't that you asking how to get it (undefined) back?
If you never had Pages '09, you can buy it from Amazon very cheaply:
http://www.freeforum101.com/iworktipsntrick/viewtopic.php?t=432&sid=f68e84cd2ec6 123bd2ed93806c7e7fb6&mforum=iworktipsntrick
Peter

[WP8.1][C#]Interacting with web pages in WinRT

I'm writing a Windows Phone 8.1 application. How would I programmatically interact with web pages- for example, search something on Google?
The main problem seems to be, I can't access the underlying HTML document of the WebView control.
What I have tried so far:
using HtmlAgilityPack (only supports parsing, can't interact)
trying to get underlying document w/ reflection (limited WinRT reflection APIs)
looking into other cross-platform GUI toolkits, such as Qt# (also do not provide access to document object)

Hi James.Ko,
To help clarify your post and let people easily tell what it is about, please use a clear and concise subject and include applicable tags.
We will help to modify the title tag base on this sticky post
or you can modify it by yourself(recommended), and thanks for your cooperation.
Before trying to answer your question, I would recommend you a blog:
http://blogs.msdn.com/b/wsdevsol/archive/2014/04/03/ten-things-you-need-to-know-about-webview-_2d00_-an-update-for-windows-8.1.aspx
You should be able to know how to invoke script into the pages and also how to get the return value. By the way, not quite understand what do you mean by underlying HTML document, means the HTML code?
--James
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

How does Openscript Interact with web components ?

I was wondering how does openscript interact with web objects (eg Edit boxes, buttons), is it through some JNI api ? If yes in which package I can find this ?

I am going to make the assumption from your comments that you are asking about using OpenScript to test applications based on Apple's WebObjects server. If that is a bad assumption let me know ...
The scripts you build against the application will work in a similar manner to those that are built against other java based application servers in that the tool will be using the various key attributes of the html objects to locate them and replicate actions against them. Typical UI driven scripting ... That said, if your testing brings you down a level from the UI and you are trying to test some of the components of the application server tier specifically, well, then you might have to write your own java code to do it.

Interacting with Web pages

We have developed a J2EE application (jsp, struts, ejbs, etc.) and now have a requirement to interact with hardware at the client's site. The application needs to interact with printers, check readers and DL readers. Can a JWS application interact with the web pages?
For example, when a check is scanned, can the information be displayed on the web page? Additionally, we need to be able to print on both sides of the check. If I tell the application to print, can it respond back to the web application when it is done so the check can be flipped over and printed on the other side?

Java WebStart is "just" a deployment mechanism. An application deployed through JWS can do anything a regular Java application can do (provided it has the appriopriate permissions). This includes talking to whatever kind of server you can think of.
If staying within the sandbox is an issue for your app, you should take a look at the JNLP API, which allows you to do some "safe" things (like printing) on the user's system through interaction with the user. The advantage of staying within the sandbox is not having to sign your app and not having to ask the user for elevated permissions.

Can't interact with Web Content Overlay when article is zoomed in

I have a problem with Web Content Overlay. It's working (interacting) only when article is viewed in 1:1 scale. Articles are added as PDF's, and when i do pinch zoom on them - Web Content Overlay stops reacting on click events.
Is it a general WCO limitation?
Can article with Web Content Overlay be zoomed in and still give user the ability to play with HTML content?
Piotr

Hello,
'''Try Firefox Safe Mode''' to see if the problem goes away. Safe Mode is a troubleshooting mode, which disables most add-ons.
''(If you're not using it, switch to the Default theme.)''
* You can open Firefox 4.0+ in Safe Mode by holding the '''Shift''' key when you open the Firefox desktop or Start menu shortcut.
* Or open the Help menu and click on the '''Restart with Add-ons Disabled...''' menu item while Firefox is running.
''Once you get the pop-up, just select "'Start in Safe Mode"''
'''''If the issue is not present in Firefox Safe Mode''''', your problem is probably caused by an extension, and you need to figure out which one. Please follow the [[Troubleshooting extensions and themes]] article for that.
''To exit the Firefox Safe Mode, just close Firefox and wait a few seconds before opening Firefox for normal use again.''
''When you figure out what's causing your issues, please let us know. It might help other users who have the same problem.''
Thank you.

In Firefox 5 with Web site tracking turned OFF I cannot log in to my router (KPN Experia box).

My home router is a KPN Experia box (I live in the Netherlands) which I administer via standard Web interface. First page of router site is UID/password as to be expected. Having upgraded recently to Firefox 5 (Windows XP & 2000 boxes) I find that if the "Tell web sites I do not want to be tracked" box is ticked then I cannot login. In fact all I get is a message back saying the password is wrong - which it isn't.

Hi Tracy,
I don't suspect Malware yet, Id guess Disk corruption or failing Hard Drive with Files not found.
Could be many things, we should start with this...
"Try Disk Utility
1. Insert the Mac OS X Install disc, then restart the computer while holding the C key.
2. When your computer finishes starting up from the disc, choose Disk Utility from the Installer menu at top of the screen. (In Mac OS X 10.4 or later, you must select your language first.)
*Important: Do not click Continue in the first screen of the Installer. If you do, you must restart from the disc again to access Disk Utility.*
3. Click the First Aid tab.
4. Select your Mac OS X volume.
5. Click Repair Disk, (not Repair Permissions). Disk Utility checks and repairs the disk."
http://docs.info.apple.com/article.html?artnum=106214
Then try a Safe Boot, (holding Shift key down at bootup), run Disk Utility in Applications>Utilities, then highlight your drive, click on Repair Permissions, reboot when it completes.
(Safe boot may stay on the gray radian for a long time, let it go, it's trying to repair the Hard Drive.)
If perchance you can't find your install Disc, at least try it from the Safe Boot part onward.

Problems interacting with various sites

I'm having trouble interacting with and viewing numerous sites. For example:
http://www.facebook.com/SmallBusinessSaturday?sk=app_183558821725512
If I enter a zip and hit enter, nothing happens. It works in both FireFox and Chrome, and shows more on the page.
I checked java on their site; it works. I don't have ClicktoFlash installed. Latest versions; 10.7.2. Reset Safari. I've had similar problems on other sites, and thought it was them, not me. Now I think it's Safari.
Ideas?
Rob
Oops. Got a suggestion offline: it's Ghostery extension. I thought I'd turned it off but it was still enabled.

Oops. Got a suggestion offline: it's Ghostery extension. I thought I'd turned it off but it was still enabled.
It was that extension? If so, good to know.

Need a topic for Verizon Web Site + Issues with Web site (please forward)

Suggestion 1: Add a topic/forum section for Verizon Web site: If I've missed it, please let me know, but I searched the forums and could not find results for "web site," except irrelevant references. Since I could not find one, here is. . .
Suggestion 2: Fix these Web site problems (can someone in Verizon forward these to your Web team? All attempts failed)
On Contact us page, Customer Service link leads to a 404, not found error
Fix faulty 'next page' link in Droid Reviews: When going from page 2 to page 3 of reviews using the 'next' link at the bottom, the reviews change from Droid Reviews to HTC Imagio reviews. Droid still shows at the top, but the content consistently shows that people are reviewing Imagios.
User names like IluvImagio and imagiouser
Features of Imagio are referenced
Bar at top shows 2000+ reviews and image of Droid; info for review section of page shows 300+ reviews
http://www.verizonwireless.com/b2c/productReview?action=showAllReviews&phoneId=5069&item=phoneFirst&...
Suggestion 3: Fix faulty link for forum registration: When trying to register for the forum, I clicked on 'Register.' I got an error that my password and username were incorrect. I thought I'd misclicked, but I could reproduce this.
Cheers.

Hello Artemis51,
My apologies for the late reply on this one. Great feedback! I'll definitely add this to the list of registration issues that we're working on.
Thank you so much for taking the time post these issues in such detail.
Regards,
Kathleen
Verizon Telecom
Online Center of Excellence
Notice: Content posted by Verizon employees is meant to be informational and does not supercede or change the Verizon Forums User Guidelines or Terms or Service, or your Customer Agreement Terms and Conditions or Plan.

Need guidance on interacting with FrontPage site (post retry)

BACKGROUND: redesigning and programming a photographers
website who is using Frontpage to upload files.
Murray told me a couple months ago that I can't work with the
site directly because it will cause problems for Frontpage and that
I will need to send
the files to my client to upload through FP.
QUESTIONS:
Can I use ftp to download from the site without causing a
problem?
Does FP do anything special with extensions would preclude me
from doing ftp if FP has only been used to upload/download files?
Can I use ftp to create and use a subdirectory to work in for
development purposes or will FP puke at that?
I am going to be doing some basic CF programming to the site
and it would be really difficult without the ability to ftp.
I am not sure to what extent my client has used FP extensions
since she basically has a home page with some pictures and links
and then Photoshop
created slide shows everywhere else. There is no programming
(except for the PS slide shows) anywhere in the site.
Any help would be appreciated.
stillwaiting

> Can I use ftp to download from the site without causing
a problem?
Yes.
> Does FP do anything special with extensions would
preclude me from doing
> ftp if FP has only been used to upload/download files?
No.
> Can I use ftp to create and use a subdirectory to work
in for development
> purposes or will FP puke at that?
You can try it.
> I am going to be doing some basic CF programming to the
site and it would
> be really difficult without the ability to ftp.
> I am not sure to what extent my client has used FP
extensions since she
> basically has a home page with some pictures and links
and then Photoshop
> created slide shows everywhere else. There is no
programming (except for
> the PS slide shows) anywhere in the site.
>
Post a link to the site - I'll take a look and see if I see
anything....
Murray --- ICQ 71997575
Adobe Community Expert
(If you *MUST* email me, don't LAUGH when you do so!)
==================
http://www.dreamweavermx-templates.com
- Template Triage!
http://www.projectseven.com/go
- DW FAQs, Tutorials & Resources
http://www.dwfaq.com - DW FAQs,
Tutorials & Resources
http://www.macromedia.com/support/search/
- Macromedia (MM) Technotes
==================
"Stephen H." <[email protected]> wrote in message
news:[email protected]...
> BACKGROUND: redesigning and programming a photographers
website who is
> using Frontpage to upload files.
>
> Murray told me a couple months ago that I can't work
with the site
> directly because it will cause problems for Frontpage
and that I will need
> to send
> the files to my client to upload through FP.
>
> QUESTIONS:
> Can I use ftp to download from the site without causing
a problem?
> Does FP do anything special with extensions would
preclude me from doing
> ftp if FP has only been used to upload/download files?
> Can I use ftp to create and use a subdirectory to work
in for development
> purposes or will FP puke at that?
>
> I am going to be doing some basic CF programming to the
site and it would
> be really difficult without the ability to ftp.
> I am not sure to what extent my client has used FP
extensions since she
> basically has a home page with some pictures and links
and then Photoshop
> created slide shows everywhere else. There is no
programming (except for
> the PS slide shows) anywhere in the site.
>
> Any help would be appreciated.
>
> stillwaiting

Can Java Interact with Web Pages??

I wonder if it possible to develop an application or applet that can automate the process of signing up for courses at Notre Dame.
Currently, we have to use a pretty plane text-based web system. I wonder if it's feasible to use Java to provide a more user-friendly front-end to this system. The program would need to read HTML, view different web pages, and write to web forms. Any tips on where to go from here?
I realize that some other language might work too, but I'd like to advance my Java skills ;-)
Thanks!!!
- Brian

From what you've posted so far it sounds like you want to make a specialized web browser. Is this what you had in mind? The Java API includes two classes that can be used to construct such a beast relatively easily: JEditorPane and JTextPane. The Swing tutorial has a page on how they can be used:
http://java.sun.com/docs/books/tutorial/uiswing/components/editorpane.html
However, their capabilities are rather limited (only support HTML 3.2). They will let you change text styles and the way pages look, but will hardly be more "user friendly" than the original site because it'll be only the old thing with a new look.
There's also a HTML parser that can be used independently of the gui components, in principle you can use it to extract information from the site and show it in a completely new user interface that has nothing to do with the original site but I haven't used it much and i'm too tired to look up and example on the 'net (been a long day, i'm off to bed)

Help!! Security Issues with web site

Whenever we start our webservices, web visitors can view our folder list. The option is disabled on the server and the web folder is not being shared.
Any ideas? One of my sites was hacked into.
thanks!!

Without an index.html file, the directory structure is shown by default in Apache.
The easiest thing to do is have an index.html file in every folder. Nothing elaborate, just a simple html page will do.
Hope this helps
-Gregg

No email addresses with web site hosting?

From what information I've seen, email addresses are not included in the web hosting part of creative cloud? Why? I think many of assume that's included in most ISP hosting plans, whether or not it's charged for separately. If true, I hope Adobe will consider, along with databases, etc.

Hi,
As part of your Creative Cloud package you get access to 5 webBasics websites, which indeed do not include e-mail.
However, our offering has several other plan options, for webCommerce or webMarketing for example, that include e-mail accounts. You can always upgrade your website separately to any of these plans.
Magda

Using Auto Fill with web sites often used

How do I turn on the "Auto Fill" Name and Pass Word, For a site I previously stated " Never for this site?
So that I can quickly access the site without filling in all the details when ever I wanty to use the site.

Try the Tiny Menu extension. I am using an older version of Tiny Menu on Lucid with Firefox 3.6.x and it works fine.

Adobe form interactive with web dynpro

I wanna get the user typed text from the form into web dynpro but get none.
After user typed the comment in a input field and press the button in the web dynpro, the program will get the pdf source from the context and parse it. The program get other text pre-defined in the form generation but doesn't get the user typed text.
I tried to change the form type to ZCI use t-code sfp_zci_update. But still failed to get the user typed text.
What's the problem?

Dear Ralf,
Thanks for your prompt replies. I appreciate it.
I've copied the following code mentioned in the note and pasted it in my wddomodifyview method.
But after activating and executing the application, the application time outs and gives ADS time out error.
I've checked and am sure that it is the below code that makes it time out.
I would also like to draw your attention to the fact that when i then run prog. FP_TEST_00, it also hangs.
Please help.
500 Connection timed out
Error: -5
Version: 7000
Component: ICM
Date/Time: Tue Mar 22 09:52:18 2011
Module: icxxthr_mt.c
Line: 2707
Server: AIERD_AED_00
Error Tag: {-}
Detail: Connection to partner timed out after 180s
Code is:
data: LR_INTERACTIVE_FORM type ref to CL_WD_INTERACTIVE_FORM,
      LR_METHOD_HANDLER    type ref to IF_WD_IACTIVE_FORM_METHOD_HNDL.
      check first_time = abap_true.
      LR_INTERACTIVE_FORM ?= VIEW->GET_ELEMENT( 'IFORM').
      LR_METHOD_HANDLER ?= LR_INTERACTIVE_FORM->_METHOD_HANDLER.
      LR_METHOD_HANDLER->SET_LEGACY_EDITING_ENABLED( abap_true ).
Edited by: User on Mar 22, 2011 5:44 AM

Interact with web site

Similar Messages

Maybe you are looking for