Help: getting data from a web page

i have a jsp page which generates some strings. i pass these strings in to a login page on some server. the web page displays my login status. is it possible to read or get data from the web page?
i have captured the header of a web page and modifying the header based on my generated strings.
or jus say is it possible to read whats in a web page into a jsp page?
thanks in advance for any help , assistance or redirection to a source where i can find help.

hi,
sorry for a poorly framed question.
this is what i m trying to do.
i call google with a header generated.
now i want to read back the content in the google search result page onto my jsp page.
possible?
first.jsp calls google. i m using redirect (url)
the url is modified based on user input
now i want the links in the google page to be put up in my page itself. so i want to read the links there...
Message was edited by:
on_track

Similar Messages

How get data from another web page?

I have my own interface..after i key In a keyword and click search, method post will post the data to server and server will response.write a HTML page that display the result based on the keyword i Key In. The problem is i want the result display on my own page. So how can i read the search result from the HTML page and display on my own design page? I use JSP to built my page. thanks

I dont know the following solution would solve ur problem, atleast u will get basic idea.
1st method
Create an inline frame (IE-IFrame etc), On pressing submit button, Post the data to required page (it might be some page on another server)and specify post target is ur inline frame.
if u want filter the result data and want to display in ur own way then send ur POST request to ur own JSP and use Http classes to read resend those data to other page (another server) and capture the results implement ur own logic to get desired data and resend to the requested browser
I hope it would solve ur problem
Cheers
Rajendra Bandi

How to retrieve data from a web page through php scripts..........

kindly suggest me the php parsing script so that i can fetch the data from a web page.....
suppose we have a url.........
http://abc.com/news/companydetails.aspx?sskicode=x&Exchange=y
and the page contains the various fields.........like
xyz 10
xyz1 20
xyz2 30 etc...
then we have to retrive data from this page trough php script and insert it into database.....
value of xyz , xyz1 n xyz2 should be retrived and further inserted into database.......
thanx ......

Should be nice..
But its not working i think..

How do I add dates from a web page into iCal?

Hello. I would love to find a way to input dates from a web page, into iCal as an event. Right now, if there is a conference or whatever that is on such and such a date, I have to keep the web page open that has the dates and time, and then open iCal, and create a new event on that date, etc. Is there a way to highlight said dates on a web page, run some automation, and voila, it is a new event in iCal?

Don't double tap. Just try pressing on the text. That should highlight it.

How can I use Automator or AppleScript to get text from a web page and paste it in execl?

I don't know how to make scripts or complexed automator workflows... that's why I'm asking.
I'm trying to make a simple app or script to ask me what text to extract from a web page, like name, address and phone number of a web page and paste each one of these data in the righ cell of excel.
I was thinking to promt a request from automator or an applescript to ask me which text to extract from the page or to look throught the HTML of the page to search for specific html tags, from which extracting text and then importing it, or paste it to the specified execl cell. Name in the name cell, address in the address cell and so on.
Can somebody help me to make this script?
If you know an alternative, like a software that already do this or another language to use, please tell.

Try holding down the alt key as you mark the text to be copied. You can then copy columns to table text.

Help get data from socket

hi all
i am trying to get data from socket www.yahoo.com site and try to write in file with following code
NOTE:here netClient is the soccket object accepted by server
File f=new File(finalpath);
BufferedReader fromClient = new BufferedReader(new InputStreamReader(netClient.getInputStream()));
OutputStream fo=new FileOutputStream(f);
String str;
try{
while((str=fromClient.readLine())!=null){
byte buf[]=str.getBytes();
fo.write(buf);
}catch(Exception e){}
finally{fo.close();}
But i am not getiing data from socket
please help
regards krunal

GeneralYerevan is absolutely right. Use URLConnection and you will get what you want. It seems to me that you do not know deeply how http works. The fact that you opened a connection to www.google.com doesn't mean that you will get data. The web server, after it accepts the socket object, waits for your request. In you case it is something like "GET / HTTP1.1", which you have to write to the stream. URLConnection does all this for you and all you have is to read the InputStream.

Automated process to pull data from a web page without using VS and PS.

Hello,
I'm looking at finding a solution to pull data from an external web page and creating a list. I'm looking for a NON-POWERSHELL AND NON-VISUAL STUDIO solution. I am open to using InfoPath Designer.
There exists a custom, non-SharePoint page built for us which has raw data. We've already created a custom list to match the data and now need to come up with a solution to automatically update the data. In this particular scenario, power shell and visual
studio cannot be used.
Thanks in advance.

Why would you cripple yourself and restrict PowerShell at the very least which has perfect functionality for doing exactly that.
I doubt you could use the InfoPath data sources to pull the raw data in, re-map it and save to SharePoint without resorting to some sort of coding within InfoPath.
Please ensure that you mark a question as Answered once you receive a satisfactory response. This helps people in future when searching and helps prevent the same questions being asked multiple times.

Getting data from a web site

I have a device that has a built in web server that I need to write a LV program for
I need to read the date the web server is producing and compare it to actcual measured data.
Now the measureing and comparing is easy but I don't know how to make LV read a webpage.
Any thoughts or examples?
Solved!
Go to Solution.

I got it to work, but It seem like the first time I launch it I sometimes I the first time I run it I get this error.
Error 97 occurred at UnknownSystem Error
Possible reason(s)
Labview: Null Refnum was passed as input.
Also it does not always ouput the text the first time and you have to run it twice.
Worse yet it seems to cache the text so sometimes when you load a new page the text is still the text left over from the previous page yet you can see the new page has loaded in the SHDocVw.IWebBrowser2 indicator.
Attachments:
No Text Output-1.jpg ‏136 KB
Good Text Ouput-2.jpg ‏220 KB
Text Output has not changed.jpg ‏173 KB

The data from my web page insert in SQL table as question marks

I use Farsi language in my web page for inserting customer data. The data that is inserted in webpage and submitted, showed as ???? in SQL table. A lot of developers say that I should use N' before the Unicode character, but I don't know how I can use it
in my code. I attached the code. Can someone say me where I should insert the N in my code?
protected void cmdInsert_Click(object sender, EventArgs e)
//Checking the validation of required fields
if (cboCustomerType.Text == "" || cboTitle.Text == "" || SearchableName.Text == "" ||
FinalName.Text == "" || NationalID.Text == "" || BusinessID.Text == "" || MobilePhone.Text == "")
lblStatus.Text = "لطفا فیلدهای اجباری را حتما پر کنید";
return;
//define ADO.NET objects.
string insertSQL;
insertSQL = "INSERT INTO Customers(";
insertSQL += "CustomerType,CustomerTitle,CustomerFirstName,CustomerLastName,CompanyType,";
insertSQL += "CompanyName,SearchableName,FinalName,NationalCode,BusinessID,City,Address,PostalCode,";
insertSQL += "Zone,MobileNumber,WorkPhone1,WorkPhone2,HomePhone,FaxNumber,Email,Website,Note)";
insertSQL += "VALUES('";
insertSQL += cboCustomerType.Text + "','";
insertSQL += cboTitle.Text + "','";
insertSQL += CustomerFirstName.Text + "','";
insertSQL += CustomerLastName.Text + "','";
insertSQL += cboCompanyType.Text + "','";
insertSQL += CompanyName.Text + "','";
insertSQL += SearchableName.Text + "','";
insertSQL += FinalName.Text + "','";
insertSQL += NationalID.Text + "','";
insertSQL += BusinessID.Text + "','";
insertSQL += City.Text + "','";
insertSQL += Address.Text + "','";
insertSQL += PostalCode.Text + "','";
insertSQL += Zone.Text + "','";
insertSQL += MobilePhone.Text + "','";
insertSQL += Phone1.Text + "','";
insertSQL += Phone2.Text + "','";
insertSQL += HomePhone.Text + "','";
insertSQL += FaxNumber.Text + "','";
insertSQL += Email.Text + "','";
insertSQL += Website.Text + "','";
insertSQL += Note.Text + "')";
SqlConnection con = new SqlConnection(connectionString);
SqlCommand cmd = new SqlCommand(insertSQL, con);
//try to open the database and execute the insert
int added = 0;
try
con.Open();
added = cmd.ExecuteNonQuery();
lblStatus.Text = added.ToString() + "اضافه شد";
catch (Exception err)
lblStatus.Text = "Error inserting record.";
lblStatus.Text += err.Message;
finally
con.Close();
//If the insert succeed, refresh the customer list.
if (added > 0)
FillCustomerList();
Regards,

Because you're composing the SQL statement with string concatenation, you would put the "N" before the single quote,
VALUES(N'";
insertSQL += cboCustomerType.Text + "',N'";
insertSQL += cboTitle.Text + "',N'"; // ...etc
However, composing SQL statements with string concatenation is not a suggested practice because it's open to SQL injection (see:
https://technet.microsoft.com/en-us/library/ms161953(v=sql.105).aspx). A safer way to do this is to use command parameters to represent the values (see SqlCommand.Parameters
property). If you use parameters, you can specify parameter data type as SqlDbType.NVarchar, which will ensure your text values are passed in as Unicode. Also ensure that the columns in question are defined in the database table definition as Unicode (NVARCHAR
rather than VARCHAR).
Hope this helps, Bob

How to get data from a second page?

Hi guys,
I have the first page, where I have a button, which will navigate to the second page to let user make some choices.
After the user makes the choices, user will click a button to get back.
How can I pass the choices back to the first page?
Regards,
Aaron.

Hi Aaron,
you can use the EventBus for the same.
1) publish the event bus on click of the button ( the event f which navigates back to the earlier page)
2) in the publish of this event bus, pass all the data which you have captured / which has been clicked.
3) subscribe the eventBus in the App.Controller page ( assuming that you have created an app.view in which you have defined the sap.m.App() , to take care of all the pages to be added into the app).
4) the handler function of this subscribe, will navigate you to the page required, along with the whole set of data you have passed in the publish of event bus.
5) use onBeforeShow(oEvent) hook method in the view, which is being finally routed to.
all the data passed from the previous view will be accessible here via : oEvent.data.dataPassedFromPreviousView
Note : dataPassedFromPreviousView, assuming is to be the object in which u have set the data in the publish.
Hope it helps.
Regards,
Viren Gupta

Copying data from a web page into Numbers

I frequently use a Keyword Density Analysis Tool on the web that displays three columns and perhaps 50 to 100 rows of data. There is no export or save to csv, so I just highlight the three columns, copy and paste into a blank Excel spreadsheet - and hey presto, I get three columns of data. that I can sort and analyse. When I do the same with Numbers I get three columns but all the data ends up in three rows - please see attached. Is there a simple way around this because I am trying to stop using Excel? Thanks./Volumes/garyloch/Public/Screenshots/Picture 2.png
/Volumes/garyloch/Public/Screenshots/Picture 1.png
/Volumes/garyloch/Public/Screenshots/Picture 3.png

The only way I was able to reproduce what you described is to run the script after copying a picture.
Here is a refined version.
It make two attempts to grab text items from the clipboard.
If both failed, it send an error message.
--[SCRIPT table2text]
Enregistrer le script en tant qu'Application ou Progiciel : table2text.app
déplacer l'application créée dans le dossier
<VolumeDeDémarrage>:Users:<votreCompte>:Library:Scripts:Applications:
Il vous faudra peut-être créer le dossier Applications.
Copiez vos données dans le Presse-papiers.
menu Scripts > table2text
Le presse-papiers sera alimenté par le composant Text ou utf8 du contenu initial.
+++++++
Save the script as an Application or an Application Bundle: table2text.app
Move the newly created application into the folder:
<startup Volume>:Users:<yourAccount>:Library:Scripts:Applications:
Maybe you would have to create the folder Applications by yourself.
Copy your block of datas to the Clipboard.
menu Scripts > table2text
The Clipboard will be filled with the text or the utf8 component of its original contents.
Yvan KOENIG (Vallauris, FRANCE)
4 février 2009
--=====
on run
try
set the clipboard to (the clipboard as text)
on error
try
set the clipboard to (the clipboard as «class utf8»)
on error
if my parleFrancais() then
error "Pas de données texte dans le presse-papiers !"
else
error "No valid text data in the Clipboard !"
end if
end try
end try
end run
--=====
on parleFrancais()
local z
try
tell application theApp to set z to localized string "Cancel"
on error
set z to "Cancel"
end try
return (z = "Annuler")
end parleFrancais
--=====
--[/SCRIPT]
Yvan KOENIG (from FRANCE mercredi 4 février 2009 21:49:14)

Getting userid from a web page

I have protected a web application running on MS IIS6 with an URL_POLICY configured in a Sun Access Manager 72005Q4 server.
On IIS6 I installed a Policy Agent 2.2.
It works. When I go to the URL of my application the authentication page of Access Manager is presented and I get authenticated and redirected to my application.
In my application I would like to get information about the user logged in and store this information.
How can I do that ?
Thanks a lot !!!
Alfredo

You can get user information through HTTP headers or cookies and you can do what you want with those values.
# Profile attributes fetch mode
# String attribute mode to specify if additional user profile attributes should
# be introduced into the request. Possible values are:
# NONE - no additional user profile attributes will be introduced.
# HTTP_HEADER - additional user profile attributes will be introduced into
# HTTP header.
# HTTP_COOKIE - additional user profile attributes will be introduced through
# cookies.
# If not within these values, it will be considered as NONE.
com.sun.am.policy.agents.config.profile.attribute.fetch.mode=NONE
# The user profile attributes to be added to the HTTP header. The
# specification is of the format ldap_attribute_name|http_header_name[,...].
# ldap_attribute_name is the attribute in data store to be fetched and
# http_header_name is the name of the header to which the value needs
# to be assigned.
# NOTE: In most cases, in a destination application where a "http_header_name"
# shows up as a request header, it will be prefixed by HTTP_, and all
# lower case letters will become upper case, and any - will become _;
# For example, "common-name" would become "HTTP_COMMON_NAME"
com.sun.am.policy.agents.config.profile.attribute.map=cn|common-name,ou|organizational-unit,o|organization,mail|email,employeenumber|employee-number,c|country
# Session attributes mode
# String attribute mode to specify if additional user session attributes should
# be introduced into the request. Possible values are:
# NONE - no additional user session attributes will be introduced.
# HTTP_HEADER - additional user session attributes will be introduced into HTTP header.
# HTTP_COOKIE - additional user session attributes will be introduced through cookies.
# If not within these values, it will be considered as NONE.
com.sun.am.policy.agents.config.session.attribute.fetch.mode=NONE
# The session attributes to be added to the HTTP header. The specification is
# of the format session_attribute_name|http_header_name[,...].
# session_attribute_name is the attribute in session to be fetched and
# http_header_name is the name of the header to which the value needs to be
# assigned.
# NOTE: In most cases, in a destination application where a "http_header_name"
# shows up as a request header, it will be prefixed by HTTP_, and all
# lower case letters will become upper case, and any - will become _;
# For example, "common-name" would become "HTTP_COMMON_NAME"
com.sun.am.policy.agents.config.session.attribute.map=
shivaram

Calling data from a web page

I am trying to communicate with an external database. I want to give the database a certain number and recieve back another corresponding number.The way it is currently done is with MATLAB. MATLAB opens a browser (in the background because you cannot see it) and connects to a url that has the certain number in it. That url connects to the database which sends the corresponding number back to the browser, which MATLAB then extracts. I was wondering if LabView has any similar built in function that can do this. If not, i think i will be able to create the correct url and have labview open a browser, but I am not sure how to extract the value that the data base sends back. I know this may not be super clear, so feel free to ask any questions. thanks in advance

Take a look at the DataSocket functions. You can wire a URL to the Read command and it will return the text of the document available at that URL. Then you just need to parse out the value that you want. In order to get help with that you'll have to provide the format of the response.

Help getting data from a DataTable

Hi:
How can I get the information of a DataTable that I Get from
a WebService?
The response from the WebService is:
<OBTENERUSUARIOResponse xmlns="
http://(IP)/(WebService)/"
xmlns:xsd="
http://www.w3.org/2001/XMLSchema"
xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance"
xmlns:soap="
http://schemas.xmlsoap.org/soap/envelope/">
<OBTENERUSUARIOResult>
<xsd:schema id="NewDataSet"
xmlns:msdata="urn:schemas-microsoft-com:xml-msdata"
xmlns:xs="
http://www.w3.org/2001/XMLSchema">
<xsd:element name="NewDataSet"
msdata:MainDataTable="tblTemporal"
msdata:UseCurrentLocale="true"
msdata:IsDataSet="true">
<xsd:complexType>
<xsd:choice maxOccurs="unbounded"
minOccurs="0">
<xsd:element
name="tblTemporal">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="CodigoUsuario"
minOccurs="0"
type="xs:long"/>
<xsd:element name="Condicion"
minOccurs="0"
type="xs:string"/>
<xsd:element name="Nivel"
minOccurs="0"
type="xs:unsignedByte"/>
<xsd:element name="Nombre"
minOccurs="0"
type="xs:string"/>
<xsd:element name="Usuario"
minOccurs="0"
type="xs:string"/>
<xsd:element name="Clave"
minOccurs="0"
type="xs:string"/>
<xsd:element name="CodigoServicio"
minOccurs="0"
type="xs:long"/>
<xsd:element name="NroDocumento"
minOccurs="0"
type="xs:int"/>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:choice>
</xsd:complexType>
</xsd:element>
</xsd:schema>
<diffgr:diffgram
xmlns:msdata="urn:schemas-microsoft-com:xml-msdata"
xmlns:diffgr="urn:schemas-microsoft-com:xml-diffgram-v1">
<NewDataSet>
<tblTemporal
diffgr:id="tblTemporal1"
msdata:rowOrder="0">
<CodigoUsuario>1</CodigoUsuario>
<Condicion>Sr.</Condicion>
<Nivel>1</Nivel>
<Nombre>NN001</Nombre>
<Usuario>***</Usuario>
<Clave>***</Clave>
<CodigoServicio>1</CodigoServicio>
<NroDocumento>***</NroDocumento>
</tblTemporal>
<tblTemporal
diffgr:id="tblTemporal2"
msdata:rowOrder="1">
<CodigoUsuario>2</CodigoUsuario>
<Condicion>Dr.</Condicion>
<Nivel>1</Nivel>
<Nombre>NN002</Nombre>
<Usuario>***</Usuario>
<Clave>****</Clave>
<CodigoServicio>1</CodigoServicio>
<NroDocumento>***</NroDocumento>
</tblTemporal>
<tblTemporal
diffgr:id="tblTemporal3"
msdata:rowOrder="2">
<CodigoUsuario>3</CodigoUsuario>
<Condicion>Pac.</Condicion>
<Nivel>3</Nivel>
<Nombre>NN003</Nombre>
<Usuario>***</Usuario>
<Clave>***</Clave>
<CodigoServicio>1</CodigoServicio>
<NroDocumento>***</NroDocumento>
</tblTemporal>
<tblTemporal
diffgr:id="tblTemporal4"
msdata:rowOrder="3">
<CodigoUsuario>4</CodigoUsuario>
<Condicion>Pac.</Condicion>
<Nivel>3</Nivel>
<Nombre>NN004</Nombre>
<Usuario>***</Usuario>
<Clave>***</Clave>
<CodigoServicio>1</CodigoServicio>
<NroDocumento>***</NroDocumento>
</tblTemporal>
<tblTemporal
diffgr:id="tblTemporal5"
msdata:rowOrder="4">
<CodigoUsuario>8</CodigoUsuario>
<Condicion>Pac.</Condicion>
<Nivel>3</Nivel>
<Nombre>NN005</Nombre>
<Usuario>***</Usuario>
<Clave>***</Clave>
<CodigoServicio>1</CodigoServicio>
<NroDocumento>***</NroDocumento>
</tblTemporal>
</NewDataSet>
</diffgr:diffgram>
</OBTENERUSUARIOResult>
</OBTENERUSUARIOResponse>
FLEX 2 Code:
public function resultHandler(event:ResultEvent):void {
if (event.result.diffgram == "")
////nothing
else
lblNombre.text =
event.result.diffgram.NewDataset.tblTemporal[1].Nombre;
If I use lblNombre.text =
event.result.diffgram.NewDataset.tblTemporal.Nombre; returns an
empty string and if I use lblNombre.text =
event.result.diffgram.NewDataset.tblTemporal[1].Nombre; the code
stops there and nothing happens.
Can you tell me if this code is correct?
I made the WebService with Visual Basic 2005 and returns a
DataTable Variable not a DataSet.

hi,
sorry for a poorly framed question.
this is what i m trying to do.
i call google with a header generated.
now i want to read back the content in the google search result page onto my jsp page.
possible?
first.jsp calls google. i m using redirect (url)
the url is modified based on user input
now i want the links in the google page to be put up in my page itself. so i want to read the links there...
Message was edited by:
on_track

Help getting data from iTunes onto my New iPad from iPhone backup

Hi for 2 days now I have been trying to sync my New iPad2 with my iPhone 3GS, I have followed lots of threads & advice which has been helpful but its not quite happening for me!
I set up iCloud and iTunes as advised, my iPhone & iPad share the same Apple ID. I backed up my iPhone to iTunes successfully, and restored the iPad via iTunes using the iPhone backup, it went thru the motions OK so I assume completed but I can't see any change.
Under "Purchases" in my iTunes account it has two tabs one for the iPhone and the other iPad listing all my Apps so clearly it recognises my Apps but the Apps only feature on my iPhone I can't get them onto my iPad. I even deleted some apps and reloaded them since the sync & backups but it still doesn't work. Strangely under my "Account" in iTunes it says only 1 Device is recognosed by iTunes and thats my New iPad, yet it still shows a Tab under Purchases for my iPhone so I don't understand why this is not listed as a recognised Device under the Accounts tab.
My contacts, calendars etc are in sync between the two devices wihtout any trouble at all.
I did think it was because some of the apps were downloaded before the sync / backup but some threads lead me to beleive you can sync the content no matter when it was purchased. Under the "Purchases" tab for my iPad I can view my "Apps" which has a "Download all" option so Ibeing at a loss what to do next I proceeded to Download All and it was clearly doing this for some time but still nothing on my iPad.
I was advised to turn iCloud off whilst I do the backup and restore on iTunes, and then turn it back on after. I have turned my iPad off/on after these updates but still the apps do not transfer across.
I feel like I am so close now but for some reason something is still not working! Please Help - thankyou.
(Just to add both devices are using the latest software update & iTunes working with Vista Windows on PC.)

Connect and select iPhone in computer iTunes sidebar, in Music tab,
select
     Sync Music,
     Selected Playlists, artists, albums....
     Select the music you want on iPhone.
     Click Sync button (bottom right)
Here's the iPhone user manual
iPhone User Guide (For iOS 6.1 Software)
Message was edited by: ckuan

Help: getting data from a web page

Similar Messages

Maybe you are looking for