Fetch data from another URL

Hi all,
i need the code that can fetch the data from another URL like i need the new from different site and put into my database and then website useing the jsp or u tell me in which and how.
thanks in advance.. URGENT
Waiting................................................ UR rpely..................

Hi,
People generally ignore "URGENT" pleas on this forum... it's only urgent to you.
You probably want to do a search for "web scraping"... basically parsing HTML pages as XML, and extracting the results.
Recently dcminter posted a link to a very good article from the IBM website, which you should read.
http://www-128.ibm.com/developerworks/java/library/j-jtp03225.html
regards,
Owen

Similar Messages

Fetch data from another mirosoft sql server to sap

Dear all,
I want to fetch data from another mirosoft sql server
to SAP(my sap server IN unix, oracle 10g).
Thanks
Shashi
Moderator Message: Try to do you own research before posting your question. Get back to the forums in case you are stuck with any issue
Edited by: Suhas Saha on Jul 26, 2011 3:21 PM

hi,
u should see following documentation:
Oracle9i Heterogeneous Connectivity Administrator's Guide
Release 1 (9.0.1)
Part Number A88789_01
in it u just go to chapter no. 4 (using the gateway),,u'll find ur answer there.
regards
umar

Receive POST data from another URL and process using Struts

Hi there
We have a website and as of now we are receiving some data from another URL which is received as an appended part of the URL. My application uses Struts and we process the received data and send back a response.
Now my question is, I have been asked to change this behavior because there are more parameters now which cannot be passed through the URL. I am supposed to get the data from the other URL as POST data (as a form) and I have to create a new Struts action to receive this data, process it and send the response back to the requesting URL.
Please explain me how to do this using some example code snippets.
Thanks a lot

Lookup in XI is used to call the target data storage system and get data from there to your mapping programme.
In XI you can do Lookup in Message Mapping, Java Mapping and in XSLT Mapping. Previously Lookup in XI was system dependent. But now what ever the system are i.e. SAP system or non-sap system(Oracle,MS SQL etc) lookup API are same.
Overview of Lookup
- Lookups are used to identify/request the data from mapping program.
- It interrupt the process and looking for data which was stored in target system.
- It get that data and comeback to process and continue with that data.
Types of Lookups in XI
- JDBC Lookup: JDBC lookup is used for accessing data from database (non SAP).
- RFC Lookup: RFC lookup is used for accessing the SAP Data.
- SOAP Lookup: SOAP lookup is used for accessing data from Webservice
Steps to perform Lookup in Mapping
Import package com.sap.aii.mapping.lookup.*;
Create connection to the target Database system.
// Determine communication channel created in ID
Channel channel = null;
channel = LookupService.getChannel("DB-SYSTEM-NAME","DB-CHANNEL-NAME");
// Get system accessor for the channel.
DataBaseAccessor accessor = null;
accessor = LookupService.getDataBaseAccessor(channel);
Build the Query String.
Getting Result
// Execute Query and get the values.
DataBaseResult resultSet = null;
resultSet = accessor.execute(Query);

Fetching Data from Another Entity (Lookup) - Done in 4.0 and needs to be done in 2013

We have a situation where we need to grab associated fields from a filtered lookup. We're willing to use javascript in conjunction with with either odata, soap or fetchxml. The goal is to bring in numbers from a custom entity and then fill in
fields to do mathematical calculations.
Basically on change of a lookup, you grab data, put it on the form, then perform the calculations.
Here is how the code used to work. How would you achieve the objective in 2013?
function Literature1_onchange()
if (crmForm.all.ftgbase_literature1id.DataValue != null)
   crmForm.all.ftgbase_quantity1.DataValue = 11;
   crmForm.all.ftgbase_total1.DataValue = null;
   var idToFetch = crmForm.all.ftgbase_literature1id.DataValue[0].id+
   //Create AJAX request
   var xmlhttp = new ActiveXObject("Microsoft.XMLHTTP");
   xmlhttp.onreadystatechange = function() {
       //A value of 4 indicates that the response has been returned
successfully
       if (xmlhttp.readyState == 4) {
           strXML = xmlhttp.responseText;
           var bundleQty = ReturnValueFromXML
(strXML,'BundleQuantity');
           var maxQty = ReturnValueFromXML(strXML,'MaxOrderQty');
           if (maxQty != null && maxQty != "null"){
               crmForm.all.ftgbase_litmax1.DataValue = parseInt
(maxQty) ;
           }else{
               crmForm.all.ftgbase_litmax1.DataValue = null;
           if (bundleQty != null && bundleQty != "null"){
               crmForm.all.ftgbase_bundlequantity1.DataValue =
parseInt(bundleQty) ;
           }else{
               crmForm.all.ftgbase_bundlequantity1.DataValue = null;
   GetRecordXML(xmlhttp, UserInfo._orgId, 'GetLiterature', idToFetch,
'GetLiterature', idToFetch );
else
   crmForm.all.ftgbase_bundlequantity1.DataValue = null;
   crmForm.all.ftgbase_total1.DataValue = null;
   crmForm.all.ftgbase_quantity1.DataValue = 11;
We're willing to either get a method working similar to this or go another route, but not a fetchxml grid, we need to preserve historical data.

Hi,
To Retrieve from other entity and populate the fields, for example on entering the account name in opportunity form the fields from account form like Sector, Region can be retrieved and can be auto populated in opportunity form using Odata as follows.
Call the function getAccountDetails in onchange event of Companyname. Do not forget to add Jquery
and Json in libraries.
function getAccountDetails() {
var companyName = Xrm.Page.getAttribute("customerid").getValue();
if ((companyName != null)) {
var companyNameValue = companyName[0].name;
var companyNameID = companyName[0].id;
var serverUrl = Xrm.Page.context.getServerUrl();
//The XRM OData end-point
var ODATA_ENDPOINT = "/XRMServices/2011/OrganizationData.svc";
var odataSetName = "AccountSet";
var odataSelect = serverUrl + ODATA_ENDPOINT + "/" + odataSetName + "(guid'" + companyNameID + "')";
//alert(odataSelect);
$.ajax({
type: "GET",
contentType: "application/json; charset=utf-8",
datatype: "json",
url: odataSelect,
beforeSend: function (XMLHttpRequest) { XMLHttpRequest.setRequestHeader("Accept", "application/json"); },
success: function (data, textStatus, XmlHttpRequest) {
var result_account = data.d;
var name;
var Id;
var entityType;
//replace the fields with the fields on your entity
Xrm.Page.getAttribute("new_sector").setValue(result_account.new_Sector.Value);
Xrm.Page.getAttribute("new_region").setValue(result_account.new_Region.Value);
error: function (XmlHttpRequest, textStatus, errorThrown) { alert('OData Select Failed: ' + odataSelect); }
Also as another option if you donot wat the java script then you can go for a workflow to poplate, please refer this link: https://www.powerobjects.com/blog/2013/11/25/retrieving-data-from-a-related-entity-crm-2013/
Reference: link
Regards, Rekha.J

Using Field symbol to fetch data from another program

I have a requirement where i need to fetch value of a field from one of the function pool so i have written a sample progam to check the logic but its doest seems to work its giving dump.
Basically i want to know how to use <programname><fieldname> with fieldsymbol.
REPORT ztest1.
DATA test(25) VALUE 'ggg'.
submit ztest.
report ztest.
constants: lv_memory(25) type c value '(ZTEST1)TEST'.
field-symbols: <fs2> type char25 .
assign (lv_memory) to <fs2>.
write : <fs2>.
I am getting same field symbol assignment dump

Hi Rahul,
You can use this concept in between the FUNCTION MODULES where both are
under same FUNCTION GROUP ( as both the FM's have same global memory area ).
And also if you are calling an FM or method from your program ,you can have the data of the calling program in that called FM or METHOD.
Hope this may help you.
Regards,
Smart Varghese

RFC fetching data from table which is not commited

Hi Experts,
               I have a query regarding commit work.Below is the RFC that i have written
FUNCTION ZBAPI_CREATE.
*"*"Local Interface:
*" TABLES
*"      IT_ZABAP_RFC STRUCTURE ZBAPI_RFC_STR OPTIONAL
*"      RETURN STRUCTURE BAPIRET2 OPTIONAL
CALL FUNCTION 'ZBO_BAPI_CREATE'
TABLES
   IT_ZABAP_RFC       = IT_ZABAP_RFC
   RETURN             = return
Break-point.
DATA lt TYPE TABLE OF ZBAPI_RFC_STR_MAIN.
CALL FUNCTION 'ZBAPI_SEARCH_RANGE'
* EXPORTING
*   IS_STR        =
TABLES
   ET_TAB        = lt
*   RETURN        =
ENDFUNCTION.
here in first RFC call i am creating a record in ZTABLE , and then at break-point
i check the ZTABLE where it does not create any record because data is not commited into ZTABLE upto this point, but just after it i have written code for fetching data from ZTABLE but i am able to get this new record in lt.
Can anybody please explain that from where this serach RFC is providing data because inside serach i am simply selecting data from ZTABLE.
Regards,
Abhishek Bajpai
Edited by: ABHISHEK BAJPAI on Jan 28, 2009 1:12 PM

Hi Thomas,
                 Thanks for reply , i checked in ZTABLE ,before search RFC call data is not there but if i commit explicitly only then it is showing data in ZTABLE. Actually my requirement is different -
I have two RFCs 1. Create 2. Search , Now from web dynpro user will call first Create RFCs but at this point it should not insert record in ZTABLE and just after it user will call another search RFC and in this search he should be able to get these newly created records.
I want to have the functionality which a user gets when working with normal database front end like SQLPLus for Oracle. In these scenarios we see that whenever user does any insert or update the data sits in the table but still it is not committed. So there he fires Select query he sees the inserted data. But if he logs off from SQL PLUS and then logs in again, and fires Select query he does not see the data as it was not committed. I want a similiar functionalty in which if user inserts the data through Create RFC and fires the Select query through Search RFC then he can see the newly Created data also even though this data is not committed.
Although if i call create RFC in update task it will not update ZTABLE but in this situation , if user will call search RFC he will not be able to get newly created records.
So my requirement is that i should be able to get those records which are not commited in ZTABLE .If you have still any doubt regarding my question then please let me know.
Regards,
Abhishek

How to display data from a recordset based on data from another recordset

How to display data from a recordset based on data from
another recordset.
What I would like to do is as follows:
I have a fantasy hockey league website. For each team I have
a team page (clubhouse) which is generated using PHP/MySQL. The one
area I would like to clean up is the displaying of the divisional
standings on the right side. As of right now, I use a URL variable
(division = id2) to grab the needed data, which works ok. What I
want to do is clean up the url abit.
So far the url is
clubhouse.php?team=Wings&id=DET&id2=Pacific, in the end all
I want is clubhouse.php?team=Wings.
I have a separate table, that has the teams entire
information (full team name, short team, abbreviation, conference,
division, etc. so I was thinking if I could somehow do this:
Recordset Team Info is filtered using URL variable team
(short team). Based on what team equals, it would then insert this
variable into the Divisional Standings recordset.
So example: If I type in clubhouse.php?team=Wings, the Team
Info recordset would bring up the Pacific division. Then 'Pacific'
would be inserted into the Divisional Standings recordset to
display the Pacific Division Standings.
Basically I want this
SELECT *
FROM standings
WHERE division = <teaminfo.division>
ORDER BY pts DESC
Could someone help me, thank you.

Assuming two tables- teamtable and standings:
teamtable - which has entire info about the team and has a
field called
"div" which has the division name say "pacific" and you want
to use this
name to get corresponding details from the other table.
standings - which has a field called "division" which you
want to use to
give the standings
SELECT * FROM standings AS st, teamtable AS t
WHERE st.division = t.div
ORDER BY pts DESC
Instead of * you could be specific on what fields you want to
select ..
something like
SELECT st.id AS id, st.position AS position, st.teamname AS
team
You cannot lose until you give up !!!
"Leburn98" <[email protected]> wrote in
message
news:[email protected]...
> How to display data from a recordset based on data from
another recordset.
>
> What I would like to do is as follows:
>
> I have a fantasy hockey league website. For each team I
have a team page
> (clubhouse) which is generated using PHP/MySQL. The one
area I would like
> to
> clean up is the displaying of the divisional standings
on the right side.
> As of
> right now, I use a URL variable (division = id2) to grab
the needed data,
> which
> works ok. What I want to do is clean up the url abit.
>
> So far the url is
clubhouse.php?team=Wings&id=DET&id2=Pacific, in the end
> all
> I want is clubhouse.php?team=Wings.
>
> I have a separate table, that has the teams entire
information (full team
> name, short team, abbreviation, conference, division,
etc. so I was
> thinking if
> I could somehow do this:
>
> Recordset Team Info is filtered using URL variable team
(short team).
> Based on
> what team equals, it would then insert this variable
into the Divisional
> Standings recordset.
>
> So example: If I type in clubhouse.php?team=Wings, the
Team Info recordset
> would bring up the Pacific division. Then 'Pacific'
would be inserted into
> the
> Divisional Standings recordset to display the Pacific
Division Standings.
>
> Basically I want this
>
> SELECT *
> FROM standings
> WHERE division = <teaminfo.division>
> ORDER BY pts DESC
>
> Could someone help me, thank you.
>

How to fetch data from Mysql with SSL.

I am using jdk1.5 and mysql 5.0.
How to fetch data from Mysql with SSL
I am using url = jdbc:mysql://localhost/database?useSSL=true&requireSSL=true.
It shows error. how to fetch

I have created certificate in mysql and checked in mysql.
mysql>\s
SSL: Cipher in use is DHE-RSA-AES256-SHA
but through ssl how to fetch data in java.

How to fetch data from DataBase using Servlet ?

Hi all,
Till now, i was just sending values from web page and receive the data in excel format using servlets.
But, now, i want to fetch data from data base. I will be giving inputs in the web page(for the query)....ON click of submit button,
Servlet should be called.
Depending on the input, query has to be executed, and response should be sent to the user.
How to do it?
Code
import java.text.*;
import java.sql.*;
import java.util.*;
import java.io.*;
import javax.servlet.*;
import javax.servlet.http.*;
import java.io.OutputStream;
/** Simple servlet that reads three parameters from the html
form
public class Fetchdata extends HttpServlet
          String query=new String();
          String uid="ashvini";
          String pwd="******";
          try
               Connection con=null;
               Class.forName("sun.jdbc.odbc.JdbcOdbcDriver");
               String url = "jdbc:odbc:Testing";
               con = DriverManager.getConnection(url, uid, pwd);
               Statement s = con.createStatement();
               query = "select * from gowri.msllst1";
               ResultSet rs = s.executeQuery(query);
          public void doGet(HttpServletRequest request,HttpServletResponse response)
          throws ServletException, IOException
                    response.setContentType("application/vnd.ms-excel");
                    ServletOutputStream out=response.getOutputStream();
                    out.println("<HTML>" +"<BODY BGCOLOR=\"#FDF5E6\">\n" +
                    "<H1 ALIGN=CENTER>" + title + "</H1>\n" +
                    "<table>" +" <th>ITEM Code</th>");
                    while(rs.next())
                    out.println("<tr><td>" rs.getString(1).trim()"</tr></td>");
                    }//end of while
                    out.println("</table></BODY></HTML>");
               }//end of doGet method
     }catch(Exception e)
                    System.out.println(e);
It is giving error message as:
C:\Program Files\Apache Tomcat 4.0\webapps\general\srvlt>javac Fetchdata.java
Fetchdata.java:17: illegal start of type
try
^
Fetchdata.java:48: <identifier> expected
^
2 errors
Is this format is correct? am i placing this doGet method at the right place? is my program's logic is correct?
Please help me?
Regards
AShvini

There is some mistakes in ur code.....how can try catch exists outside a function???
make use of try catch isde ur doGet method and put
Connection con=null;
Class.forName("sun.jdbc.odbc.JdbcOdbcDriver");
String url = "jdbc:odbc:Testing";
con = DriverManager.getConnection(url, uid, pwd);
Statement s = con.createStatement();
query = "select * from gowri.msllst1";
ResultSet rs = s.executeQuery(query);
isdie doGet method, for the time being,
i think u get me..
regards
shanu

How to fetch data from database in javafx 2.2 table which is editable.

Dears!
I want to fetch data from database in javafx 2.2 tableformat with jdbc , which is also editable and i can add more records in this table also.
Can anybody help me

I can vaguely recall some sort of JavaFX database connectivity feature, I'm not sure if it's valid anymore.The link is based on JavaFX Composer which only applied to NetBeans 6.9 and JavaFX 1.x (both of which are now dead techs).
There is a good chance you will have to write your own. There are several blogs describing other peoples' work. You could probably use them as a reference.Here is Narayan's basic [url http://blog.ngopal.com.np/2011/10/19/dyanmic-tableview-data-from-database/] tutorial for displaying data from a database in a TableView, you'll need to look elsewhere for the editing portion.
The [url http://docs.oracle.com/javafx/2/ui_controls/table-view.htm]JavaFX TableView tutorial gives info about how to handle edits in a TableView, but you will need to tie the updates back to the database yourself.
It is possible that [url http://www.javafxdata.org/]DataFX may provide some facilities to help support you.

SQL Select Performance - Approached to fetch data from big table

Hi
I just wanted to know view on different approached to fetch data from a table which has 40 billion records and which joined to another table which has 1 million record.
e.g.
I have two tables TableA and TableB
TableA has 40 Billion records has 6 columns
     TableA has partitions on Date
     TableA has required indexes
TableB has 1 Milluion record and has 10 columns
     Table A has indexes
Now I have written query like
select distinct TableA.column1,TableA.column2,TableB.columnA
FROM TableA join TableB
ON TableA.Column1=TableB.Column2
WHERE TableA.DateColumn between StartDate and EndDate
for a given date range it will fetch 5 billion of records which takes around 40 minutes.
I just wanted to know what all tuning approaches I can follow. What would be the best approach to make record retrieval faster in such a scenario.
Just wanted to know your vies/experience in such a scenario

Sufficiently large array fetchsize
and,
possibly using parallel query,
pop into my mind.
I would be interested though in the business requirement that asks for you to write a program that gets 5 billion (!) rows out of the database...

Fetch data from n tables mdb file

hello,
I am able to fetch data from n no. of columns in a table but i want to fetch data from n no. of tables as well... below is part of the code:
while (res.next())
for(int j=1;j<=tbn;j++) --- tbn no.of tables
System.out.println("table counter");
for (int i = 1; i <= cno; i++) --- cno no. of columns
phno = res.getString(i);
v = new Vector();
v.addElement(phno);
System.out.println(v);
}

wow thanks for quick reply,,, i would like to fetch data from atleast 2 tables ...below is my code.... its printing the last row of the second table
public Vector msdata(String filepath)
String databaseFolder=filepath;
String driver = "sun.jdbc.odbc.JdbcOdbcDriver";
String url = "jdbc:odbc:DRIVER={Microsoft Access Driver (*.mdb)};DBQ="+filepath;
String userNameFromDB = "", pwdFromDB = "";
try
Class.forName(driver);
conn = DriverManager.getConnection(url,"","");
stmt = conn.createStatement();
DatabaseMetaData dbmd = conn.getMetaData();
String[] types = {"TABLE"};
String colnum = null;
ResultSet tables = dbmd.getTables(null, null,"%", types);
// Get the table names
while (tables.next())
// Get the table name
tableName = tables.getString(3);
tbn++;
System.out.println("Table Name: " + tableName);
res = stmt.executeQuery("select * from "+tableName);
ResultSetMetaData resultsMD = res.getMetaData();
cno = resultsMD.getColumnCount() ;
System.out.println("number of columns: " + cno);
System.out.println("number of tables: " +tbn);
while (res.next())
for(int j=1;j<=tbn;j++)
while (res.next())
//System.out.println(tbn);
for (int i=1; i<= cno;i++)
phno = res.getString(i);
System.out.println(phno);
v = new Vector();
v.addElement(phno);
System.out.println(v);
res.close();
tables.close();
stmt.close();
conn.close();
catch(Exception ee)
System.out.println("driver error............");
ee.printStackTrace();
return v;
}

Data from another table, to be displayed on table based screen

I have a block that is based on one table, if I found the record(s) on that table I will display it on the forms, No Problemo. But, if record(s) was not in the said table, I have to get the data on another table and then display it on the same forms. Is there someone who can show me how I can get the data from another table and display it on screen that is based on another table?

suppose you have 2 table emp_n and emp with same table structure
first check data from emp_n if not found then go to emp
try it:-
you will change block name at run time(query data source)
by
emp_n is old
emp is new
set_block_property('emp_n',QUERY_DATA_SOURCE_NAME,'emp');
if no data found in emp_n table then
change the block query name by
set_block_property('emp_n',QUERY_DATA_SOURCE_NAME,'emp');
in next try it will go to emp table for fetching record
kuljeet pal singh

Fetching data from internal table in smartform

Hi,
I'm able to fetch data from one internal table, but in the table the fields are not coming perfectly, can anybody help me in this?
Thanks in advance.

Hi
You have to to specify the text node that you have created for the table that it belong to which cell in the table. Also you styles to format the text(eg: left aligned, center alinged etc)
If you have further query please post.
If this resolves your query close the thread and reward points
Cheers
Shafiq

Multiple select queries used in Excel BI report ,fetching data from Sharepoint DB(SP2010_Prod_ProjectServer) causing blockage on DB ,when more than one workbook(same copy of Excel BI Report) refreshed using Refresh All option.

I am using mutiple select queries to fetch data from Project Server 2010 DB(its sharepoint DB) and these queries fetch data in Excel BI report by establishing connection with DB using instance name and all. I have enhance all these select queries and data
is being fetched in secs. but when more than one copy of same Excel BI report is refreshed using 'Refresh All' option, then these select queries cause blockage on DB.
Please let me know mitigation for this blockage issue.
Should I use begin transaction and commit transaction statements/ shared lock statements.
please reply

Hi,
run same query at the same time?

Fetch data from another URL

Similar Messages

Maybe you are looking for