Query from a huge data source

I am currently working on the query on the BO through a Java application. Following the sample procedure, I can perform a query to extract data from the built-in Universe e-fashion using the JDK-provided web services: QueryService and ReportEngine.
However, I encountered some problems when doing the same thing in a universe that contains million rows of data [let say Unvierse A]. I am not sure how the differences between the 2 universes affect the result.
I have tried several times like setting different query objects and query condition but the results still outputs error. There are some error messages I commonly found when I tried to execute the query from the Universe A.
DataProviderInformation boDataProviderInfo = boQuerySrv.createDataProvider(boUniverseUID, boQuerySpec, boRetProp);
DocumentInformation docInfo = objReportEngine.getDocumentInformation(boQueryDocRef, null, actions, null, retBOData);
org.apache.axis2.AxisFault: Read timed out
org.apache.axis2.AxisFault: Read timed out
When I tried doing the same query job in QaaWS / Webi, the report result looks fine. Am I missing some setting in Java ?
Any help is greatly appreciated.
Here are my findings on the Universe Specification:
(com.businessobjects.datasource.DataSourceSpecification)
e-fashion
getAdvancedConditionSupported() - true
getBothOperatorSupported() - true
getCombinedQuerySupported() - true
getConditionObjectValueSupported() - true
getDuplicateRowSupported() - true
getEditQueryAllowed() - true
getIsNullOperatorSupported() - true
getMaxInListNumber() - 999
getMaxRetrievalTime() - 300
getMaxRowsRetrieved() - 90000
getMissingRowSupported() - false
getName() - eFashion
getNotIsNullOperatorSupported() - true
getPercentageRankConditionSupported() - false
getRankConditionSupported() - false
getSortOnAnyObjectSupported() - true
getViewSQLSupported() - true
Universe A
getAdvancedConditionSupported() - false
getBothOperatorSupported() - false
getCombinedQuerySupported() - false
getConditionObjectValueSupported() - false
getDuplicateRowSupported() - false
getEditQueryAllowed() - true
getIsNullOperatorSupported() - false
getMaxInListNumber() - -1
getMaxRetrievalTime() - 600
getMaxRowsRetrieved() - 5000
getMissingRowSupported() - false
getNotIsNullOperatorSupported() - false
getPercentageRankConditionSupported() - false
getRankConditionSupported() - false
getSortOnAnyObjectSupported() - true
getViewSQLSupported() - false

Similar Messages

Implementing Logical FACT & Logical dimension from 2 different data sources

Hi Gurus,
Here is my situation. We have 2 Different Data sources. One is SRMW and the other one is a different source. What we are trying to implement here is we wanted to create logical dimensions and logical facts as well in the BMM layer. For ex: w_day_d from SRMW and other time dimension from another source makes a logical table. And similarly a fact from SRMW and and another similar fact (Same data types though) will make a logical fact in the BMM.
I have done the POC of it, but the only problem is that i was able to fetch the data from only one data source not the other source.
Any suggestions ??
Thanks in Advance.

What I already mentioned is that you have to create multiple logical table sources and set the fragmentation content on each logical table source.
When you have two physical tables for the product dimension, for example DIM_PRODUCT_A and DIM_PRODUCT_B, you must add them to your logical table Products as two separate logical table sources and map all columns to the corresponding logical table columns on the Column Mapping tab.
Hereafter you should go to the Content tab of each logical table source and describe what content is in the logical table source.
For example for the logical table source of DIM_PRODUCT_A:
"BM"."Product"."Product Name" <= 'Product 2'
and for the logical table source of DIM_PRODUCT_B.
"BM"."Product"."Product Name" >= 'Product 3'
Then you must also check "This source should be combined with other sources at this level"
When you run a query in Answers only on the product table, two queries will be generated to get values from both tables.
Regards,
Stijn

Reading Values from Listbox and data source into MS Office Toolkit

Hi,
Been trying to get this to work but making no progress and my lack of experience on labview is becoming a hinderence.
Does anyone know how I can read the values from the listbox example attached into MS Office Toolkit for Excel?
The values from the listbox need to be compared to mulitple values from a strain data source.
Cheers,
Mike.
Attachments:
Capture.PNG ‏62 KB

Hi,
Ok in the attached vi I want value from the listbox "0kg through to 10kg" to be put into the excel table in the report generation toolkit along side data from the convert strain gauge reading.
Cheers,
Mick.
Attachments:
Strain Gauge Edit2.vi ‏112 KB

Adhoc Query Requirement with Multiple Data Source

Hi All,
I have a Adhoc Query Requirement with Multiple Data Source. Is there any way to achive it. Other than Resultant set and bring into Model.
Thanks
SS

You can compare stuff in the EL, but I don't think this is what you need.
You can just use Java code in the backing bean class for all the business logic. You can use DAO classes for database access logic. Finally for displaying you can use the JSF tags such as h:outputText.

How to get process start time from BI BPM Data Source

Hi,
I would like to get the process start time using the VC data source BI_BPM_MY_PROCESSES_DS.
The return parameter BI_START_TIME_VALUE returns numbers like 1.271.858.563.350,00. This seems to be ms beginning from 1970.
I tried the following to get the current date/time but it didn't work:
=DTADD(DATETIME(1970,01,01,00,00),@BI_START_TIME_VALUE,'Z')
Any idea how to do this?
Thanks,
Kevin

Hi Experts,
Do you have ideas for this SQL query ?
Regards.

Importing from Excel as data source

Hi,
I developed rpd using Excel as a data source,rpd is consistent & i'm able to view the datas correctly in rpd.
But in Presentation Services it was throwing me an error when im combining columns from two different tables.
SELECT TransLog.Device_ATM_POS saw_0, RespCodes.R_C_NAME saw_1 FROM JPMC ORDER BY saw_0, saw_1
State: HY000. Code: 10058. [NQODBC] [SQL_STATE: HY000] [nQSError: 10058] A general error has occurred. [nQSError: 16001] ODBC error state: S1000 code: -3079 message: [Microsoft][ODBC Excel Driver] Type mismatch in expression.. [nQSError: 16002] Cannot obtain number of columns for the query result. (HY000)
Also my Date Format while viewing data is (e.x: 28-OCT-08); In presentation services,the error is,
SELECT TransLog.TRL_DATE_LOCAL_TXN saw_0 FROM JPMC ORDER BY saw_0
State: HY000. Code: 10058. [NQODBC] [SQL_STATE: HY000] [nQSError: 10058] A general error has occurred. [nQSError: 46046] Datetime value 01-OCT-09 does not match the specified format. (HY000)
Please guide me to solve this issue.
Thanks in advance,
Princy

Your first problem comes from the ODBC driver.
The driver see the data in the columns of your join has two different data type. Check here:
http://support.microsoft.com/kb/141284
For the second error, your date string must follow the format in the nqsconfig.ini.
DATE_TIME_DISPLAY_FORMAT = "yyyy/mm/dd hh:mi:ss" ;
DATE_DISPLAY_FORMAT = "yyyy/mm/dd" ;
TIME_DISPLAY_FORMAT = "hh:mi:ss" ;I assume that with ODBC you get a DATETIME by default.
Then the data (the content and not the excel format) that you must
have in your excel sheet is "yyyy/mm/dd hh:mi:ss".
You can try to change it with a DATE data type in the physical layer of OBIEE and to have a string value of this format "yyyy/mm/dd".
Success
Nico

Power Query: Making a local data source public

If I am using an Excel workbook as my data source for my raw data, can I upload this to a Power BI site and change the Source so that a refresh will work and I can share the query?
FROM: Source = Excel.Workbook(File.Contents("C:\Users...book.xls")
TO: Source = Excel.Workbook(File.Contents(https://sites.powerbi.com/sharepointpages/...book.xls)

Any suggestions for Mtink?
Thanks!
Ed Price, Azure & Power BI Customer Program Manager (Blog,
Small Basic,
Wiki Ninjas,
Wiki)
Answer an interesting question?
Create a wiki article about it!

Retrieving data from two CRM data sources having same field name.

Hello Experts,
I am extracting data from 0CRM_OPPT_H(Opportunties) and 0CRM_SALES_ACT_1 (Activities), in both data sources we have a comman field "DESCRIPTION_UC".which is the field for both Opportunity Description and Activity Description.
In BW "0CRM_DESCR" is the same object which is mapped to both opportunity and Activity descriptions field"DESCRIPTION_UC".
Data is retriving fine in both Infoproviders.
Our Requirement is to populate both above said Activity and Opportunity descriptions in the report, to achive this we need to create a multiprovider and populate the data.Plz help me how to assaign the objects in the multiprovider.
Thanks
Satya

Hi,
In Characteristics tab.
u find the identification tab.
Go there and click on both infoproviders corresponding to both info providers.....
One needs to clearly understand that there are different approaches in identification of KFs and Chars in a MP.
KFs, if they are identical by meaning, must be selected from EXACTLY ONE INFOPROVIDER.
CHARs must be selected in EACH INFOPROVIDER involved.
For example, I have a Char COUNTRY in my MP. And in the infoproviders I have Chars such as SENDING COUNTRY, DESTINATION COUNTRY, TRADING COUNTRY, COUNTRY OF GOODS ORIGIN, COUNTRY OF TRANSPORT. I need to identify which country in infoprovider will be treated as a COUNTRY in the MP. And such identification should be set for each Char in MP for each infoprovider.
If there is no data for COUNTRY in one of the providers (or COUNTRY is not properly identified in MP) then data from this infoprovider will come into MP query as NOT ASSIGNED or not come at all.
You can search these forums for something like no data in multiprovider. Youll find a lot of threads concerning this problem. In most cases the reason of this exactly what was said wrong identification of chars in MP or absence of char values in some infoproviders.
Check this link for more info
Identification in Muticube
Hope this helps u..
Best Regards,
VVenkat
Edited by: Venkata Narayana Jakkampudi on Dec 24, 2008 12:37 PM
Edited by: Venkata Narayana Jakkampudi on Dec 24, 2008 12:41 PM

How to send data from 4 different data sources to one ODS

Hello Gurus,
There is a transaction called KSB1 in R/3.
It has data related to cost center , cost element, G/L .
In BI, i need to transfer the data from these Data sources to one ODS.
Can any body give me some idea.
Points will be awarded for any kind of response .
Thanks .
Anu

Hi Rupa..
In your requirement some data sources (Cost centre, Cost element) are master data sources.
They are available as info Objects in BI (Content).
So there is no need to create ODS on these.
But the general scenario for creating ODS from multiple data sources in case of Transaction documents
Like :
PO header, PO line items...
For this the Pre-requisite is to have common fields between these data sources (eg PONo).
Hope this gives idea for u....
Cheers...
Varma

Create two or more flash files from one (Excel) data source

Hi experts,
I have the following requirement about Xcelsius.
Our data source is a relational database. Via the ODBC driver we manage to create several queries and execute them into Microsoft Excel. Those excel sheets are the basic for the Xcelsius reports.
Now we want to build some highly visualized reports on that, but the crucial fact is. We don't want to have all the reports in one FlashFile, but we need several flash file depending on the area of the queries.
Hence our requirement would be one of the following points:
- create multiple flash files from one .xlf
- create multiple .xlf from data source
Another requirement is the automatic execution of the process. We don't want to have a person in between, who has to call all the .xlf files to create the Flash reports step by step. What we need is an automatic process.
Can this requirement be fulfilled in a way?
Maybe by using the Xcelsius SDK?
Thanks for any helps and comments!
Sebastian

Sebastian,
Firstly talking about the important requirement i.e. automating the process:
In your case you can achieve this by using the XML maps. This will pick the data automatically when ever report is refreshed.
Secondly, both the approaches are correct, however i would go with the first one.
1. Create multiple flash files from one .xlf
You just need to create one dashboard and have a filter on areas (Invisible) and then export to flash (for every area).
2. Create multiple .xlf from data source
This approach is also fine, however you need to create multiple dashboards and do the same thing i.e filter data based on area.
P.S. Did you get a chance to explore options to integrate Xcelsius with your Relational Database, this will be much effective.
-Anil

Will OBIEE Support creating reports from 2 different data sources

Hello Guys
I am new to BI . Can anybody let me know how to create a report using 2 different data sources .
Ex: Suppose we have 10G and SQL server , can we import tables to rpd and join 1 fact & dimension from 10G and 1 Fact from SQL server to the 10G tables . If so ,
1) Will the repository be consistent ?
2) Is it a best practice to do this kind of modeling ?
3) Will it affect the performance of the reports ?
Your advice is highly appreciated .

Hi,
Dont try to do this at the BI server layer. Oracle has special abilities to do this thing. So use the power of oracle to import the tables from the sql server to oracle and in the bi server just create one data source.
you can browse for *'DBLINK'* in oracle.
Regards,
Karthick

DI UI : fill matrix with a query from user table data

hello,
I create a user table.
I want to fill a matrix on a form with some aggregated data of this user table.
I do :
Public Sub SetMatrixRep()
Dim oRecordSet As SAPbobsCOM.Recordset
Dim oCentre As SAPbouiCOM.EditText
Dim oCompte As SAPbouiCOM.EditText
Dim oBudget As SAPbouiCOM.EditText
Dim oDepense As SAPbouiCOM.EditText
Dim oSolde As SAPbouiCOM.EditText
Dim i As Long
i = 0
Set oRecordSet = oCompany.GetBusinessObject(SAPbobsCOM.BoObjectTypes.BoRecordset)
oRecordSet.DoQuery ("select * from [@CAP_OPRC_BUDGET]")
While oRecordSet.EOF = False
    ' filling the matrix
    Set oCentre = oMatrixRep.Columns("clCentre").Cells.Item(i).Specific
    oCentre.String = oRecordSet.Fields.Item(0).Value
    'oMatrixRep.Columns("clCentre").Cells(1).Specific.String = oRecordSet.Fields.Item(0).Value
    'SBO_Application.MessageBox (oRecordSet.Fields.Item(0).Value)
    oMatrixRep.AddRow
    oRecordSet.MoveNext
    i = i + 1
Wend
End Sub
I've got an error : Row - Index invalid.
Could you help me please ?
Thanks.
Romeo.

Hi
This is a routine that I call from my Item Event handler
Hope it can help you
Public Sub PopolaMatrice(oApplicazione As SAPbouiCOM.Application, pVal As SAPbouiCOM.IItemEvent)
    Dim oForm               As SAPbouiCOM.Form
    Dim oMatrix             As SAPbouiCOM.Matrix
    Dim oDBDataSource       As SAPbouiCOM.DBDataSource
    Dim oConditions         As New SAPbouiCOM.Conditions
    Dim oCondition          As SAPbouiCOM.Condition
    Dim oDocNum             As SAPbouiCOM.EditText
    Dim lIndice             As Long
    Set oForm = oApplicazione.Forms.GetFormByTypeAndCount(pVal.FormType, pVal.FormTypeCount)
    Set oDBDataSource = oForm.DataSources.DBDataSources.Item("MyUserTableName")
    Set oMatrix = oForm.Items("MyMatrixName").Specific
    oMatrix.Clear
    'setting the condition object
    'this is equal to the following SQL statement
    'WHERE UserFieldName1 = "MyCriteria1" and UserFieldName2 = "MyCriteria2"
    Set oCondition = oConditions.Add()
    oCondition.BracketOpenNum = 2
    oCondition.Alias = "UserFieldName1"
    oCondition.Operation = co_EQUAL
    oCondition.CondVal = "MyCriteria1"
    oCondition.BracketCloseNum = 1
    oCondition.Relationship = cr_AND
    Set oCondition = oConditions.Add()
    oCondition.BracketOpenNum = 1
    oCondition.Alias = "UserFieldName2"
    oCondition.Operation = co_EQUAL
    oCondition.CondVal ="MyCriteria2"
    oCondition.BracketCloseNum = 2
    oDBDataSource.Query oConditions
    'filling the matrix
    For lIndice = 0 To oDBDataSource.Size - 1
        oDBDataSource.Offset = lIndice
        oMatrix.AddRow
    Next lIndice
End Sub

Call query from database as item source

Hello!
I have a query that is too long to paste it as the record source for an Apex item. It exceeds the limit of 32K.
Is there a way to save that query at database level and call it from the apex item?
If there is, please be so kind and give a small example!
Thank you,
Sebastian

Hello,
Why not put that code into a PL/SQL packaged function and use the "PL/SQL Function Body" or "PL/SQL Function or Expression" types instead?
John.
Blog: http://jes.blogs.shellprompt.net
Work: http://www.apex-evangelists.com
Author of Pro Application Express: http://tinyurl.com/3gu7cd
REWARDS: Please remember to mark helpful or correct posts on the forum, not just for my answers but for everyone!

Import into SQL Server db from Sybase 7 data source - SQL Server 2008 R2/2012

Hi,
I need to import Sybase 7 data into a SQL Server 2008 R2 or 2012 database.
Has anyone any experiences about this import?
Thanks

The nuance is in basically setting your connection manager right.
If I remember correctly, I did that using the ODBC/ADO, but I do not remember the Sybase version.
I suggest you visit a post dedicated to this operation (the author chose to use the ADO.NET type of a provider):
http://msbimentalist.wordpress.com/2013/11/01/import-and-export-from-sql-server-to-sybase-db-using-ssis/
Arthur My Blog

Need to control page view to 20 from an html data source for a spry data repeating region

</style>
<script src="SpryAssetPan/SpryData.js" type="text/javascript"></script>
<script src="SpryAssetPan/SpryHTMLDataSet.js" type="text/javascript"></script>
<script src="SpryAssetPan/SpryPagedView.js" type=”text/javascript”></script>
<script type="text/javascript">

</script>
</head
<body>
<div id="wrapper">
<div spry:region="ds1">
    <div id="repeatOne" spry:repeat="ds1">
      <p>{Photo_2}<br />
      {Item}</p>
    </div>
Here you can find the file that I need to Create Paged View data set navigation
http://www.hohmangraphics.com/masterProductGuide/WrapAround_art/joestest_2.html

Thank you,
With some adjustments it worked, see source code below,
<script src="SpryAssetPan/SpryData.js" type="text/javascript"></script>
<script src="SpryAssetPan/SpryHTMLDataSet.js" type="text/javascript"></script>
<script language="JavaScript" type="text/javascript" src="SpryAssetPan/SpryPagedView.js"></script>
<script language="JavaScript" type="text/javascript">
var ds1 = new Spry.Data.HTMLDataSet("wrapAround_master2.html", "wrap2", {distinctOnLoad: true, sortOnLoad: "Item", sortOrderOnLoad: "ascending"});
var pv1 = new Spry.Data.PagedView( ds1 ,{pageSize: 10});
//-->
</script>
</head>
<body>
<div id="wrapper">
<p>
<input type="button" value="First" onclick="pv1.firstPage();" />
<input type="button" value="Prev" onclick="pv1.previousPage();" />
<input type="button" value="Next" onclick="pv1.nextPage();" />
<input type="button" value="Last" onclick="pv1.lastPage();" />
<br />
</p>
<div spry:region="pv1 ds1">
    <div id="repeatOne" spry:repeat="pv1">
      <p>{Photo_2}<br />
      {Item}</p>
    </div>

Query from a huge data source

Similar Messages

Maybe you are looking for