BusinessObjects Query Preventing Exadata loading process?

We use BusinessObjects to query an Exadata back end. Recently, we had an issue where the overnight DW load failed entirely - this was explained as a "resource locking issue caused by a long-running BusinessObjects report".
Does this sound plausible to the people here? My understanding is that both BusinessObjects and Exadata have preventative measures available to prevent such issues arising.
Thanks in advance.

Please mind there is way too few information to truly know what happened. It requires at least traces of both operations to understand what truly happened.
One thing which could have happened is the following:
- if the BO reports use smartscans/offloading, they do full scans on the segments in the query via direct path.
- data loading requires access to the segments it's about to load or change. This can not be done when these segments are scanned via direct path.
Regular (non-direct path) access does not require the same protection from the database, so loads can co-exists with them much better.
If you can get more information about where the load did wait for, we can do a little more analysis.

Similar Messages

Btree vs Bitmap. Optimizing load process in Data Warehouse.

Hi,
I'm working on fine tuning a Data Warehousing system. I understand that Bitmap indexes are very good for OLAP systems, especially if the cardinality is low and if the WHERE clause has multiple fields on which bitmap indexes exist for each field.
However, what I'm finetuning is not query, but load process. I want to minimize the total load time. If I create a bitmap index on a field with cardinality of one million, and if the table has one million rows (each row has a distinct field value), then my understanding is
The total size of the bitmap index = number of rows * (cardinality / 8) bytes
(because there are 8 bits in a byte).
Hence the size of my bitmap index will be
Million * Million / 8 bytes = 116 GB.
Also, does anyone know what would be the size of my B-tree index? I'm thinking
The total size of the B-tree index = number of rows * (field length+20) bytes
(assuming that the field length of rowid is 20 charas).
Hence the size of my b-tree index will be
Million * (10+20) bytes = 0.03 GB (assuming that my field length is 10 charas).
That means B-tree index is much lesser than the size of the Bitmap index.
Is my math correct? If so, then the disk activity will be much higher for a bitmap index than a B-tree index. Hence, creation of the bitmap index should take much longer than the B-tree index if the cardinality is high.
Please let me know your opinions.
Thanks
Sankar

Hi Jaffar,
Thanks to you and Jonathan. This is the kind of answer I have been looking for.
If I understand your email correctly, for the scenario from my original email, bitmap index will be 32MB where as Btree will be 23MB. Is that right?
Suppose there is an order table with 10 orders. There are four possible values for OrderType. Based on your reply, now I understand that the bitmap index is organized as shown below.
Data Table:
RowId     OrderNo     OrderType
1     23456     A
2     23457     A
3     23458     B
4     23459     C
5     23460     C
6     23461     C
7     23462     B
8     23463     B
9     23464     D
10     23465     A
Index table:
OrderType     FROM     TO
A     1     2
B     3     3
C     4     6
B     7     8
D     9     9
A     10     10
That means, you might have more entries in the index table than the cardinality. Is that right? That means, the size of the index table cannot be EXACTLY determined based on cardinality. In our example, the cardinality is 4 while there are 6 entries in the index table.
In an extreme example, if no two adjacent records have the same OrderType, then there will be 10 records in the index table as well, as shown in the example below.
Data Table (second example):
RowId     OrderNo     OrderType
1     23456     A
2     23457     B
3     23458     C
4     23459     D
5     23460     A
6     23461     B
7     23462     C
8     23463     D
9     23464     A
10     23465     B
Index table (second example):
OrderType     FROM     TO
A     1     1
B     2     2
C     3     3
D     4     4
A     5     5
B     6     6
C     7     7
D     8     8
A     9     9
B     10     10
That means, the size of the index table will be somewhere between the cardinality (minimally) and the table size (maximally).
Please let me know if I make sense.
Regards
Sankar

Exception while loading process

Hi all,
I just installed BPEL 2.0.10 (PM and Designer) and as I completed my first BPEL process (a simple invocation of a synchronous WS) I got the following problem
<2004-09-09 19:05:47,036> <DEBUG> <default.collaxa.cube.engine.deployment> <Cube
ProcessHolder::bind> Exception while loading process
ORABPEL-05217
Error while creating process.
An error has occurred while attempting to instantiate the class "bpel.FirstBPEL.
FirstBPEL__BPEL4WS_BIN" for the process "FirstBPEL" (revision "1.0"). The excep
tion reported was: bpel.FirstBPEL.FirstBPEL__BPEL4WS_BIN
Please try recompiling your BPEL process again. The current BPEL process archiv
e "FirstBPEL" may have been compiled with an older version of "bpelc".
Obviously I have no older version of 'bpelc'. The stack trace reported
at com.collaxa.cube.engine.deployment.CubeProcessFactory.create(CubeProc
essFactory.java:83)
at com.collaxa.cube.engine.deployment.CubeProcessLoader.create(CubeProce
ssLoader.java:351)
at com.collaxa.cube.engine.deployment.CubeProcessLoader.load(CubeProcess
Loader.java:276)
at com.collaxa.cube.engine.deployment.CubeProcessHolder.loadAndBind(Cube
ProcessHolder.java:698)
at com.collaxa.cube.engine.deployment.CubeProcessHolder.getProcess(CubeP
rocessHolder.java:512)
at com.collaxa.cube.engine.deployment.CubeProcessHolder.getStatus(CubePr
ocessHolder.java:168)
at com.collaxa.cube.engine.CubeEngine.lookupProcessStatus(CubeEngine.jav
a:967)
at com.collaxa.cube.beans.BPELProcessManagerBean.getErrors(BPELProcessMa
nagerBean.java:52)
at com.collaxa.cube.beans.ProcessManagerBean_1eyxw1_EOImpl.getErrors(Pro
cessManagerBean_1eyxw1_EOImpl.java:370)
at com.oracle.bpel.client.BPELProcessHandle.getErrors(BPELProcessHandle.
java:163)
at jsp_servlet.__ngprocessloaderror._jspService(__ngprocessloaderror.jav
a:188)
at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)
at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run
(ServletStubImpl.java:1053)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:387)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:305)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispat
cherImpl.java:594)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispat
cherImpl.java:409)
at weblogic.servlet.jsp.PageContextImpl.include(PageContextImpl.java:155
at jsp_servlet.__displayprocess._jspService(__displayprocess.java:414)
at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)
at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run
(ServletStubImpl.java:1053)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:387)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:305)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationActio
n.run(WebAppServletContext.java:6310)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3622)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
Can somebody help me?
BTW I'm using WLS 8.1 sp2
Regards.
Antonio.

I tried both solutions but with no benefit. If it helps here are the FirstBPEL.bpel content and the FirstBPEL.wsdl
BEGIN FirstBPEL.bpel -----------------------------
<process name="FirstBPEL" targetNamespace="http://acm.org/samples" suppressJoinFailure="yes" xmlns:tns="http://acm.org/samples" xmlns="http://schemas.xmlsoap.org/ws/2003/03/business-process/" xmlns:bpelx="http://schemas.oracle.com/bpel/extension" xmlns:ora="http://schemas.oracle.com/xpath/extension" xmlns:ns0="http://www.openuri.org/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:ns1="urn:MSGSenderService">
     <partnerLinks>
          <partnerLink name="client" partnerLinkType="tns:FirstBPEL" myRole="FirstBPELProvider" partnerRole="FirstBPELRequester"/>
          <partnerLink name="msgWs" partnerRole="MSGSenderServiceProvider" partnerLinkType="ns1:MSGSenderServiceLink"/>
     </partnerLinks>
     <variables>
          <variable name="input" messageType="tns:FirstBPELRequestMessage"/>
          <variable name="output" messageType="tns:FirstBPELResponseMessage"/>
          <variable name="msgInput" messageType="ns1:MSGSenderService_sendMsg"/>
          <variable name="msgOutput" messageType="ns1:MSGSenderService_sendMsgResponse"/>
     </variables>
     <sequence>
          <receive createInstance="yes" name="request" partnerLink="client" portType="tns:FirstBPEL" operation="initiate" variable="input"/>
          <assign name="assignInput">
               <copy>
                    <from variable="input" part="payload" query="/tns:FirstBPELRequest/tns:from">
                    </from>
                    <to variable="msgInput" part="String_1"/>
               </copy>
               <copy>
                    <from variable="input" part="payload" query="/tns:FirstBPELRequest/tns:to">
                    </from>
                    <to variable="msgInput" part="String_2"/>
               </copy>
               <copy>
                    <from variable="input" part="payload" query="/tns:FirstBPELRequest/tns:body">
                    </from>
                    <to variable="msgInput" part="String_3"/>
               </copy>
               <copy>
                    <from variable="input" part="payload" query="/tns:FirstBPELRequest/tns:la">
                    </from>
                    <to variable="msgInput" part="String_4"/>
               </copy>
          </assign>
          <invoke name="forward" partnerLink="msgWs" portType="ns1:MSGSenderService" operation="sendMsg" inputVariable="msgInput" outputVariable="msgOutput"/>
          <sequence name="main">
               <assign name="assignOutput">
                    <copy>
                         <from variable="msgOutput" part="result">
                         </from>
                         <to variable="output" part="payload" query="/tns:FirstBPELResponse/tns:msgId"/>
                    </copy>
               </assign>
               <invoke name="callback" partnerLink="client" portType="tns:FirstBPELCallback" operation="onResult" inputVariable="output"/>
          </sequence>
     </sequence>
</process>
END FirstBPEL.bpel -------------------------------
BEGIN FirstBPEL.wsdl -----------------------------
<?xml version="1.0"?>
<definitions name="FirstBPEL"
targetNamespace="http://acm.org/samples"
xmlns:tns="http://acm.org/samples"
xmlns:plnk="http://schemas.xmlsoap.org/ws/2003/05/partner-link/"
xmlns="http://schemas.xmlsoap.org/wsdl/"
>
<types>
<schema attributeFormDefault="qualified"
elementFormDefault="qualified"
targetNamespace="http://acm.org/samples"
xmlns="http://www.w3.org/2001/XMLSchema"
>
<element name="FirstBPELRequest">
<complexType>
<sequence>
<element name="from" type="string" />
<element name="to" type="string" />
<element name="body" type="string" />
<element name="la" type="string" />
</sequence>
</complexType>
</element>
<element name="FirstBPELResponse">
<complexType>
<sequence>
<element name="msgId" type="string"/>
</sequence>
</complexType>
</element>
</schema>
</types>
<message name="FirstBPELRequestMessage">
<part name="payload" element="tns:FirstBPELRequest"/>
</message>
<message name="FirstBPELResponseMessage">
<part name="payload" element="tns:FirstBPELResponse"/>
</message>
<portType name="FirstBPEL">
<operation name="initiate">
<input message="tns:FirstBPELRequestMessage"/>
</operation>
</portType>
<portType name="FirstBPELCallback">
<operation name="onResult">
<input message="tns:FirstBPELResponseMessage"/>
</operation>
</portType>
<plnk:partnerLinkType name="FirstBPEL">
<plnk:role name="FirstBPELProvider">
<plnk:portType name="tns:FirstBPEL"/>
</plnk:role>
<plnk:role name="FirstBPELRequester">
<plnk:portType name="tns:FirstBPELCallback"/>
</plnk:role>
</plnk:partnerLinkType>
</definitions>
END FirstBPEL.wsdl -------------------------------

Repository corrupted/loading process is taking long time

The repository load process is getting stuck at the below message for long time. We have disabled sort indexes on all look up tables but still it is taking huge amount of time to load the repository.Any information on this would be of great help.
94 2011/08/26 20:16:55.523 Report Info Background_Thread@Accelerator Preload.cpp Processing sort indices for 'Products'... (98%)
81 2011/08/27 02:08:23.298 Report Info Background_Thread@Accelerator Preload.cpp Processing sort indices for 'Products'... (100%)
Regards,
Nitin

Hi Nitin,
There are many performance improvement steps that one can take regarding this including verifying your repository.
But i think it should only be a problem if this problem reoccurs.
The accelerators get created when there is a change in table and update indices creates them,possibly there are multiple changes and load by update indices has not taken place for sometme thats why it is creating them.
For better performance one can do following:
Make a judicious choice of which fields to track in change tracking
Disk Space has a huge impact on smooth functioning of MDM. If the disk space is not enough MDM Server cannot even load the repositories
Have a closer look at data model and field properties
Verify if your MDS.INI has this parameter: Session Timeout Minutes (Number. Causes MDM Console, CLIX, and applications based on the new Java API to expire after the specified number of minutes elapses. Default is 14400 (24 hours).When set to 0, sessions never time out.).When you have many open connections, this can to generate performance issue on MDM server
Refer to SAP Note Number: 1012745
Hope this helps.
Thanks,
Ravi

Process Chain Load Processing Time Issue

Hi All,
One my process Chain is running daily , but after 2 hours of load it is showing Red in the Monitor screen, but after 5 hours load is successful.
Why Monitor screen is showing Red?
Is it possible to Extend the load processing time in the Infopackage level?
for e.g- if they set as 60 seconds -- go to Red
I want to change to 120 seconds -- go to Red.
If yes...where we can do it ...please let me know the steps...
Regards,
Nithi.

hey hi,
double click on the infopackage -> go to "scheduler" on the top left corner of the menu -> click "Timeout time" and you have the different option to change it.
hope this helps.

Package-query: error while loading shared libraries: libcurl.so.4: can

Hi all
when i run yaourt to install any things :
package-query: error while loading shared libraries: libcurl.so.4: cannot open shared object file: No such file or directory
why?
what can i do?
I'm very newbie so help me with easy commands!
thanks

try to reinstall yahourt :
https://wiki.archlinux.org/index.php/Yaourt

Data Load process for 0FI_AR_4 failed

Hi!
I am aobut to implement SAP Best practices scenario "Accounts Receivable Analysis".
When I schedule data load process in Dialog immediately for Transaction Data 0FI_AR_4 and check them in Monitor the the status is yellow:
On the top I can see the following information:
12:33:35 (194 from 0 records)
Request still running
Diagnosis
No errors found. The current process has probably not finished yet.
System Response
The ALE inbox of BI is identical to the ALE outbox of the source system
or
the maximum wait time for this request has not yet been exceeded
or
the background job has not yet finished in the source system.
Current status
No Idocs arrived from the source system.
Question:
which acitons can I do to run the loading process succesfully?

Hi,
The job is still in progress it seems.
You could monitor the job that was created in R/3 (by copying the technical name in the monitor, appending "BI" to is as prefix, and searching for this in SM37 in R/3).
Keep on eye on ST22 as well if this job is taking too long, as you may have gotten a short dump for it already, and this may not have been reported to the monitor yet.
Regards,
De Villiers

How do I prevent all dialog processes in SM50 from being occupied?

Hi experts,
I have set rdisp/rfc_min_wait_dia_wp = 4 and I still saw all dialog processes got occupied.
(PS: This screenshot is captured after a few minutes). Anyway, how do I prevent all dialog processes in SM50 from being occupied?
Should I increase rdisp/rfc_min_wait_dia_wp ( = 4 now ) and rdisp/wp_no_dia ( = 18 now ) to a higher value?

Hi Gaurav & Nick,
If I understand correctly, there are 4 dialog processes running and 14 RFC running at the same time.
If I want to resolve this problem, I need to reduce paralellism of RFCs and increase dialog work processes, right? Here is my new configuration. Any thoughts?
new parameters:
rdisp/wp_no_dia = 20
rdisp/rfc_min_wait_dia_wp = 10
rdisp/rfc_check = 3
old parameters in profile:
rdisp/wp_no_dia = 18
rdisp/wp_no_btc = 13
rdisp/wp_no_enq = 0
rdisp/wp_no_spo = 2
rdisp/wp_no_vb = 5
rdisp/wp_no_vb2 = 2
rdisp/rfc_min_wait_dia_wp = 4
rdisp/rfc_check = DEFAULT (DEFAULT is 2, ASYNC and SYNC RFC)

Compiling a package without disturbing the load process

Hi,
I need to compile a package, with the changes, in the database without stopping the load process that is using this package. Please let me know if any one has any ideas.
Thanks

sdk11 wrote:
Hi,
I need to compile a package, with the changes, in the database without stopping the load process that is using this package. Please let me know if any one has any ideas.
ThanksIf you mean: "I need to create or replace a package", while some session is still running code of that package.
Then sorry: nocando.
Unless you are on 11.2, in which case you could (with the necessary preparation/configuration done first) create a new version of the package in another edition than the session is using. But the session will have to finish its work using the package as-is currently.

How to design data load process chain?

Hello,
I am designing data load process chains for the first time and would like to get some general information on best practicies in that area.
My situation is as follows:
I have 3 source systems (R3 and two for which I use flat files).
How do you suggest, should I define one big chain for all my loading process (I have about 20 InfoSources) or define a few shorter e.g.
1. Master data R3
2. Master data flat file system 1
3. Master data flat file system 2
4. Transaction data R3
5. Transaction data file sys 1
... and execute one after another succesful end?
Could you also suggest me any links or manuals on that topic?
Thank you
Andrzej

Andrzej,
My advise is to make separate chains for master & transaction data (always load in this order!) and afterwards make a 'master chain' where you insert these 2 chains one after the other (so: Start process -> Master data chain -> Transaction data chain).
Regarding the separate chains; paralellize as much as possible (if functionally allowed). Normally, the number of parallel ('vertical') chains equals the nr of CPU's available (check with basis-person).
Hope this provides you with enough info to start off with!
Regards,
Marco

BPS/Web: 'Your previous query is still being processed'

Hi,
One of our users get the following message when clicking on a page link in a BPS web application we designed:
'Your previous query is still being processed'. The user is only clicking once on the link and gets in an endless loop (when monitoring the system, no activity can be seen).
All our other users are fine. We checked the internet explorer settings of this user and they are identical to all the other users. We know it is not linked to the user ID or the portal.
Has anyone already seen this ? Any idea where we should look at ?
Thanks for any help.
David

Hello David,
on one hand you are saying only one user has the problem but on the other hand you write that it's not linked to the user ID?
If the frontend settings are OK, then it might be a firewall issue. Some of them block ports or filter JavaScript.
Regards,
Marc
SAP NetWeaver RIG, US BI

How to automate the data load process using data load file & task Scheduler

Hi,
I am doing Automated Process to load the data in Hyperion Planning application with the help of data_Load.bat file & Task Scheduler.
I have created Data_Load.bat file but rest of the process i am unable complete.
So could you help me , how to automate the data load process using Data_load.bat file & task Scheduler or what are the rest of the file is require to achieve this.
Thanks

To follow up on your question are you using the maxl scripts for the dataload?
If so I have seen and issue within the batch (ex: load_data.bat) that if you do not have the full maxl script path with a batch when running it through event task scheduler the task will work but the log and/ or error file will not be created. Meaning the batch claims it ran from the task scheduler although it didn't do what you needed it to.
If you are using maxl use this as the batch
"essmsh C:\data\DataLoad.mxl" Or you can also use the full path for the maxl either way works. The only reason I would think that the maxl may then not work is if you do not have the batch updated to call on all the maxl PATH changes or if you need to update your environment variables to correct the essmsh command to work in a command prompt.

Help Please : Cron Job to automate load process

Hi
I am trying to automate data load process. I am loading data into a number of tables from flat files.
Currently I have a UNIX (SunOS) file with a bunch of SQLLDR commands and I changed permission on this file to executable. Every morning I execute this file to load data.
Now I want to automate this process by writing a cron job and scheduling it. I am running into a number of problems. I exported ORACLE_SID, ORACLE_HOME and PATH still cron is unable to find SQLLDR.
Whatelse am I missing. Here is my command file and cron file.
Please help!?!?!?
ORAENV VARiables
export ORACLE_HOME=/export/opt/oracle/product/8.1.6
export ORACLE_SID=fid1
export PATH=$PATH:$ORACLE_HOME/bin
.profile
. $HOME/oraenv
daily_full.sql file
export ORACLE_SID ORACLE_HOME PATH
sqlldr userid=user/pwd control=acct.ctl log=acct.log
sqlldr .......
Cron Job
16 11 * * 1-5 /apps/fire/data/loadscripts/daily_full.sql >> /apps/fire/data/loadscripts/fulllog.log 2>&1
Output fulllog.log file
/apps/fire/data/loadscripts/daily_full.sql: sqlldr: not found
/apps/fire/data/loadscripts/daily_full.sql: sqlldr: not found
Thanks
Shanthi

Hi Ramayanapu,
first; you have written a shell-script not an sql-script. Please rename your file from daily_full.sql to daily_full.sh
I suggest that you use the cronjob from a user who has the enviroment with the variables ORACLE_SID and ORACLE_HOME.
In this case cron will operate from the $HOME variable of this user.
Perhaps your export will destroy the .kshrc setting. The statement has no effect in your script, please remove it.
Rename your sqlldr-Statement as follows;
$ORACLE_HOME/bin/sqlldr userid=user/pwd control=<path>acct.ctl log=acct.log
<path> will placed with the path of your controlfile.
Your user/pwd will correspond with a ORACLE user who has the right to insert in the destination table.
Your logfile will be place in the %HOME directory.
Hope that i could help to solve your problems
with kind regards
Hans-Peter

Query on Planning WorkFlow Process

Hi Guys,
I have a query on Planning WorkFlow Process i.e Two Business Units are willing to do their Budgeting & Forecasting Process in different periods.
I would like to bring first one process for this and I would like to grant access for these two business units accordingly.
Will it be any problem doing like this? If not please suggest me what is the best approach for this.
Thanks,
Suresh.

Hello Suvin,
You can try to check the value for your return sales order with T-code MB51
Go to MB51 Enter Movement type 651 execute..
Next screen Press Ctrl + Shift + F12 . It will take you to next screen..
In this screen use Ctrl + F8, you will get field Column selection Popup..
in that Choose " Amount in LC" & Sales Value.
With this you will get the value. If the value is Zero then it means that the return stock from customer is non valuated.
Note:
T.Code MB52 : Display Warehouse stock of Material in Hand.
App:lication
You use this report to display the total stock of a material (quantity and value) at plant and storage location level. If transit stocks or stock transfer stocks exist at plant level, the system totals these stocks and displays them in the column In Stock Transfer in a stock line without a storage location.
Note that in this report, the stock value of the warehouse stock is calculated using the following simplified formula:
Stock value = quantity x value/valuated stock
Therefore the stock value specified here only has informal characters and does not represent the actual stock value.
Br,
Tushar
Edited by: Tushar Patankar on Jan 11, 2011 6:28 PM

No Infopackage available in Load process (In Process Chain)

Hello All,
We have a problem in process Chain,
When we add the load Process Item and want to see all the infopackage available, the system say no data... We have Infopackage on Datasource vs 3.x and Datasource BI7.
Thanks in advance for your help.

Hi Bruno,
if i am right u r getting message" no data selected" when u try 2 find IP. which SP u wrking on. try to look 4 ur IP in infosources tab next to data targets in process chain maintainence. It looks like some bug. check note 1062704
Thanks
Prashant

BusinessObjects Query Preventing Exadata loading process?

Similar Messages

Maybe you are looking for