How to increase partial cache size on Lookup stuck at 4096 MB SSIS 2012
Hello,
After converting from SSIS 2008 to SSIS 2012, I am facing major performance slowdown while loading fact data.
When we used 2008 - one file used to take around 2 hours average and now after converting to 2012 - it took 17 hours to load one file.
This is the current scenario: We load data into Staging and Select everything from Staging (28 million rows) and use a lookups for each dimension. I believe it is taking very long time due to one Dimension table which has (89 million rows).
With the lookup, we currently are using partial cache because full cache caused system out of memory.
Lookup Transformation Editor - on this lookup -
Does anyone know how to increase the size on partial Cache size 64-bit? I am being stuck at 4096 MB and can not increase it. In 2008, I had 200,000 MB partial cache size.
Any ideas with how to make this faster?
Thanks in advance!
Hi Sarora,
First of all, you may want to re-think if that huge dimension is really a dimension or you can re-design your model so you lower its cardinality.
Then, why are you using Partial Cache?
Partial Cache will end up querying directly a lot of times your huge dimension. Potentially, as many times as the No Lookup mode.
If you can afford loading the whole dimension in memory it'd be MUCH better in terms of performance. If you are loading the whole dimension, try just querying the surrogate key and the business key columns, you'll find the amount of memory used will be much
lower.
I am not sure how much memory do you have available or how much memory the Lookup used to take, but with these amounts you talked about you were probably loading the whole table in memory. You can rough estimate the amount of memory the Lookup will take
in Full Lookup mode using
(ColumnWidth1 + ColumnWidth2 + ... + ColumnWidthN) * NumberOfRows
Regards.
Pau
Similar Messages
-
How to increase the cahce size?
how to increase the cache size?
i am using safari 4.0.3HI and Welcome to Apple Discussions...
I know of no way to increase the cache size but it's easy to empty it. File/Empty Cache or
Ctrl + Alt + E.
Carolyn -
How to increase the buffer size ?
Our BI system displays the following message when I execute a query on the web : buffer too small
How to increase the buffer size ?
Thanks in advanceIndeed, we are using Bex Web 7.0
The query uses a big structure and when I execute it on the web, it takes a long time (> 5 min) and I receive folowing message on top of the result page : " could not buffer query structures. Buffer too small "
When I execute the query in Bex analyzer, it takes a long time too but we dont get the message
I have checked the cache size:
- Local cache : 100 MB
- Global cache : 200 MB
Please let me know any solution as there is no BASIS TEAM. The guy who installed the soft was a consultant and is no more reachable.
Thanks in adavnce -
How to Increase the retreving size of instances using PAPI filters.
Hi,
How to Increase the retreving size of instances using PAPI filters.
In my engine database instance size exceeds 2500 then we are getting following exception.
If we login in to user workspace able to see the instances but while trying to retrieve from PAPI getting below exception and showing the user's inbox aize as 0.
In Process Admin console we set all the required parameters.
Still I m getting the same problem.
Can you please lgive mev the solution.
<Mar 23, 2010 8:58:24 PM SGT> <Warning> <RMI> <BEA-080003> <RuntimeException thrown by rmi server: fuego.ejbengine.EJBProcessControl_1zamnl_EOImpl.getInstancesByFilter(Lfuego.papi.impl.j2ee.EJBSecureEngineInfo;Ljava.lang.String;Lfuego.papi.Filter;)
java.lang.ClassCastException: cannot assign instance of java.util.HashSet to field fuego.view.FilterImpl.attributes of type java.util.List in instance of fuego.view.FilterImpl.
java.lang.ClassCastException: cannot assign instance of java.util.HashSet to field fuego.view.FilterImpl.attributes of type java.util.List in instance of fuego.view.FilterImpl
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2032)
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1212)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1953)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1871)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1753)
Regards,
Bharath.
Edited by: bg57295 on Mar 24, 2010 6:45 PMHi Bharath,
Believe me, you have an incompatibility between different build#.
PAPI has an instance cache. When certain process has more instances than the maximum specified, the cache is switch to status OPEN. That means, that PAPI will not be able to resolve some instance queries using the information in the cache. When that occurs, PAPI forward all those queries to the engine.
The incompatibility introduced is in the communication between PAPI and Engine. So, you only get the exception when you have more instances than the maximum cache size.
Regards,
Ariel -
Why can't I increase the cache size in FF 4?
OK, first of all, to be honest I really don't like FF 4. I see absolutely no advantages over the previous versions and I can't find anything to like about FF 4..
One big and annoying factor (besides the how UI and layout) is why can't I increase the cache size?
If I choose to manage it myself and override what the developers did, I can go to 1024 and that's it. If I want 5GB of cache, I'm out of luck because some coded decides how I want to manage my disk space? They're kidding, right?
What the heck is the matter with these guys?
This thing is so bad that I've resisted upgrading, I didn't have a choice when I upgraded to Ubuntu 11.04, it came with the package.. Yuk... I've been a FF user since late 2003 or early 2004... I'm about to part ways with this thing if they don't fix it...Even IE sucks less than this thing....
None of my Windows machines are going to get 4 loaded if I can help it.. About 1 million people agree with me...correction.. It's not a million.. it's legion at this point..
Google "I hate FF 4" and you'll get 40,900,000 results... I don't trust Google further than I can throw them, but 41 million people complaining about this thing? What a freakin travesty... -
How to increase the attachment size of a portal
Hi,
We have a portal developed using JSP.
We have an option for attaching files. Now the maximum limit is only 5 MB. So we thought of using FTP so that we can increase the attachment limit. But we are not able to attach files more than 1 MB.
Could you please help us in resolving this. Any idea how to increase the attachment size limit?
Thanks in advanceHi,
See what Patrick Yee has posted.
how to create own page format in smartforms immmedia
Svetlin -
How to increase the database size
Hi All ,
Our Client is going to increase their customers from 3.5 million to 5 millions
(12 millions in future ) and there is no increase in the existing licenses..
At present we have very less space in Data base server. We are Going Live at the End of the Month.
How to increase the database size to meet the Client requirements.
we have to increase the No of Processerors etc...
Below are the details of Servers:
System Model: IBM,7040-681
Machine Serial Number: 830D5BF
Processor Type: PowerPC_POWER4
Number Of Processors: 2
Processor Clock Speed: 1904 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
LPAR Info: 4 bgl-svr-biap
Memory Size: 4096 MB
Good Memory Size: 4096 MB
Note : Server is IBM P690.
1) System Lansdcape --> Two System Landsacpe ( Dev to Prod )
2) BW Version --> 3.5
3) SAP Basis --- > 6.4
4) No of Application servers currently having --> Only One Server
Can any body suggest me how to solve this.....
Thanks in Advance..
Kasi ChukkaHi Kasi,
Your question is not very clear, from the looks of it, the load on your client's system will be doubling soon.
You need to look at the system stats on how the system is handling the current load, use transactions ST06, ST04 and ST02 to check if the DB hit ratios are as expected, the cpu idle time, the busy periods. Identify if there is large amounts of paging on the server(candidate for increase in real memory).
On AIX level, you will need to look at CPU / Memory usage.
On SAP Application server, you need to look at SAP Buffers.
On Oracle end, look at SGA stats, if it need to increase, the data growth that is current and estimated growth (DB02).
You will not get an exact answer to it, you will need to analyze the existing load and then estimate (guess). The hardware upgrade will also depend on what the client is willing to spend, its always a good practise to add 20% to what you have estimated as these figures are never accurate.
All the best.
Cheers,
Nisch -
How to Increase the SGA Size.
Hi Guru's
I want to Know
How to Increase the SGA Size in Database 8.1.7.4.1
My Ram Size is 6 GB
When I query the Below Script
select name, value
from v$parameter
where name in ('shared_pool_size', 'java_pool_size', 'streams_pool_size',
'log_buffer', 'db_cache_size', 'db_2k_cache_size', 'db_4k_cache_size',
'db_8k_cache_size', 'db_16k_cache_size', 'db_32k_cache_size',
'db_keep_cache_size', 'db_recycle_cache_size', 'large_pool_size');
Result
shared_pool_size 300000000
large_pool_size 0
java_pool_size 50000000
log_buffer 10485760
Please Suggest Me the How Much Value also to increase the SGA
My RAM SIZE is 6 GB
Regards
***SBJ***SGA size on 8i is static , and for increasing the size you have to make the changes in the pfile and bounce the database
First thumb rule is that your SGA should not exceed more than 40% of your PHYSICAL RAM in oracle <= 8i version. You can go around 80% from oracle 9i onwards
http://mohamedazar.wordpress.com/2010/08/30/can-i-increase-sga-target-size-greater-than-sga-max-size/
Edited by: Amigo on Dec 18, 2010 1:31 AM -
How to increase the font size of print ouput in SAP 4.7
Hi,
How to increase the font size of the ouput of Write statement on PRINT ? in 4.7
THANKS IN ADVANCE
MOOSAYou can do that using the PRINT-CONTROL Statement.This will only work when you send the list to the printer.Sample code is as below :
REPORT zfont NO STANDARD PAGE HEADING LINE-SIZE 80 LINE-COUNT 65.
Start of print-control
NEW-PAGE PRINT ON.
PRINT-CONTROL FUNCTION 'SF000'.
WRITE: / 'This is CPI 20'.
SKIP.
PRINT-CONTROL FUNCTION 'SF020'.
WRITE: / 'This is CPI 6'.
SKIP.
PRINT-CONTROL FUNCTION 'SF008'.
WRITE: / 'This is CPI 12'.
Depending on your SAP printer device, this may also work
PRINT-CONTROL FONT 1 LPI 6.
you can try to change font and LPI numbers
WRITE: / 'font 1 lpi 6'.
PRINT-CONTROL FONT 2 LPI 6.
WRITE: / 'font 2 lpi 6'.
PRINT-CONTROL FONT 3 LPI 6.
WRITE: / 'font 3 lpi 6'.
End of print-control
NEW-PAGE PRINT OFF.
*--- End of Program -
How to increase the column size of Alv tbale
Hi All,
I created an Alv table to display the content of my database table. In one of the column the entire data from my database are not displayed the last few characters are missing. The data type for that column in the database is char. Can any one help me how to increase the column size in my Alv table or any suggestions to resolve this issue.Hi Vadiv,
Try with this..
DATA: LR_IF_CONTROLLER TYPE REF TO IWCI_SALV_WD_TABLE,
LR_CMP_USAGE TYPE REF TO IF_WD_COMPONENT_USAGE,
LR_CMDL TYPE REF TO CL_SALV_WD_CONFIG_TABLE,
LR_TABLE_SETTING TYPE REF TO IF_SALV_WD_TABLE_SETTINGS.
LR_CMP_USAGE = WD_THIS->WD_CPUSE_ALV( ).
IF LR_CMP_USAGE->HAS_ACTIVE_COMPONENT( ) IS INITIAL.
LR_CMP_USAGE->CREATE_COMPONENT( ).
ENDIF.
" get reference to the ALV model
LR_IF_CONTROLLER = WD_THIS->WD_CPIFC_ALV( ).
LR_CMDL = LR_IF_CONTROLLER->GET_MODEL( ).
LR_TABLE_SETTING ?= LR_CMDL.
" Set column width
DATA LR_COL TYPE REF TO CL_SALV_WD_COLUMN.
LR_COL = LR_CMDL->IF_SALV_WD_COLUMN_SETTINGS~GET_COLUMN( 'PERNR' ).
LR_COL->SET_WIDTH( '70' ) .
LR_COL = LR_CMDL->IF_SALV_WD_COLUMN_SETTINGS~GET_COLUMN( 'ENAME' ).
LR_COL->SET_WIDTH( '100' ) .
LR_TABLE_SETTING->SET_FIXED_TABLE_LAYOUT( ABAP_TRUE ).
You can refer to webdynpro component SALV_WD_TEST_TABLE_PROPS. Go to the view TABLE and look inside the method SET_COLUMN_SETTINGS. I hope this will help you.
Cheers,
Kris. -
How to increase the letter size of the email text
how to increase the letter size of the email text
== as soon as I started using the serviceIf you set a higher Page Zoom level for that website Firefox should remember that zoom level and restore that level when you return to that website. See this:
https://support.mozilla.com/en-US/kb/Page+Zoom
That feature doesn't work in the Private Browsing mode, and you'll lose that setting if you clear your browser history. -
How to increase the font size of the report output in the printout.
Hi Team,
i have a requirement like to print the report output as a direct print from an internal table.I am using the below mentioned code, the output is printing fine but the Font size of the output text is so small so i need to increase the font size of the text of output data.
call function 'GET_PRINT_PARAMETERS'
exporting
immediately = 'X'
line_count = 65
line_size = 320
mode = 'CURRENT'
no_dialog = ' '
release = 'X'
user = sy-uname
importing
out_parameters = st_param
exceptions
archive_info_not_found = 1
invalid_print_params = 2
invalid_archive_params = 3
others = 4.
if sy-subrc eq 0.
new-page print on parameters st_param no dialog.
could you please suggest me how to increase the font size while printing the report output..
Thanks in Advance.
Puneet.hey,
in our system when we click on print. on widow is coming.
there is a properties button.
we click on it.
there FORMAT----AND then we select forat from there and then printing .
not sure. but check on ur system. is there properites button.
HI,
READ THIS,
You can specify attributes such as the character width and font size in the device type formatting yourself.
contact ur basis team .
in the report PRINT-CONTROL SIZE option is there. try to find more o this. -
How to increase the heap size of the container in whioch BPEL is running ?
Hi All,
I recently raised an SR they have asked me to do the following,
Can you please try and start the container running the BPEL process with max
heap space (-Xmx) of 2 GB and the eden space (-Xmn) at about 60% of 1228m and
the option -XX:+AggressiveHeap set. (even though this option is recommended for
multi processor machines say 4)
can anyone kindly explain me how to increase the Heap size and Eden size of BPEL container ?
Thank YouHi Deepak I cant see any attribute or element in the oc4j_opmn.xml file regarding heap memory. In the server properties I changed the size of heap memeory how can I rollback.
I am getting the following error
Configuration information
Running in C:\product\10.1.3.1\OracleAS_1
Operation mode:Startup, App Server, No Enterprise Manager, Single Instance
Oracle home:C:\product\10.1.3.1\OracleAS_1
Oracle home name:Unnamed
Instance name:SOA.01hw117905.India.TCS.com
Instance type:allProducts
Version:10.1.3.4.0
Uses infrastructure:false
Not an infrastructure instance, no infrastructure information available
Components:[j2ee, apache, orabpel, oraesb, owsm, Wsil]
2009-08-19 09:08:51.863--Begin log output for Mid-tier services (SOA.01hw117905.India.TCS.com)
2009-08-19 09:08:51.863--Processing Step: starting OPMN
2009-08-19 09:09:00.394--Processing Step: starting OPMN managed processes
2009-08-19 09:09:35.19--End log output for Mid-tier services (SOA.01hw117905.India.TCS.com)
An unknown OPMN error has occured
oracle.appserver.startupconsole.model.ConsoleException: An unknown OPMN error has occured
at oracle.appserver.startupconsole.control.OPMNController.doStart(OPMNController.java:121)
at oracle.appserver.startupconsole.control.Controller.start(Controller.java:69)
at oracle.appserver.startupconsole.control.GroupController.doStart(GroupController.java:47)
at oracle.appserver.startupconsole.control.Controller.start(Controller.java:69)
at oracle.appserver.startupconsole.view.controller.ControllerAdapter.start(ControllerAdapter.java:30)
at oracle.appserver.startupconsole.view.controller.MasterControlAdapter.run(MasterControlAdapter.java:94)
at oracle.appserver.startupconsole.view.Runner.main(Runner.java:39)
Caused by: oracle.ias.opmn.optic.OpticControlException: Error from opmn during process control operation
at oracle.ias.opmn.optic.AbstractOpmnEntity.runCommand(AbstractOpmnEntity.java:174)
at oracle.ias.opmn.optic.AbstractOpmnEntity.start(AbstractOpmnEntity.java:110)
at oracle.appserver.startupconsole.control.OPMNController.doStart(OPMNController.java:89)
... 6 more
Exception caused by
Error from opmn during process control operation
oracle.ias.opmn.optic.OpticControlException: Error from opmn during process control operation
at oracle.ias.opmn.optic.AbstractOpmnEntity.runCommand(AbstractOpmnEntity.java:174)
at oracle.ias.opmn.optic.AbstractOpmnEntity.start(AbstractOpmnEntity.java:110)
at oracle.appserver.startupconsole.control.OPMNController.doStart(OPMNController.java:89)
at oracle.appserver.startupconsole.control.Controller.start(Controller.java:69)
at oracle.appserver.startupconsole.control.GroupController.doStart(GroupController.java:47)
at oracle.appserver.startupconsole.control.Controller.start(Controller.java:69)
at oracle.appserver.startupconsole.view.controller.ControllerAdapter.start(ControllerAdapter.java:30)
at oracle.appserver.startupconsole.view.controller.MasterControlAdapter.run(MasterControlAdapter.java:94)
at oracle.appserver.startupconsole.view.Runner.main(Runner.java:39)
<?xml version='1.0' encoding='WINDOWS-1252'?>
<response>
<msg code="-82" text="Remote request with weak authentication.">
</msg>
<opmn id="01hw117905:6200" http-status="206" http-response="2 of 3 processes started.">
<ias-instance id="SOA.01hw117905.India.TCS.com">
<ias-component id="default_group">
<process-type id="home">
<process-set id="default_group">
<process id="172" pid="2176" status="Alive" index="1" log="C:\product\10.1.3.1\OracleAS_1\opmn\logs\\default_group~home~default_group~1.log" operation="request" result="success">
<msg code="0" text="">
</msg>
</process>
</process-set>
</process-type>
<process-type id="oc4j_soa">
<process-set id="default_group">
<process id="173" pid="5556" status="Stopped" index="1" log="C:\product\10.1.3.1\OracleAS_1\opmn\logs\\default_group~oc4j_soa~default_group~1.log" operation="request" result="failure">
<msg code="-21" text="failed to start a managed process after the maximum retry limit">
</msg>
</process>
</process-set>
</process-type>
</ias-component>
<ias-component id="HTTP_Server">
<process-type id="HTTP_Server">
<process-set id="HTTP_Server">
<process id="171" pid="2724" status="Alive" index="1" log="C:\product\10.1.3.1\OracleAS_1\opmn\logs\\HTTP_Server~1.log" operation="request" result="success">
<msg code="0" text="">
</msg>
</process>
</process-set>
</process-type>
</ias-component>
</ias-instance>
</opmn>
</response> -
How to increase the FONT Size in a report while printing in SAP
Hi ,
Can anybody let me how how to increase the Font size while printing a report in SAP .
Thanks
Dhaval..hi Raje,
WELCOME TO SDN
use <b>PRINT-CONTROL</b> option
PRINT-CONTROL FUNCTION 'SF000'.
WRITE: / 'This is CPI 20'.
SKIP.
PRINT-CONTROL FUNCTION 'SF020'.
WRITE: / 'This is CPI 6'.
How to change font sizi in a classical report?
REgards,
Santosh
Message was edited by: Santosh Kumar P -
How to increase the font size in the safari tool bar
Hello,
I am trying to set-up Yosemite for my mom who is a senior. The toolbar and address bar for safari seem to be quite small. Does anyone know how to increase the font size in the tool bar and address bar? I already figured out to make the font size bigger on a webpage which is nice but the rest of the interface, though pleasing to look at, is quite miniscule.
Hope someone can help.I too would like an easier way to do it. The only way that I have found (& it works for all applications, desktops Document & Download files) is to decrease the size of your Screen display from 2560 by 1440 ( this is your "Default for display") to 1920 by 1080. This is accomplished by going to "Accessibility Preferences" in your menu bar or through Systems Preferences and choosing the DISPLAY icon, then unchecking the "Default for Display" Setting and then check "Scaled".
Your screen resolutions will then appear in the drop down box & you can choose a smaller display (e.g. 1920 x 1440), then all print will appear larger on the screen.
If anyone knows a slicker way, I 'm all ears (actually "eyes" would be more appropriate.
I hope this helps you.
-fpn7
Maybe you are looking for
-
Touch screen doesn't work after Vista Home64-bit upgrade to Windows 7 64-bit Home Premium on IQ506
Hello, right before I upgraded to Win7, I made sure that the Touchsmart software worked and that the touch screen itself worked. As soon as I performed the upgrade (not the clean upgrade that wipes all your existing data, but rather the upgrade that
-
Add exif-data while / after saving for web?
I use "save for web" quite often. However; i would like to add some exif-data to the picture after it is saved. Is there any way to do this with JavaScripting in Photoshop (CS3) ?
-
WAY TO IMPORT DATA FROM 11G DATABASE TO 10G DATABASE?
Hi All, I have a requirement to take an full export dump of an Oracle database and import it fully to a 10g database. I have never touched 11G until now and would like to know whether the 11G expdp will be downward compatible so that I can use the du
-
Updating Content in Flash? Possible?
I'd like to know if the following is possible: Let's say I develop a game and post it on several different sites. In the game, there is an ad for widgets. I find another sponsor after the orignal sponsor's agreement runs out. I would like to update t
-
How to export from Content DB?
Hi all, We are planning to do content migration from CDB to UCM, so need to export content with content ID from CDB, do you know how to do that? Thanks, Carrie