Import Manager Performance Issue

A data load that once took 10 minutes to run is now taking more than 2 hours! What could have happened? This change in run time has occurred in the last week after we've been loading data constantly over the past year! The results are the same whether running the import on a workstation or directly on the server. I've tried the following without changing the results:
1. Rebooted Server (MDM and SQL server on the same machine)
2. Updated Indices
3. Archived repository, deleted repository, rebooted server and unarchived repository. I was hoping that reloading the database would correct an indexing problem.
Here is the system's statistics:
- MDM 5.5 SP3 5.5.28.88
- Repository Size: 8GB
- Contains about 180k products with JPG images
I have opened a Marketplace message on this issue - #337011.
Any suggestions beyond what I've already tried would be appreciated.
Much Thanks!
Travis

Arun,
We are using "Update (All Mapped fields)"
This scenario had 96 mapped fields and 24 rows of data being loaded.
thanks!
Travis

Similar Messages

Import Manager Delimiter Issue "|

Hi,
We are facing a issue in during Import...We are loading Pipe Delimited file. Whenever we get "after |(Pipe) MDM is throwing an exception stating that 'Number of field values does not match the field columns'...Please let me know any body faced these kind of issues and solution. The format used here is UTF-8...
Example : |TEST123"EEE|TEST|A| - Here " comes after the Pipe and MDM Import Manager Accepting
|"TEST123 EEE|TEST|A| - MDM Import Manager is throwing an error stating that 'Number of field values does not match the field columns' because " comes immediately after pipe....
Thanks
Ganesh Kotti

Ganesh, please see [Note 1346052 - Connecting to source Import Manager error message|https://websmp230.sap-ag.de/sap(bD1lbiZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=1346052].
The " has special meanings in import manager and can only be used in pairs. If the first character of a field is a ", then there has to be another one in the same field. Or you can remove it alltogether.

Order Management Performance Issue

In the Oracle Applications home page, when I login as OM Super User and for order to cash functionality, when I click on Order, Returns > Quick Sales Orders screen, it takes forever to load. When I reboot my client desktop PC machine, it loads quickly.
Any ideas how to solve this performance issue for Order Management Quick Sales?
We are running Oracle 12.1.1 EBS on Linux 64 bit OS platform.

Hi,
Please see if these documents are applicable.
Note: 845765.1 - R12: Performance Navigating To Line Item Tab: OE_AK_SOLD_TO_ORGS_V [ID 845765.1]
Note: 399998.1 - OEXOEORD: Performance Entering Item On A Sales Order Line
Regards,
Hussein

Office 365 Outlook 2013 and Business Contact Manager Performance issues

I have some slowness with Outlook 365 at times. Most of the times, Outlook will have to restart. I use Business Contact
Manager so I cannot turn off Exchange Cache. Are there some steps I can follow to troubleshoot? The problems started 7 days ago and seem to be getting worse.

Hi,
The Outlook slowness problem can be caused by many factors, one common cause is some 3rd-party add-ins. We can troubleshoot in Outlook Safe Mode first:
Press Win + R and type “outlook.exe /safe” in the blank box, then press Enter.
If there’s no problem in Safe Mode, disable the suspicious add-ins to verify which add-ins caused this issue.
We can also check the OST file size since large .ost files can also slow the performance of Outlook.
Make sure that offline OST file in Outlook isn't too large. A large OST file may indicate corruption or fragmentation of the file. This can affect performance.
In Outlook, right-click the mailbox in the navigation pane, and then click
Properties.
Click Folder Size, and then note the Total size value on the
Local Data tab.
Open the Outlook system folder by opening the following folder path, depending on the operating system:
Windows 7 or Windows Vista: %userprofile%\AppData\Local\Microsoft\Outlook
Windows XP: %userprofile%\Local Settings\Application Data\Microsoft\Outlook
Note the size of the OST file for the user’s Outlook profile. If the OST file is more than 3 to 4 gigabytes (GB) larger than the
Total size value, the file may be corrupted or fragmented. Close Outlook, rename the OST file, and then reopen Outlook to re-create the OST file.
Some other troubleshoot steps can be found in this Microsoft Knowledge Base:
http://support.microsoft.com/kb/2441551/en-us
Regards,
Melon Chen
TechNet Community Support

Captivate 3 File Management Performance Issue

We transitioned to Captivate 3 last year. However, we still
maintain a catalog of Captivate 2 courses that have not been
imported into Captivate 3. As a result, we need both tools
installed on our systems.
We discovered that after installing Captivate 3, we weren't
able to move any Captivate files between folders on the network
without waiting at least 40 seconds for Captivate 3 to render a
thumbnail of the opening slide. (If we tried to move the file too
soon, we would get an error indicating that the file was in use by
another user or application.)
Anyway, I recently changed laptops and the new one already
had Captivate 3 on it. So, we added Captivate 2, which superceded
the Windows default application for .cp files. Suddenly, I can move
files quite easily on the network with no waiting.
Question: Is there an easier way to turn off the previewing
feature for people who only run Captivate 3?
Because there's no value in seeing a thumbnail of a Captivate
File.
We're a globally distributed organization and we can't afford
to wait for Captivate to chow on every file for >40 seconds
before we can move it.

I don't know of a way to turn off the preview feature but you
can change
the association easily. Whether you want to or not depends on
how
critical it is that CP3 starts when any .cp file is
double-clicked...
If you change the association of a .cp file to CP2, it seems
your
experience would indicate the preview is not done...but also
means if
users double-click a .cp file, it will try to open in CP2,
regardless of
the version of CP the file was made with.
To change associations, open Windows Explorer > Select the
'Tools'
drop-down menu > Select 'Folder Options' > Choose the
'File Types' tab >
Find the extension you want to modify > Click 'Change' and
browse to the
.exe you want to open that extension (CP2 in this case).
HTH
Erik
Mr_Bigglesworth wrote:
> So, we added Captivate 2, which superceded the Windows
default application
> for .cp files. Suddenly, I can move files quite easily
on the network with no
> waiting.
Erik Lord
http://www.capemedia.net
Adobe Community Expert - eLearning
http://www.adobe.com/communities/experts/
http://www.awaretips.net -
Authorware Tips!

Performance issue within SAP Solution Manager

We use SAP Solution Manager 4.0, SPS 13 for System Monitoring of almost 100 systems.
We configured SOLMAN as CEN system and activated the CCMSPING with push option.
For almost the 2/3 of the systems we configured SAPCCM4X agents.
Our current problem is a performance issue in tcode DSWP. When we try to enter into one of the solutions there (by pressing on it) we get the following warning:
Determining warning messages from CCMS
It tooks a while and then it is possible to access the desired solution.
My important question is of course:
How can this issue be solved?
Is there some techniques to analyse and change the problem
How can I check whether the SOLMAN works in a pull or push mode, when the data from the satellite systems will be collected and how can this be changed?
As I know there are two ways of sending/retrieving the data:
via RFC (pull)
via CCMS (push)
Which method is faster?
Is there some changes in CCMSPING possible? (interval for sending/retrieving the data)?
Is there some other settings, e.g. like profle parameters (e.g. rdisp/...) that could be performed to solve the problem?
Thank you very much for any helpful information
Regards
Thom

Push is beter for performance. SAP advice.
Maybe activating Central Data Cache on the CEN and SolMan with parameter alert/cache/size_MB can help.
more info here: http://help.sap.com/saphelp_nw70/helpdata/EN/10/75ea3b6d73e807e10000000a11402f/frameset.htm

Performance issue with FDM when importing data

In the FDM Web console, a performance issue has been detected when importing data (.txt)
In less than 10 seconds the ".txt" and the ".log" files are created the INBOX folder (the ".txt" file) and in the OUTBOX\Logs (the ".log" file).
At that moment, system shows the message "Processing, please wait” during 10 minutes. Eventually the information is displayed, however if we want to see the second page, we have to wait more than 20 seconds.
It seems a performance issue when system tries to show the imported data in the web page.
It has been also noted that when a user tries to import a txt file directly clicking on the tab "Select File From Inbox", the user has to also wait other 10 minutes before the information is displayed on the web page.
Thx in advance!
Cheers
Matteo

Hi Matteo
How much data is being imported / displayed when users are interacting with the system.
There is a report that may help you to analyse this but unfortunately I cannot remember what it is called and don't have access to a system to check. I do remember that it breaks down the import process into stages showing how long it takes to process each mapping step and the overall time.
I suspect that what you are seeing is normal behaviour but that isn't to say that performance improvements are not possible.
The copying of files is the first part of the import process before FDM then starts the import so that will be quick. The processing is then the time taken to import the records, process the mapping and write to the tables. If users are clicking 'Select file from Inbox' then they are re-importing so it will take just as long as it would for you to import it, they are not just asking to retrieve previously imported data.
Hope this helps
Stuart

Performance Issues in weblogic managed server

Hi,
We are facing performance issues in our managed servers in weblogic domain and in logs it is showing this error continuously.
<Oct 2, 2013 10:39:27 AM MST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '47' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "700" seconds working on the request "Workmanager: OIMMDBWorkManager, Version: 0, Scheduled=false, Started=true, Started time: 700360 ms
", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-294 "[STUCK] ExecuteThread: '47' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, blocked, priority=1, DAEMON> {
    -- Blocked trying to get lock: java.io.PrintStream@41a53700[not locked]
    java.io.PrintStream.println(PrintStream.java:755)
    com.wyndham.operations.user.eventHandlers.PostCreateOperationsEventHandler.execute(PostCreateOperationsEventHandler.java:60)
    oracle.iam.platform.kernel.impl.OrchProcessData.runPostProcessEvents(OrchProcessData.java:1225)
    oracle.iam.platform.kernel.impl.OrchProcessData.runEvents(OrchProcessData.java:665)
    oracle.iam.platform.kernel.impl.OrchProcessData.executeEvents(OrchProcessData.java:268)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:810)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:971)
    oracle.iam.platform.kernel.impl.OrchProcessData.runEvents(OrchProcessData.java:665)
    oracle.iam.platform.kernel.impl.OrchProcessData.executeEvents(OrchProcessData.java:268)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:810)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:880)
    oracle.iam.platform.kernel.impl.OrchProcessData.handleAdditionalChanges(OrchProcessData.java:552)
    oracle.iam.platform.kernel.impl.OrchProcessData.runEvents(OrchProcessData.java:665)
    oracle.iam.platform.kernel.impl.OrchProcessData.executeEvents(OrchProcessData.java:268)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:815)
    oracle.iam.platform.kernel.impl.OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:843)
    oracle.iam.platform.kernel.impl.OrhestrationAsyncTask.execute(OrhestrationAsyncTask.java:97)
    oracle.iam.platform.async.impl.TaskExecutor.executeUnmanagedTask(TaskExecutor.java:99)
    oracle.iam.platform.async.impl.TaskExecutor.execute(TaskExecutor.java:52)
    oracle.iam.platform.async.messaging.MessageReceiver.onMessage(MessageReceiver.java:60)
    sun.reflect.GeneratedMethodAccessor1493.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:575)
    com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
    com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
    com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:86)
    com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
    com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
    com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:102)
    com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
    com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:151)
    $Proxy460.onMessage(Unknown Source)
    weblogic.ejb.container.internal.MDListener.execute(MDListener.java:518)
    weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:467)
    weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:327)
    weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4638)
    weblogic.jms.client.JMSSession.execute(JMSSession.java:4134)
    weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:3820)
    weblogic.jms.client.JMSSession.access$000(JMSSession.java:115)
We have performed workload manager tuning in weblogic console as below.
The property ‘Maximum Threads Constraint’ of work managers OIMMDBWorkManager = 80 and OIMUIWorkManager = 20
Please suggest the solution.

Hi,
If you look more closely at the STUCK Thread stack trace, you will notice that the thread is attempting to acquire a LOCK on the following Object monitor: java.io.PrintStream@41a53700. The native thread state is also in a BLOCKED state.
My primary recommendation is to generate a full JVM Thread Dump (next re-occurence) so we can identify the potential culprit Thread holding such lock. One more thing, please see if you have multiple snapshots of this thread 294?
I also recommend to review the following source code:
com.wyndham.operations.user.eventHandlers.PostCreateOperationsEventHandler.execute(PostCreateOperationsEventHandler.java:60)
Sharing the same Stream object in this case would trigger thread lock contention given java.io.PrintStream has built-in synchronization ex:
   public void println(String x) {
synchronized (this) {
     print(x);
     newLine();
Regards,
P-H
http://javaeesupportpatterns.blogspot.com

ABAP Memory (EXPORT/IMPORT) - Performance Issue

Performance wise, is it a good idea to use ABAP memory to export and import data between programs?
Thanks in advance,
JT

IMHO is you EXPORT/IMPORT a couple of variable...Your not going get any performance issues....So go ahead -:)
Greetings,
Blag.

Performance Issue on "Planning Manager" program

Hi,
In order management --- the "Planning Manager" request is taking lot of time to run when we create 100,000 lines of sales orders at a time( I mean,this causes the planning manager to run slower). Can you please help me out how can i increase the planning manager request to run fast(performance)?.
Thanks In Advance,
Balu

Duplicate post:
Performance issue on AFPO
Performance issue on AFPO

Import Manager Issue

Hi,
I have a bunch of records which have similarities in the description field of the source file and I need to consolidate all such records and add a separate ID to all such records in a different field. Example data is like this.
1 Rajani Kumar
2 Roman Rytov
3 Rytov Roman
4 Rytov R
5 Kumar Rajani
Here,1&5 represent the same Record for Rajani Kumar
and 2,3 & 4 represent same record for Roman Rytov.
So, I need to give an Id into a different destination field - A for Rajani Kumar(that is for 1&5 records)and B for Roman Rytov (that is for 2,3 &4 records).
Any solutions for this scenario while importing the records using Import Manager? Which is the best method ??
Regards,
RK

The process your are describing is a de-duplication process. For this exercise you need first to define a matching strategy and then implement this in MDM 5.5. This concepts has been demonstrated in a similar scenario identifying duplicate customers. Since this is rather extensive example I will only describe the highlights of what was done.
Based on the customer definition, a set of matching strategies was defined, each representing a specific matching scenario (e.g. one such strategy is: a matching consisting of : VAT number + Street + Name + Postal Code fields is assigned a Match Rage of 100, Match Group = Vat Number and Match Type = Matched.) Each element was initially assumed a weight (e.g. Vat Number = 34 ,street = 14 etc..) and the criteria was set to match results > 60 to be Match, result between 30 and 60 to Dubious and result <30 as Not matched.
For each of the above strategies a specific map was constructed based on the corresponding matching criteria per each strategy. Once these maps configured, the records for the de-duplication process are imported with this import only updating pre-defined fields for each of suspect matched records recording the Match Rate, Match Group and Match Type.
Once completed (all imports run ) you can see the MDM client all the matched records and group/sort them by Match type and grouping finally if you wish , merging the duplicate records while maintain their remote key information.
Kevin

Performance Issue in Document Management of SAP Solution Manager

Hi
We have 10k+ documents in our current project and searching any specific document takes time of around 1-2 min. Searching document via SOLAR_EVAL or Menu-->Find Document of Solarxx is giving same output in terms of response time, later being slightly better. Other projects which have comparatively less documents, etc are fine in search response times and other functionalities implemented in system like issue mgmt, etc are also ok in terms of performance.
Can anyone please advice how this performance issue of searching specific document can be resolved?
What first thing which hits me is cleaning SolMan KW and either archiving/deleting old versions of document (because snapshots of every change in single document is stored in solman). If this can really help in making performance better for searching documents, please advice in detail as how this can be done or share any document.
If anyother way this can be achieved, please let me know that also.
Points will be awarded.
Thanks in advance.
Regards,
SM

Hi
1) Is deleting older documents is definitely going to improve response time of searching. You said 'yes' but just wanted to double sure.
Yes
2) This program deletes all unsed and de-linked document. I can understand 'De-linked' but not 'Unused'
i meant the samething
3) Deleting documents based on user id is big problem. We have almost 800 Users in SolMan, who has used this project form last 5+ years. So all these 800 users have to go into multiple selection of user id
Try giving *
4) I tried this on our sandbox (SP19 Level) which has shown all unused documents which can be deleted. But this deletion has to be done one-by-one. In our production, if we have 10K+ documents, i assume almost thousand or more will be residing as de-linked in KW
Try giving *
5) Any Documentation available on this program.
Learnt by experience but you can check some sapnotes below
Note 1124579 - Using SOLMAN_UNUSED_DOCUMENTS to delete unused documents
Note 1377997 - SOLMAN_UNUSED_DOCUMENTS: No deletion conf. for each doc.
Hope above clarifies
Regards
Prakhar

Service Manager 2012 SP1 consoles hanging or slow performance issue in Virtual Environment

Hii,
We are facing SCSM SP1 console performance issue which is utilizing high CPU and working deadly.
For information, our SCSM is in Virtual environment via Hyper-V.
When running the console over an RDP session to a Hyper-V virtual machine, we have to be careful not to maximize the console so that it will remain fast. If we maximize on the VM, the console is so slow as for it to be unusable.
Can someone share his experience, please?
Regards, Syed Fahad Ali

Hi Sayed,
This is a bug and hopefully Microsoft team will solve it soon. if you can to vote for this bug here
https://connect.microsoft.com/WindowsServer/feedback/details/810667/scsm-console-consumes-a-lot-of-cpu-when-opened-maximized-on-work-item-view-like-all-incidents
Mohamed Fawzi | http://fawzi.wordpress.com

Import Manager Out of Memory error

I am running MDM 5.5.24.06 server on Windows XP Professional. The server has 4.0 GB RAM with 1.5 GB Virtual memory.
I am trying to load 129 material master records from R/3 4.6 ( XML file size 8 MB), into MDM using Import Manager.
When I click on import icon (Import Status tab selected), MDM Import Manager rightway returns 'Out of Memory' error.
Tried to import the file again after rebooting the machine, restarting MDM Server, but still it returned the same error.
Has anybody tried loading the R/3 material data into MDM? What's the experience? What was the load (# of records)?
What was MDM IM performance? What's your hardware/software config?
Appreciate your help.
Thanks,
Abhay

Hi Abhay,
My workstation has Windows 2000, Pentium 4 CPU 3.2 Ghz, 515,555 KB RAM. The recommended specifications can be found on service market place of SAP, and we used those to procure our workstations.
MDM server must be more pwerful than a workstation. Try running the import manager from the server machine itself. If it works there but not on your machine, it is memory of your workstation.
Sometimes, I think this error comes when import map some issues- fields not mapped accurately or remote key mapped wrong etc.
It is probably judicious to rpove the system memory as first step.
Good luck!

SQLs erver migration performance issue

We are performing migration from oracle to MSSQL server 2005 (Windows 2003/SAP 4.6D).Our target system configuration is like below:
->OS - Windows 2003 x64
->DB - MSSQL server 2005 SP4
->SAP - 4.6 D kernel
->CPU - 4 processors (2.67ghz each)
->RAM - 16 GB
->source system DB size - around 1 TB and package splitting was implemented.
While importing the export dump that came from source system, we are facing load performance issue's.
1) We have started 10 parallel processes and after import is started, CPU is getting 95% to 99% utilized and when we check SQL server studio-> Activity monitor we found below information:
-There were around 20 processes are in status sleeping
-Only one or two system processes are running with commands - INSERT,SELECT INTO commands ( column)
-At any point of time only two processes are running and CPU utilization is hitting high.
-Import is very slow and its taking 35 hours to complete
We have followed few SAP notes(1054852,1241751 e.tc..) and below are the settings for SQL server:
-Minimum server memory - 5 GB
- Maximum server memory - 5 GB
- index creation memory - 0
- Maximum memory per query - 1024 kb
- Maximum degree of parellelism - 1
- Parallellism locks - 0
- Cost threshold of parellism - 5
- Enabled trace flags - 610,620,1117,1211,3917
- Windows environment variable BCP_BATCH_SIZE = 10000
- SQL log file size - 100 GB
- tempdb size - 20 GB
2) When we tried another test import after tuning parameters (Maximum degree of parellelism to 3) and increasing r3load parallel processes to 20, we found of inserts
are overflowing in process list and blocking other waiting processes and putting them in suspended mode.CPU utilization is at 80%
Are there any SQL server parameters need to be tuned to fix this import load time issue in both scenarios? Are there any best practises for migrating to SQL server?
Thanks..

> 1) We have started 10 parallel processes and after import is started, CPU is getting 95% to 99% utilized and when we check SQL server studio-> Activity monitor we found below information:
What processes is using the CPU? The SQL Server itself or others? (see task manager)
> -Minimum server memory - 5 GB
> - Maximum server memory - 5 GB
For the time of the migration itself I'd give the database more memory (10 GB or more) and reconfigure later when the import is done.
What parameters do you use for the R3load? I'd recommend
-loadprocedure fast -merge_bck -c 10000
and also set
BCP_LOB=1 in the environment.
Markus

Import Manager Performance Issue

Similar Messages

Maybe you are looking for