Siebel batches

What is the best way to automate batch upload?
That is i have external data coming in from external systems in terms of millions of records.
I need to process this data and store it in the siebel tables. I am using eim for this, also i am splitting it into threads which is right now doing ok.
But the number of batches are increasing and so is the data. Any kind of best practice document in this regard? Or any tool that is already developed that can help to configure this easily?
I searched and found one called Control M , but it is not exactly what i am looking for. As i will need to automate plsql programs(which manipulate the data before inserting into siebel) also.
Thanks in advance!
dias

Hi Wilson
I guess it could be, i am trying to learn more about it. The Golden gate solution goes beyond what we require and is quite comprehensive, it also would mean a major overhaul of how the system works here. The transformations that GG offers will have to be studied in detail, as converting exisitng business functionalites to the transformational logic would be cumbersome.
I will suggest it, but i dont think this would be an immediate solution.
Thank you
Dias

Similar Messages

Batch Address Verification and Standardization using AV

Hi,
We would like to use EDQ AV for batch address verification and standardization. Can you please let us know the high level steps for this since i could only see the job for real time address verification and standardization.
Can we use the address clean process used for real time address verification and standardization for batch as well. Do we have to use staged tables like how batch entity/contact deduplication uses or do we directly connect to the address table in siebel schema using a data source and do batch address verification and standardization by using the address clean process given for real time address verification and standardization in a new job.
Thanks,
Sukhesh

Hi,
When EDQ is attached to Siebel, batch address verification and cleansing tasks are instigated via Siebel's DQ Manager. You can set up a job template using the instructions in Section 5 of this document:
http://www.oracle.com/technetwork/middleware/oedq/documentation/cdssiebel-1688412.pdf
In the case of Siebel, 'batch' jobs in fact simply call the web service with however many records you scope into the batch run.
For other purposes - i.e. when you want to run the EDQ-CDS Address Clean process on other sources of data, you simply need to bind in the source and target from/to the AddressClean data interface in EDQ and set up a job with these mappings. You can run this at the same time as running real-time address cleaning, provided you use a different Run Label.
Regards,
Mike

Siebel EDQ batch job performance

Hi there,
We are using Siebel Public Sector 8.2.2.4 with EDQ 11.1.1.7 version to clean up existing contact records and also set up real-time deduplication for ongoing contacts. We didn't tune any parameters both from Siebel and EDQ side till now.
We observed that the process is taking 45-50 minutes to process 6000 records. We noticed that the process is taking more time while inserting the records from Siebel to staging database. The EDQ contact deduplication is just fine and it it taking around 8-14 minutes based on number of records to process.
Is there a way we can tune anything from Siebel side to improve the performance while loading the data into staging database. May be Batch max number of records or number of DB connections or sessions etc to improve the performance?
Also, can you suggest if we could run the jobs from Siebel ( by splitting into multiple batches) in parallel? I am not sure if this is an option as the parallel tasks uses the same sharing database and it might have an conflict.
Please suggest.
Regards
Siva Sonti

Hi,
So to understand correctly, these are true batch jobs with the data being handed over using the staging tables.
It seems like the problem here - which we have seen before - is the performance of the candidate selection query in Siebel for incremental batch jobs - the piece where the candidate records for the selected batch of records to match are selected. How long does a Full Batch job take to run (as this does not need to make this query)?
Also, is this Siebel CRM or UCM? If UCM, you can use the 'UCM Batch' workflow which although it calls EDQ in real-time can be scaled using as many tasks in Siebel as the system can handle; customers have been able to load up to 9000 records/minute with this method.
The nature of the shared staging database means it only supports a single job for data from a single business component (e.g. Contact) at any one time, as you suspected.
If you are really 'loading records' into Siebel, you may be better of loading them using the EIM interface - perhaps with EDQ pre-matching the data and directly writing to the EIM tables.
Regards,
Mike

Error while importing N Accounts to 1 Address with UCM Batch Manager

Hi,
I got a problem with importing Accounts using the UCM Batch Manager. Previous steps were loading the EIM Tables EIM_UCM_ORG and EIM_UCM_ADRPER. To associate addresses I used the column EIM_UCM_ADRPER.PAR_UCM_ACCNT_UID. No errors occured during an Enterprise Integration Mgr jobs to load the data into SDH tables.
The error described below occurs if I have N Accounts using one Address. Example:
h5. Account Name --> City --> Postal Code --> State --> Street
Account #1 --- Munich --- 80331 --- N/A --- Some Street 1
Account #2 --- Munich --- 80331 --- N/A --- Some Street 1
h5. If I try to get the Accounts into the Base tables using the UCM Batch Manager I get the following message from the log file:
ObjMgrBusCompLog     Error     1     000003084c571160:0     2010-08-03 19:11:14     (odbccon.cpp (2097)) SBL-DBC-00111: An error has occurred writing to a record.
Please continue or ask your systems administrator to check your application configuration if the problem persists.
DBCLog     DBCLogError     1     000003084c571160:0     2010-08-03 19:11:14     SQLError: [23000],[Microsoft][SQL Native Client][SQL Server]Cannot insert duplicate key row in object 'dbo.S_ADDR_PER'-Objekt with unique index 'S_ADDR_PER_U1'.
DBCLog     DBCLogError     1     000003084c571160:0     2010-08-03 19:11:14     SQLError: [01000],[Microsoft][SQL Native Client][SQL Server]The statement has been terminated.
ObjMgrBusCompLog     Error     1     000003084c571160:0     2010-08-03 19:11:14     (sqlobj.cpp (43735)) SBL-DAT-00381: A record that contains identical values to the record you have created already exists.
If you would like to enter a new record, please ensure that the field values are unique.
ObjMgrLog     Error     1     000003084c571160:0     2010-08-03 19:11:14     (adptutils.cpp (5715)) SBL-EAI-04381: For instance of Integration Component 'Account_Business Address', using user key '[City] = "Munich" AND [Postal Code] = "80331" AND [State] = "N/A" AND [Street Address] = "Some Street 1"', a record with identical values already exists in the Siebel database.
Please ensure that the field values in the input message are unique.
EAISiebAdpt     EAISiebAdptErr     1     000003084c571160:0     2010-08-03 19:11:15     [0] For instance of Integration Component 'Account_Business Address', using user key '[City] = "Munich" AND [Postal Code] = "80331" AND [State] = "N/A" AND [Street Address] = "Some Street 1"', a record with identical values already exists in the Siebel database.
Please ensure that the field values in the input message are unique.(SBL-EAI-04381) (0x75017d)
h5. Result:
Account #1 gets inserted with Record Type: "Source-Insert"
Account #2 will not be imported and gets Record Type: "Incomplete"
Does anyone know how to handle this problem?
Many Thanks
Sebastian
Edited by: user13098670 on 04.08.2010 06:34

I have selected the option
Add new metadata and replace existing objetcs. But it is not importing. Also I tried other options like
1. deleting the existing mapping and tried.
2. Putting the mapping in recycle bin and try.
3. Take it from recycle bin.Even during taking it from recycle it is giving me the following error .
Error occurred importing mapping
<DWH_CMMDTY_INVC_FACT_MAP/DWH_CMMDTY_INVC_FACT_MAP>
(at line 141).
Detailed Error Message:
API2014: Internal Error: Error in createStage:
In above all cases it is giving me the error.
Could you please help?

Export file Attachments in Siebel

hi ,
we have a requirement to export siebel attachment from Siebel eclinical application. The entity relation is between activity and attachments.
When i am trying to export the files attachments using the following IFB code
[Siebel Interface Manager]
     USER NAME = "sadmin"
     PASSWORD = "****"
     PROCESS = "EXPORTATTACHMENTS"
[EXPORTATTACHMENTS]
     TYPE = EXPORT
     TABLE = EIM_ACT_DTL
     BATCH = 2
     ATTACHMENT DIRECTORY = "f:\sia81\CTMS\siebsrvr\OUTPUT"
     EXPORT ALL ROWS = FALSE
     EXPORT MATCHES     = S_ACTIVITY_ATT,( FILE_NAME LIKE "MarcRendell-PS%")
When runnign this ifb following is the observation
1) the process is extracting all the reocrds activity table to EIM tables and seems like EXPORT MATCHES condition is kinda ignored as there were less numbers of recprds which were expedted.
2) the files are not getting exported to the location ( also tried with SiebFS)
Could you please help me with your inputs which will help me to solve this issue.
Warm Regards
Ashutosh

hi
when i used this IFB without quotes still i could not manange to get the files in the OUTPUT folder.
[Siebel Interface Manager]
     USER NAME = "sadmin"
     PASSWORD = "sadmin"
     PROCESS = "EXPORTATTACHMENTS"
[EXPORTATTACHMENTS]
     TYPE = EXPORT
     ATTACHMENT DIRECTORY = G:\sia81\CTMSTG\siebsrvr\OUTPUT
     BATCH = 2
     TABLE = EIM_ACT_DTL
     EXPORT MATCHES     = S_EVT_ACT,(ACTIVITY_UID LIKE "1-36RUP%")
     ONLY BASE TABLES = S_EVT_ACT,S_EVT_ACT_X,S_ACTIVITY_ATT
I could see the following error in the log file.
rem Unzip G:\sia81\CTMSTG\siebsrvr\OUTPUT\XXXXX_104 - Dr XXX - XXX FUL -
EIMSQL     EIMSQLSubEvent     4     00000fee4f2f03c0:0     2012-02-08 05:39:11     rem 13 Oct 2009.pdf failed.
please suggest probable cause.
Thanks
Ashutosh

UNICODE conversion of Siebel Database- Impact on interface

Hi All,
This is regarding the impacts on Interfaces after Siebel database UNICODE conversion.
We are planning to do a UNICODE conversion of the Siebel database.In the current landscape we have Siebel interacting with multiple application which are non UNICODE.
Majority of the interfaces(outbound/inbound) are batch interfaces which either use file or PL/SQL + EIM for the data transfer.
We have the following queries about the impact on the Interfaces post conversion
1) the Interfaces which are outbound from siebel to non -unicode database what will be impact on these interface.
2) For the above mentioned interfaces do we need to do some conversion of data before it gets loaded to non unicode database.
3) for the inbound interfaces will the siebel unicode data base will allow the data which is flowing from non unicode database.
Could you please guide me with your experiences which will help us in planning this conversion.
Do let us know if there must to consider points for Siebel database unicode conversions
Thanks,
Ashutosh

Ashutosh,
Did you already start on the Unicode conversion?
We contacted Oracle, but so far they only said we need to go through a workshop where we can estimate the impact on the interfaces.
Since we need to do a cost/benefit analyses before we decide to do this, it's hard to do so when you don't know the impact on the interfaces.
In our case we use EIM, Web Services, MSMQ (XML) and flat files.
Anyone with experience with a conversion to Unicode and impact on interfaces?
Ji Yong

Siebdev.exe - Can I run this in batch mode?

Just so you are aware, I know nothing about siebel. However, in conjuction with a siebel developer who should know; we are trying to invoke siebdev.exe from a CIB server (jenkins specifically).
However, running the /batchimport option appears to launch a gui; which I'm fairly sure is causing the app to fail via the jenkins batch job on a windows server (we get an event log application fial)
Can anyone tell me iif it is posisble to run siebdev.exe silently? or at least so it doesnt fire up the gui?
Appreciate any help that you can offer.
Many thanks
dD

so, further to this
I setup a windows schedule job, and that appears to run the job fine.
However, this runs as my admin account rather than as the service (which doesnt have admin access rights to the machine).....
Do I need admin rights to run this?
dD

Batch Delete Notes

By mistake, a Notes file from act was imported twice into Siebel, creating duplicate entries of every note in the file. Is there a way to batch delete notes from Siebel?
Edited by: Dani Duran on Apr 20, 2009 8:04 AM

Hi, This is my understanding. Batch delete seems to be available along with the list feature. As such there are no ways to prepare list out of notes, So there seems to be no option to me to delete it by batch delete. The other option could be to write a WS code. hope this helps
-- Venky CRMIT

Batch delete custom obeject records

Hi expert,
we accidently imported hundreds of records into custom object. I undertsand batch delete function does not apply to custom object. Is there any other alterntaive to batch delete these unwanted records? (besides manually delete one by one... :P)
Thanks, sab

hello Bob,
The customer care replied they don't know when this patch will apply to our environment, is there anyway we can push this to be avialble asap?
The oracle customer care's reply is as follows:
1. Web Services Support for Custom Object 3 will be available in the new Patch 931.0.03 Unfortunately we don't have any information regarding the date of deployment for this patch for your environment. 2. An Enhancement Request,3-600732901, has been logged with the Siebel Support Engineers regarding this issue. Please be assured that development and engineering will analyze this request and will take the appropriate action towards implementation if it meets their approval. We appreciate all customer feedback and will work hard to implement as much as we can into our product. However, we are currently unable to provide you an estimated time of implementation while your request is being analyzed and processed. Please review the Training and Support portal for future Release Notes indicating the most current product updates or contact Professional Services for a custom solution.
Thanks, Sab.

ATG - Siebel Catalog

Hello Everyone,
I have a older version of Siebel which doesnot support the SCOA model. 'Product Data Integration for Siebel Innovation Pack 2012 guide ' - not so useful in my case. But I presume the data model is similar to newer versions.
Well, I am planning to marry ATG and Siebel Catalog, a batch export/import from Siebel(after a change trigger). Are there any exisiting webservice methods available in Siebel to export catalog. Siebel catalog is very complex, so wondering if its feasible approach.
Please let me know what are the options available to implement this process.
Any insights are very much appreciated.
Thanks

Generally, the catalog will be created in Sibel and flows to ATG, i.e. Siebel will be the master of Catalog Data. Oracle provided a ATG-Siebel reference integration module that helps integrating ATG and Siebel easily. You can find the details from the below link. Note that you need a valid Oracle support id to access this.
https://support.oracle.com/CSP/ui/flash.html#tab=KBHome(page=KBHome&id=()),(page=KBNavigator&id=(bmDocType=WHITE%20PAPER&bmDocDsrc=KB&bmDocID=1358285.1&viewingMode=1143&bmDocTitle=ATG%20Web%20Commerce%20and%20Siebel%20Reference%20Integration&from=BOOKMARK))
>>What is data that flows from ATG into Siebel????
User Profile and Order Details
>>Whats is the data that flows from Siebel to ATG???
Catalog Details
>>What is the data setup that needs to be done separately in each system.???
This really depends on your enterprise architecture and design.
Some other links that will be useful --> http://www.oracle.com/us/products/applications/atg/atg-siebel-integration-1917689.pdf
http://docs.oracle.com/cd/E14004_01/books/OrdMgt/OrdMgtATGIntegration2.html
Cheers
R

Fulfillment Batch Printing on OpenUI

Hi all,
We're POC'ing OpenUI in 8.1.1.9 for our client. They rely heavily on the Fulfillment module and client side batch printing.
Client side printing in Siebel uses the printcorrespondence.js function that, rather unhelpfully, contains this line of code:
Wrd = new ActiveXObject("Word.Application");
Obviously, ActiveXObject is not supported in any browser other than IE, so Firefox, Chrome or whatever are never going to work with this code.
I'm just wondering if anyone else has encountered this and come up with a solution? There seem to be no alternative ways of communicating with Office / Word, client side, from standard browsers so this is possibly something Oracle are going to have to right off. I'd thought about the new Office JavaScript API's as a possible way around this but I don't think that's quite what the API is all about.
Any thoughts greatly appreciated.
Regards,
Oli

well, since people tend rather to upgrade their SAP system than downgrading them i dont really see the problem.
Like i understand you, you had a problem in 4.7 System which is now gone in 6.0. Somehow i fail to see the "Problem" maybe you can help me out here.

Siebel Communication Outbound Manager Crashes

Hi,
The Siebel Outbound manager in 8.0 Crashes quite often, when there are multiple requests posted at the same time...triggered via WF batch manager...Do any one have experienced this?
Can anyone suggest a workaround if available?

Hi Axel,
Find below the Error Log... Let me know if you need anything more
2021 2007-10-09 15:07:00 2007-10-09 15:07:06 +0200 00000006 001 003f 0001 09 CommOutboundMgr 54526011 7436 9920 C:\sba80\siebsrvr\log\CommOutboundMgr_0052_54526011.log 8.0.0.1 SIA [20408] ENU
CommSrvr     CommSrvrError     1     0000003b470b20b0:0     2007-10-09 15:07:00     @cInst = 0 so we are able to execute the buscomp.
CommSrvr     CommSrvrError     1     0000003b470b20b0:0     2007-10-09 15:07:00     @cInst = 0 so we successfully execute the buscomp.
CommSrvr     CommSrvrError     1     0000003b470b20b0:0     2007-10-09 15:07:00     @cRecip = 0 so we are able to execute the buscomp.
CommSrvr     CommSrvrError     1     0000003b470b20b0:0     2007-10-09 15:07:00     @cRecip = 0 successfully execute the buscomp.
Exception 0xc0000005 at 0x0050e7b7
Thread: 0x000026c0, Process 0x00001d0c
- CONTEXT -
EIP: 0x00000000, EFL: 0x00010212, FS: 0x0000003b, GS: 0x00000000
CS: 0x0000001b, DS: 0x00000023, SS: 0x00000023, ES: 0x00000023
EAX: 0x00000000, EBX: 0x15113ba8, ECX: 0x00000000, EDX: 0x14e75cc4
ESI: 0x14e41398, EDI: 0x0000000a, EBP: 0x00000000, ESP: 0x032dfff4
- CALL STACK -
sslcshar +0xe7b7 = CCFMap<CCFElemStr,CCFElemStr>::operator[]() +0x1c7
sslcshar +0x216f5 = CCFPropertySet::SetProperty() +0x15
sslcsrms +0x3ef3 = SrmRequest::Serialize() +0x2b3
sslcsrcn +0x47d0 = SrmConn::SendRequest() +0x1d0
sslcsrcn +0x6097 = SrmConn::SubmitSynch() +0x77
sslcfsm +0x17f2 = FSMClientStub::submitFSMReq() +0xd2
sslcfsm +0x2675 = FSMClientStub::writeFile() +0x135
sslcfsm +0x250f = FSMClientStub::writeFile() +0x7f
SSCOMMSV +0x40b3f = CSSSvcCOMMEngine::SendMessageW() +0x4c8f
SSCOMMSV +0x2009d = CSSSvcCOMMEngine::SubmitRequest() +0x180d
SSCOMMSV +0x210c7 = CSSSvcCOMMEngine::DoSubmitRequest() +0x187
SSCOMMSV +0x23d64 = CSSSvcCOMMEngine::DoInvokeMethod() +0x164
sscfom +0x181ca = CSSService::InvokeMethod() +0x1ba
sssabsvm +0x29e2 = LessComparison::operator()() +0x1342
sssabsvm +0x413e = CreateSmiMThreadObj() +0xaae
siebmtshmw +0x19ac9 = GetSmiTaskAPI() +0x1059
siebmtshmw +0x1a163 = GetSmiTaskAPI() +0x16f3
siebmtshmw +0x1ac33 = GetSmiTaskAPI() +0x21c3
siebmtshmw +0x1bce4 = GetSmiTaskAPI() +0x3274
siebmtshmw +0x1c071 = GetSmiTaskAPI() +0x3601
siebmtshmw +0x156a5 = SmiBeginTrace() +0x30c5
siebmtshmw +0x16cb6 = GetSmiWorkQObj() +0x14e6
siebmtshmw +0xc286 = SmiCleanupDetTask() +0x3b26
sslcosd +0x2132 = OSDThreadPrivIsInit() +0x1d2
sslcosd +0x21bc = OSDThreadPrivIsInit() +0x25c
MSVCR71 +0x9565 = endthreadex() +0xa0
kernel32 +0x2608b = GetModuleFileNameA() +0xeb
- STACK DUMP -

Data Quality Manager component Crashing during Batch Key Generation?

Hi All,
I have setup batch key generation for "FINS Members" buscomp and when the job is executed the task crashes always. I have observed the crash is not consistent on a particular data.
Most of the times we get FDR file generated and sometimes we have another file "hs_err_pid xxx.log" in the siebel server BIN directory.
When batch is executing one specific record it seems to be running out of memory.
Below is the detail from the crash log:-
Virtual memory info:
Total : 2097024 KB
Available : 1122452 KB
Available extendent: 0 KB
Few Crash Scenario 's:-
Crash Scenarios:
73 Contacts - DqMgr CRASH while processing the record "1-908F9". After removing the record from the system, batch job completed with no crash. The contact record has two address associated with this and the name details are below:
Last Name - ER11 PASS 3 LN
First Name - ER11 PASS 3 FN
Middle Name - ER11 PASS 3 MN
Two Address Associated
689 contacts DqMgr CRASH while processing the record "1-6KRHD". After removing the record from the system, batch job completed with no crash. The contact record has one address associated with this and the name details are below:
Last Name - UAT TESTING
First Name - SCENARIO 6 CLIENT
Middle Name - DO NOT USE
One Address Associated
Any help?
Thanks.

Hi
Thanks for using My Oracle Support Community.
You mention - "After removing the record from the system, batch job completed with no crash"
I would recommend you to check the record and if there are any differences between this record and the others for which the process gets completed.
Also, please raise a Service Request with Oracle Tech Support with all the relevant logs so that we can analyse the issue in detail and suggest you further recommendations.
Thanks,
Shwet

Books of Business Batch Assign fail

When I attempt to Batch assign a list of records to a newly configured Book, the log reports all records have failed to assign - "Access Denied".
These are the step I have taken with no further success. I am logged on as Administrator.
1. Added myself as a User to each book and sub-book in Book Management.
2. Logged in and out of Siebel.
3. Under User-Edit-Historical Availability set to "Full Availability".
4. Checked Administrator Role has access to Book record type.
5. Checked Administrator Role has "Manage books" privilege.
6. Set Company Profile-Historical Availability to "Full".
Unfortunately, the Batch Assigns still give "Access Denied".

Ky_CancerSA, Add yourself to the very top book in your heirarchy and remove yourself from all the other books, this should give you the access to do what you need to do. Also check your access profile and make sure you still have the admin access problem. Perhaps you've got limited access in the access profile to books as a related item?
cheers
alex

Siebel 7.7 installables

Hi,
Has anyone recently installed Siebel 7.7 from the installables available from edelivery.oracle.com? We are doing a 7.7 install as an interim step of an upgrade from 6.3 to 8 however some necessary files appear to be missing from the edelivery downloads, hence the install cannot proceed.
Has anyone experienced this and can offer a viable workaround or can anyone suggest an alternative reliable download location for the 7.7 install software? The product is Siebel 7.7 eBusiness Applications Horizontal.
Many thanks,
Kevin Armstrong.

There has been an issue with the 8.0.0.3 batch on My Oracle Support (Metalink 3) this week.
Still is I think. It could that there are more problems. What is the issue?
You can't download one or more files from edelivery?
If so, try asking here:
Downloads Issues
You are getting an error when you try to create the install image?
If so, what error message are you getting?
Axel

Siebel batches

Similar Messages

Maybe you are looking for