Flat File Reconciliation Issue

Hi All,
I am trying to achieve the flat file reconcilation. For that, I created a GTC connector with following configuration
Staging Directory (Parent identity data):  /home/GTC
Archiving Directory: /home/GTC/archive
File Prefix: PLC
Specified Delimiter: |
File Encoding UTF8
Source Date Format yyyy/MM/dd hh:mm:ss z
*Reconcile Deletion of Multivalued Attribute Data check box  [cleared]*
Reconciliation Type Full
In the Configuration Mapping, I created a Status varaible and mapped it to OIM Object Status and changed the Data type of Last Logon TimeStamp to Date.
The Layout of flat file PLC.csv.txt is like this:
Account Name|Full Name|Domain|Last Logon Timestamp|Description|GUID|Mail|Employee ID|First Name|Last Name
PLC\!alders|Steve Alder|PLC.COM|2007/01/10 11:16:27|Directory and Messaging Services|E109B9F8-40BD-4E72-B336-B46600A5B38E|||Steve|Alder
PLC\!lewisj|Jonathan Lewis|PLC.COM||Data Centre Scheduled Activities Team|1D580887-EDEB-4C87-A079-837AFBAA782F|||Jonathan|Lewis
The reconciliation is working fine however the record without date is visible in Reconciliation manager. The other record (with date) is not being displayed in Reconcliation Manager.
I can't see any error in logs also. Not sure but this might be due to changing Data type from string to Date of Last Logon TimeStamp while Configuring Reconcliation Mapping. However, I need to have Last Logon TimeStamp as Date.
Please help.
Cheers,
Sunny

Hi,
Ok, will try removing the 'z'. These are the new logs:
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProvider......2+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],validationProviderclassname:com.thortech.xl.gc.impl.validation.IsFloatValidatorProvider, name:IsFloat+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],nameIsFloat+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProvider......2+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],validationProviderclassname:com.thortech.xl.gc.impl.validation.IsDoubleValidatorProvider, name:IsDouble+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],nameIsDouble+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProvider......2+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],validationProviderclassname:com.thortech.xl.gc.impl.validation.IsInRangeValidatorProvider, name:IsInRange+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],nameIsInRange+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProvider......2+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],validationProviderclassname:com.thortech.xl.gc.impl.validation.MatchRegexpValidatorProvider, name:MatchRegularExpression+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],nameMatchRegularExpression+
+DEBUG,24 Aug 2009 19:49:38,211,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProvider......2+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],validationProviderclassname:com.thortech.xl.gc.impl.validation.ValidateDateFormat, name:ValidateDateFormat+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],nameValidateDateFormat+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],come in validationName.equalsIgnoreCase(name)+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProviderClassName. ..found transformation provider.....+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProviderClassName....provider class name = ..com.thortech.xl.gc.impl.validation.ValidateDateFormat+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION], provider nameValidateDateFormat+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION], provider def attribnull+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION], provider resp codes{}+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],inside getProviderClassName. ..found transformation provider.....com.thortech.xl.gc.impl.validation.ValidateDateFormat+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.ADAPTERS],Class/Method: tcADPClassLoader/getClassLoader entered.+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.ADAPTERS],Class/Method: tcADPClassLoader/getClassLoader left.+
+DEBUG,24 Aug 2009 19:49:38,212,[XELLERATE.GC.PROVIDERREGISTRATION],Loading Provider Class -->com.thortech.xl.gc.impl.validation.ValidateDateFormat+ +WARN,24 Aug 2009 19:32:54,225,[XELLERATE.GC.FRAMEWORKRECONCILIATION],Record failed on Validation and therefore would not be Reconciled+*
+WARN,24 Aug 2009 19:32:54,225,[XELLERATE.GC.FRAMEWORKRECONCILIATION],Parent Data -->{Description=2029/03/07 09:01:11, Account Name=HRL\PUNEET, First Name=, Last Logon Timestamp=HRL1.CORP, Domain=Les, GUID=Hrl, Employee [email protected], Full Name=PUNEETKING, Mail=C7F1A30E-A0C7-444E-BA09-EC66E63831EB, Last Name=PUNEET}++DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.SCHEDULER.TASK],Class/Method: SchedulerBaseTask/isStopped entered.+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.SCHEDULER.TASK],Class/Method: SchedulerBaseTask/isStopped left.+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/getNextPage entered.+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/getNextPage - Data: page size--> - Value: -1+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],pagesize-->-1+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/end entered.+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Medthod: SharedDriveReconTransportProvider/end - Before calling: copyFilesToArchive(for Parent files)+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/copyFilesToArchive entered.+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/copyFilesToArchive - Data: src File--> - Value: LINUXRECON.COM.txt~+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],src File-->LINUXRECON.COM.txt~+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/copyFilesToArchive - Data: stage Dir--> - Value: /home/GTC+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],stageDir-->/home/GTC+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/copyFilesToArchive - Data: archive Dir--> - Value: /home/GTC/archive+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],archiveDir-->/home/GTC/archive+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],fis closed for /home/GTC/LINUXRECON.COM.txt~+
+DEBUG,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],fos closed for /home/GTC/archive/LINUXRECON.COM.txt~+
+INFO,24 Aug 2009 19:32:54,225,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Info Data: file deleted --> - Value: true+
+WARN,24 Aug 2009 19:32:54,226,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],FILE SUCCESSFULLY ARCHIVED : /home/GTC/LINUXRECON.COM.txt~+
Cheers,
Sunny
Edited by: sunny@newbie on Aug 24, 2009 7:58 PM

Similar Messages

  • Urgent: Flat file reconciliation - Clarification reqd

    Hi,
    Can someone pls. clarify on the below:
    I am using OIM 11g version, and i need some clarifications, when working on GTC - Flat file reconciliation.
    * I am using a flat file reconciliation for create, update and delete accounts in OIM 11g. Create and update are working fine, but I am not sure how it will work in Delete scenario. Means how to delete a user using flat file reconciliation. It would be great if someone explain the functionality or provide across some link on the same.
    * Is that, we need to configure the policy such that when a row is removed from the file, the account is getting deleted on OIM. Is it possible? or if some simpler approach is there pls. guide us on that.
    * We were facing issue when we created accounts, with passing employee Type as "Full-Time Employee". On further digging, we came to know its an issue with space.
    Since OIM was able to create account via GTC if we pass, a value which doesn't contain any space. say like employee Type as "Intern".
    If space is the constaint, pls. guide how to escape the space. I tried to give double-quotes, single-quotes, back-slash etc. nothing helped.
    Some one pls help on this to the earliest.
    Regards,
    Karan
    Edited by: user8674642 on Feb 11, 2011 5:10 AM

    Thanks for your update. Its really helpful.
    I tried with "Full-Time" instead of "Full-Time Employee". It worked. Will test for other scenarios like "Non Worker", "Part-Time Employee", "Contingent Employee" where they have space as a constraint. Any document which states this steps would be great.
    Also, regarding deletion of account, is the approach we are following works fine. Pls. guide we are in correct track.
    For deletion of account via Flat-file, the below option we are planning to approach.
    We created an account with flat file data, with login,firstName,lastName,eMail,organization,employeeType,identityStatus and when we changed the value identityStatus as Disabled for an existing user with End-Date to current date, it was found when we execute the scheduler "Disable/delete account using end-date" the account got removed from OIM.
    Couple of guidance required here:
    1) Not sure about what is the equivalent mapping field for End-Date in OIM in 11g version.
    2) What should be format of End-date i should provide in flatfile so, oim can store in the backend.
    Pls. help me in these above clarification.
    Regards,
    Karan

  • Flat File reconciliation failing with no error

    Hello,
    I'm trying to set up flat file reconciliation with OIM 11g. I've followed this guide
    http://www.oracle.com/webfolder/technetwork/tutorials/obe/fmw/oim/10.1.4/oim/obe12_using_gtc_for_reconciliation/using_the_gtc.htm
    and configured the mapping for my fields. When I execute the scheduled task to launch the reconciliation process, I get no errors, but no user is created either. In OIM's output, the only message relevant to the reconciliation that is printed is
    <Sep 7, 2012 3:12:44 PM EDT> <Warning> <XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT> <BEA-000000> <FILE SUCCESSFULLY ARCHIVED : /u01/flat_files/hcm_1.txt>
    In OIM's logs, there are a bunch of notifications about the values retrieved from the flat file, and the logs end with this :
    [2012-09-07T15:12:44.511-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: Query for getTargetTableEntity=select RECON_CITY,RECON_USR_MANAGER_KEY,RECON_ORG_NAME,RECON_EMPLOYEEID,RECON_DEPARTMENTID,RECON_HIREDATE,RECON_ADDRESS,RECON_MANAGER_LOGIN,RECON_DISPLAYNAME66894369,RECON_CHGLOGATTR_IDXLST,RECON_USR_END_DATE,RECON_PHONE,RECON_ACT_KEY,RECON_COUNTRY,RECON_USR_LOGIN,RECON_USR_TYPE,re_key,RECON_POSTAL,RECON_STATE,RECON_USR_EMAIL,RECON_USR_EMP_TYPE,RECON_USR_PASSWORD,RECON_LASTNAME,RECON_USR_START_DATE,RECON_FIRSTNAME from RA_MOCKPSHCMGTC85 where EXISTS (select re_key from recon_events where rb_key=6 and recon_events.re_key=RA_MOCKPSHCMGTC85.re_key)
    [2012-09-07T15:12:44.517-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: getTargetTableEntity =[{usr_manager_key=null, Locality Name=St-glinglin3, Organization Name=Xellerate Users, Employee Number=c2345678, Department Number=01, Hire Date=Sat Dec 31 00:00:00 EST 2011, Manager Login=null, Home Postal Address=2021 du fin fin3, Display Name=c2345678, RECON_CHGLOGATTR_IDXLST=4,1,6,10,8,9,14,2,13,12,3,15,7,5,11, End Date=null, Home Phone=514-555-1234, act_key=1, Country=Mozambique3, User Login=c2345678, Xellerate Type=null, re_key=6, Postal Address=2020 du fin fin3, State=Arizona3, Email=null, Role=Full-Time, usr_password= , Last Name=Doe3, Start Date=null, First Name=John3}]
    [2012-09-07T15:12:44.518-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: Query for getTargetTableEntity=select RECON_USR_MANAGER_KEY,MLS_LOCALE_CODE,RECON_USR_END_DATE,RECON_ORG_NAME,RECON_ACT_KEY,RECON_USR_LOGIN,RECON_USR_TYPE,re_key,RECON_MANAGER_LOGIN,RECON_USR_EMAIL,RECON_DISPLAYNAME66894369,RECON_USR_EMP_TYPE,RECON_USR_PASSWORD,RECON_USR_START_DATE,RECON_CHGLOGATTR_IDXLST from RA_MLS_MOCKPSHCMGTC85 where EXISTS (select re_key from recon_events where rb_key=6 and recon_events.re_key=RA_MLS_MOCKPSHCMGTC85.re_key)
    [2012-09-07T15:12:44.521-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: getTargetTableEntity ={}
    [2012-09-07T15:12:44.523-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: Query for getTargetTableEntity=select usr_territory,usr_pwd_warn_date,usr_emp_no,usr_locale,usr_middle_name,usr_manually_locked,usr_update,usr_disabled,usr_date_format,usr_display_name,usr_timezone,usr_mobile,usr_locked,usr_ldap_organization,usr_pwd_reset_attempts_ctr,usr_currency,usr_end_date,usr_deprovisioned_date,usr_pager,usr_time_format,usr_created,usr_deprovisioning_date,usr_po_box,usr_color_contrast,usr_create,usr_full_name,usr_ldap_guid,usr_country,usr_accessibility_mode,usr_type,usr_change_pwd_at_next_logon,usr_pwd_expire_date,usr_pwd_cant_change,re_key,usr_email,usr_provisioned_date,usr_data_level,usr_common_name,usr_automatically_delete_on,usr_locked_on,usr_login_attempts_ctr,usr_last_name,usr_start_date,usr_first_name,usr_manager_key,usr_locality_name,usr_policy_update,usr_number_format,usr_street,usr_embedded_help,usr_pwd_expired,usr_dept_no,usr_hire_date,usr_createby,usr_pwd_warned,usr_home_postal_address,usr_telephone_number,usr_name_preferred_lang,usr_font_size,usr_updateby,usr_description,usr_home_phone,usr_ldap_organization_unit,usr_pwd_min_age_date,usr_fax,usr_postal_code,act_key,usr_key,usr_login,usr_title,usr_status,usr_gen_qualifier,usr_postal_address,usr_state,usr_pwd_never_expires,usr_initials,usr_pwd_must_change,usr_emp_type,usr_ldap_dn,usr_password,usr_pwd_generated,usr_language,usr_provisioning_date from RECON_USER_OLDSTATE where EXISTS (select re_key from recon_events where rb_key=6 and recon_events.re_key=RECON_USER_OLDSTATE.re_key)
    [2012-09-07T15:12:44.527-04:00] [oim_server1] [NOTIFICATION] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: [ACTIVE].ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oiminternal] [ecid: 11d1def534ea1be0:315618d7:139a11a9ada:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: getTargetTableEntity ={}
    Since I can see no errors, I'm not really sure where to look to understand why users are not created. Any ideas?
    Thanks,
    --jtellier                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           

    Looking at your log it is clear that, you are populating Xellerate Type=null. This is mandatory field and can't be null. However, when you create user using UI, the default value "End-Users" is being passed by default, because we have the corresponding field "Design Console" access check box at oim user profile.
    Just map the constant value for trusted recon
    Xellerate Type=End-Users
    --nayan                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • Error in flat file reconciliation in oim11g on linux.

    Hi all,
    i am getting following exception in flat file reconciliation of oim 11g on linux machine. Any one please help me out from this error .
    *<Apr 19, 2011 12:29:26 PM EDT> <Error> <XELLERATE.WEBAPP> <BEA-000000> <Class/Method: CreateConnectorAction/imageScreen encounter some problems: >*
    java.lang.NumberFormatException: null
    at java.lang.Long.parseLong(Long.java:375)
    at java.lang.Long.parseLong(Long.java:468)
    at com.thortech.xl.ejb.beansimpl.tcFormDefinitionOperationsBean.getFormFieldsData(tcFormDefinitionOperationsBean.java:2135)
    at com.thortech.xl.ejb.beansimpl.tcFormDefinitionOperationsBean.getFormFields(tcFormDefinitionOperationsBean.java:1694)
    at Thor.API.Operations.tcFormDefinitionOperationsIntfEJB.getFormFieldsx(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
    at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at com.bea.core.repackaged.springframework.jee.spi.MethodInvocationVisitorImpl.visit(MethodInvocationVisitorImpl.java:37)
    at weblogic.ejb.container.injection.EnvironmentInterceptorCallbackImpl.callback(EnvironmentInterceptorCallbackImpl.java:54)
    at com.bea.core.repackaged.springframework.jee.spi.EnvironmentInterceptor.invoke(EnvironmentInterceptor.java:50)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
    at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
    at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    at $Proxy312.getFormFieldsx(Unknown Source)
    at Thor.API.Operations.tcFormDefinitionOperationsIntfEJB_r9z3jf_tcFormDefinitionOperationsIntfRemoteImpl.getFormFieldsx(tcFormDefinitionOperationsIntfEJB_r9z3jf_tcFormDefinitionOperationsIntfRemoteImpl.java:2665)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at weblogic.ejb.container.internal.RemoteBusinessIntfProxy.invoke(RemoteBusinessIntfProxy.java:84)
    at $Proxy188.getFormFieldsx(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
    at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)
    at $Proxy311.getFormFieldsx(Unknown Source)
    at Thor.API.Operations.tcFormDefinitionOperationsIntfDelegate.getFormFields(Unknown Source)
    at com.thortech.xl.webclient.actions.CreateConnectorAction.imageScreen(CreateConnectorAction.java:1176)
    at com.thortech.xl.webclient.actions.CreateConnectorAction.goNext(CreateConnectorAction.java:521)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.struts.actions.DispatchAction.dispatchMethod(DispatchAction.java:269)
    at com.thortech.xl.webclient.actions.tcLookupDispatchAction.execute(tcLookupDispatchAction.java:133)
    at com.thortech.xl.webclient.actions.tcActionBase.execute(tcActionBase.java:894)
    at com.thortech.xl.webclient.actions.tcAction.execute(tcAction.java:213)
    at com.thortech.xl.webclient.actions.CreateConnectorAction.execute(CreateConnectorAction.java:135)
    at org.apache.struts.chain.commands.servlet.ExecuteAction.execute(ExecuteAction.java:58)
    at org.apache.struts.chain.commands.AbstractExecuteAction.execute(AbstractExecuteAction.java:67)
    at org.apache.struts.chain.commands.ActionCommandBase.execute(ActionCommandBase.java:51)
    at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:191)
    at org.apache.commons.chain.generic.LookupCommand.execute(LookupCommand.java:305)
    at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:191)
    at org.apache.struts.chain.ComposableRequestProcessor.process(ComposableRequestProcessor.java:283)
    at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913)
    at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:462)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
    at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at com.thortech.xl.webclient.security.XSSFilter.doFilter(XSSFilter.java:103)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at com.thortech.xl.webclient.security.CSRFFilter.doFilter(CSRFFilter.java:61)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.iam.platform.auth.web.PwdMgmtNavigationFilter.doFilter(PwdMgmtNavigationFilter.java:115)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.iam.platform.auth.web.OIMAuthContextFilter.doFilter(OIMAuthContextFilter.java:100)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:330)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3684)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2268)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2174)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1446)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
    Thank u & regards,
    Praveen.

    What all are the fields you are bringing from Flat File to OIM ?
    It says NumberFormatException which generally comes when you try to convert String (that does not represent a number) into Number. Check your fields and their mapping once again.

  • Custom code for Flat file reconciliation on LDAP

    Hello,
    I have to write a custom code for flat file reconciliation on LDAP as the GTC connector wasn't working entirely.
    Could someone help me out with this.. How do i do this ??
    Thanks

    flat file reconciliation on LDAPWhat do you mean by Flat File on LDAP ?
    If you want to create Flat File connector then search google for reading a flat file using Java.
    Define RO Fields and do mapping in Process Defintion. You can use Xellerate User RO for Trusted Recon.
    Make a map of CSV that and Recon Field
    Call the Reconciliation API

  • Error in Performing Flat-File Reconciliation

    Hi All,
    I was trying perform flat file reconcilation using the GTC Connector. The format of my flat file (PPSLocal.txt) is like this:
    Account Name|Full Name|Domain|Last Logon Timestamp|Description|GUID|Mail|Employee ID|First Name|Last Name
    PPS\SophosSAUPPS010|SophosSAUPPS010|PPS.LOCAL||Used for download of Sophos updates|EED86D86-750C-404A-9326-044A4DB07477||||
    PPS\GBPPL-SI08$|GBPPL-SI08$|PPS.LOCAL|||79677F4D-8959-493E-9CF9-CDDDB175E40B||||
    PPS\S6Services|Series 6 Services Account|PPS.LOCAL||Series 6 Services Account|B4F41EE2-6744-4064-95F6-74E017D0B9AF||||
    I created a GTC Connector "OtherDomain" specified all the configuration;
    Staging Directory (Parent identity data) /home/GTC
    Archiving Directory /home/GTC/archive
    File Prefix PPS
    Specified Delimiter |
    File Encoding UTF8
    Source Date Format yyyy/MM/dd hh:mm:ss z
    Reconcile Deletion of Multivalued Attribute Data check box unchecked
    Reconciliation Type Full
    After that i performed the connector configuration mapping and ran the respective schedule task which displayed the following error message on console:
    Class/Medthod: SharedDriveReconTransportProvider/getFirstPage - Before calling: getAllData
    *DEBUG,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/getAllData entered.*
    *DEBUG,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/getReconFileList entered.*
    *DEBUG,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider.EndsWithFilter/accept entered.*
    *INFO,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Staging dir -->/home/GTC*
    *INFO,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Number of files available -->0*
    *DEBUG,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/getReconFileList left.*
    *ERROR,20 Aug 2009 09:08:49,202,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Problem encountered in reconciling the first page of data*
    com.thortech.xl.gc.exception.ReconciliationTransportException: No Parent files in staging directory or necassary access(READ) permissions are missing
    *     at com.thortech.xl.gc.impl.recon.SharedDriveReconTransportProvider.getAllData(Unknown Source)*
    *     at com.thortech.xl.gc.impl.recon.SharedDriveReconTransportProvider.getFirstPage(Unknown Source)*
    *     at com.thortech.xl.gc.runtime.GCScheduleTask.execute(Unknown Source)*
    *     at com.thortech.xl.scheduler.tasks.SchedulerBaseTask.run(Unknown Source)*
    *     at com.thortech.xl.scheduler.core.quartz.QuartzWrapper$TaskExecutionAction.run(Unknown Source)*
    *     at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)*
    *     at weblogic.security.service.SecurityManager.runAs(Unknown Source)*
    *     at weblogic.security.Security.runAs(Security.java:41)*
    *     at Thor.API.Security.LoginHandler.weblogicLoginSession.runAs(Unknown Source)*
    *     at com.thortech.xl.scheduler.core.quartz.QuartzWrapper.execute(Unknown Source)*
    *     at org.quartz.core.JobRunShell.run(JobRunShell.java:178)*
    *     at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:477)*
    *ERROR,20 Aug 2009 09:08:49,202,[XELLERATE.GC.FRAMEWORKRECONCILIATION],Reconciliation Encountered error:*
    com.thortech.xl.gc.exception.ProviderException: No Parent files in staging directory or necassary access(READ) permissions are missing
    *     at com.thortech.xl.gc.impl.recon.SharedDriveReconTransportProvider.getFirstPage(Unknown Source)*
    *     at com.thortech.xl.gc.runtime.GCScheduleTask.execute(Unknown Source)*
    *     at com.thortech.xl.scheduler.tasks.SchedulerBaseTask.run(Unknown Source)*
    *     at com.thortech.xl.scheduler.core.quartz.QuartzWrapper$TaskExecutionAction.run(Unknown Source)*
    *     at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)*
    *     at weblogic.security.service.SecurityManager.runAs(Unknown Source)*
    *     at weblogic.security.Security.runAs(Security.java:41)*
    *     at Thor.API.Security.LoginHandler.weblogicLoginSession.runAs(Unknown Source)*
    *     at com.thortech.xl.scheduler.core.quartz.QuartzWrapper.execute(Unknown Source)*
    *     at org.quartz.core.JobRunShell.run(JobRunShell.java:178)*
    *     at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:477)*
    Caused by: com.thortech.xl.gc.exception.ReconciliationTransportException: No Parent files in staging directory or necassary access(READ) permissions are missing
    *     at com.thortech.xl.gc.impl.recon.SharedDriveReconTransportProvider.getAllData(Unknown Source)*
    *     ... 11 more*
    *WARN,20 Aug 2009 09:08:49,203,[XELLERATE.GC.FRAMEWORKRECONCILIATION],Though Reconciliation Scheduled task has encountered an error, Reconciliation Transport providers have been "ended" smoothly. Any provider operation that occurs during that "end" or "clean-up" phase would have been executed e.g. Data archival. In case you want that data to be a part of next Reconciliation execution, restore it from Staging. Provider logs must be containing details about storage entities that would have been archived*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/end entered.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Medthod: SharedDriveReconTransportProvider/end - After calling: Re-setting instance variables*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Medthod: SharedDriveReconTransportProvider/end - After calling: Re-set over for instance variables*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.GC.PROVIDER.RECONCILIATIONTRANSPORT],Class/Method: SharedDriveReconTransportProvider/end left.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SCHEDULER.TASK],Class/Method: SchedulerBaseTask/run left.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SCHEDULER.TASK],Class/Method: SchedulerBaseTask/isSuccess entered.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SCHEDULER.TASK],Class/Method: SchedulerBaseTask/isSuccess left.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SERVER],Class/Method: SchedulerTaskLocater /removeLocalTask entered.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SERVER],Class/Method: SchedulerTaskLocater /removeLocalTask left.*
    *DEBUG,20 Aug 2009 09:08:49,203,[XELLERATE.SERVER],Class/Method: QuartzWrapper/updateStatusToInactive entered.*
    *DEBUG,20 Aug 2009 09:08:49,207,[XELLERATE.SERVER],Class/Method: QuartzWrapper/updateStatusToInactive left.*
    *DEBUG,20 Aug 2009 09:08:49,207,[XELLERATE.SERVER],Class/Method: QuartzWrapper/updateTaskHistory entered.*
    *DEBUG,20 Aug 2009 09:08:49,208,[XELLERATE.SERVER],Class/Method: QuartzWrapper/updateTaskHistory left.*
    *DEBUG,20 Aug 2009 09:08:49,209,[XELLERATE.SERVER],Clearing Security Associations with thread executing Scheduled task*
    *DEBUG,20 Aug 2009 09:08:49,210,[XELLERATE.SERVER],Class/Method: QuartzWrapper/run left.*
    *DEBUG,20 Aug 2009 09:08:49,210,[XELLERATE.SERVER],Class/Method: QuartzWrapper/execute left.*
    However, to my amazement, the reconciliation event for all the user are getting created in OIM Design console;
    I have tried changing the directory /home/GTC permission to 777 also but it didnt help.
    If anyone has any clue on this, kindly help.
    Cheers,
    Sunny

    AS you are saying that fiel is there.
    Can you please tell me how your recon sch task is running, I mean to say at what interval or once or daily ?
    If you are putting your file in parent form it is going to archive after recon. that';s correct and your recon manager is getting users that is also correct it means your recon si working fine.
    Now to run this recon second time you have to put one more fiel with new records or updated records in the parent dir otherwise it shows error.
    For me it is not showing any error.
    As user774847 is saying that it is known issue, i can't comment on this as I am not getting this error. I get this error only when i don't put any flat file in parent dir and i run the sch task.
    Just put new file or updated one for each time you run the SCh Task and make the SCh Task ONCE or Daily.
    Let me know if errors are still coming

  • OIM 11.1.1.5 Flat File Reconciliation :

    Hi,
    I am using a csv file as a Target Source and trying to reconcile in OIM. I can successfully do so unless I try to populate the manager field in OIM. As soon as I try to populate the Manager field, I get an error.
    I read that the Manager attribute in OIM User Form is mapped to the usr_mgr_key in the backend. I believe it should automatically get the usr_key and map that to the usr_mgr_key upon reconciliation.
    In my example : Supervisor_ID = RANDY_MARSH (with user key is 61 already) exists in my OIM.
    The error I am getting is as follows : Any input is highly appreciated.
    ++usrColumnsList = usr_manager_key,usr_type,usr_title,usr_emp_no,usr_email,usr_dept_no,usr_middle_name,usr_login,act_key,usr_last_name,usr_first_name++
    ++usrDataArray = [61, End-User, Non Billable, 100002, [email protected], 4168500121, Theodore, 100002, 24, Cartman, Eric]++
    ++matchingRulesWhereClause = (((USR.USR_EMP_NO='100002')AND(USR.USR_TYPE='End-User')AND(USR.USR_DEPT_NO='4168500121')AND(USR.USR_LAST_NAME='Cartman')AND(USR.USR_TITLE='Non Billable')AND(UPPER(USRMGR.USR_LOGIN)=UPPER('61'))AND(USR.ACT_KEY='24')AND(USR.USR_EMAIL='[email protected]')AND(UPPER(USR.USR_LOGIN)=UPPER('100002'))AND(USR.USR_FIRST_NAME='Eric')AND(USR.USR_MIDDLE_NAME='Theodore')))++
    ++dateFormat = MM-DD-RRRR HH24:MI:SS++
    ++]]++
    ++[2011-12-28T16:33:30.203+05:30] [oim_server1] [ERROR] [IAM-5010000] [oracle.iam.reconciliation.impl] [tid: OIMQuartzScheduler_Worker-2] [userId: oiminternal] [ecid: d0b6053d8947039f:239a101:1345ff4d6f6:-8000-0000000000000002,0] [APP: oim#11.1.1.3.0] Generic Information: {0}[[++
    ++oracle.iam.platform.utils.SuperRuntimeException: java.sql.SQLSyntaxErrorException: ORA-00904: "USRMGR"."USR_LOGIN": invalid identifier++
    ++ORA-06512: at "DEV_OIM.XL_SP_RECON_USR_MATCH", line 14++
    ++ORA-06512: at "DEV_OIM.XL_SP_RECON_USR_DATA_MATCH", line 31++
    ++ORA-06512: at line 1++
    ++     at oracle.iam.reconciliation.dao.event.EventMgmtDao.ignoreEventUsrDataMatch(EventMgmtDao.java:450)++
    ++     at oracle.iam.reconciliation.impl.ReconOperationsServiceImpl.ignoreEvent(ReconOperationsServiceImpl.java:385)++
    ++     at oracle.iam.reconciliation.impl.ReconOperationsServiceImpl.ignoreEvent(ReconOperationsServiceImpl.java:346)++
    ++     at Thor.API.Operations.tcReconciliationOperationsIntfEJB.ignoreEventx(Unknown Source)++
    ++     at sun.reflect.GeneratedMethodAccessor9086.invoke(Unknown Source)++
    ++     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)++
    ++     at java.lang.reflect.Method.invoke(Method.java:597)++

    I tried passing 61 but it didnt work.
    Anyways I was able to troubleshoot the error. It was rather a mistake on my side. There was a required field that I was missing on this flat file, EmployeeType that maps to Role on the OIM side. However the error shown in the logs was a bit misleading.
    Thanks for you help.

  • Flat file truncation issue

    I am attempting to perform a fairly standard operation, extract a table to a flat file.
    I have set all the schemas, models and interfaces, and the file is produced how I want it, apart from one thing. In the source, one field is 100 characters long, and in the output, it needs to be 25.
    I have set the destination model to have a column physical and logical length of 25.
    Looking at the documentation presented at http://docs.oracle.com/cd/E25054_01/integrate.1111/e12644/files.htm - this suggests that setting the file driver up to truncate fields should solve the issue.
    However, building a new file driver using the string 'jdbc:snps:dbfile?TRUNC_FIXED_STRINGS=TRUE&TRUNC_DEL_STRINGS=TRUE' does not appear to truncate the output.
    I noticed a discrepancy in the documentation - the page above notes 'Truncates strings to the field size for fixed files'. The help tooltip in ODI notes 'Truncates the strings from the fixed files to the field size'. Which might explain the observed lack of truncation.
    My question is - what is the way to enforce field sizes in a flat file output?
    I could truncate the fields separately in each of the mapping statements using substr, but that seems counter-intuitive, and losing the benefits of the tool.
    Using ODI Version:
    Standalone Edition Version 11.1.1 - Build ODI_11.1.1.5.0_GENERIC_110422.1001

    bump
    If this is an elementary issue, please let me know what I've missed in the manual.

  • XML to Flat File design issue

    Hi,
    A newbie to SSIS but was able to create an SSIS package which extracts XML data from one of the SQL server columns using "Execute SQL Task" and passes that to a for each loop container which contains an XML task for apply transform to each input
    xml and append it to a flat file(additonally using a script task within for each container).
    All good so far but now I want to apply conditional splitting to "Execute SQL Task" in the above and additionally pipe it to the exact similar additional process(For each container doing xml task as described above) for a different kind of
    flat file.
    If I alter the design to use the data flow approach and apply OOTB conditional split, I run into not knowing how to connect and execute more than one  foreach container and embedded XML and script task (dataflow to control flow connection)
    It is easy to put everything in a sequence container and repeat the Execute SQL Task . But to me that is very inefficient.
    Any creative ideas or pointers to some internet content which tells me how can this be done most efficiently.
    Hope my question makes sense and let me know if you need more clarification.
    Thanks in advance.
    SM

    As I understand what you're asking for is a way to create conditional branches to do different typeof processing for each subset of data. For this you can do like below 
    1. Add set of tasks to additional processing for each type of flat file and link them to Execute sql task.
    2. Make the precedence constraint option as Expression And Constraint for each of them. Make constraint as OnSuccess and expression based on your condition. You may need to create SSIS variables to capture value of fields to be used in expression manipulation.
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • JCA flat file read issue

    Hi,
    We needs to read a flat file and transform it to destination xml format. Then send it to destination file location.
    Steps we have done:
    1. Create JCA adapter and configure the flat file schema
    2. Create proxy based on the jca
    3. create transformation for the source to target schema (this has no namespace)
    4. Create BS for sending the output
    Everything workins as expected when testing from OSB test console. But then the file is placed in the source folder, the output xml has the namespace xmlns:soap-env="http://schemas.xmlsoap.org/soap/envelope/" to the root node.
    e.g,
    <Root xmlns:soap-env="http://schemas.xmlsoap.org/soap/envelope/" >
    <Child>
    <Child1/>
    <Child2/>
    <Child3/>
    </Child>
    </Root>
    But expected output is
    <Root>
    <Child>
    <Child1/>
    <Child2/>
    <Child3/>
    </Child>
    </Root>
    We tried converting the xml to string then repalcing the xmlns:soap-env="http://schemas.xmlsoap.org/soap/envelope/" value with balnk.
    Also we tried with hadcorded xml using assign action instead of transformation. Even the harded xml also having the namespace to the root node.
    But the end system is failing due to this namespace value.
    Help me to resolve the issue.
    Thanks,
    Vinoth
    Edited by: Vinoth on Jun 8, 2011 10:12 PM

    Ideally your endsystem should not fail if you specify any number of namespace identifiers in the XML unless you are using them in elements or attributes within the XML. They should try to resolve this on their side.
    But to see whats going on in OSB, can you please paste log the $body variable in the before the publish action and paste the content here. Or send the sbconfig of the Proxy and business to me on my email mentioned in the profile if possible.

  • Flat file load issue-Urgent

    Hello
    I'm trying to load a master data infoobject with a flat file and getting errors.
    The infoobject ZCOLLECT_DATE has two fields - ZQUARTER and ZCOLLECTDATE
    ZCOLLECT_DATE is of Data type NUMC, Length 5, conversion routine PERI5 and Output length 6
    I created a flat file in Excel the following way:
    Left the first row blank
    Second column - 1/2008 (for ZQUARTER)
    Thrid column - 01/11/2008 (for ZCOLLECTDATE)
    I saved it as a CSV (save as-> csv).
    In the infopackage, I've selected this file in the External data tab, File type CSV, Data separator ; , Escape sign "
    When I try to load the infoobject, I get the following error:
    "Error in conversion exit CONVERSION_EXIT_PERI5_INPUT"
    I thought this was because the Length in my infoobject was 5, whereas ZQUARTER is of length 6 in my flat file (eg-1/2008) and ZCOLLECTDATE is of format mm/dd/yyyy.
    Any thoughts on what the issue is?
    Thanks
    Alex

    Hi Hemant
    I changed it to 12008, 22008 etc.. but still get the error ""Error in conversion exit CONVERSION_EXIT_PERI5_INPUT"
    Also, when I save the xls file as CSV, I get two pop-ups saying some features are not compatible and only those features that are compatible will be saved. Are these normal warnings, or could they be causing the issue?
    Also, in the infoobject, since it only consists of dates, do I need to specify conversion routine PERI5 in Infoobject properties/maintenance?
    Thanks

  • Flat File Load Issue - Cannot convert character sets for one or more charac

    We have recently upgraded our production BW system to SPS 17 (BW SP19)
    and we have issues loading flat files (contain Chinese, Japanese and
    Korean characters) which worked fine before the upgrade. The Asian
    languages appear as invalid characters (garbled) as we can see in PSA. The Character Set
    Settings was previously set as Default Setting and it worked fine until
    the upgrade abd we referred to note 1130965 and with the code page 1100
    the load went through (without the Cannot convert character sets for one or more characters error) however the Asian language characters will appear
    as invalid characters. We tried all the code pages suggested in the note e.g.
    4102, 4103 etc on the info packages but it did not work. Note that the
    flat files are encoded in UTF-8.

    I checked lower case option for all IO
    When i checked the PSA failed log no of records processed is "0 of 0" my question is with out processing single record system is througing this error message.
    When i use same file loading from local workstation no error message
    I am thinking when  I FTP the file from AS/400 to BI Application Server(Linex) some invalid characters are adding but how can we track that invalid char?
    Gurus please share your thoughts on this I will assign full points.
    Thanks,

  • Problem performing flat file reconciliation in 11gR2

    Hello,
    In R1, I had configured a simple GTC flat file connector that worked well. I've now updated to R2 (well actually, I've done a clean install), recreated the same connector configuration and tested with a text file that worked in R1, but this time, it doesn't work. I've added the following lines in my oim server logs config to have a better idea of what's going on :
    <logger name="oracle.iam.identity.scheduledtasks"/>
    <logger name="oracle.iam.scheduler"/>
    <logger name="oracle.iam.platform.scheduler"/>
    <logger name="Xellerate.Scheduler"/>
    <logger name="Xellerate.Scheduler.Task"/>
    <logger name="oracle.iam.reconciliation"/>
    However, the problem seems to happen before any reconciliation task is executed because I don't see any information about the data being read from the file. Here are the errors I'm getting :
    oracle.iam.reconciliation.exception.ReconciliationException: Invalid Profile - GTCCSVTEST1_GTC
    at oracle.iam.reconciliation.impl.ReconOperationsServiceImpl.getProfile(ReconOperationsServiceImpl.java:2121)
    at oracle.iam.reconciliation.impl.ReconOperationsServiceImpl.ignoreEvent(ReconOperationsServiceImpl.java:544)
    at oracle.iam.reconciliation.impl.ReconOperationsServiceImpl.ignoreEvent(ReconOperationsServiceImpl.java:535)
    Caused by: oracle.iam.reconciliation.exception.ConfigNotFoundException: Invalid Profile - GTCCSVTEST1_GTC
    at oracle.iam.reconciliation.impl.config.CoreProfileManagerImpl$ProfileMarshaller.unMarshal(CoreProfileManagerImpl.java:521)
    at oracle.iam.reconciliation.impl.config.CoreProfileManagerImpl$ProfileMarshaller.unMarshal(CoreProfileManagerImpl.java:504)
    [org.xml.sax.SAXParseException: cvc-minLength-valid: Value '' with length = '0' is not facet-valid with respect to minLength '1' for type 'matchingRuleType'.]
    at javax.xml.bind.helpers.AbstractUnmarshallerImpl.createUnmarshalException(AbstractUnmarshallerImpl.java:315)
    at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.createUnmarshalException(UnmarshallerImpl.java:522)
    Caused by: org.xml.sax.SAXParseException: cvc-minLength-valid: Value '' with length = '0' is not facet-valid with respect to minLength '1' for type 'matchingRuleType'.
    at org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source)
    at org.apache.xerces.util.ErrorHandlerWrapper.error(Unknown Source)
    It looks like something is wrong with my reconciliation profile, so I've gone to the Design Console and created a default reconciliation profile for my GTCCSVTEST1_GTC Resource Object, but it did not help.
    Any ideas?
    Thanks,
    --jtellier                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

    That's it. I've just learned that a Reconciliation Rule is created automatically when a field is set as "Matching Only" when configuring the connector. I had such a field in the initial configuration, but skipped this step when configuring the connector in R2.
    Thanks,
    --jtellier                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

  • Flat File Load- issue

    Hi All,
    I am facing a problem while doing a deta load through Flat File; it's an .csv file.
    Problem arises whne I have some records like this £1,910.00 ; it's creating a separate column.
    I am having lot's of such amount field.
    is there any breakthrough for this issue ?? Your ans would be highly appriciated.
    Regards,
    Kironmoy Banerjee

    Hi,
    As satish has mentioned it is better to maintain two seperate columns as below
    1.0currency     
        GBP     
    2.0amount
        1910
    (GBP )Indicates British Pound.
    When ur maintaining amount as 1,910.00 it will go for next column because in info package  Extraction tabe Data Separator will be , (Comma).
    Regards
    Surendra
    Edited by: vaade surendra on May 7, 2010 11:37 AM
    Edited by: vaade surendra on May 7, 2010 11:37 AM
    Edited by: vaade surendra on May 7, 2010 11:38 AM
    Edited by: vaade surendra on May 7, 2010 11:41 AM

  • RFBIBL00 Flat File Creation issue

    Hello All,
    I'm using "RFBIBL00" to post the FI documents, and the input to the FB01 transaction screen is obtained from a flat file from AL11 directory.
    The issue here is regarding the date format of the Document date and Posting date. If the date format is as YYYYMMDD in the flat file, and if I'm using the date parameter (in the default option of one's SAP own data) other than starting with YYYY, the document is not getting posted and it is throwing error saying that date format is not correct. If I have chosen the date format starting with YYYY, then the document is getting posted successfully.
    Any suggestions/ideas to make the date format as independent?
    Thanks,
    Bharath.

    Hi Bharath
    I think you'll have to use the appropriate conversion exit for the same. Choose from the below options which suit you.
    SAP Internal format is 'YYYYMMDD' Example: '19990123'
    1. CONVERT_DATE_TO_EXTERNAL
    2. CONVERT_DATE_TO_INTERNAL
    3. CONVERSION_EXIT_PDATE_INPUT Conversion Exit for Domain GBDAT: DD/MM/YYYY -> YYYYMMDD
    4. CONVERSION_EXIT_PDATE_OUTPUT Conversion Exit for Domain GBDAT: YYYYMMDD -> DD/MM/YYYY
    5. CONVERSION_EXIT_IDATE_INPUT External date INPUT conversion exit
    6. CONVERSION_EXIT_IDATE_OUTPUT External date OUTPUT conversion exit
    7. CONVERSION_EXIT_LDATE_OUTPUT Internal date OUTPUT conversion exit (e.g. YYYYMMDD)
    8. CONVERSION_EXIT_SDATE_INPUT External date (e.g. 01.JAN.1994) INPUT conversion exit
    9. CONVERSION_EXIT_SDATE_OUTPUT Internal date OUTPUT conversion exit (e.g. YYYYMMDD)
    The date coming in from the flat file will certainly tick to one particular format i guess.
    Hope this helps.
    Harsh

Maybe you are looking for

  • View in edit window not getting updatet properly

    Hello I have some problems with the view in the edit window not getting updatet correctly. I noticed this in spectral view. For example, when I zoom in very much, so I only see about 3 seconds of audio and then select one second of audio and do a tim

  • Bluetooth Pairing with Microsoft Sync - Motorola Droid Razr Maxx HD

    After the upgrade of my father-in-law's phone to KitKat (v 4.4.2) the bluetooth pairing to his Microsoft Sync in a 2013 Ford Explorer no longer works right. After deleting the pairing on the vehicle and then repairing, the contacts do not copy over.

  • Print to PDF from within Acrobat Pro X

    I keep reading threads here and there about users having the same issues that I'm having with Acrobat Pro X... I used to be able to print a portion of a PDF file to create another PDF... I see a lot of answers like SAVE AS and EXTRACTing pages... Whi

  • PDF open problem

    unable to open PDF - have to save to word, then open with DF Vista - worked two weeks ago.  have installed adobe and reader again but did no good.  suggestions?

  • Disable Driver Enforcement for Virtual Audio Cable?

    Hi, I'm trying to get this thing called "Virtual Audio Cable" Working, but It is apparently not signed, so I cant even use it. Is there a fix to this? I've tried to use bcdedit -set. I have tried to use DSEO Too, but I dont know what file it wants me