Item Import effeciency pointers
I will be looking to load around approximately 30 million (200000 items X 150 Inventory Organizations) items into Items table. Any one of you have been involved in huge load into Item tables please share your experiences, any tricks/methods you adopted, any new indexes you built to make the whole effort more effective and trouble free. By any chance does Item Import program has any in-built parallel workers working for it?
I am sharing couple of things which worked for me before and feel free to comment or to add more.
What is the optimum load/batch? Usually 5000 items takes 15-20mts and I treat this as optimum load. Please let me know if you have a better number.
By not letting the item import program delete the records from Interface table, Item import completes faster. I think this will cut down at least 2-3 minutes for each batch.
I greatly appreciate your pointers in making Item load faster.
We converted about 100000 items for 68 organizations (including one master). The whole import consistently finished (we did trial runs about 10 times) in 6 to 7 hours.
1. Mistakes make your import to run longer. Wrong data leads to longer validations and hence adds to import time. Then again you need to spend time on correcting them again.
1.1 We assigned process_id in the staging table and wrote a wrapper program that kicks off the item import with correct parameters (process_IDs). Manually submitting can lead to mistakes.
2. First we load into the master all items. Assign a set_process_id for 5000 (idle batch as you said) and run the item import for all the processes (so you will be running 200000/5000 which is about 40 concurrent requests at the same time).
3. Purging interface table is OK as long as you gather stats on the table continuously. In fact this strategy helped us more than keeping the records in the interface table.
4. We did not have all 100000 items to be assigned to 67 child organizations. Some of them had much fewer than that some same number.
5. So depending on that we run for some number organizations at the same time lie say 10 child organization rows at the same time.
6. Over the period of time we corrected the mistakes in data (master child attribute differences, conflicts between attribute values and so on).
7. Obviously you need a strong functional resource to understand the data issues to recommend the data corrections. More number of applications more attributes used,hence more issues.
8. Consistently gather status on entire INV, IBE, EGO schemas.
9. Plan server resources carefully. Allocate as many computing resource as you can when you are converting items.
10. Understand all attributes well and inter and intra dependency between them. You can avoid time taken by pre validating them (using oracle APIS). You can take a cue from database package INVPOPIF.inopinp_OI_process_create or inv_item_grp.create_item.
11.Understand the process flag number and the stages where they error out. Again the same database package can help you in that.
Finally have a good book or a movie while you kick off as it is going to be a loooong process :)
HTH.
Thanks
Nagamohan
Similar Messages
-
Oracle Open interface- Error in Item Import (INCOIN)
Hi,
I am migrating items to oracle using oracle open interface.
I am getting the follwing errors.
1. The TEMPLATE_ID or TEMPLATE_NAME specified is not valid for this Organization
2. The revision entered is for an item that does not exist in MTL_SYSTEM_ITEMS nor MTL_SYSTEM_ITEMS_INTERFACE (No Revision Is Used)
3. Expense Account is required when Inventory Asset Value is "No" and Inventory Item is "Yes"
4. Item number is invalid.
EBS: 11.5.10
The Migratin was working fine in the previous instance. Pls let me know if you have any information on this.
Thanks
AMHi,
Please see these docs.
INCOIN: Error Message Template_ID or Template Name Specified is not a Valid Template When Item Catalog ID is NULL during Item Import in UPDATE Mode [ID 1076193.1]
Item Import: What Does "Sync" Items Do? [ID 417887.1]
INCOIN Gets INV_TEMPLATE_ERROR After Patch Applied [ID 141579.1]
Item Open Interface (INCOIN/IOI) Setup and How-To [ID 115557.1]
Understanding Item Import and Debugging Problems with Item Import [ID 268968.1]
Thanks,
Hussein -
Item Import - completes with " Completed Error" status and process_flag=4
I am trying to Import Item through Open Interface.
RDBMS : 9.2.0.5.0
Oracle Applications : 11.5.10
Populated data into mtl_system_items_interface with process_flag = 1.
Once I run the "Item Import" program it completes with error, with the following in the log file.
The records are updated with process_flag = 4. but there are no error details in mtl_interface_errors for those corresponding records in the interface table.
How do I identify the error ?
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Inventory: Version : 11.5.0 - Development
Copyright (c) 1979, 1999, Oracle Corporation. All rights reserved.
INCOIN module: Import Items
Current system time is 07-SEP-2010 11:39:11
Page Length = 93, Page Width = 132
===================================================================
Debug Mode : Enabled
Output to Terminal : No
Argument Method : Database Fetch
Trace Mode : Disabled
===================================================================
Argument 1 (ORG_ID) = 174
Argument 2 (ALL_ORG) = 1
Argument 3 (VAL_ITEM_FLAG) = 1
Argument 4 (PRO_ITEM_FLAG) = 1
Argument 5 (DEL_REC_FLAG) = 1
Argument 6 (PROCESS_SET) = 11
Argument 7 (CREATE_UPDATE) = 1
===================================================================
Item Catalog Group Descriptive Elements Open Interface import completed successfully for all records in this record set.
Item Catalog Group Descriptive Elements Open Interface import completed successfully for all records in this record set.
Start of log messages from FND_FILE
End of log messages from FND_FILE
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Found a few Packages related to Item revision , were in Invalid status.
Compiled them all and now the items are getting imported without any issue.
Thanks Sandeep for your word. -
Open Item Import fails with a process_flag = -999 or -888
Problem description
============
The Open Item Import fails with a process_flag = -999 in
mtl_system_items_interface. This keeps the item from being imported into
mtl_system_items. The process_flag has to be set back to 1 to have the row(s)
reprocessed.
Solution
======
UPDATE mtl_system_items_interface
set transaction_type='CREATE'
where transaction_type=<'>
Commit;
Re run the Item Import it should go fine.
Regards,
MehboobHi,
It looks like you have posted the same in below thread.
Item Import completed with Process_Flag = 31, 41 and 42
Any way if you have problem you can refer to below metalink notes.
NOTE:103869.1 - Item Attribute vs Template Attributes Using IOI
NOTE:106812.1 - Instructions for Running Item Open Import (IOI) Including Historical Revision Da
NOTE:109628.1 - FAQ for Item Import
NOTE:268968.1 - Understanding Item Import and Debugging Problems with Item Import
NOTE:458544.1 - Inventory Item Open Interface ITAR Template
NOTE:52746.1 - A Guideline to IOI Error Messages and Solutions
Thanks
Vishalaksha -
How to use XML Gateway for Order Import and Item Import?
Hello XML gurus,
I'm working in Oracle Apps area and do not have much knowledge on XML or web programming. Currently in my project there is a need to use Order Import and Item Import using interface tables and XML Gateway. The items/orders information will be in the XML format from Siebel system, there will be no custom processing...just process the data as-is.
I've read the XML Gateway user guide but did not understand much.
Anyone with similar implementation experience?
I'm looking for a step-by-step guide on what needs to be done in Oracle Apps side to populate the interface tables from XML file and call the import APIs?
Your inputs, suggestions, tips are highly appreciated. :)
Thx,
JagsI have a similar requirement to automate the order import and was looking at XML Gateway. Please update if you were able to find more information.
- Ayyappa -
Item Import program sets process_flag to 30000/60000
The Oracle Manufacturing Import Items program adds and subtracts 30000 or 60000 to the process_flag value as part of its processing, regardless of the fact that the data had been inserted by third party application with a process_flag value of 0 (inactive), that is, the third party import program had not yet set the process_flag to 1 (pending).
This issue is coming after upgrade to 11.5.10.
Please let me know if you have encountered this issue or have seen it in metalink/web?Item Import - PROCESS_FLAG= -888 or -999
Problem description
============
The Open Item Import fails with a process_flag = -999 in
mtl_system_items_interface. This keeps the item from being imported into
mtl_system_items. The process_flag has to be set back to 1 to have the row(s)
reprocessed.
Solution
======
UPDATE mtl_system_items_interface
set transaction_type='CREATE'
where transaction_type=<'Your Current value which is not CREATE'>
Commit;
Re run the Item Import it should go fine.
Regards,
Mehboob -
Hi
I'm running the import items program to update the existing item in inventory. For that it is throwing some error when the record move from interface table to inventory base table. See below error message.
TRANSACTION ID : 203532465
ORGANIZATION ID : 3895
TABLE NAME : MTL_SYSTEM_ITEMS_INTERFACE
COLUMN NAME : MASTER_CHILD_4F
MESSAGE NAME : INV_IOI_MASTER_CHILD_4F
ERROR MESSAGE : Master - Child Conflict in one of these Attributes: Pick Components(PICK_COMPONENTS_FLAG), Assemble To Order(REPLENISH_TO_ORDER_FLAG), Base Model(BASE_ITEM_ID), ATP Components(ATP_COMPONENTS_FLAG), Check ATP(ATP_FLAG), Fixed(FIXED_LEAD_TIME
Can anyone give the solutuion for this?
ThanksHi,
Please review the following documents and see if it helps.
Note: 142697.1 - IOI PROCESS: Error Master - Child Conflict in One of These Attributes
https://metalink2.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=142697.1
Note: 208715.1 - Item Import Errors When Loading Into Child Organizations
https://metalink2.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=208715.1
Note: 360542.1 - Import Price Catalog Errors with Master/ Child Conflict on the UOM when Importing Item
https://metalink2.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=360542.1
Regards,
Hussein -
Can Item Import handle default subinventory/locator
Hi,
I have developed Item Conversion in my project, now there is one additional requirement to add default sub inventory/locator with the item during item migration. I have doubt that Item import will linked default sub inventory/locator with the item.
I have studied and found that we need to go to Setup->Transactions->Item Transaction Defaults, and when item is linked to default sub inventory/locator with the help of this screen, it updates tables MTL_ITEM_SUB_DEFAULTS, and MTL_ITEM_LOC_DEFAULTS for that item.
Now my question is that, if I get these two fields in Item data template and need to insert these two during item migration, how is this possible?
I know there will be many suggestions, Please share ur views with me.
Thanks and Regards,
NidhiNidhi,
Item import cannot handle this. Also there are no public APIs available for this. For subinventory defaults you can use NV_ITEM_SUB_DEFAULT_PKG (we used and found no issues). You can write a simple wrapper to validate information passed to this.
For locator defaults there no database package found at all. Entire insert happens from the form itself. It is just another simple insert like the above into MTL_ITEM_LOC_DEFAULTS table. So you can explore your options.
Thanks
Nagamohan -
Documentation on item import R12 PIM
Does anyone have any documentation on the R12 PIM item import through excel? I neeed to figure out how the tables are populated when the New Item Request and Change order functionality is setup.
I'm not finding much info on metalink, maybe I'm not searching right, is anyoen aware of any metalink numbers for this info.
please let me know
thanks
satyaThank, we will take a look at those articles.
Gather stats error:
In GATHER_SCHEMA_STATS , schema_name= ALL percent= 30 degree = 8 internal_flag= NOBACKUP
stats on table AQ$_WF_CONTROL_P is locked
stats on table FND_CP_GSM_IPC_AQTBL is locked
stats on table FND_SOA_JMS_IN is locked
stats on table FND_SOA_JMS_OUT is locked
Error #1: ERROR: While GATHER_TABLE_STATS:
object_name=GL.JE_BE_LINE_TYPE_MAP***ORA-20001: invalid column name or duplicate columns/column groups/expressions in method_opt***
Error #2: ERROR: While GATHER_TABLE_STATS:
object_name=GL.JE_BE_LOGS***ORA-20001: invalid column name or duplicate columns/column groups/expressions in method_opt***
Error #3: ERROR: While GATHER_TABLE_STATS:
object_name=GL.JE_BE_VAT_REP_RULES***ORA-20001: invalid column name or duplicate columns/column groups/expressions in method_opt*** -
Dear All,
I need Item Import open interface code, can any body help me?
Regards,
Hanimi.Hanimi
It is very specific to your needs. Basic code can be taken from Metalink Note: 115557.1. You can modify that based on your needs. Also you can read up charpter 14 of the supply chain management APIs and interface guide for clear instructions.
Thanks
Nagamohan -
PRIMARY_UOM_CODE Error while trying to do bulk item import in Fusion applications
Hi,
I am trying item bulk import in fusion applications version 11.1.5. However I am getting the followin error message on submitting the Item Import process :
Import completed with error or warning. Import errors or warnings are.
PRIMARY_UOM_CODE - The value of the attribute Primary Unit of Measure is not valid.
Any idea what could be this issue? We have the Basic UOM code setup and a UOM class is also defined for the same. In my insert script I am specifying the UOM_CODE = 'Ea' as defined in my system.
Is there any other setup that we are missing here?
RegardsSorry for the delay. Based on some notes in our system there was an enhancement to introduce new field (PRIMARY_UOM_NAME) for import representing the human readable UOM. It was slated as a feature for Release 5 of Fusion, however I am not quite sure if it made Release 5, the column is there in Release 6 ..
Jani Rautiainen
Fusion Applications Developer Relations
https://blogs.oracle.com/fadevrel/ -
We recieve a warning in item import saying the item code is invalid in MTL_SYSTEM_ITEMS_INTERFACE.
Process flag for these items in MTL_SYSTEM_ITEMS_INTERFACE is 4, process flag for these
items in mtl_item_catogries_interface is 3, in mtl_interface_errors :
message_name = 'inv_icoi_invalid_item_number', column_name='item_number', and
error_message = 'Item number INT_19 is invalid'.
Note that in another instance process worked correctly.
Can Anybody help on this issue.
ThanksHi Sandeep,
I have encountered the similar problem some time back.
To what I remember, I had opened the description of the message which had led me to the customizing entry. After maintaining that entry in the customizing, I could get rid of the message.
I am not able to recollect exactly what I have done, would you help me with the message number.
Best regards,
Harsha -
Item Import similar set process ID
Hi All,
I am working on Oracle Applications 11.5.10
While running item import program for a set_process_id, the program ( standard item import) picked the records for similar set process ID too.
For eg, I submitted Item import for set_process_id 1234. Item import picked up unprocessed records for set_process_id 10000001234 and processed them. I got to know about this, since the records for set_process_id 10000001234 erred.
Not sure is anyone else has encountered this error or not . Wanted to know if this is a common behavior ??? If yes then is there anyway this can be avoided ?Hi Sandeep,
Can you please tell why is the set_process_id column updated by Oracle?
I am inserting records into interface table with set_process_id = -9990 but this value is modified by oracle when i run "Item Import" program.
Because of this, i am unable to distinguish between the records which i inserted into interface and the existing records.
I need to distinguish my records and send error report to the user. Is there any way to do this?
Regards,
Sreekanth -
Hi,
In the item import to B1 using DTW or Excel import through B-One Application how to specify excisable or not.
Thanks and Regards,
S.G.SekarHello,
In SAP we can not import excise info of Item Master as well business partner it is the manual activity after import all item and party
master in SAP by DTW.
Thanks
Manvendra Singh Niranjan -
ESYU: Item Import 실행시 'Sync Items' option의 의미는?
Purpose
Item Master - Version: 11.5.10
Information in this document applies to any platform.
EXECUTABLE:INCOIN - Import Items
Item Import concurrent에서 "Sync Items"는 무엇을 하는 것인가?
Import Items program을 실행시 "Create or Update Items" 라는 parameter가 있다.
1은 'Create', 2는 'Update', 3은 'Sync Items' 인데 3 option은 무엇인가?
Solution
Item이 존재하지 않을때 item을 create 하거나 item이 존재하지만 item을 update 할 때 'SYNC' transaction type을 이용할 수 있다.
예를 들면,
Item이 존재하지 않아 item을 생성할 경우..
insert into mtl_system_items_interface
(process_flag, set_process_id, transaction_type,organization_id,segment1,
description,template_name)
values
(1,1,'SYNC',204,'sync_item', 'Testing through the interface','Finished Good');
Item이 이미 존재할 때 transactable flag를 update 하는 경우..
insert into mtl_system_items_interface
(process_flag, set_process_id, transaction_type,organization_id,segment1,
description,MTL_TRANSACTIONS_ENABLED_FLAG)
values
(1,1,'SYNC',204,'sync_item', 'Testing through the interface ','N');
Reference
Note 417887.1
Maybe you are looking for
-
How does Adobe ExportPDF differ from the export feature in Adobe Acrobat Pro 9.0?
How does Adobe ExportPDF differ from the export feature in Adobe Acrobat Pro 9.0?
-
Audio file "06f9bF1 M.wav" not found!
Hi im new to the forums so please help When i select certain midi instruments within Logic Express 9 i get the above message depending on the instrument. Any ideas why i cant access these instruments?
-
Everything apart from one MBP can see my AppleTV?
I have a Time Capsule as my WiFi router and an AppleTV connected on Ethernet. My MBP can stream to the ATV whether it is on Ethernet or WiFi. My iPhone AirPlays to it happily over WiFi. However, my house mate's MBP iTunes refuses to see the ATV re
-
hello, I want to add Image related to particular file to cell of the JTable, I already have name of the file in cell but want to display file or directory name with its related icon. i am using TableCellRenderer ,but don't know how to keep both filen
-
Hi I have a printer hp photoshop 5510 was working perfect and yesterday I was trying to print and it is not working at all.showing me information--Unable to communicate with printer!! so I have checked everything .like wifi connection ,IP address ,s