Import Server problem
Hello,
in the last days we experience some strange phenomena with the Import Server. For example, I created an XML import mapping for the standard repository "Material", created a port in the console and used the mapping there. Manual execution of the mapping worked fine. I dumped the file in the correspondent Ready-folder and the Import Server swallowed the file and progressed it.
So far so good.
I did this again, no problem. I tried a different file and got error messages, because the file format didn't match. But the Import Server still swallowed the file. Then I tried a larger file like the first one (the first one was just a 10-records-test), but no reaction. The Import Server did not swallow the file.
I read this thread: , stopped and started the MDM Server and the Import Server several times and then dumped files again - same result, even with the file with which it worked before.
I created a new mapping on Repository "Vendor" like the one on "Material", for the same file, no reaction. The Import Server seems to be sleeping.
Anyone faced a similar situation before? Any suggestions what I could do to resolve the problem?
Best regards,
Jörg
Message was edited by: Jörg Thiesmann
Some additional information on my problem:
The second file read the following error once for each record I wanted to read:
So there IS only one root element. The test file with which it worked before has exactly the same start/end.
This was the last logfile.
Message was edited by: Jörg Thiesmann
Similar Messages
-
When i am importing the delimiter text data file manually with import manager(by both port method & delimiter file), 1116 records are getting imported, but when i do import server automation with same file & Map only 130 records are getting imported in to repository.
Details of server.
SAP MDM 7.1.04.122 (SP4)
Observations
1. In sap MDM console when i see port details, the status of port is : HAS exception.
2. In Exception folder log is created in ImportX subfolder.
3.in log folder, in files i could see most of lines as
<Failure ts="2010/04/01 12:43:26.084 GMT" tid="4184" entry-no="39" operation="Import" import-action="Create" row="1">One or more field values are invalid</Failure>
Did anyone faced the similar issue, or did i do any mistake or missed any step...Hi Srinivas,
As you said that status of your import Exception is Empty once you delete all the records from Exception folders.
But when you again import records through MDIS all records are not getting imported. right?
I feel that it could be also possible that saved map which you are using into Port may have missed field/values.
So, I would suggest please go for this step by step and let me know if you face any issue.
1st step: Open this file using Import manager Type = Delimited text, select your Remote System and Delimiter as per your requirement. Map all your Fields and Values. Make sure that all your desired fields and their values are mapped correctly.
Now in the last come to import status and check that Action items: Ready to import . Don't import records here but save this map File-->Save As->Give Map name say MAP1 and then close your import manager.
2nd Step: Put this file into Ready folder and make sure that you MDIS services is stopped so that you can open this same file using MDM Import Manager Type = Port and select you required Remote system which you defined in MDM Console while defining Port and make sure that this port in console also contain the same map MAP1. Also make sure that you put same Delimiter Correctly in port as you put during mdm import manager.
check the status of Import into Import status Tab as Action items: Ready to import or not. It should have Action Items: Ready to import if not then map the missing values/fields and then Go to File-->Save.
Now Run your MDIS Services, and put this same file into your ready folder. This should import all of your records into MDM and i feel this will solve your Problem with MDIS.
Revert with result.
Regards,
Mandeep Saini -
Import Manager - Problem with 0..n field in Import Manager
Iu2019m having problems with XMLs that contain multiple or single tags in MDIS process. For example: I did the map using a XML with multiple tags for Address:
<address>
<item>
u2026
</item>
<item>
u2026
</item>
</address>
When I send two address or more Address, the Import Server work fine, but when I send only one Address, the address is not imported.
<address>
<item>
</item>
<item>
</item>
</address>
Opening the xml file with only one Address in Import Manager, I saw that the fields isnu2019t mapped, but when I open a xml file with multiple Address itu2019s open correctly.
The XSD cardinality for the Address\Item is 0..nHi Evandro ,
If it is processing the input file correctly through the Manul Import manager process then update your latest Map by using SAVE As option or else save this correct map with a new name altogether and use this new map in the port for automatic importing.
If your file is able to process correctly through the Import manager without showing any errors till the Import step in the Import manager then this map must be correct and shoul automate the importing correctly.
Provided you are using the similar file for automatic importing as well.The file name and the fields as well as the value mapping as saved in this corrected map must not differ with the input file else this saved map will not be able to import correctly.
Check to see if you have made correct setting for automatic importing by refering the below link:
http://help.sap.com/saphelp_mdm550/helpdata/en/43/12036df94c3e92e10000000a1553f6/frameset.htm (Automatic importing MDIS - Import manager ref guide>MDM import server(MDIS)>MDIS Consfiguration)
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/8973bcaf-0801-0010-b7a7-f6af6b1df00e(mdm import and syndication server)
Also check the exception folders if your import is not taking place automatically:
http://help.sap.com/saphelp_mdm550/helpdata/en/43/12036df94c3e92e10000000a1553f6/frameset.htm (Exceptions- MDM Import Manager MDIS-Exception handling)
Hope It Helped
Thanks & Regards
Simona Pinto -
Map including spliting operation dosen't work in MDM Import Server
Hi All,
I met a problem with MDM Import Server when using a map file with spliting operation in it, although I can use it in MDM import manager to load data successfully. The error in log file is like this:
Record Matching...
Importing Lookup...
One or more attribute values are invalid.
One or more attribute values are invalid.
One or more attribute values are invalid.
One or more attribute values are invalid.
Import Failed!
The spliting in my map is: I split field "Category" into category1 and category2 with space " ". e.g. value "Trousers M" is splitted into "Trousers" and "M" . Then I map category1 to category and category2 to size.
I tried to delete this spliting and just map "Category" to "Category" then it works well for Import Server.
Is it the bug of MDM import server? can anyone give me a explaination?
Thanks! BinUnder Configuration Options of the Import Manager,
check the values for
<b>Default Batch Handling</b>
AutoMap Unmapped Values = Yes
Unmapped value Handling = Add/Ignore/Fail.
Set the values according to your needs.
Make sure that the data source is updatable as well. -
MDM Import Server after error in import file
We setup Import Server and it processed a few files. then we tested what happens when there is an error. it logged a file to LOG folder. but would not start picking up new files we dropped in the READY folder. We removed the file with an error but still nothing; we fixed the error and put the file back and still nothing; we stopped and restarted the server, reposititory and import server but still nothing. Any ideas how we "reset" import server so it will start to process files again ? thanks
Hi Jay
I have faced the similar problem; have done some turn around to make things work, it may not be permanent solution. I have cleared the folders LOG,EXCEPTION(StructuralX), STATUS by copying the files to someother location for future reference and it worked.
Please feel free to revert to me for further clarifications.
thanks
Alexander
Note:Please mark the helpful answers. -
Hi ,
I have a scenario where PI is sending data to MDM inbound port which is automaticaly getting imported to MDM .
Now problem is PI is succesfully sending data but file is not coming to Inbond port.
PI side all the configuration is fine .
Through Import amanger its working fine.
Kindly help me out .
Thanks in advance.
Regards,
Neethu JoyHi Neethu,
it seems problem at PI level because as you said file not coming in MDM inbound port.
To check MDM import server working or not just put file in MDM inbound port manually and check wether file processing automatically or not.
if PI sending file to to inbound port then you need to check port in MDM console and configuration parameter such as remote system, map , file format, processing time, file aggregation count etc.
Kindly check and revert back.
Thanks,
Jignesh Patel -
"Source file does not conform to XML Schema!" error at Import Server
Dear SDN,
When I run Import Server the import job stopped with the error "Source file does not conform to XML Schema!" in Log file. I used MDM SP05 Patch01 and HF1.
Both of 2 Import Server have same problems. Of course it works in Import Manager.
What do I have to check?
Regards,
EricHi Eric
Just confirm this...
One needs to load XML schema file in MDM and can be done by specifying this file in Port .
Refer this link.
http://help.sap.com/saphelp_mdm550/helpdata/en/fa/69b20ae0ae4b158a3f6d025b3d3847/content.htm
Just make sure that corresponding XSD file is specified in the port
Regards -
Import server: Undefined elements exception
Hi,
I do have a problem with the import server. I get ,'save-update map' structural exceptions in the import server. It complains about undefined elements, and if saved the update it works for one single XML file but other still fail with similar (other element though) error. Mapping the files in the import manager just works. We are using version 5.5.41.70 here of all components. I noticed a thread which explains about sp5 patch 01, hotfix 1, which fixes this, but we're having that one already.
I did validate the xml already against the xsd used, the xml is valid.
Error from logfile is:
"Some portions of this import map are out of date.<LF/>Solution: Please, Launch the Import Manager GUI, preferably using the original source file that the map was generated for, otherwise the same source file and Save Update [File->Save Update] the map.<LF/> Parent hierarchy: <E1MARAM>.<LF/> Undefined element: <EKWSL>. ".
Thanks,
WimHi Wim,
it looks like that your Import Map does not have all IDoc fields mapped to the corresponding repository fields. If you map the fields in Import Manager and choose the Save->Update option, IM adds the new mapping to the old existing one. But of course it is still possible that there are other unmapped IDoc elements which need to be mapped once manually before the Import Server can process the file automatically. The best way to solve this is creating a "Dummy" IDoc file that contains a value for each and every field. Then use this "Dummy" IDoc in Import Manager, load the Map and check the mappings. You can add/delete mappings according to your expected real data. Save->Update once again and you should not into the issue any longer.
Best regards
Michael -
Import Server - Multiple Qualified Table - Map Crash
Hello,
Requirement: I need to update multiple qualified table using single source file.
Preparation: I have created a map where mapping to multiple qualified table fields maually.
Have created a Inbound Port using the above map.
Problem: Import server throws an exception; while opening the Import Manager using the Port Option and corresponding Exception; Lot of fields were un-mapped. Looks like Import map crashed.
Please feel free to throw some light reg the same!
Thanks
AlexanderHi Alexander,
If you are performing multiple qualifier table mapping and importing then you will hav eto create differnt map for each table importing.In that case you will rrquire multiple inbound ports and in each ports deatils you will give the map name pertaining to which qualified lookup table you wish to import.
Actually using automatic importing for lookups is not desirable as the lookups always need to be prepopulated before your main table importing.
The exception taht you are receiving could be due to the reason that the map you are saving is using only one table mapping and so most of the fields are left unmapped.
try not to use automatic importing for Lookup qualifier tables and use manual importing and see if the the exception still comes.
Hope it helps
Kindly reaward points if found useful
Thanks
Simona -
Hi All
We have very strange problem on our test environment. The problem is with Import Manager. All maps set up t oautomatisk on test server have structructural error, however when I use exactly that same map on manual then all is fine. Each error cause the port to block, but on manual import all is fine.
Did you experianced something like that, We are about to install SP6 on the test env. do you know if that can help?
We have MDM 7.1 SP5 now. Servers are 64.
Thank you for help with that strange problem.
BR
RafalRafal -
1. Check whether your schema which you are using in the specific port is same as the structure of the XML file placed in the
ready folder. structural error occur even if the schema is not matching.
2. Also make sure your import server is running properly. try restart after setting of ports
3. ensure that the root set in mds.ini. is the root of distribution directory where Ready folder resides
also check the below link for similar issue
Structural Exception thrown during Automatic Import in MDM
hth
thx
Deep -
Hi All,
If we use Import Server on the Port of a repository, we need to specify a map that can be run on the Port in Console.
But can I run multiple maps on the same file using the Import Server? If yes, how can it be done?
How can we raise an event whenever a file is dumped into a directory? I am using Import Manager batch and I want to schedule the batch process whenever a file gets dumped to a particular folder.
Thanks in advance.
Pooja.Hi Subbu,
Thanks for providing me the code. But I am still facing a problem. I have modified my code as below -
import java.io.File;
import java.lang.*;
public class DirMonitor
static final String DIR_PATH = "<Valid path>";
static final int PING_PERIOD = 3000;
public static void main(String[] args) throws Exception
File dir = new File(DIR_PATH);
while (true)
String[] filelist = dir.list();
if(filelist!=null)
System.out.println("No.of Files found are:" + filelist.length);
Runtime rt = Runtime.getRuntime();
Process p = rt.exec("<Complete path to the batch file>");
System.out.println("Check");
p.waitFor();
System.out.println("Next Check");
try
System.out.println("Waiting.....");
Thread.sleep(PING_PERIOD);
System.out.println("Waiting Complete...");
catch (Exception e) {}
As soon as I am running this program, It runs well till System.out.println("Check");.
But it stops to process further on "p.waitFor()" statement.
Looks like the process does not terminate. I don't know why?
I doubt wheteher the batch file is running or not, as I don't see the batch file running on the command prompt.
Note: My batch file is running fine when I am trying to run it manually.
Can you please suggest what could be the problem?
Regards,
Pooja -
Hi All ,
We are using import server for importing records into MDM.
In our scenarios ,we are using mulitiple ports & depending on condition, files/records are dropped into particular port.
For Eg. There 3 ports say .. Port1 , Port 2 , Port3 . Files are dropped into ready folders of these port thro' XI.
Now when import server starts , files are imported from Port1 , then from Port2 , & lastly from Port3.
But Business scenario requires , file to be imported from Port3 first , after that Port1 & Port 2 resp.
Does anybody know how to do it using import server?
We dont want to use import batch .
Thanks ,
NileshHi Nilesh,
Could you please change the sequence of the Ports in the Port table, the way you
want to Import the informations...and do run the scenario...
please feel free to revert to me if things doesn't workk...
thanks
Alexander
P.S. Kindly reward the points, if found problem solved..
Hey sorry guys my solution pretty similar since I have posted almost on the same time....
Message was edited by: Alexander Raja
Alexander Raja -
Import Server doesn't pick up file
Hello
I am trying to import vendor xml file
I put in the right directory but the server doesn't pick up the file
the service is started
the port/mapping/system config in mdm console has been done
the mdis.ini looks like that :
[GLOBAL]
String Resource Dir=D:\PROGRA1\SAPMDM1.5\IMPORT~1\LangStrings\
Log Dir=D:\PROGRA1\SAPMDM1.5\IMPORT~1\Logs
Version=5560
Server=xxx
Interval=5
Automap Unmapped Value=True
Unmapped Value Handling=Add
Always Use Unmapped Value Handling=False
VXR_MAX=25000
Verbose=0xFFFF
-- Verbose OFF: 0x0000
-- Verbose ON: 0xFFFF
-- FI Verbose: 0x0001
-- XML Verbose: 0x0002
-- MAP Verbose: 0x0004
-- THRD Verbose: 0x0008
-- PARSER Verbose: 0x0010
-- STRUCTX Verbose: 0x0020
-- VALUEX Verbose: 0x0040
-- IMPORTX Verbose: 0x0080
String Resource Dir=C:PROGRA1SAPMDM1.5IMPORT~2LangStrings
Log Dir=Logs
SLD Registration=False
Wily Instrumentation=False
NCS Library Path=D:\PROGRA1\SAPMDM1.5\IMPORT~1\
Wily Instrumentation Level=1
MapScanTopToBottom=False
[CustomersLOCALHOSTMSQL_9_9_4_3]
Chunk Size=50000
No. Of Chunks Proccessed In Parallel=5
Login=Admin
PasswordE=KA9FPAOJG0BK7
Log Protocol Transactions=False
[VendorsLOCALHOSTMSQL_7_9_4_3]
Chunk Size=50000
No. Of Chunks Proccessed In Parallel=5
Login=Admin
PasswordE=KA9FPAOJG0BK7
Log Protocol Transactions=False
what should be the file name in the directory ? could this be the problem ?Hi Kaushik,
For picking up the file file ready folder you need to do the following steps:
1) Creation of users and assinging password to the users.
2) Creation of maps in import manager for importing the data.
3) Creation of ports. In this you have to mention map name which you have made for importing the data, format of the file present in ready folder and your processing type as automatic.
4) Mention user name and password in the MDIS.ini file. Also mention the time interval.Save this file.
Now you can find that import server is picking up the data from ready folder.
If you are still facing some problems please go through this URL: [http://help.sap.com/saphelp_mdm550/helpdata/en/19/d4301589b54841af17e7c42b4cee49/content.htm]
Hope I am able to solve your problem
Regards
Dilmit Chadha -
Differ between import manager and import server
Hi to all,
Can any one explain difference between import server and import manager and how the data will be imported to the same.
Regards
MMHi reddy,
Can any one explain difference between import server and import manager and how the data will be imported to the same
Please follow the text below, which has been taken from the help.sap.com
Both MDIS and the MDM Import Manager can import data from a source file into an MDM repository. However, each has unique capabilities that distinguish it from the other. When each is used to its advantage, the result is an import strategy which provides the most efficient importing of data possible.
The strength of the Import Manager is its connection to the source data, which enables its interactive map-making capabilities. When the Import Manager connects to a source it preloads the entire source file, giving it knowledge of every field and every value in the source data. This u201Ctotal awarenessu201D is crucial for preparing a complete import map. To help ensure a map is complete, the Import Manageru2019s Import Status tab alerts users to any discrepancies between source data values and the current map. The user can fix these problems interactively within the Import Manager and save the corrected map before any data is imported.
Preloading an entire source file comes at a price, however. It consumes memory on the computer running the Import Manager and very large source files may exhaust the computeru2019s available memory.
By contrast, MDISu2019s strengths are its scalability and automation.
For scalability, instead of preloading the entire source file into the host machineu2019s memory as the Import Manager does, MDIS processes records in a stream by loading a record at a time into memory.
This streaming technique enables MDIS to process much larger source files than the Import Manager, as the demand for memory on the host machine is not affected by the size of the import file.
In addition to file size, file quantity poses a second scalability challenge. For example, a real-time transactional environment may produce a staggering number of files, each containing only one or two records. To import these files individually through Import Manager would be extremely inefficient. MDIS tackles this problem with a file aggregation feature that processes files systematically in batches rather than as individual files, resulting in faster, more efficient import of data.
As it relates to automation, MDIS requires no user intervention to import files to an MDM repository. Instead, it relies on maps created previously within the Import Manager. Once an import file is placed in the appropriate folder, its data is imported automatically into the MDM repository using the rules of the pre-defined import map. Once a file is processed, MDIS scans the repository for the next file to import. This process continues 24 hours a day, seven days a week, until either MDIS or MDM Server are stopped.
The trade-off for this scalability and automation is that if discrepancies between the source data and the import map arise, MDIS cannot u201Cfixu201D these problems by itself. Instead, the u201Cproblem casesu201D can be fixed manually at a later time using the interactive capabilities of the Import Manager. Unlike the Import Manager, however, MDIS can set aside problem records or files and continue importing.
These conceptual and operational differences between the Import Manager and MDIS are summarized in the table below.
Item
Import Manager
MDIS
Source file location
Anywhere
Automatic inbound port
Import process
Interactive
Automatic
Import map state
Editable
Read-only
Object loaded in memory
Entire import file
Individual records
Streaming import support
No
Yes
File aggregation support
No
Yes
Maximum import file size
Limited (50,000 records)
Unlimited
Status location
Import Status Tab
MDM Console/Report file
Error correction prior to import
Yes
No
Exception handling during import
No
Yes
For additional info, kindly refer the link below:
http://help.sap.com/saphelp_mdm550/helpdata/en/43/12036df94c3e92e10000000a1553f6/frameset.htm
GO to-> MDM import Server
Hope it helps.
Thanks and Regards
Nitin Jain -
Hi
Have anyone knows how many Desktops an Import Server Supports ?
Thks in advance
RodrigoRzarraga,
It appears that in the past few days you have not received a response to your
posting. That concerns us, and has triggered this automated reply.
Has your problem been resolved? If not, you might try one of the following options:
- Do a search of our knowledgebase at http://support.novell.com/search/kb_index.jsp
- Check all of the other support tools and options available at
http://support.novell.com.
- You could also try posting your message again. Make sure it is posted in the
correct newsgroup. (http://support.novell.com/forums)
Be sure to read the forum FAQ about what to expect in the way of responses:
http://support.novell.com/forums/faq_general.html
If this is a reply to a duplicate posting, please ignore and accept our apologies
and rest assured we will issue a stern reprimand to our posting bot.
Good luck!
Your Novell Product Support Forums Team
http://support.novell.com/forums/
Maybe you are looking for
-
How do I take a Prepaid Vanilla Mastercard off of my Apple ID?
My Apple ID has a Prepaid Vanilla Mastercard for payment. But its empty and I don't know how to get my payment method to say "Nothing." I have $25 on my account (From Itunes gift cards) which I cannot use untill I get the Mastercard off of my Apple I
-
ABAP selection screen modification
Hello, I have the following selection screen: PARAMETERS: p_kalaid LIKE kala-kalaid, p_kalabe LIKE kala-kalabez, p_kalada LIKE kala-kaladat, p_klvaf LIKE kalv-klvar, p_tvers LIKE kala-tvers, p_kokrs LIKE kala-kokrs, p_bukrs LIKE kala-bukrs,
-
Macbook Pro Retina Crashes to black screen
Anonymous UUID: A009E67F-191E-4041-690B-9AD850109AC9 Wed Nov 20 16:47:12 2013 panic(cpu 0 caller 0xffffff7fa42abfac): "GPU Panic: [<None>] 5 0 a0 d9 9 8 0 3 : NVRM[0/1:0:0]: Read Error 0x00000144: CFG 0xffffffff 0xffffffff 0xffffffff, BAR0 0x11
-
It's slow in Windows 7 with 4 GB memory even though it has an elevated CPU & I/O priority!
It once worked fine & it works great on my home system with roughly the same parameters!
-
Editing Chart legends: How to change the line structure within the legend?
Hi, I have one problem: I have several charts in Numbers and since I need to print them in black/white, colors cannot be used to differentiate between the lines. So if I have a dotted line and a solid line, the legend only shows me solid lines as lin