Import Manager Usage : Approaches for developing Import file structure and text validations

Hi Experts,
We are having 50+ import maps. We have provided option to users to drop the files for data import. Currently Import Manager(7.1 Sp08) does not have capability of pre-import validation of file data such as
a. file structure - number of columns specific to import map
b. file text validations - special characters, empty lines, empty cells
c. Uniqueness of the records in the file
For this, we are planning to build temporary folder(port specific) in which user drops in the file. We use the custom development to do above mentioned validations and then move the files to actual import ports.
Please let us know if you have worked on similar requirements and how you have fulfilled such requirements.

Hi Ganga,
Assuming you have a well defined xsd and are getting valid xmls from source in the Inbound Port of MDM. Also,you have a Primary key in form of External ID (say).
So just by making and defining a XSD you get most of what you want in your questions a and b.
Now if you wish to use PI to drop files in the inbound port then you can build all the validations in PI itself and you would not need Staging table.
Otherwise,you can have another table (preferably Main table) in the same repository or other dummy repository where records are created on import based on External ID.
Here you can launch an MDM workflow on import of these records and run assignments to replace unwanted characters and Validations to give error for rejecting some records based on the data quality level desired.Once unwanted characters are removed and data is validated it can be syndicated using a syndication step in the Workflow.So records which fail are not sent and which pass are sent to a outbound port.
From the outbound port PI or some other job can pick the file from this outbound folder and drop to Inbound folder of the same repository which imports to the required Primary Main table.Here again you have the option to leverage validations in PI and further check if data is fine.
Once this activity is done you can delete the records from the staging table.

Similar Messages

  • When importing photos with iBooks Gallery widget, is anyone aware of a technique for simultaneously importing the photo's description (or jpeg file name) and writing it into the iBook Author caption field for the imported photo?

    When importing photos with the iBooks Author Gallery widget, is anyone aware of a technique for simultaneously importing the photo's description (or jpeg file name) and writing it into the iBook Author caption field for the corresponding imported photo? I have 4,800 stills to import and can't imagine it's necessary to copy and paste the description for each.

    As always, feel free to use the 'Provide iBooks Author Feedback' menu item for features you'd like added in the future, etc.
    As for AS, I'm not sure anyone has sniffed iBA's dictionary is you friend for hot prospects, I'm sure

  • Is it possible to import MS Outlook Mail for MAC 2011 files into AppleMail?

    Is it possible to import MS Outlook Mail for MAC 2011 files into AppleMail?

    Yes and no.
    Outlook for Windows (or Mac) can save individual emails as .msg format, Apple Mail cannot import these but there is a utility that can convert them to the .eml format supported by Apple Mail.
    Outlook for Windows can also export entire folders of emails as PST files, again Apple Mail cannot import these but there are utilities which can convert PST files to the mbox format supported by Apple Mail.

  • Import cannot be resolved for IPrivate* imports

    Hi All,
    I got the error "import cannot be resolved for IPrivate* imports'" when I import existing project. And then I close the project, copy files to gen_wdp folder again and open project according to the method in Thread
    Always getting 'import cannot be resolved' for IPrivate* imports.
    Then the problem resolved.
    After that I have done some modifications and rebuild it. However the same problem occurs again. I repeat close/open project again but it doesn't help. That's to say I cannot make any modifications to the project and build out any new EAR files.
    If anyone can help, I will appreciate it a lot.

    Hi Xiao,
    Is <b>ShineWay_ReClaimsView</b> a view in your component in this project ?
    If yes ensure that it doesn't have any errors. Then rebuild your project.
    If you in dc environment and this view is from other project (dc). Then ensure that the dc having this view is build (dc build) correctly.
    As abhilash said the gen_wdp files are generated and you shouldn't touch them. You will get more problems than solutions.
    Best Regards,
    <a href="">Ashwani Kr Sharma</a>

  • Muse trial version only has "close" for option under file menu and it's grayed out.

    Muse trial version only has "close" for option under file menu and it's grayed out.

    Some menu entries in the main menu bar are hidden if you use the mouse and only appear if you use the keyboard to open the menu (Bug 626825).
    You can see the difference if you use Alt+F to open the File menu or other menus like the Edit menu (Alt+E) and Bookmarks menu (Alt+B) and compare that to what you see if you use the mouse to open the menu after you have made the menu bar visible by tapping Alt or by pressing F10.
    Add code to userChrome.css below the @namespace line to make the hidden items appear again.
    You can use the ChromEdit Plus or Stylish extension to have easier access to the customization files.
    *ChromEdit Plus:
    <pre><nowiki>@namespace url(""); /* only needed once */
    /* Always show menu entries with class="show-only-for-keyboard" */
    #navigator-toolbox menuitem[class="show-only-for-keyboard"]{display:-moz-box!important}

  • Best approach for publishing a paid version and an ad supported free version of the same app

    One of my Windows 8 store app is almost ready for store submission.
    What is the best approach for publishing a paid version and  an ad supported  free version of the same app.
    Can I do the following
    1. Submit the app with unlimited free trial to store
    2. During the free trial ads will be displayed
    3. If the user purchases the app, then the ad would not displayed
    Any advise is greatly
    Best Regards

    Although the in-App purchase option is good but for ad based apps my approach is different.
    I would suggest putting 2 different apps in the store, one free with Ads and one without. Reason being you want the extra reference and xaml ad controls depending upon how
    many you have on the paid version of the apps. I would keep my apps as lighter and cleaner as possible specially when its a paid app.
    I currently manage both free and paid app through one solution and reuse most of the code except for the views.
    Binoj Daniel

  • File structure and hierarchy in Aperture.

    Hi, everyone.
    I am trying to import folders with images into Aperture and, much to my surprise, have found that this process is everyting but intuitive and straightforward.
    My library (outside of Aperture) is made up of folders each corresponding to a day and location. These folders are labeled using the data and location as part of their name.
    As I try to import these folders into Aperture I can't seem to import them into a single folder or project as sub-folders or sub-domains of that project. I have tried to create a project and them import the folders into it but Aperture won't import them into that project and doesn't allow me to drag and drop it either once it has been imported. I also tried to create albums and folders but haven't been successful.
    How does this file structure in Aperture work in terms of hierarchy ? It certainly isn't structured the way the Finder is or any other file system I have seen to date. Creating folders, organizing them and bringing any type of data into these folders should be a simple process but in Aperture it doesn't seem to be.
    Am I doing something wrong or is Aperture trying to re-invent the wheel ?
    Is there any tutorial I can watch or read on how to work with Aperture's file structure and import folders and folders into it ?
    Thank you in advance.

    Regarding your specific problem I suggest treating each existing dated folder of image files as a single Project in Aperture. In Aperture a Project is a specific time-based concept that may or may not jive with what you previously considered a project. For instance I may have in my mind that shooting all the highest peaks in every state is a "project," but that would be inappropriate as an Aperture Project. Instead each peak might be a Project, but the pix of all the peaks would be pointed to as an Album.
    The way I look at it conceptually:
    Aperture is a database (DB), and each image file lives in one Project.
    Albums are just collections of Pointers that point to individual image files living in one or more Projects. Since they just contain pointers, albums can be created or deleted at will without affecting image files. Very powerful. And Albums of pointers take up almost zero space, so they are fast and do not make the Library size grow.
    Keywords can be applied to every image separately or in batches. Keywords are hugely powerful and largely obviate the need for folders. Not that we should never use folders, just that we should use folders only when useful organizationally - - after first determining that using keywords and albums is not a better approach.
    As one example imagine the keyword "flowers."  Every image of a 100,000 images Library that has some flowers in it has the keyword flowers. Then say we want to put flowers in an ad, or as background for a show of some kind, or to print pix for a party, or even just to look for an image for some other reason. We can find every flower image in a 100k-image database in 2 seconds, and in another few seconds create an Album called "Flowers" that points to all of those individual images.
    Similarly all family pix can have a keyword "family" and all work pix can have a key word "work." Each individual pic may have any number of keywords. Such pic characteristics (work, family, flowers, etc.) should not be organized via folders.
    So by using keywords and albums we can have instant access to every image everywhere, very cool. And keywords and albums essentially take up no space in the database.
    Another approach is to use a folder "Family" for family pix, a folder "Flowers" for flowers pix and another folder "Work" for work pix. IMO such folders usage is a very poor approach to using an images database (probably stemming from old paper or film work practices). Note that one cannot put an image with family in a field of flowers at a work picnic in all three folders; but it is instant with keywords.

  • Need help understanding Time Capsule file structure and how to get it back

    I have the original Time Capsule on which I backup both my Mac Pro and my wife’s Macbook. When Snow Leopard came out, I successfully used the ‘Restore from Time Machine’ feature on my Mac Pro so I know it has worked. However, my wife’s MacBook harddrive died the other day and I was trying to do the ‘Restore from Time Machine’ and all it would find was a backup from April (when I put her in a new larger drive). Time Machine would not find any backup files newer that April. She stated that she had seen the the Time Machine backup notices regularly and as recent as the day the haddrive died (Nov. 23) so I figured that I should have no problem. Here is what I have found in my trouble shooting and what leads to my questions below.
    This is the file structure I found: (note that our ID’s are ‘Denise’ and ‘John’)
    *Time Capsule* (the drive as listed in my Finder window sidebar under ‘shared’)
    >Folder called ‘Time Capsule’ (when logged in as either ‘Denise’ or ‘John’)
    >>Denise Sparsebundle
    >>>Backup of Denise’s iBook (mounted image)
    >>>>Folder called ‘Backups.backupdb’
    >>>>>Folder called ‘Denise’s iBook
    >>>>>>Single folder with old April backup (not the right files)
    >>John Sparsebundle
    >>>Backup of John’s Mac Pro (mounted image)
    >>>>Folder called ‘Backups.backupdb’
    >>>>>Folder called ‘John’s Mac Pro’
    >>>>>>Folders containing all my backup files
    >Folder Called ‘Denise’ (if logged as ‘Denise’)
    >>Denise’s Sparsebundle (a disk image)
    >>>Backup of Denise iBook (the mounted image. Name from old machine)
    >>>>>Denise’s iBook (Contains the backup I need)
    >Folder Called ‘John’ (if logged in as ‘John’)
    >> (empty)
    For some reason, my wife’s backup files are stored within a folder located at the top level of the Time Capsule drive called ‘Denise’, however, mine are within a folder called ‘Time Capsule’ which is at the same level as the ‘Denise’ folder.
    For some reason, when trying to use Time Machine to recover, it bypasses the top level ‘Denise’ folder which contains the correct files and goes into the ‘Time Capsule’ folder and finds the outdated backup files.
    I would assume that both my backup files and my wife’s should be at the same level of the Time Capsule.
    I was eventually able to use Migration Assistant to recover the files after installing a fresh OS and mounting the correct Sparsebundle image.
    So, my question, how do I get this fixed so that if I have to recover a drive with Time Capsule, it will find the correct files.
    Sorry for the long post and thanks in advance for any help.

    John Ormsby wrote:
    What I was trying to determine is why different backups for one particular machine are located at different file structure levels on my Time Capsule and why the most resent one for that machine is at a different level that for my other machine. Also, what is the correct level that both machines backups should be at.
    well John, first can you clarify if you are on 10.4.8 as your profile suggests ? if so, i'm wondering how you can use TM at all because TM was introduced with Leo. if you're not on 10.4.8, please update your profile. if you could, please also indicate details of your machine such as available RAM, processor, etc.
    second, what OS is your wife's machine running ?
    third, i frankly don't know too much about TM's file structure or if there indeed is such a thing as the correct one. however, i do know that it is best to leave TM to do its thing (as long as it's working). FWIW, though off-topic, you may want to have a look at this read for further information.
    last but not least, i see TM backups to my TC only as a part of my backup strategy. the backbone of my strategy is to create bootable clone of my startup disk(s) using e.g. Carbon Copy Cloner on a regular basis. while TM is capable of doing a full system restore, i don't trust it as much as a working clone. i use TM to retrieve a file i accidentally trashed a week ago but you cannot boot from a TM backup if your startup disk goes belly up.
    If I have missed this information in either the FAQs or the Troubleshooting article, I would greatly appreciate being pointed to it .
    i expect you didn't miss anything and i'm sorry you didn't find any help there. perhaps if Pondini (author of the FAQ and troubleshooting user tips) reads this thread, you will get the necessary advice on the file structure and more besides.
    good luck to you !

  • IWeb file structure and naming system

    I am trying to publish my iWeb directly to my domain ( using the FTP direct publish function. However, iWeb is applying an overly complex naming system.
    For example, its publishing not only the page names, but also the name of the Site in iWeb, after the original URL. Here's an example:
    First, I need everything to be on the domain. Then, I only need the name of the individual pages to be published, not the Site Name itself. I already have a site name, and that's my domain.
    Any other advice on how to control file structure and naming in iWeb?

    This is not incorrect and it is the way iWeb publishes and has done ever since iWeb 06. When you publish from iWeb to a local folder, what you get is your Site folder with your site name and a separate index file.
    If you don't want your site name included, then what you need to do is rather than using the direct ftp from iWeb, select ftp to a local folder instead. Your site will then be published to your desktop. Then download either Cyberduck or Transmit for free - these are dedicated ftp programs. Then all you do is load just the contents of your site folder to your public_html folder on your server and your url will then be
    Be aware though, that if you are loading like this, you are breaking iWeb site structure and RSS feed will not be available to you if you need to use it.
    If you want to continue to use the built in iWeb ftp, then you could try naming your site public_html and then leaving the directory blank and then uploading like this and because you have named your site public_html and are uploading to the same place, your public_html folder on your server will be replaced with your website, thus eliminating the site name.
    I have tried this method once myself with my own site and it does work, however, I still prefer to publish to a folder and then upload to my sever using Cyberduck.

  • Always getting 'import cannot be resolved' for IPrivate* imports

    Everytime I import a Web Dynpro DC from our NWDI I see 'import cannot be resolved' errors when I open for example the Component Controller implementation. An Organize Imports does not fix this. If I rightclick inside the code and select 'Show in Package Explorer' it jumps to the .java file for the implementation (within the gen_wdp folder). In that same tree I can see the IPrivate*.java files as well.
    I also tried Repairing and Rebuilding the project. All to no avail...
    Why is this happening and how can I resolve it?
    Kind regards,
    Pascal Willemsen

    If I open the generated Java files in gen_wdp I see loads of errors (all '...cannot be resolved...'), but the Tasks view contains no errors at all (answer to Armin).
    A development component build runs and seems to succeed without problems.
    It seems that the Web Dynpro's contain a circular dependency, which I think is the cause of the problem:
    1. wdThis in the Component Controller is an IPrivateComponent instance.
    2. IPrivateComponent extends IPublicComponent.
    3. IPublicComponent has a gen_delegate member which is an InternalComponent instance.
    4. InternalComponent implements IPrivateComponent.
    I guess NWDS doesn't know where to start...?

  • Best approach for storing XML files long term

    We have a legal requirement to store the XML files that relate to SAP billing documents for 10 years. (This is a "digital seal" requirement in Mexico.) The files will be sent to SAP server by the third party software. We'll attach them as GOS objects to the billing documents, but we need another option for safekeeping the files for 10 years. Files need to be accessible somewhat easily if there is an audit down the road. We expect to have about 500 files per month, 5k each.
    The simplest solution that comes to mind is just to copy the files to a designated folder (or rather several folders by year or month) and backing it up regularly, but I'm wondering if there could be another solution.
    Has anyone had a similar requirement and what approach would you recommend? I'm also checking with our Basis support, but thought I'd ask here as well.
    Thank you.

    You may also check here:

  • 'Data for last import/Statistics' tab missing for Distributed imports in EMIGALL

    Hi experts,
    For some reason when I initiate Distributed loads using 'Distributed imports' in EMIGALL, I do not get the third and fourth tabs viz. 'Data for last import' and 'Statistics for import runs' after the loads are triggered. Is there a specific Note that needs to be applied. I checked Notes like 1179843, 780996 however they were relevant for previous releases and I am currently on release 605. Any insights to this problem?

    SharedObjects does the trick nicely!

  • Import - Add to catalog won't maintain file structure

    Deaar all,
    I use Lightroom 4.3 on Mac OS-X 10.8.3. I recentrly clean-reinstalled the computer.
    I copy my images from a memory card onto my harddrive. My folder structure looks like this:
    Before reinstalling I could just import my images into Lightroom by adding to the catalog and the Folder structure in Lightroom would be the same as on the drive.
    Now, if I try to import images, Lightroom creates in its catalog (the left of the Library window) new folders "on top of" the existing 'Fotos' folder. So I end up with something that looks like:
       <Year>   (can be the same as above)
           <Month> (can be the same as above)
    When I try to show the parent folder, I get an error message at the top level (also shown the folder hierarchy where I want 2013-03 in the Fotos hierarchy):
    What do I need to do to make Lightroom duplicate the folder structure on-disk during import?
    Thank you for your help,

    Indeed, I did change the user name from karel (backup) to Karel (current install).
    Magic! I moved the Fotos folder to a new folder, let Lightroom find the missing top level Fotos folder and tried to import the march directory: it is in the right place!
    I will just let it render the previews, then move the Fotos folder to where it was, point Lightroom to the new locatiion again and all should be well!
    Thanks a lot!

  • Technology for instant messenger, file sharing and picture sharing

    As part of project(for studies), our team is working on software which had features of instanst messenger, p2p file sharing and picture sharing and support for storing profiles, offline messages. Although we had some idea abt how to proceed.....but we need to know which java technology would be best suited for various aspects for efficiency....
    1. GUI
    2. Networking
    3. Security (which class is suited for authentication)
    4. File Sharing(which files support is provided)
    5. Picture sharing(and formats and size supported)
    anything missing we need to consider.............
    and we r useing JDBC...or shud achicives be better option

    1. GUISwing
    2. NetworkingPlain sockets.
    (Most efficient NIO, but that's probably a bit tought for you if you are new to java)
    3. Security (which class is suited for
    authentication)Write custom classes for that.
    4. File Sharing(which files support is provided)You either need to write code for that (use sockets) or look for a 3rd pary networking library.
    5. Picture sharing(and formats and size supported)Same as above. There's no difference in sharing an image and an mpr3 song.
    anything missing we need to consider.............
    and we r useing JDBC...For what?

  • The 2 year old fix for changing temp files is no longer valid, I need to change the temp file location in the latest firefox.

    In 3.6.3 I'm unable to find the parent cache to change where the temp files are located. I have an SSD drive, and I need to get the temp file off, and onto my platter drive. I have read the previous fix of about:config and changing the parent cache location, but it no longer seems to be there. I'm unable to locate anything relating to my SSD drive location in about:config.
    == User Agent ==
    Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.70 Safari/533.4

    Unfortunately, it appears that what I wrote about not being able to find the location IN about:config of the cache to change it from my C: drive to a different location, was mildly misunderstood that I didn't know how to get into about:config.
    The location of browser.cache.disk.parent_directory does not currently exist in 3.6.3. I'm assuming it's under a different location. Also using the simple string of "cache" lists several options, but none of them appear to be where firefox is currently dumping the temp files onto my C:
    I merely need to know how to switch the temp file location from 1 drive, to another. Not downloads, the temp file.

Maybe you are looking for

  • BEx query iView in Portal

    Hi All, I am trying to create a BEx query iView in EP 7.0 and my BI system is BI7.0. I am refering to the following <a href="">LINK</a> for this but I am not

  • How do I run a shell script via AppleScript?

    Seems obvious, "do shell script" but that doesn't work for me. I have an Automator app which runs a shell script, I'd like to take that into an AppleScript. My AS doesn't run the shell script. Perhaps "do shell script' is expecting the script to be l

  • IPod touch: need to restore to previous update so it will work again on mac computer

    iPod touch: - my iPod has always been used with my desktop iMac computer, which has iTunes version 9 currently installed. It is updated to it's latest possible update, so I am assuming it is not compatible with the latest, iTunes 10. While working on

  • PDF portfolio viewing on ipad

    i am not able to open pdf portfolios in emails received on my ipad.  I get an adobe "click here" button but nothing happens.  Can anyone suggest a solution?

  • Servlet cannot find applet class.. HELP..DONT REPLY..SOLUTION FOUND

    Hi.. can anybody help me.. with this age old problem? I have an applet.. which generates a pie chart .. Pie.class. If i embed it in a normal HTML page.. it runs smoothly. Now the problem is.. in my servlet i tried to do this out.println("<applet code