Unable to process flat-files without delimiters in ODI 11.1.1.7

Hi,
We have a requirement to process a flat file using ODI 11.1.1.7 (installed on Windows and mounted on Oracle 11g Database).  The flat-file is a normal ASCII file coming from mainframes machine and has no delimiters (column as well as rows).  The first 48 characters is ROW 1, from character 49 to 96 is ROW 2 and so on.  I am unable to create a DataStore for this file in ODI.  If I reverse engineer using the file RKM, it is creating a datastore with over 2000 columns which is not the case (actual file layout given below).  The absence of a row delimiter is making ODI think that the entire file has only one single row. 
I am also unable to create a DataStore manually. If I am not providing any value for the "row delimiter" it is throwing me an error.  However, I am able to process this file using SQL*Loader (there is a FIX option available where we can specify the length of a row). 
Is there a way to do it from within ODI?  I tried to modify a KM to create a control file for SQL*Loader and execute it but the control file is not getting generated as expected.
File Layout:
Column 1 - Warrant Number (Position 1 - 9) - Number
Column 2 - Type (Position 10-10) - Number
Column 3 - Warrant Amount (Position 11-18) - Packed Decimal Signed
Column 4 - Issue Fund (Position 19-22) - String
Column 5 - Issue Sub Fund (Position 23-24) - String
Column 6 - Filler (Position 25-48) - String
Thanks
Srivatsan P

Hi LuizFilipe,
I tried also with your method but i am getting below error when i am trying to view data.
See com.borland.dx.dataset.DataSetException error code:  BASE+62
com.borland.dx.dataset.DataSetException: Execution of query failed.
Chained exception:
java.sql.SQLException: ODI-40439: Could not read heading rows from file
  at com.sunopsis.jdbc.driver.file.FileResultSet.<init>(FileResultSet.java:164)
  at com.sunopsis.jdbc.driver.file.impl.commands.CommandSelect.execute(CommandSelect.java:57)
  at com.sunopsis.jdbc.driver.file.CommandExecutor.executeCommand(CommandExecutor.java:33)
  at com.sunopsis.jdbc.driver.file.FilePreparedStatement.executeQuery(FilePreparedStatement.java:135)
  at com.borland.dx.sql.dataset.o.f(Unknown Source)
  at com.borland.dx.sql.dataset.QueryProvider.e(Unknown Source)
  at com.borland.dx.sql.dataset.JdbcProvider.provideData(Unknown Source)
  at com.borland.dx.dataset.StorageDataSet.refresh(Unknown Source)
  at com.borland.dx.sql.dataset.QueryDataSet.refresh(Unknown Source)
  at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.initialize(AbstractEditFrameGridBorland.java:628)
  at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.<init>(AbstractEditFrameGridBorland.java:869)
  at com.sunopsis.graphical.frame.edit.EditFrameTableData.<init>(EditFrameTableData.java:50)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
  at oracle.odi.ui.editor.AbstractOdiEditor$1.run(AbstractOdiEditor.java:176)
  at oracle.ide.dialogs.ProgressBar.run(ProgressBar.java:656)
  at java.lang.Thread.run(Thread.java:662)
Well i created file datastore with selected below things
File format : fixed
Heading(number of lines) : 0
field separator : null
record separator : by default --> MS-DOS
text delimiter: (blank)
decimal separator : (blank)
then when i did reverse engineering, able to see the row of data and then i separate the data with c1,c2,c3,c4
please let me know did i miss something.
Thanks
Himanshu

Similar Messages

  • Trying to create a Photomerge in Bridge, when the files open in Photoshop ( small jegs ) , I get a error message of " Unable to process latte files " / " null is not an object "

    Trying to create a Photomerge in Bridge, when the files open in Photoshop ( small jegs ) , I get a error message of " Unable to process latte files " / " null is not an object "
    Please help

    Wait a second, Photoshop can make lattes now?  Personally I prefer my coffee black, but man have I been under-utilizing this program.

  • Export table data in a flat file without using FL

    Hi,
    I am looking for options where I can export table data into a flat file without using FL(File Layout) i.e., by using App Engine only.
    Please share your experience if you did anything as this
    Thanks

    A simple way to export any record (table/view) to an csv fiel, is to create a rowset and loop through all record fields, like below example code
    Local Rowset &RS;
    Local Record &Rec;
    Local File &MYFILE;
    Local string &FileName, &strRecName, &Line, &Seperator, &Value;
    Local number &numRow, &numField;
    &FileName = "c:\temp\test.csv";
    &strRecName = "PSOPRDEFN";
    &Seperator = ";";
    &RS = CreateRowset(@("Record." | &strRecName));
    &RS.Fill();
    &MYFILE = GetFile(&FileName, "W", %FilePath_Absolute);
    If &MYFILE.IsOpen Then
       For &numRow = 1 To &RS.ActiveRowCount
          &Rec = &RS(&numRow).GetRecord(@("RECORD." | &strRecName));
          For &numField = 1 To &Rec.FieldCount
             &Value = String(&Rec.GetField(&numField).Value);
             If &numField = 1 Then
                &Line = &Value;
             Else
                &Line = &Line | &Seperator | &Value;
             End-If;
          End-For;
          &MYFILE.WriteLine(&Line);
       End-For;
    End-If;
    &MYFILE.Close(); You can of course create an application class for generic calling this piece of code.
    Hope it helps.
    Note:
    Do not come complaining to me on performance issues ;)

  • I am trying to restore bookmarks to Version 5 from a backup I made from Version 4.+. I get an error message "Unable to process backup file." What's wrong?

    I made a backup of my bookmarks when I was running Firefox Version 4+ (stored in a "json" file on a thumb drive). My primary hard disk crashed and when I down loaded Firefox on to a new hard drive, I got version 5.0. When I tried to restore the saved bookmarks, I got an error message that says "Unable to process backup file."

    A possible cause is a problem with the file places.sqlite that stores the bookmarks and the history.
    * http://kb.mozillazine.org/Bookmarks_history_and_toolbar_buttons_not_working_-_Firefox
    * http://kb.mozillazine.org/Unable_to_process_the_backup_file_-_Firefox

  • Solved "Error message": Unable to process backup file .json of bookmarks saved from different computer

    Want to move bookmarks from old laptop running Firefox 3.1.6 and Win XP to new laptop running Win 7 64-bit and FF 3.1.6 which I just installed. On new laptop I browsed from FF to Restore bookmarks from file I had saved from old laptop (edit to add: it is about 4500kb). The file (bookmarks-2010-10-15.json) is NOT write protected. FF reports "Unable to process backup file".
    I have shut down FF and rebooting computer. I am able to restore a bookmark file that was created on new laptop but NOT the one saved from old laptop so I do NOT think the file that the knowledge base (http://kb.mozillazine.org/Unable_to_process_the_backup_file_-_Firefox) refers to as potentially problematic is the problem in my case. I do NOT want to proceed with the other suggestions (create new profile and etc.) for fear of creating even more problems.
    Appreciate your advice - I have probably a 1000 or more bookmarks to move and so this is vital and probably typical of anyone with a new computer.

    PROBLEM SOLVED I did backup from old laptop again both as .json file and as an export to html. This time the .json file worked to restore from it.
    I had read on a different thread here about using the html version and was going to give that a try but also made the new .json at the same time to see if I could get that to work - which it did. I expect that either approach gives the same results and so if one approach is not working for you perhaps the other approach will take care of it.

  • IDOC to flat file without XML conversion

    Hi,
    I want to implement a scenario like this:
    IDOC --> XI --> flat file
    The flat file has to have the IDOC structure as you have when you write an IDOC to the R/3 file port. But we want to have this process running through XI.
    When you use the IDOC Adapter the IDOC is converted to XML first, which is time consuming. So this I want to skip this step.
    So is it possible to receive the IDOC directly in XI without converting it to XML? How should this process be designed.
    Ron

    Ron
    Looks like you need IDOC tunneling. It is possible by making a configuration parameter.
    You can find more information in http://help.sap.com/saphelp_nw04/helpdata/en/ab/bdb13b00ae793be10000000a11402f/content.htm
    While you try it, I will try to simulate this requirement in our system and let you know the result.
    KK

  • Send IDOC to  flat file without mapping will it possible???

    Hello everybody,
    Iwould like to  know, We have middleware tech is Webmethods. I want to send IDOC from SAP R/3 to flat file in Legacy system. how to do that? What willbe the structure of Flat file.

    hi
    Create a FILEPORT uing transaction WE20 and assign the fileport to your outbound message type in processing option, you can give the physical path in fileport and create the flat file format of IDOC.
    hope this helps
    regards
    Aakash Banga

  • How to Process flat File in Oracle Apps through Concurrent Program

    Hello Everyone,
    My client has a request, to process a bank file (Lockbox) which is a flat file that will be copied on UNIX box and I will have to create a new concurrent request that will process this flat file and will update receipt information in Oracle Apps database tables.
    Could you please suggest, if there are any other standard Oracle Apps functions (Example FND) available which can be used through Concurrent program that can be used to open a file from a particular directory and can be read from the flat file and after processing this file can be closed.
    Please let me know, if you have a small example, that would help me a lot.
    Thanks

    There are base concurrent programs in Accts Receivable that do consume lockbox flat files. Pl see the AR Setup/User Guides at
    http://download.oracle.com/docs/cd/B40089_10/current/html/docset.html
    Srini

  • Can SAP XI AS2 Adapter process flat files? Pl. tell me how to configure it

    I have a requirement to read and write delimited ASCII flat files using the AS2 adapter in SAP XI. The AS2 adapter should be able to read from delimited ASCII Flat files and also write to delimited ASCII flat files. Kindly let me know how to configure the AS2 adapter so that it can read and write delimited flat files. I badly need to know this configuration for a client requirement which requires file processing by the AS2 adapter in XI 7.0. Thanks in advance

    Hi,
    Is the requirement is to just read the flat file and process it ? if so, u can use File Adapter provided , ur source system provides u the data in the file format in the some directory
    following thread discussions may help u -AS2 adapter-
    Seebuger AS2 adapter for XI as sender for multiple messages
    Seeburger AS2 Adapter
    Hope this helps,
    Regards,
    Morthy

  • Can i load transaction data thro flat files without loading masters?

    Hi all,
    is it possible to load history data using flat files in sales cube without having loaded any masters?
    thanks

    Hi
    You can load the transaction data without loading the master data. You have to check the option in update rules (update also if no master data exists).
    In reporting you will not be able to see the attribute and text data. Its always adivceable to load master data first and run apply hierarchy/attribute change and load the transaction data.
    AHP: Nice to see you after a long time
    REGards
    Rak

  • Process Flat Files

    Hi everyone, 
    I currently need to process about 400 txt files, equivalent to about 1TB of data in maximum 5-6 hours. I need to run a very simple scrip, where I would capture about 0.10% of the data. Something like a select function with some where clause. Originally I
    was thinking to import this data in a SQL server however I'm not sure my computer could handle the workload in a reasonable time frame. 
    What would you suggest? Is there any other products that Microsoft offers to process extremely large flat files?
    Thank you in advance.
    Cheers,

    Hi AlexB0865,
    The solution you have mentioned should be the best one in my opinion. The performance bottleneck in this case are:
    Load data from 400 text files, which is about 1 TB large. Each file should be about 2.5GB
    Bulk insert data to SQL Server
    Filter data from the 1TB data
    For the first chanllange, it won't be an issue in SSIS per my testing. I have a file with 23504761 rows, which is 2.5GB large. This file can be imported into a SQL Server table within 1 minute.
    For the second chanllange, we can split the bulk insert to improve the performance.
    For the third chanllange, with proper index(es) created, the performance won't be a problem.
    Henk details the testing result regarding this same scenario in blog:
    http://henkvandervalk.com/speeding-up-ssis-bulk-inserts-into-sql-server
    If you have any more question, please feel free to ask.
    Thanks,
    Jinchun Chen

  • Unable to process huge files in SFTP BASED PROXY SERVICE

    Hi,
    I credted osb project which will have sftp based proxy and sftp based business service.After completing the development i tested the fie transfer through WINSCP ,but my sftp based proxy was picking the files but i am unable to see the files in the output directory for huge files,for small file it is coming after aquite long time .please assist me .

    If you enable content streaming then you cant access the file/message content within the Proxy service and can not perform actions like Replace or perform transformations on the content. Use streaming for pass through scenarios only. If you want to read a large file and also perform transformations on content I would recommend using JCA Adapter for FTP and try reading records from file in batches, a few records at a time. Just so we know the requirement better, what is the file size and what is the format of the content?

  • Unable to create Flat File

    Hi,
    I am trying to create a flat file source system in BW.When i do that i get an error   ' No entry for BW_USER in table RSADMIN available'.ANy ideas pls?

    Hi,
    Goto RSA1 -> Menu path "Setting" -> "Global Setting" -> Enter the background under "BW User ALE" field. You first have to creat a user like "ALEREMOTE" in SU01 and then assign that user here. After that try creating flat file source system.
    Hope this resolves the problem.
    - Parin Gandhi.

  • Processing flat file within ODI

    Friends,
    I need to read a flat file consisting of 'detail or main record' and 'trailier Record
    1) Detail Record consist of each transaction details including amount etc.
    2) Trailer Record consist of total value on detail records ( number of records and total amount)
    How can I verify the total amount in trailer against sum of all detail records?
    Thanks
    KS

    hehehehe
    Was a "bad way" to say "execute the calculations".
    An way to do it is:
    1) create a ODI variable
    2) at refresh tab put something like
    select t.col_trailier_sum_amount - sum(d.col_amount)
    from loaded_tabledetail d, loaded_table_trailier t
    where d.record_type = 'detail' and t.record_type = 'trailer"
    group by t.col_trailier_sum_amount
    * I'm using 2 tables at this example but is the same with just one...
    3) create a package and drag and drop:
    a) the interface that load the temp table
    b) the variable in Refresh mode
    c) the variable in evaluate mode ( set the evaluate operator to "=" and value to "0")
    d) choose the OK (true) and KO (false) path that you need to each case
    Does it make sense to you?

  • Aperture Unable to process RAW files even though finder shows a preview

    I have recently upgraded to Aperture 3.0 which decided to delete my library. Using PhotoRec i am slowly recovering all of my files.
    The files that have been recovered are .cr2 files and .jpg files. The jpegs display fine without a problem however every 2 out of 3 cr2 RAW files will not import into iPhoto, Aperture or pretty much any other RAW processing software. Aperture just says "Unsupported File Type".
    My issue is that Finder is showing a preview of the image in the icon, and is showing a preview in CoverFlow, but everything refuses to open the file. This must surley mean that the data is still intact within the .cr2 file? else Finder would be unable to display the preview of the file?
    Does anyone know how to fix this or what could be causing this issue?
    Apple please, please fix this issue with Aperture, I fear that I have lost a lot of photos in this process.
    Please help!

    Aarthek - the Canon PowerShot G2 is not supported centrally on your Mac.
    http://www.apple.com/aperture/specs/raw.html
    I've just finished importing my old archive produced by this camera. What I did was to produce fresh JPEGs (medium quality, so low file size) in the same directory as the original RAW images. I happen to have Photoshop CS3 and could easily do these in batches, but worst case, you should still have Canon's ImageBrowser suite which could do this. I then imported the JPGs for cataloguing, keywording, etc. Then, if I want to do some serious work on an image from my G2, I'll right-click the image and select +Show in Finder+ and get straight to my corresponding RAW image which I can then process in Photoshop.
    but I don't understand why the thumbnail shows up when I'm importing as though there are no issues.
    There's a small embedded JPG in the RAW files and that's what you're seeing. I think that's also what you saw on the G2's display when you were out shooting and stopped to review an image in the field.
    Regards,
    Gary

Maybe you are looking for