Read&write binary float var to file

Hello everybody.
Oracle 11G R 2 on Linux.
My problem.
I have some millions of records (270.000.000)  with numeric data that can be store in binary float variables. Making the database work with so big table convert the database in a slow and hard to manage, because copys and so. The advantage is that this data only need be read, not modified or add news record.
So, Im thinking to store in the file system, with UTL_FILE package, one or more binary files and access data through a algorithm to calculate the position of data inside the file. The data can be stored in binary float vars.
My question.
How I can add this binary data in binary format to the stream of write and read from the stream of data when I write to disk and when I read from disk.
Any idea welcome.
Thanks in advanced & regards everybody.

I think that you dont understand the problem.
The problem is easy, I have a table with 270.000.000 records. When you try to do anything with this table the database go slow, for your understand, when you ask a simple and easy query, by example a select count(*) from, it take more than 200 seconds to answer.
ok, but the data is all numeric that can be stored in binary float var and moreover its position in a sequential file can be calculate.
So if I make a sequential file, or more than one, where I can save this data I kick this problem to the database.
And what I´m asking for help is if anybody know a way, using UTL_FILE, to include in the stream to save and read this data from disk (UTL_FILE.put_raw and UTL_FILE.get_raw) in binary float format, nothing more than this I want.
You are correct that I 'dont understand the problem' because you yourself do not know what the 'problem' is.
All you said is 'try to do anything with this table the database go slow' but you don't tell us what that 'anything' is. You give only ONE example.
A COUNT(*) in Oracle could possibly use an index but you don't tell us if you have any indexes. You don't even provide the table DDL so we can see the structure.
Your description gives the impression that all you have is a table with ONE column defined as BINARY FLOAT and that column is defined as NOT NULL. If that is the case you can create an index and Oracle can use it to get the COUNT(*) results.
That ONE query is just about the only thing that might be faster with the data in a file. Since each value is four bytes and they can't be null then all you need to know is the length of the file. Then you can divide by four to find out how many entries there are.
For anything else your 'file' solution will need to read the ENTIRE FILE to do anything other than access values as if the file was a large array of BINARY FLOAT four byte values.
And for that, as I previously suggested, just forget Oracle and write a simple Java program that uses RandomAccessFile. Then for any given 'array' value just multiply by four, set the FilePointer value to that result and read your 4 bytes.

Similar Messages

  • Read/write Java float[]

    I'm looking for the quickest and most effecient way to read/write a float array (float[]) to file in a raw binary fashion.
    In C I would do...
    float fp = (float )malloc(sizeof(float)*nfloats);
    // ... populate fp
    int file = open("filename.bin", O_CREAT|O_WRONLY|O_TRUNC);
    write(file, (void *)fp, sizeof(float)*nfloats);
    close(file);
    (forgive the lack of error checking etc. - for explanation purposes only)
    So if in Java I have a...
    float[] fp;
    How dow I read/write fp to a file in a similar way?
    Many thanks!

    The easiest to program is java.net.DataInputStream.readFloat().
    The most efficient is probably java.nio.FloatBuffer.get(), followed by java.nio.ByteBuffer.getFloat().

  • How can read/write FORMSWEB.CFG & DEFAULT.ENV file entries programatically?

    Environment: Forms 9i (Web)
    As : Oracle 9i As
    How can read/write FORMSWEB.CFG & DEFAULT.ENV file entries programatically?

    I guess you cannot. There is an enhancement request to get the name of the config-section as a GET_APPLICATION_PROPERTY.
    What you could do is add extra parameter(s) to your form and pass the necessary formsweb.cfg parameters in this form parameter. See Get formsweb.cfg section name in Forms for more info and an example.

  • Read/write operation on SAP IDOC file

    Hi All,
    We are developing an application, which will be used for registering and processing of travel data for a client.One of itu2019s functionality is to get the data from external system in different format(like CSV, Excel, Fixed Flat file, XML, main frame file, DBF and SAP IDOC) and import it into Oracle databases.
    One of the design considerations for it, is to read these files and convert it into predefined XML format
    and then import these data from XML to oracle database.
    Currently we are analyzing the requirement and trying to find out all the Open Source JAVA API which can convert these different format files to predefined XML format, using some mapping file.
    We have found out Open Source JAVA API for all the file format, except SAP IDOC files.
    Any Java API to read/write the SAP IDOC file, Please advise
    Regards,
    Madhu
    Edited by: Madhu Sudhan on Feb 17, 2009 12:06 PM

    Hi All,
    We are developing an application, which will be used for registering and processing of travel data for a client.One of itu2019s functionality is to get the data from external system in different format(like CSV, Excel, Fixed Flat file, XML, main frame file, DBF and SAP IDOC) and import it into Oracle databases.
    One of the design considerations for it, is to read these files and convert it into predefined XML format
    and then import these data from XML to oracle database.
    Currently we are analyzing the requirement and trying to find out all the Open Source JAVA API which can convert these different format files to predefined XML format, using some mapping file.
    We have found out Open Source JAVA API for all the file format, except SAP IDOC files.
    Any Java API to read/write the SAP IDOC file, Please advise
    Regards,
    Madhu
    Edited by: Madhu Sudhan on Feb 17, 2009 12:06 PM

  • Read/Write folder, but newly added files Read Only?

    Our company uses a server to store a shared logo database and work files, and to transfer data from one user to another. At this point, we do not have any need for Read Only on this server; everything should be Read/Write. That's how it was set up initially, and the permissions were propagated. About a year ago, our old XServe crashed and was replaced with a new XServe. I believe our trouble started there, and has since migrated to our Snow Leopard Server: we have several folders where, if an employee uploads a folder and/or file, those files become Read Only. We have to go to the Get Info for that folder and fix the permissions each time. This has to happen up to 20 or so times a day, and I'm the only one who has server access to fix it; it also seems to be affecting more and more folders. I'm not in IT, so this is a little beyond me, but I've been working with IT on this (I'm Mac, he's PC). Can anyone offer a suggestion as to how else we can go about permanently setting the permission to Read/Write on all folders? Server Admin hasn't been successful.
    Thanks!

    Hi
    +"We have to go to the Get Info for that folder and fix the permissions each time"+
    This might be fine for OSX Client but it's not the way to do things on OSX Server. Consider stopping doing this because ultimately you're adding to the problems you're seeing. To reset permissions launch terminal on the server and issue this command:
    sudo chmod -R -N /pathtoshare
    Depending on how much data there is as well as the structure (nested folders within nested folders etc) this may take some time. If you're sharing the Volume (hard drive), don't. Share a folder instead. If you have only one share point which is the name of the drive. Create a folder with the same name and move all the data into that folder. Un-share the drive and Re-share the folder.
    Once the command has ran, repeat for any other share points you may have. When finished launch Server Admin because this is what you should be using. Select the Server name. Click on the Sharing icon. Select Share Points. Select the share point you're interested in and add desired users or groups into the ACL window. Select Read/Write. Don't fiddle with the POSIX permissions. Cick Save. Click on the small gear wheel and select Propagate Permissions. By default ACL will be ticked. You don't tick anything else. Click save/apply and let it do its stuff. Repeat for any other share points you may have.
    Tony

  • How read/write matlab style WAV sound file?

    The supplied LabVIEW WAV read/write VIs require fixed sampling rates (like 8000, 11025, 22050, 44100), and use integer data (so the waveforms take on large +/- integer values).
    I need to read/write WAV files that are like those used in Matlab with its wavread and wavwrite functions. Those can use ANY sample rate, and the waveforms have decimal values between -1 and +1.
    Could someone suggest either how to directly write these standard WAV files with an existing VI, or how to write my own VI to do this?
    Thanks in advance.

    That's a great help! Thanks. I have made the changes to the supplied NI VIs so that any rate can be used. The new read/write VIs are attached and seem to work ok.
    Best,
    F
    Attachments:
    Snd_Read_Wave_File.vi ‏128 KB
    Snd_Write_Wave_File.vi ‏110 KB

  • Read / Write a MAX .daq configuration file?

    How can I read or write a .daq configuration file programmatically ?(channel names, range, units, etc.)
    And/Or:
    Does anyone know the internal structure of a .daq file? Is it documented?
    Thanks.
    MichelC.

    Michel,
    The .daq file, where all the MAX information gets stored, is in binary format. You will have a hard time decoding it LabVIEW.
    However, you can use some DAQ VIs to get this information.
    Under Data Acquisition>>Calibration and Configuration>>DAQ Channel Utilities palette, use the following VIs:
    Get DAQ Channel Name
    Get Channel Information
    Get Scale Information
    Zvezdana S.
    National Instruments

  • How to write binary data to browser - File Save dialog

    Hi,
    problem:
    i have a working webservice and i get binary data from that webservice.
    my dynpro java  already works and i have byte[] b which has my binary result.
    what i want:
    when the user clicks on the button, the action onActionGetResult() is executed and inside this method, the byteArray b exists. what can i do, to say the dynpro application that it should  send the binary data direct to the browser, so that the "File Save Dialog" appears and the user can save the file to the harddisk
    any ideas?

    I've found the solution:
    IWDWindow window = wdComponentAPI.getWindowManager().createNonModalExternalWindow(
    res.getUrl(WDFileDownloadBehaviour.ALLOW_SAVE.ordinal()),
    res.getResourceName());
    window.show();
    this worked for me

  • Read & Write all folders and files

    How do I allow another account user read & write privileges to all my files and folders? I have set the other user as an administrator however each file and folder that i've copied into their documents folder still need to be changed individually (through the Get Info window) in order to save changes or add new files to them. This is very time consuming, so is there an easier way?

    Not exactly what you are looking for but maybe some useful information:
    http://www.computerworld.com.au/article/197922/useraccounts_file_sharing_leopard_whatnew?pp=1&fp=2&fpid=2

  • Why can't I open read/write rules file?

    I have followed the Cookbook XML tutorial exactly as prescribed, even down to using all the examples from the 'Completed' folder, but when I try to perform any procedure such as generating a EDD or reading an XML instance (the ColorDoc.xml example) I get the following in the log file:
    Could not open the read/write rules file
    (App\ChapterReadWriteRules)
    Make sure you have read access to the file and that
    the file is not already in use.
    Using XP and Framemaker 7.
    Its a real blocker this proble. Have tries unsetting the XP Read-only folder property on all the folders in the heirarchy but XP won't let me do that. Very grateful if anyone could help me over this problem.

    What is the path you mentioned the structapps.fm file for read/write rules
    It should be full file path for read/write rules(including extension of file). Otherwise there is possibility of throwing the error you mentioned.
    Would it be possible to paste your XML application defined in your structapps.fm file??
    Thanks
    Basav

  • ATTN Java Gurus: udf.policy - Unable to Grant Read,Write to Specific File

    NOTE: A correct answer to this question will receive the rarely used OTN 25pt <font color="silver" size="3" face="script">Platinum Star</font><font color="silver" size="4" face="script"> &#9733;</font> *
    Essbase 9.3.1
    Using a Java CDF that reads and writes to a file
    I'm trying to grant permission to a specific file in the file system by granting permission in the udf.policy file.
    When I uncomment the line permission java.security.AllPermission; the CDF works fine and interacts with the file correctly. This is just to prove that the CDF works, I need to tighten this up to a single file. I stop and start the app after each edit.(I've also tried bouncing the Essbase server too)
    When I use the following, I get an exception, shown below. Nothing of consequence is being written to the app or essbase logs
    grant {
      permission java.io.FilePermission "C:/test/essbase/CalcProfile.db", "write, read";
    };java.security.AccessControlException: access denied (java.io.FilePermission C:\esstest\Server\PlugIns\Essbase read)
         at java.security.AccessControlContext.checkPermission(AccessControlContext.java:323)
         at java.security.AccessController.checkPermission(AccessController.java:546)
         at java.lang.SecurityManager.checkPermission(SecurityManager.java:532)
         at java.lang.SecurityManager.checkRead(SecurityManager.java:871)
         at com.hyperion.essbase.calculator.ESecurityManager.checkRead(ESecurityManager.java:80)
         at java.io.File.exists(File.java:731)
         at org.sqlite.Conn.open(Conn.java:98)
         at org.sqlite.Conn.<init>(Conn.java:57)
         at org.sqlite.JDBC.createConnection(JDBC.java:77)
         at org.sqlite.JDBC.connect(JDBC.java:64)
         at java.sql.DriverManager.getConnection(DriverManager.java:582)
         at java.sql.DriverManager.getConnection(DriverManager.java:207)
         at com.accelatis.essbase.calcprofile.cdf.CalcComment.calcComment(CalcComment.java:16)
    >
    I've tried creating the policy using PolicyTool, same result. However, I have no idea what or if I should put in the "CodeBase" field.
    Has anyone had success creating read & write permissions to a single file using the udf.policy file? What is the magic syntax?
    Regards,
    Robb Salzmann
    * <font face="small" size=".2em" color="silver">right after the platinum star award is created</font>

    Hi Robb,
    Never heard of the OTN 25pt Platinum Star award... It sounds appetizing, but I know I won't get it since I've got no Java experience. :)
    I was just gonna ask if you've thought about posting the same question on one of the Java forums?
    https://forums.oracle.com/forums/category.jspa?categoryID=285
    Cheers,
    Mehmet

  • Automotive Diagnostic Command Set & kwp2000 Read/Write Memory By Address

    I used NI Automotive Diagnostic Command Set 1.0 Read/Write EEPEOM By Address of ECU base VW TP2.0  KWP2000 diagnostic protocol . I used NI example ReadWrite Memory.vi but not successful. I know must use below step. 
    Description
    The usual procedure for getting a security access to the ECU is as follows:
    Request a seed from the ECU using RequestSeed.vi with access mode = n.
    From the seed, compute a key for the ECU on the host.
    Send the key to the ECU using SendKey.vi with access mode = n + 1.
    The security access is granted if the ECU validates the key sent. Otherwise, an error is returned.
    Who has used NI Automotive Diagnostic Command Set 1.0 and know VW TP2.0 KWP2000 protocol. Please support some suggest and example VI.
    Thanks

    I modify NI example Read/Write Memory lool at attached files.
    Now I know how to calculate the key and successful.But sometimes ok and sometimes no ok. The best luck is pass three error.
    Attachments:
    pho0.JPG ‏99 KB
    ReadWrite ECU.vi ‏66 KB
    seedaddkey.vi ‏12 KB

  • How to read/write a binary file from/to a table with BLOB column

    I have create a table with a column of data type BLOB.
    I can read/write an IMAGE file from/to the column of the table using:
    READ_IMAGE_FILE
    WRITE_IMAGE_FILE
    How can I do the same for other binary files, e.g. aaaa.zip?

    There is a package procedure dbms_lob.readblobfromfile to read BLOB's from file.
    http://download-east.oracle.com/docs/cd/B19306_01/appdev.102/b14258/d_lob.htm#sthref3583
    To write a BLOB to file you can use a Java procedure (pre Oracle 9i R2) or utl_file.put_raw (there is no dbms_lob.writelobtofile).
    http://asktom.oracle.com/pls/ask/f?p=4950:8:1559124855641433424::NO::F4950_P8_DISPLAYID,F4950_P8_CRITERIA:6379798216275

  • Can TestStand open, read, write and close binary files?

    From a TestStand sequence, I need to open, read, write and close binary files. Does TestStand support this capability?

    Christine -
    In the past I have used the C/C++ Adapter to call directly into the CVI RTE functions. The CVI functions I have used are OpenFile, WriteFile and CloseFile. The functions are exported from the DLL as CVI_OpenFile, CVI_WriteFile, and CVI_CloseFile. I just had to make sure that on termination of the sequence, that the integer handle was properly released by calling the close function.
    If you are using LabVIEW, you could call directly into the low level VIs to do a similar set of operations.
    Scott Richardson (NI)
    Scott Richardson
    National Instruments

  • How can I read a binary file?

    In my AIR application, I'm trying to read a binary file and then post it via an HTTPService to a remote ColdFusion component that accepts a "binary" type argument.  The result of the post is always:
    The FILEOBJ argument passed to the addFile function is not of type binary.
    Here is how I'm reading the file in Flex, where fileObj is of type File:
    var fs : FileStream = new FileStream();
    var bytes : ByteArray = new ByteArray();
    fs.open(fileObj, FileMode.READ);
    fs.readBytes(bytes, 0, fs.bytesAvailable);
    fs.close();
    I then pass "bytes" as the parameter to my HTTPService's send call, like so:
    var params : Object = {method : "addFile", fileObject : bytes};
    service.send(params);
    When I debug, bytes contains the correct file size.  Is it not in binary form?  I've tried several other suggestions, but with the same result, so would appreciate any help.
    Thanks!

    One more step...
    short are U16 integer
    double are double precision float
    bool seem to be 2 bytes (= U16)
    char are string (variable length)
    rgb are U16 integer, with high order byte = 0
    rect should be 4 x U16 (top, left, bottom, right)
    Chilly Charly    (aka CC)
             E-List Master - Kudos glutton - Press the yellow button on the left...        

Maybe you are looking for

  • Can't open .ase file in  Dutch  Ps cs4

    Hi, I can't open  .ase files in Dutch PS cs4. I have tried it with different  .ase files. Can somebody tells me what's wrong? Thanks, Moreen

  • Question about acrobat js

    i want to know if exist a method in js that show me a dialog that allow me select a file to obtain information about this file selected.

  • Error executing webutil program

    Gurus, This is the post which I have already closed earlier since I got the solution for Webutil program (the thread is printing file to printer from forms 10g) .. Now the problem is very peculiar When I execute the form from printer (network) when I

  • Portege R100: recovery issue - Error partioning drive

    My old portege r100 is not working at all. I tried to use the product recovery cd rom but during the recovery process the following message apears: Error partioning drive! What does it mean? What can i do to overcome it? Thanks in advance Yannis

  • Error when generating XL Report from Report Organizre

    Dear Experts, I get this error msg, and it happens to a particular XL Report only, other reports are Ok. Even so, I dont know hwats wrong if this report. Does anyone know what could have caused this error and what has gone wrong in my report? [Click