Storing data in binary files

I am trying to store my data in binary files to save space and lessen time spent on hard disk reads. However, I can't seem to find the proper way to do this in java.
For example, I have the integer 65535 in java. How do I convert it into a 2 byte string FF FF in java?
When I read 2 bytes FF FF to a string from a binary file, how do I interpret it as a -32767 or a 65535 ?
Sorry if this seems like a really obvious question. None of the integer or string methods in java seems to do what I want :(

If all you want is a compressed file, you might want to use java.util.zip.GZIPOutputStream, and send it data in a simple format (like XML) rather than trying to compress everything to bytes yourself.

Similar Messages

  • Problem woth storing data in binary.

    Hi,
    I have some data which I am storing in binary and when I read it back in, I get different data than that which was stored...I was wondering if anyone could help me out as to what I have done wrong,  Below are the 2 Vi's I am using to test this: the first one makes the binary file, the second one reads it back in.  Thanks a lot for any help!
    Intern NSWCCD Carderock.
    Attachments:
    Untitled.vi ‏47 KB

    The read vi is actually a bit more complex to modify.
    Modifications to "read from SGL file":
    Replace the "4" with an "8" for the quotient&remainder division (8bytes/DBL).
    Change the "1D array" and "2D array" output to DBL.
    Open "Read File +[SGL]"
    Change "to Single precision float" to "to double prescision float".
    Change the "1D data" and "2D data" arrays to DBL.
    Of course you could just use a few low level VIs instead, you probably don't need all that flexibility to read or write a plain DBL 1D array.
    LabVIEW Champion . Do more with less code and in less time .

  • How to Convert Binary Data in Binary File

    hi,
    my telecom client puts a binary file which is asn.1 encoded with BER.
    how to handle binary data in java.
    how to convert binary to hexa to ascii format
    how to convert binary to octet to ascii format
    please help me in this.
    regards,
    s.mohamed asif

    You don't need to convert the data.
    Only you can do is print it in that formats, like it:
    public static String byteArrayToHex(byte[] b) {
        StringBuffer sb = new StringBuffer();
        for (int i = 0; i < b.length; i++)
             sb.append(Integer.toHexString(b&255) + " ");
    return sb.toString();
    take a look at this
    http://java.sun.com/docs/books/tutorial/essential/io/

  • Storing data in XML file

    Hi,
    I am a student and very new to XML. I know what it is but I never had developed anything in it.Now I am doing an assignment for which I need your help.
    I have to store Customer data in XML file after he enters it in GUI.Customer is having the following fields:
    String name1=BuyerGui.name.getText().trim();
    String street1=BuyerGui.street.getText().trim();
    int zipcode1=Integer.parseInt(BuyerGui.zipCode.getText().trim());
    String city1=BuyerGui.city.getText().trim();
    String country1=BuyerGui.country.getText().trim();
    String email1=BuyerGui.eMailAddress.getText().trim();
    I may have to update it some times.
    I am working in Java 4.2. I heard that I can use JAXP but no idea how to do it.
    Anybody help me with sample code because I dont have verymuch time for my assignment.
    Thanks in advance,
    Sai Ram

    Here is sun's tutorial on JAXP with samples:
    http://java.sun.com/xml/tutorial_intro.html
    -jay

  • Retrive data from binary file to xl file

    i want to retrieve the data from tdms file to xl file.

    Hi mayalayam,
    AFAIK there comes a filter with the TDMS package to read tdms files directly from Excel!?
    And after typing "TDMS Excel" in the search field in the upper right I found this link to get that "free Excel import filter"... (It's a German page, so maybe you do the search on your own too.)
    Message Edited by GerdW on 07-08-2009 01:29 PM
    Best regards,
    GerdW
    CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
    Kudos are welcome

  • Storing data from XML files in Oracle DB

    Hi!
    I just started to work with XML and need to save data from XML files into Oracle database. I tried to run sample from Oracle web site. The code was following:
    public class xmlwritedb
    public static void main(String args[]) throws SQLException
    String tabName = "EMP"; // Table into which to insert XML data
    String fileName = "emp.xml"; // XML document filename
    DriverManager.registerDriver(new oracle.jdbc.driver.OracleDriver());
    // Initialize a JDBC connection
    Connection conn =
    DriverManager.getConnection("jdbc:oracle:oci8:scott/tiger@");
    // Insert XML data from file (filename) into
    // database table (tabName)
    OracleXMLSave save = new OracleXMLSave(conn, tabName);
    URL url = save.createURL(fileName);
    int rowCount = save.insertXML(url);
    System.out.println(" successfully inserted "+rowCount+
    " rows into "+ tabName);
    conn.close();
    But it does not work.
    OracleXMLSave object does not see file name.
    Please, help me solve this problem. Also,where is it possible to find any documentation on oracle.xml.* classes API.
    Thank you.
    Maya.
    null

    <BLOCKQUOTE><font size="1" face="Verdana, Arial">quote:</font><HR>Originally posted by sudeepk:
    If a java exception is thrown probably during ur install u might have forgotten
    grant javauserpriv to scott;
    grant javasyspriv to scott;
    Thanks
    [email protected]
    <HR></BLOCKQUOTE>
    Thank you!!!

  • How does my application save the raw data to binary file?

    Hi all,
    At first, please look at my attachment. There is the part of my code (it is inside of a while loop) which saves a raw data from my firewire camera. I am thinking how does this saving process work? How does it save the data in each while loop's iteration time (pixels, rows and columns)? For example if I use 100x1000 8-bit image. There is also Set File Position.vi which makes next line after iteration (at least I think so?). It is important to know when I'm processing the data later with Matlab.
    My second question:
    If I set height = 100 and width = 1000 as parameters, image indicator from IMAQdx Grab's image out says that the image is "only" 1000x96 8-bit image. Where are "missing" 4 bits?
    B R,
    Jick
    Attachments:
    binarysave.JPG ‏40 KB

    Hi again,
    Here is my whole CameraSoftware. It is a part of the bigger measurement program.
    I hope you can find the solution of "lost 4 bits"
    B R,
    Jick
    Attachments:
    camerasoft.JPG ‏162 KB
    save&grab.JPG ‏48 KB
    confcam.JPG ‏38 KB

  • How to display a binary file

    Hello,
    I am working on creating program that lets me display data I've collected and stored in a binary file. Here is the code (+pic of the program) for collecting and storing the data. Data will be recorded on multiple channels (possibly 4 channels). The program I've attached can display the data in real time as data is being collected. My issue is just to call back all the data and display it in a graph that shows all the data from all channels. I'm stuck on creating this display program. Any help would be greatly appreciated.
    Thank you
    Attachments:
    Program.vi ‏190 KB
    program1.JPG ‏91 KB

    The way that data is stored in disk in LabVIEW is documented.  Check out the waveform datatype in this help file.
    I had a fairly indepth discussion about this with someone who wanted to use this to do a 'random access' read of the variant attributes of a waveform, without loading the whole thing.
    It's fairly deep in the grass, but then again you are dealing with 1's and 0's
    Regards,
    Peter D

  • Binary file write cancatenat​ion during writing

    Hi, 
    I'm trying to write a 2D array into a binary file and save the whole complete array in 2D.  As shown in the picture, data is written and appended to the binary file during each loop.  However, each loop would generate a 5x800 2D array (5 rows, 800 elements in each row).  Right now I have to use another vi to process the binary file I saved to concatenate all the arrays in the binary file to finally obtaion a 5 x 800n (n is the number of loops) array.  Is there a way to save the data into binary file in that format during each loop instead of writing into different segments and I have to concatenate different segments together after that?  
    On the other hand, if there's a way to do that, would that increase the loop cycle time because it's more computationally expensive?  Thank you very much for your help.
    Thank you,
    Charles
    Attachments:
    picture2.png ‏37 KB

    See the attached examples.
    If you have the file open you can basically just write data to it whenever you have it available, just do not include the length. It can cost a bit to write single elements so the row option is more commonly used, but it depends on how large each row is (if they are huge then it will cost to much to keep them in memory and you write parts of each row instead...). 
    I have not covered cases where you need to close the file and add data later, but the difference then is just that you need to set the write position after you have re-opened the file.
    MTO
    Attachments:
    Write and read 2D array.vi ‏26 KB

  • Storing data in  tablemodel to a binary  file

    hi,
    i have a program that uses AbstractTableModel with Jtable....I need to store data in a file when the program closes... i heard that there is a way to some how convert data in Tablemodel to a binary file and retrieve data from the binary file...other then storing it in a text file and parsing the data. So can anyone help me?
    Thanks

    You can loop through the data in the table and Serialize the data using object serialization.
    Simply implement the java.io.Serializable interface. Then use this code for serizlizing the data. Note that to serialize data, it must be an object not primitive types.
    serialize to a binary file
    try
        ObjectOutputStream os = new ObjectOutputStream(new FileOutputStream(new File("datastore.ser")));
        os.writeObject(<your data from table>);
        os.flush();
    catch (IOException ioe) { ioe.printStackTrace(); }
    reconstructing the object from binary file
    try
        ObjectInputStream is = new ObjectInputStream(new FileInputStream(new File("datastore.ser")));
        obj = (<data type of Object>) is.readObject();
    catch (IOException ioe)
        ioe.printStackTrace();
    }Hope this helps,
    Riz

  • Storing binary data to a file......

    Hi Friends,
    I am trying to make a webapp in which users can upload Videos and I can store that videos on the server. I have this bit of code:
        public ActionForward execute(
                ActionMapping mapping,
                ActionForm form,
                HttpServletRequest request,
                HttpServletResponse response) throws Exception{
                        VideoUploadForm myForm = (VideoUploadForm)form;
                        // Process the FormFile
                        FormFile myFile = myForm.getTheFile();
                        byte[] fileData    = myFile.getFileData();
      }My question is, should i store the byte array into some text file???Then how can i read it back and get the original format i.e *.avi or *.mpg.
    This might be easy,but this is my first time dealing with binary data,so your help would be appreciated.
    Thanks
    P.S: Any links would be appreciated

    Thanks BalusC,
    After lots of hardwork finally I am trying to upload the binary file in the database,but getting this error:
    java.sql.SQLException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'desc, file_blob) values(1, 1, 'uploaded file from user', _binary'\0\0�!\0\0�\' at line 1
            at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2928)
            at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1571)
            at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1666)
            at com.mysql.jdbc.Connection.execSQL(Connection.java:2994)
            at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:936)
            at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:773)
            at org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:168)This is my code thats trying to write that binary file:
    public class StoreData {
        private static Log log = LogFactory.getLog(StoreData.class);
        private static final String INSERT_BLOB = "Insert into videos.files (id, owner_id, desc, file_blob)" +
                                                  " values(1, 1, 'uploaded file from user', ?)";
        public void WriteData(VideoUploadForm myForm){
            log.info("Writing file to database");
            Connection conn = ConnectionUtil.getConnection();
         PreparedStatement stmt = null;
            // Process the FormFile
            FormFile myFile = myForm.getTheFile();
            byte[] bytes = null;
            try{
                bytes = myFile.getFileData();
            }catch(IOException ie){
                log.error("Upload File not Found");
                ie.printStackTrace();
            InputStream is = new ByteArrayInputStream(bytes);
            try {
                stmt = conn.prepareStatement(INSERT_BLOB);
                stmt.setBinaryStream(1,is,bytes.length);
                stmt.execute();
                stmt.close();
            }catch (Exception e) {
                log.error("Error writing data to file:");
                e.printStackTrace();
         } finally {
             ConnectionUtil.closeStatement(stmt);
             ConnectionUtil.closeConnection(conn);
    }Looking for some help here.....

  • Should heavy binary files be stored in database?

    I was asked an interesting question: Should a database contains all data? Or heavy binary files should be stored in file system?
    Example of heavy binary files : videos or heavy pdf files (+200 MB).
    With an old aspx web app (1.1) I tried to open a 200MB pdf file stored as a blob in an Oracle 11g database, and it just run out of memory.
    However, same asp.net web application had no problem to open same pdf file stored in file system of a server. It could be that maybe there is some proper way to open heavy blobs fields with asp.net.
    For integrity reasons, I say that all data should be stored in database, but my described case showed me that maybe it's not the way.
    SQL Server allows the contents of varbinary(max) columns to be stored on the file system, maybe there is something similar in Oracle?

    user521219 wrote:
    With an old aspx web app (1.1) I tried to open a 200MB pdf file stored as a blob in an Oracle 11g database, and it just run out of memory.Because it likely tried to read, and cache, the entire BLOB. Instead of reading and streaming BLOB chunks to the (web browser) client.
    However, same asp.net web application had no problem to open same pdf file stored in file system of a server. It could be that maybe there is some proper way to open heavy blobs fields with asp.net.So now blame Oracle for the inability of an ASP/.Net programmer to stream file contents correctly, but not LOB contents?
    SQL Server allows the contents of varbinary(max) columns to be stored on the file system, maybe there is something similar in Oracle?You want Oracle to be like SQL-Server? Oracle does a poor SQL-Server imitation. It plays the role of being Oracle, technically the most advance relational database management system available, excellently.

  • How can I read a binary file stream with many data type, as with AcqKnowledge physio binary data file?

    I would like to read in and write physiological data files which were saved by BioPac�s AcqKnowledge 3.8.1 software, in conjunction with their MP150 acquisition system. To start with, I�d like to write a converter from different physiodata file format into the AcqKnowledge binary file format for version 3.5 � 3.7 (including 3.7.3). It will allow us to read different file format into an analysis package which can only read in file written by AcqKnowledge version 3.5 � 3.7 (including 3.7.3).
    I attempted to write a reader following the Application Note AS156 entitled �AcqKnowledge File Format for PC with Windows� (see http://biopac.com/AppNotes/ app156Fi
    leFormat/FileFormat.htm ). Note the link for the Mac File format is very instructive too - it is presented in a different style and might make sense to some people with C library like look (http://biopac.com/AppNotes/ app155macffmt/macff.htm).
    I guess the problem I had was that I could not manage to read all the different byte data stream with File.vi. This is easy in C but I did not get very far in LabView 7.0. Also, I was a little unsure which LabView data types correspond to int, char , short, long, double, byte, RGB and Rect. And, since it is for PC I am also assuming the data to be written as �little endian� integer, and thus I also used byte swap vi.
    Two samples *.acq binary files are attach to this post to the list. Demo.acq is for version 3.7-3.7.2, while SCR_EKGtest1b.acq was recorded and saved with AcqKnowledge 3.8.1, which version number is 41.
    I would be grateful if you someone could explain how to handle such binary file stream with LabView and send an example to i
    llustrate it.
    Many thanks in advance for your help.
    Donat-Pierre
    Attachments:
    Demo.acq ‏248 KB
    SCR_EKG_test1b.acq ‏97 KB

    The reading of double is also straight forward : just use a dble float wired to the type cast node, after inverting the string (indian conversion).
    See the attached example.
    The measure of skin thickness is based on OCT (optical coherent tomography = interferometry) : an optical fiber system send and received light emitted to/back from the skin at a few centimeter distance. A profile of skin structure is then computed from the optical signal.
    CC
    Chilly Charly    (aka CC)
             E-List Master - Kudos glutton - Press the yellow button on the left...        
    Attachments:
    Read_AK_time_info.vi.zip ‏9 KB

  • How can I read a binary file stream with many data type, as with AcqKnowled​ge physio binary data file?

    I would like to read in and write physiological data which was saved by Biopac�s AcqKnowledge 3.8.1 software, in conjunction with their MP150 acquisition system. To start with, I�d like to write a converter from different physiodata file format into the AcqKnowledge binary file format for version 3.5 � 3.7 (including 3.7.3). It will allow us to read different file format into an analysis package which can only read in file written by AcqKnowledge version 3.5 � 3.7 (including 3.7.3).
    I attempted to write a reader following the Application Note AS156 entitled �AcqKnowledge File Format for PC with Windows� (see http://biopac.com/AppNotes/app156FileFormat/FileFo​rmat.h
    tm ). Note the link for the Mac File format is very instructive too - it is presented in a different style and might make sense to some people with C library like look (http://biopac.com/AppNotes/app155macffmt/macff.ht​m) .
    I guess the problem I had was that I could not manage to read all the different byte data stream with File.vi. This is easy in C but I did not get very far in LabView 7.0. Also, because it is for PC I am assuming the data to be written as �little endian� integer, and thus I also used byte swap vi.
    I would be grateful if you someone could explain how to handle such binary file stream with LabView and send an example to illustrate it.
    Many thanks in advance for your help.
    Donat-Pierre

    One more step...
    short are U16 integer
    double are double precision float
    bool seem to be 2 bytes (= U16)
    char are string (variable length)
    rgb are U16 integer, with high order byte = 0
    rect should be 4 x U16 (top, left, bottom, right)
    Chilly Charly    (aka CC)
             E-List Master - Kudos glutton - Press the yellow button on the left...        

  • Why files in Lightroom mobile and files in the creative cloud not the same? idea-  one place(stored date) for all application ??????

    Why files in Lightroom mobile and files in the creative cloud not the same? idea- one place(stored date) for all application ??????

    Lightroom Mobile is not a cloud storage service. You shouldn't treat it as a way of backing up your files. You are merely storing Smart Previews of your files in the cloud space, high-quality JPEGs of your files regardless of their original format on your desktop. The point is that they are there so you can continue editing them in a Lightroom-like environment even while away from your desktop/laptop computer. The files in Lightroom Mobile can only be used in Lightroom Mobile.
    This is very different from what is offered by the Creative Cloud storage, which can be used to synchronize your files between any device (that can support the individual files).
    The vast difference in how each service works and its intended use is why they are separate.

Maybe you are looking for