What file type should i use for reading a large file of data?

I want to store data in a file and access them later. The data file could reach 500 to 1000 MBytes, as a binary file.
I may have memory problems.
I do not need the whole data in memory, only a few data each time, for my calculations.
If i use a binary file, i can not read only a few data. I have to load the whole file and then read the data i need.
Is this correct?
If i use another type of file, can i read only a few bytes without loading the whole file?
Maybe a TDMS file?
Solved!
Go to Solution.

I would probably use a TDMS file for this since it could also be read into excel if it were small enough - just more flexiblility. But you can also do it using binary types. You don't have to read the entire file when using binary files. See below.

Similar Messages

  • What pdf tag should I use for footnotes?

    I get involved in generating fully accessible tagged pdf's for asisstive technologies and the like. I have a doc in InDesign which uses footnotes. When I tag the document, should I map the footnotes (paragraph) style to a particular predefined pdf tag (http://www.alistapart.com/d/pdf_accessibility/PDFtags.html) and if so which one? P, STORY, NOTE....? I'm not sure and can't find any reference out there to help me.

    offtheroad wrote:
    What instrument area should I use for pulling in iTunes files to edit together, Voice, guitar, ...
    drop the files into a blank area of the timeline and GB will create a track for the files. if you want to do it manually, create a New Basic Track

  • Which file type should I use and how I use it?

    Hello!
    I need to create a file with some data that has been inserted manually.
    In this file, for example, there are:
    ProjectName1: string1, string7… string10, date1
    ProjectName2: string11, string15… string20, date2
    ProjectNamek: string 100, string 116 … string 140, date1
    I know only one thing: one of the strings.
    What I need to find in the file:
    I need to find the string at one of these rows and get its ProjectName and date.
    For example: if I have string15,
    I should find string15 in the file, and get its ProjectName and date:
    ProjectName2, date2
    Which file type should I use and how I use it? What is the best solution?
    Thanks!

    800512 wrote:
    I need to create a file with some data that has been inserted manually.
    In this file, for example, there are:
    ProjectName1: string1, string7… string10, date1In addition to Pandiya's advice, if the string is always in exactly the above format
    (ie:
    1. ProjectName always starts the line and ends with a ':'.
    2. The rest of the strings on the line are separated by ", " and will never contain ", "
    you might also want to have a look at String.split().
    Winston

  • Any Idea Which Message type/Idoc Type should be used for FI Invoice

    Hi Experts,
    Any idea what message type/Idoc type should be used for FI invoice. We are going to send IDOC from R/3 to Non-SAP System using ALE. We are using T-codes FV60/FV65.
    Thanks,
    Sony

    Hi Sony,
    I never dealt with FI IDoc.
    I think you need to setup EDI outgoing payment in IMG. Please take look this report <b>RFFOALE1</b> - ALE Distribution of Payment Data and <b>RFFOEDI1</b> and check also the program documentation.
    Hope this will help.
    Regards,
    Ferry Lianto

  • What video file format should i use for a banner mpu ad

    Hi,
    I have to make a banner mpu ad which plays video, the file i
    have is a wmv file (3000k).
    Should i convert this file to a flash video file and drop it
    in the flash file or should i convert it to another video file
    format bearing in mind that the file size has to be its very
    minimum.
    Please advice. Thanks.

    MECS wrote:
    what formats do I have available to work with in Director 11?
    Dewey
    Hi Dewey,
    Use MP4 H.264 for best results (quality & performances).
    cheers

  • Which file type should I use?

    Hi all,
    I am finally building my book. Using Elements 10 as my primary. My workflow starts with creating a new file (file/new/blank)
    I just finished the first page and to be safe I saved it as a PDF, PNG and JPEG. When all the pages are done I am going to print it locally. I think JPEG will be useful and this first page is only 8MB. I just have to decide what my other file type should be, which will the file I print. Both the PNG and PDF files were 60MB each. Should I contine to save as both? I will most likely come back and re-edit as well. Thanks.

    You actually have two questions:
    In order to re-edit at a later date, save it as either a PSD (Elements native file format) or TIFF.  These file formats preserve your layers and masks, so re-editing is a snap.
    When it's time to print, talk to the printshop you're going to use and ask them what file format they prefer.  Most places can handle PDFs.
    Ken

  • What sequence setting should I use for a High Quality Video Montage?

    I am about to start a new project for a client using photographs only.  I have two questions:
    1.  What should I use for the sequence settings?  Should I edit with a HD sequence setting? 
    2.  I am going to scan the pics myself.  What Pixel or resolution is appropriate to get the best quality?  I'm looking for wide screen 16 x 9, not 3 x 4.

    First, decde how you are going to deliver this production to your client. Then tell us what that delivery medium will be. Then we'll have some advice for you.
    See the section in the FCP manual on using still images. You need to understand that in video there are only pixels, no dots per inch or lines per inch. Those terms are meaningless in video. You wil sand at a size in raw pixels that is only slightly larger than your delivery format.
    bogiesan

  • What file formats should I use for maps?

    I've come to the IL forum simply because of the number of file formats IL will process.  My question however is more generic to file formats.
    I work with a large local county government (just as a citizen) and one of the projects we're working on is to get a full suite of maps (and other GIS output) for distribution.  Although they will be made available online, the intent is to print/plot.
    For some maps, we'll want to have the capability to add vector graphics (ovals, rectangles, text, arrows) for highlighting.
    The intent is for the county to provide machine readable GIS output so that we can do our own printing (via Kinkos for example).  We'll also be putting the maps online although only for simple viewing and downloads.
    What file format(s) should I ask to have the map sets in?
    Because I'm a novice when it comes to understand which format to ask for I've done some homework on jpg, tiff, gif, etc.  I think IL will take in any of them and that's where any vector graphics would be added (for print destined output).  I also have FW which could be used for web destined output if needed.
    What is most important is the quality of the printed output so I'm assuming dpi is going to be important.  I'm also assuming that we'll ask for the output to be intended for a rather large plot (e.g. 36" x 48" or perhaps even larger) even though we may not actually produce a map of that size.  For what I've learned on this and other Adobe forums, no matter what file size and format we get, printing to larger paper will eventually lose visible resolution thus the intent to start with the largest we'd ever print.  We might have circumstances where we would crop but again understand what can happen when blowing those up.
    One option, of course, is to have the county produce PDFs.  Is that a good idea for our purpose meaning do we lose anything to have the file format generally acceptable?  I'm assuming somewhere along the process we'll need to produce pdfs for downloads but that may not be the best format to get from the GIS output.
    Keep in mind that we don't have GIS software at present.  In the future we may move to using a GIS viewer which would mean we would have file generation capabilities, but for now, we're going to have to handle non-gis output files.
    I'm not even sure I'm asking the question well so feel free to educate me along the way.  I'm interested in learning.
    Tom

    (pricy)  I know that may sound strange given having CS2,
    Yep. Sure does. Plus:
    So in comparing prices, be sure to include the costs of the third-party plug-in route, such as MAPublisher (and the associated headaches of mission-critical dependence upon third-party add-ons in general).
    Since IL can take in pdfs and can add vector markup
    Working with PDFs is pretty much universal these days, for practical purposes.
    Understand this about PDFs and Illustrator: Illustrator's Save As...PDF dialog provides an option for "Preserve Illustrator Editing Capabilities." Selecting that option actually embeds in the resulting file a full duplication of the file as native Illustrator objects. That results in very bloated PDF file sizes--because they contain two full copies of the file.
    That's not what you want to do for PDFs that will be distributed/downloaded. So you're going to want to keep your AI-native files separate anyway. Opening a PDF that was saved without that option turned on in Illustrator is pretty much the same thing as opening it other mainstream drawing progams. So the "seamlessness" of PDF/Illustrator is really much about marketing.
    But no matter. Your mind is already made up to use AI for this. If it were me, I'd be exploring all options.
    JET

  • FAQ: What system hardware should I use for Photoshop?

    We all know we can find the Minimum System Requirements on the side of any software box. For the most recent version of Photoshop you can check the Tech Specs. If you'd like info on the older versions, you can check here.
    What does it mean if your computer meets the Minimum System Requirments? Well, you'll be able to install and launch the software without an error. Not meeting some of the minimum requirements could result in a hard or soft stop when installing. A hard stop prevents the installation from continuing because critical requirements are not met. A soft stop is a warning that you may encounter issues if you continue, but you can make that judgement on your own.
    But meeting the minimum requirements isn't necessarily give you a happy experience with Photoshop, especially if you work with large file normally. We normally don't make recomendations on the type of hardware you use on your system. We've changed our minds. Here is a list of recommendations for Good, Better, and the Best systems:
    System and hardware recommendations: Beyond the minimum

    Hello Brinmr,
    i do not hava license for matlab so i can not test it.
    On this page you found the supported NI hardware and here is the information the 6008 can be
    used in session mode Supported Hardware - National Instruments- NI-DAQmx
    and if i understand the function startForeground correct is this a session mode function.
    You can made some tests with a simulated 6321 or 6251, but if this also not works then you should contact
    the mathworks to ask them how you should implement your functions with mathlab.
    best regards
    Alexander Glasner
    AE NIE

  • SP Transaction Notification - what object type number to use for BP Activity

    Have to re-post it, the previous one has been accidently marked as answered.
    I'm trying to add some script into SP Transaction Notification and want to make it
    run when user add a new "BP Activity" into B1.
    What object type number should I use in SP Transaction Notification stored
    procedure?
    BTW, following this article:
    SAP Business One Form Types and Object Types
    http://scn.sap.com/community/business-one/blog/2013/07/09/sap-business-one-form-types-and-object-types
    I tried 103, but it seems like doesn't work.
    103 ActivityTypes object
    Thanks.

    Found my answer here, object type should be 33. Strange, this is inconsistent with article in my original post
    Object code for Activity (OCLG)

  • What port type should i use?

    I am using Seebeyond as middleware and it sending Vehicle IDoc VEHCLE01 to SAP System.
    Please help me
    what should port type I need to use? Should it be file port or t-rfc port?
    What should partner type need to use? Can it be LS type?
    Is it ALE or EDI Scenario?
    Thanks in advance.

    Hi,
    Yes, the Port can be a File Port (IDocs will be saved in this folder) or t-rfc port. File port should be OK.
    Partner Type can be LS.
    Cheers,
    Bhanu

  • What Compressor codec should I use for footage recorded on a Canon T3i, edited on FCP 6, and intended for Vimeo?

    I am looking for help!
    My planned workflow is as follows:
    Footage recorded on Canon Rebel T3i  --->  Edited on Final Cut Pro 6 (sequence compression is apparently H.264 according to the browser)  --->  Compressed with Compressor (ver 3.0.5) in original 1920 x 1080, 24p format  --->  Uploaded to Vimeo
    I am now at the point where I am trying to find a Compressor setting that will create a compressed movie that looks somewhat similar to what I see in the canvas in Final Cut Pro 6.  I have tried using the H.264, Apple ProRes 422(HQ), HD Uncompressed 8-bit, and XDCAM HD 1080p24 settings and in all cases, my movie plays back fine, however, the brightness/exposure seems to be hiked up a few stops and there is a substantial amount of noise in both the blacks and midtones that doesn't appear in FCP's canvas.
    My compressed movie I wish to export is only intended for Vimeo (similar to Youtube).  Is there a different setting I should be trying, or perhaps a way of downloading a more effective or current codec??  Any suggestions are greatly appreciated as it is very disappointing to see my movie degraded so much from its orginal quality.
    Shaun M

    H.264.  But the FCP Legacy (FCP 7 and earlier) Canvas and Viewer aren't color accurate.  Not designed to be. Their purpose is to show you what you are doing, show you the footage so you can make editing decisions. For color accuracy, the ideal way, since this was designed with television and feature editing in mind, is to have an IO device like those AJA.com and DECKLINK.com make, and send the signal to an HDTV or broadcast monitor. 
    Apple has realized that more and more people are editing for the web and computers only, so they made it so that FCX's viewer IS color accurate.  So...what that means is that currently, using what you have, you won't get things to match....they aren't designed to. So you can adjust for what happens when you export.
    But a big issue is that you are editing H.264 in FCP native. FCP doesn't work with H.264 native well, all sorts of potential issues can arise.  Sync issues, quality issues, the correct shot be exported, all sorts of things.  FCP works best with the FCP editing codecs. What are they? They are found in the EASY SETUP list.  But for HD, the most commonly used option is ProRes 422.  There is a BIG problem that FCP Legacy will SEEM like it'll work with H.264 natively just fine...it doens't throw up any warnings. That is bad. Also something Apple fixed with FCX. 
    The fact that you are editing H.264, and trying to export H.264, might also lead to the footage being more off that it would if you edited ProREs 422, and exported H.264.  Note...H.264 is a higher data rate codec, and easier for FCP to work with...but because it has a higher data rate, the file sizes are much higher than the original H.264.  5-6x larger.  FCP 7 did have a way to import Canon 5D, 7D and T2i (needed a hack with the T2i) via Log and Transfer.  But it doesn't work with the T3i...not even with that hack. Because FCP 7 was no longer updated after the T3i came out. It's 4 year old software, discontinued 2 years ago.
    If you want to edit native, you need to look at Adobe Premiere Pro CC. It's interface is more accurate too.

  • What "Partitions" type should I use when I create an image in Disk Utility?

    I have a Sony HDR-SR1 camcorder and have been creating images in Disk Utility to dump copies of my camcorders hard drive to. That way I can mount the disk image and import into iMovie just as if the camera was plugged in. These are the options I've been using:
    Volume Size: varies
    Volume Format: Mac OS Extended (Journaled)
    Encryption: none
    Partitions: Single partition - Apple Partition Map (the default I believe)
    Image Format: read/write disk image
    The option I'm not sure of and can't find much information on is Partitions. Up until now all the ones I've created use what I listed above. What is the difference between all the options (hard disk, cd/dvd, no partition, single partition - *multiple options*) and what should I be using to ensure long term compatibility with these disk images. Thanks.

    You don't need the journaling feature. Everything else appears proper. As for the various formats, check DU's help files.

  • What eq settings should i use for my ipod touch if i am using a car cassette cd adapter

    i have found a cheaper way to listen to my ipod touch in my new 1999 cadillac catera is to use a casette adapter that you would use if you wanted to use a portable cd player in a car (although mine already has a cd player in it)
    however my problem is that the audio for coming out of the speakers sounds a but tinny, and rough, i tried to use the eq settings (treble booster) and sound check to alevate the problem, and while it is marginally bettter now, the audio still sounds very rough and tinny
    my question to all you apple experts is that if someone wanted to use a car cd casette adapter with their ipod touch, what audio settings does he/she need to use in order to make it sound right (meaning just like if you were using speakers at home or your headphones)

    The appropriate MPEG2-DVD preset should suffice.

  • What feature of Should I use for my Website

    I want to creat a web application that support visitors to create imgaes of their favourite cricket team. What feature / product of adobe can help me in doing this for my Cricket website.

    If it's a window server, then probably aspx.  I am unfamiliar with aspx so can't really offer any more advice about it's use  :-)
    However, there are probably many more freely available open source scripts and such for use on a website, for polls, login etc., if you decide to use PHP.  I guess it all depends on the type of website you are going to create and whether you are going to create it yourself on depend on 3rd party applications to help you build the site.

Maybe you are looking for