Gateway failing to stream large binary content

I've written a portlet that allows users to browse network filesystems as a portlet within their ALUI page.
The portlet code runs on a remote (WebLogic) server, and allows users to add any network shares (along with login credentials) they need.
I want to allow users to download files. This works fine for small files, but larger files fail (currently failing at around 1MB).
The code streams the file out in 1KB chunks - browsing to the portlet directly gives an immediate response, and the file download works at a good speed.
I need the portlet to be Gatewayed - users do not have direct access to the underlying portlet server.
It looks to me like the Gateway is waiting for the ENTIRE file to be downloaded before it's sent to the client, so the portlet timeout kicks in and causes the download to fail (it never even prompts the user to download - the portlet just shows the timeout error).
So is there any way to get the download to be Gatewayed, and force it to offer the download prompt to the user immediately rather than waiting for the end of file? I'm thinking either a config setting, or something that I can add to the script that streams the file out to tell the Gateway that this content doesn't need to be scanned or cached at all (i.e. just act as a plain proxy).
The code is specifically sending all downloads down with a content type of "application/octet-stream".

Hi,
I've used Bea's reverse proxy with Apache httpd and iPlanet web server without any issues many many times, sometimes in configurations way more complex that the one you are describing.
Regards,
LG
Edited by lgalfaso at 06/01/2007 7:38 PM
Edited by lgalfaso at 06/01/2007 7:39 PM

Similar Messages

  • Binary Content through Gateway and Proxy fails

    We are trying to deliver secured content (some in the form of images and PDFs) over our new extranet implementation. We have chosen to gateway all content (generated in Publisher) to leverage portal security. HTML content reaches the client fine; however, all binary content fails. (Images return the dreaded red X).
    Analysis has shown us the following:
    1) The Proxy server needs to be HTTP/1.1 compliant
    2) Using Internet Explorer 6,7, the end-user needs to check the Advanced Setting option "Use HTTP 1.1 though Proxy Connections"
    Both conditions MUST be true. If either condition is NOT true, the binary content fails.
    Additionally, we have confirmed the following:
    1) Disabling the Binary Gateway does not resolve the issue
    2) Binary Content also fails in Firefox (but more testing needed)
    3) Bypassing the proxy allows the binary content to succeed through.
    We are running:
    - ALI 5.04 (upgrading soon)
    - MS ISA Server as Reverse Proxy (but tested with other proxies as well
    Our business does NOT want to tell our external users they have to change their browser settings (force HTTP 1.1 through proxy connections) to be able to see content on the site. Some companies lock down these settings, and to force them to change for use is deemed to be unreasonable.
    Is anyone delivering binary content (i.e. images, PDFs) through their gateway and a proxy server -- successfully?
    Please let me know.
    [email protected]

    Hi,
    I've used Bea's reverse proxy with Apache httpd and iPlanet web server without any issues many many times, sometimes in configurations way more complex that the one you are describing.
    Regards,
    LG
    Edited by lgalfaso at 06/01/2007 7:38 PM
    Edited by lgalfaso at 06/01/2007 7:39 PM

  • Streaming Large Files to Response OutputStream consumes plenty of memory

    When we write large file's (> 100 MB) binary content to the Servlet Response OutputStream using the write method, it consumes plenty of Heap Memory on the server (Weblogic 7). The Heap does'nt come down after
    writing to the outputstream, it stays high for quite a long time, infact it comes down only we access the same page again. Is there a way to get this optimized?
    TIA.

    The servlet container will buffer your output, so that it knows how much of it there is, so that it can set the Content-Length header, so that the recipient knows where the payload ends.
    I don't know about Weblogic, but in Tomcat there are AFAIK two ways to get genuine streaming instead of buffering: set the Content-Length header before writing any output (and if you know the content length in advance). Or use chunked encoding (set the "Transfer-Encoding: chunked" header, google for it.)
    I don't know if it works, but if those two don't do it for you, you could also try forcing the reply to be HTTP/1.0 instead of HTTP/1.1, or disable keep-alive ("Connection: close"). HTTP/1.0 (which doesn't have keep-alive) and no-keep-alive might not need the Content-Length header because closing the socket will give an EOF to the recipient, so it knows where the payload ends.

  • Generate a PDF doc from binary content.

    Hi folks,
    I have this scenario: File Adapter <- XI -<ABAP Proxy.
    The scenario starts when R/3 runs a report (job scheduled) that invokes an outbound method of ABAP Proxy. Under this outbound method, few parameters are sent to XI, one of them is an xstring. The xstring (binary content) can be a PDF or TXT document, depends of the “doc_format” parameter value.
    I already read some documents and web logs about file format conversions. But my problem is that the XML element is coming in binary (xstring) and I need to generate a new PDF document from that element. All the web logs mention conversion from XML to any other format and not from binary! 
    My idea is to develop a Receiver File Adapter Module. The Module only picks the binary XML element and converts it in a PDF document giving the name and the format that comes into others neighbors elements of XML.
    Anyone knows which classes/methods are needed? Or is there another easy way to do this that am I not seeing?
    Thanks in Advance,
    Ricardo.

    Hi all,
    First, thank you all for the quick replies.
    To be clear, I have a binary stream that I want to convert into PDF format and not XML to PDF. So, like I said before, the SDN web logs only mention conversions from XML to PDF and not binary stream to PDF or even others formats. Using XSL I need my source message in XML and that is not the case…
    Venkat, your approach is develop a module to get the binary stream and other module to convert into PDF format, am I right?
    Cheers,
    Ricardo.

  • Connect to SAP gateway failed Connect_PM  TYPE=B

    Hi experts,
    I get the following error when i ping through JCO destinations on portals.
    com.sap.mw.jco.JCO$Exception: (102) RFC_ERROR_COMMUNICATION: Connect to SAP gateway failed Connect_PM  TYPE=B MSHOST=imtsapdev01 GROUP=CLUST R3NAME=DMI MSSERV=sapmsDMI PCS=1 LOCATION    CPIC (TCP/IP) on local host with Unicode ERROR       partner '127.0.0.1:3310' not reached TIME        Tue Jan 27 16:39:54 2009 RELEASE     700 COMPONENT   NI (network interface) VERSION     38 RC          -10 MODULE      nixxi.cpp LINE        2823 DETAIL      NiPConnect2 SYSTEM CALL connect ERRNO       10061 ERRNO TEXT  WSAECONNREFUSED: Connection refused COUNTER     1
    However my JCO destinations were working perfectly until recently. I checked on the logon group. I have one called CLUST, which i use for this purpose.
    I have also checked both service files and they have the following for the ECC server im connecting to.
    3610 because its system number 10 i am connecting to.
    sapmsDMI 3610/tcp
    From the JCE destinations screen i cannot even ping the server. I can though when i log on to the server through remote desktop.
    thanks and regards
    dilanke
    as a reply to nishants posts.
    goto rz70
    give hostname -->
    service --> sapgw00 (sapgw(instance number)
    execute it
    click on yes
    check rfc call (success or failed)
    I have done this. i left hostname as "blank" gave service as "sapgw10"
    The following is what i  got as the output.
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDRFC
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDMSGSRV
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDIPSERV
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDINSTSP
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDINSTSC
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDGWSRV
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDDBSYS
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDCOMPSYS
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDCLIENT
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDBCSYS
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDAPPL_SERV
        0: IMTSAPDEV01_DMI_10                        : Execute program: SLDASSOC
        0: IMTSAPDEV01_DMI_10                        : Collection of SLD data finished
        0: IMTSAPDEV01_DMI_10                        : Data collected successfully
        0: IMTSAPDEV01_DMI_10                        : RFC data prepared
        0: IMTSAPDEV01_DMI_10                        : Used RFC destination: SLD_NUC
        0: IMTSAPDEV01_DMI_10                        : RFC call failed: Error opening an RFC connection.
        0: IMTSAPDEV01_DMI_10                        : Existing periodic jobs removed. Number: 1
        0: IMTSAPDEV01_DMI_10                        : Program scheduled: 20090127 184357
        1: IMTSAPDEV01_DMI_10                        : Event-controlled job already exists; scheduling not necessary
    so i guess its not successful. when i look at rz70 of a server where this works correctly its not succsessful either
    if it is success then technical system name will be in sld
    to restart sld --> /sld --> administration --> stop server --> restart server
    or check in VA --> SLD data supplier value --> Runtime
    I checked this and i do not see aa problem. you have configuration status as valid and send reult as Success
    Services file is locted on OS level of R3 system--> Goto --> Start --> Run -> (type)Drivers(enter) --> etc -> (here is services file)
    check ur r/3 server entry is there or not,
    I have the followng in the service file for the server
    sapmsDMI 3610/tcp
    if not add it

    Hi Experts,
    when ilook at the remote gateway properties in SMGW this is what i see on the R/3 server. ive looked at my other system which i can connect to and there isnt much of a difference in the parameters. How can test this to see if it works?
                                                                                    Details of remote gateway                                                                               
    entry                         = 0                                            
      state                         = CONNECTED                                    
      local                         = 1                                            
      system type                   = REMOTE_GATEWAY                               
      client                        = FALSE                                        
      wait for frag write           = 0                                            
      suspended                     = 0                                            
      read/write socket             = 4                                            
      HANDLE                        = 4                                            
      TIME                          = Sun Oct 19 18:54:14 2008                     
      SOCKET                        = 1352                                         
      STAT                          = NI_CONNECTED                                 
      TYPE                          = STREAM IPv4                                  
      OUT                           = 48225 messages 48225 bytes                   
      IN                            = 1 messages 64 bytes                          
      LOCAL                         = 127.0.0.1:3310                               
      REMOTE                        = 127.0.0.1:1297                               
      OPTIONS                       =                                              
      connect                       = Sun Oct 19 18:52:17 2008                     
      last request                  = Thu Jan 29 13:09:58 2009                     
      conversation no               = 0                                            
    thanks and regards,
    dilanke

  • New How-To: Exchanging Binary Content Using MTOM

    Hello,
    One of the new features of the OracleAS Web Services (10.1.3.1) is the support of Message Transmission and Optimization Mechanism (MTOM) to exchange binary content using SOAP Web Services.
    This is documented in the following how to:
    - How-To Use MTOM to Exchange Binary Data Using Web Services
    Regards
    Tugdual Grall

    hi All,
    I m stuck in a similar kind of issue, in my case content selectors is used but after that i need to perform some filteration and sorting to select the necessary node, at the last i end up with a node object or a input stream and then how to render this to the screen is issue (node has a binary property with html file)
    I have tries the the option discussed in this thread but it didnt worked, as most of them are aroung jsp tags.
    Brad
    <%@ taglib uri="http://www.bea.com/servers/portal/tags/content" prefix="cm"%>
    <%@ taglib uri="http://www.bea.com/servers/content/ui/jsp/templates" prefix="templates"%>
    <cm:getNode id="node" path="/path/to/node"/>
    ${templates:getFileContents(node)}
    this looks simple but not working, difference is, in place of "<cm:getNode id="node" path="/path/to/node"/>" i have node object.
    Code snippet
    <pz:contentSelector rule="ContentDisplaySelector" versionedContent="true" id="nodes"/>
    <%
    InputStream in =null;
    if(nodes.length>1)
         ArrayList<Version> nodeArrayList = new ArrayList<Version>();
         for(int i=0;i<nodes.length;i++)
              if(null != nodes[i] && Workflow.PUBLISHED == nodes.getStatus())
              nodeArrayList.add(nodes[i]);
    //sorts as per start date and end date
         Collections.sort(nodeArrayList,new VersionedNodeComparator());
         IVersionManager versionManager = ContentManagerFactory.getVersionManager();
         ContentContext contentContext = new ContentContext();
    //how can i use this input stream to render the html output
         in = versionManager.getStream(contentContext,nodeArrayList.get(nodeArrayList.size()-1).getNodeId(),nodeArrayList.get(nodeArrayList.size()-1).getProperty("file").getId());
    %>
    ${templates:getFileContents(<%nodeArrayList.get(nodeArrayList.size()-1)%>)}
    i m also looking for a tag based solution.
    please help with ur suggestions.
    chandar..

  • Connection to gateway fails

    Dear Guru's
    We have imported portal content in our PRD portal, however when we try to reach some ESS services the following error message appaers, help needed
    Connect to SAP gateway failed Connect_PM  TYPE=A ASHOST=nldbpd00 SYSNR=01 GWHOST=nldbpd00 GWSERV=sapgw01 PCS=1 LOCATION    CPIC (TCP/IP) on local host with Unicode ERROR       partner 'nldbpd00:sapgw01' not reached TIME        Fri Jul 31 14:34:57 2009 RELEASE     700 COMPONENT   NI (network interface) VERSION     38 RC          -10 MODULE      nixxi.cpp LINE        2823 DETAIL      NiPConnect2 SYSTEM CALL connect ERRNO       10060 ERRNO TEXT  WSAETIMEDOUT: Connection timed out COUNTER     2
    I allready set the JCO Pool numbers to 100 etc.
    Variable CPIC_MAX_CONV is set in Windows.
    Has this something to do with RFC-connections? Or do we need to open a port?
    Looking closer at the service it calls sapgateway sapgw01 wich is the gateway of our acceptance system, the service should call gateway sapgw00 wich is the gateway of our PRD system. How can we fix this ?
    Edited by: Stephan Luijbregts on Jul 31, 2009 5:18 PM
    Edited by: Stephan Luijbregts on Jul 31, 2009 5:20 PM

    Hi,
    There is some problem with the Jco connection. If you go to JcO maintenence and test the connectivity of each data/metadata  (in webdynpro page of Content admin)you will know which connection has the problem. The causes might be
    1. Service not included in services file of the server
    2. Wrong parameter
    3. Something wrong in SLD
    Regards
    Srini
    Edited by: Sinivasan Rajamani on Aug 1, 2009 8:30 PM

  • Convert Large Binary File to Large ASCI File

    Hello, I need some suggestions on how to convert a large binary file > 200MB to an ASCI File. I have a program that streams data to disk in binary format and now I would like to either add to my application or create a new app if necessary. Here is what I want to do:
    Open the Binary File
    Read a portion of the File into an array
    Convert the array to ASCI
    Save the array to a file
    Go back and read more binary data
    Convert the array to ASCI
    Append the array to the ASCI file
    Keep converting until the end of the binary file.
    I should say that the binary data is 32-bits and I do need to parse the data; bits 0-11, bits 12-23, and bits 31-28, but I can figure that out later. The problem I see is that the file will be very large, perhaps even greater than 1GB and I don't have a clue how to read a portion of the file and come back and read another portion and then stop at the end of the file. I hope to save the data in a spreadsheet.  If anyone has some experience with a similiar situation I'd appreciate any input or example code.
    Thanks,
    joe

    sle,
    In the future, please create a new thread for unrelated questions.  To answer your question, you can use "Split Number" from the Data Manipulation palette.
    Message Edited by jasonhill on 03-14-2006 03:46 PM
    Attachments:
    split number.PNG ‏2 KB

  • IOS8 fails to stream password protected website mp3 and mp4 files

    EDucational content in a password protected website folder (mp3 and mp4 lecture presentations) fail to stream from a simple directory list website with iOS 8 yet continue to work fine on an iPhone 4 with iOS 7.   Apple says "expected behavior" with all browsers on iOS 8.  Before i direct new students to other platforms so they can access course material, any fixes?

    i drafted the solution here,
    https://wiki.archlinux.org/index.php/Us … ows_shares
    why is it i seem to get no comments on most of my posts, do i just do wierd stuff, or have i offended someone?  :-| 
    If your not sure if i do wierd stuff, read the link above, lol.

  • (102) RFC_ERROR_COMMUNICATION: Connect to SAP gateway failed

    hello everybody,
    i have a problem in all my receiver RFC comunication Channel (PI 7.1).
    Every night we resart the R3 system where CC need to comunicate.
    On the morning all Receiver RFC CC don't work and i have the follow error:
    Receiver channel 'CC_SAP_RFC_LOOKUP' for party '', service 'BS_ECD'
    Error can not instantiate RfcPool caused by:
    com.sap.aii.adapter.rfc.RfcAdapterException: error initializing
    RfcClientPool:com.sap.aii.adapter.rfc.core.repository.RfcRepositoryException: can not connect to
    destination system due to: com.sap.mw.jco.JCO$Exception: (102) RFC_ERROR_COMMUNICATION: Connect
    to SAP gateway failed
    Connect_PM TYPE=A ASHOST=192.168.10.38 SYSNR=00 GWHOST=192.168.10.38 GWSERV=sapgw00 PCS=1
    I need stop and start the CC.
    I cannot propose to customer to stop and start CC every morning.
    How can i solve this problem?
    thanks
    Alex

    Hi,
    As a workaround you can plan the availability of your RFC channels according to the downtime of R3 system.
    The channels will be stopped and started automatically in this case. take a look here,
    http://help.sap.com/saphelp_nwpi71/helpdata/en/46/ad6cfeb5492a86e10000000a1553f6/content.htm
    regarding the problem, did you see Q25 of this note
    Note 730870 - FAQ XI 3.0/ PI 7.0/ PI 7.1/ PI 7.11/ PI 7.2/ 7.3 RFC Adapter
    regards,
    francis

  • STREAMING 을 이용해서 BLOB 에 BINARY DATA 를 저장하는 SAMPLE

    제품 : JDBC
    작성날짜 : 2003-08-07
    STREAMING 을 이용해서 BLOB 에 BINARY DATA 를 저장하는 SAMPLE
    ============================================================
    PURPOSE
    STREAMING 을 이용해서 BLOB COLUMN 에 BINARY DATA 를 저장하는
    방법을 SAMPLE 을 통해 알아 봅니다.
    Explanation
    다음 예제는 먼저 blob column 이 들어 있는
    MEDIA_STORE 라는 table 을 만들고 그 table 안에
    e:\temp\mytest.avi 파일을 insert 하는 내용입니다.
    Example
    다음을 실행하기 전에 다음명령으로 예제 TABLE 을 생성해야
    합니다.
    CREATE TABLE MEDIA_STORE ( MNAME VARCHAR2(25),
    MTYPE VARCHAR2(15),
    MDATA BLOB );
    OracleBLOB.java 소스
    import java.io.*;
    import java.sql.*;
    import oracle.sql.*;
    import oracle.jdbc.driver.*;
    public class OracleBLOB extends Object
    Connection conn;
    public OracleBLOB()
    private void openSession() throws SQLException, Exception
    try {
    //Register the Oracle JDBC Driver.
    Class.forName("oracle.jdbc.driver.OracleDriver");
    //DriverManager.registerDriver(new oracle.jdbc.driver.OracleDriver());
    //Open a session.
    conn = DriverManager.getConnection("jdbc:oracle:thin:@krint-5.kr.oracle.com:1525:ora920","scott","tiger");
    } catch(SQLException e) {
    e.printStackTrace();
    private void insertBLOB() throws SQLException, Exception
    BLOB blob;
    File binFile;
    FileInputStream instream;
    OutputStream outstream;
    try {
    //Set AutoCommit to OFF - required by BLOB locking mechanism.
    conn.setAutoCommit(false);
    //Create a statement.
    Statement stmt = conn.createStatement ();
    //Insert an empty BLOB locator.
    stmt.execute("INSERT INTO MEDIA_STORE VALUES('THX','DVD-VOB',empty_blob())");
    //Execute the query and lock the BLOB row.
    ResultSet rset = stmt.executeQuery ("SELECT MDATA FROM MEDIA_STORE WHERE MNAME='THX' FOR UPDATE");
    rset.next();
    //Get the BLOB locator.
    blob = ((OracleResultSet)rset).getBLOB(1);
    //Get the large binary media file.
    binFile = new File("e:\\temp\\mytest.avi");
    instream = new FileInputStream(binFile);
    //Insert to the BLOB from an output stream.
    outstream = blob.getBinaryOutputStream();
    //Read the input stream and write the output stream by chunks.
    byte[] chunk = new byte[blob.getChunkSize()];
    int i=-1;
    System.out.println("Loading");
    while((i = instream.read(chunk))!=-1)
    { outstream.write(chunk,0,i); System.out.print('.'); }
    //Close the input and output stream.
    instream.close();
    outstream.close();
    //Close the statement.
    stmt.close();
    } catch(SQLException e) {
    e.printStackTrace();
    private void closeSession() throws SQLException, Exception
    try {
    //Close the session.
    conn.close();
    } catch(SQLException e) {
    e.printStackTrace();
    public static void main(String[] args) throws SQLException, Exception
    OracleBLOB app = new OracleBLOB();
    app.openSession();
    app.insertBLOB();
    app.closeSession();
    실행결과 :
    E:\temp>java OracleBLOB
    Loading
    E:\temp>
    Reference Documents
    Note:95816.1

  • Caching binary content (raw files) in Weblogic -- in-built support ?

    There are some raw binary files on disk (PDFs , images etc).
    There is a servlet which receives requests for files, does some authorization
    checks -- then reads file & delivers binary content to HTTP response.
    To avoid file read for each request, we need to cache the binary content in Weblogic.
    The important design aspects for this caching wud be : (i) some files can be quite
    large (ii) frequency of request can vary greatly between different files (ii)
    the files are not modified on disk frequently -- hence the cache can be refreshed
    after longer intervals
    Does Weblogic provide any built-in caching mechanism for such operations ?
    Thanks,
    Subodh

    To avoid file read for each request, we need to cache the binary contentin Weblogic.
    Does Weblogic provide any built-in caching mechanism for such operations ?There are some JSP cache tags.
    http://edocs.bea.com/wls/docs70/jsp/customtags.html#56944
    There are various caching packages, both commercial and open source. For
    what you're describing, I think you'd have no problem using OSCache, which
    is open source.
    http://www.opensymphony.com/oscache/
    If you need clustered cacheing use Coherence.
    http://www.tangosol.com/coherence.jsp
    Peace,
    Cameron Purdy
    Tangosol, Inc.
    http://www.tangosol.com/coherence.jsp
    Tangosol Coherence: Clustered Replicated Cache for Weblogic
    "Subodh" <[email protected]> wrote in message
    news:3fd4236c$[email protected]..
    >

  • HELP! OSB 11g binary-content

    I want to make this simple. I have poked around in the very verbose documentation and just want what must be an easy question so forgive me. I have the following scenario:
    I have a proxy service that includes a java callout. The java callout executes queries (using java as it allows a dynamic means to add additional queries as necessary without any mods). The query takes the resultset and GZIPS it and passes the compressed data as a byte array.
    The proxy then routes to a business service that makes a rest call to an external site passing the byte array to that url but not as a query parm just streamed there. The url uses the PoST method and the business service is an XML service and I have tried a Messaging Service also.
    I have tried assigning the variable that contains the binary-content ref (the variable that the byte array is assigned to out of the java callout), to the $body (I have since found out that is not right). My last try is to do nothing and I get a response that the data is not GZIP format, but I am wondering if that is because I am not really passing the data as I should...
    So...to make this easy...what, if any assign, replace, insert etc should I make with the byte array binary content variable that will be used by the business service to pass the data along? When tracing is on I see that the variable containing the byte array is set as expected with something like 'con:binary-content ref=.......'.
    Any help is appreciated.
    Al

    ... creates the binary-content attribute with a reference to the actual dataTo retrieve the actual binary content from the reference you have to assign it to another variable...
    Create a new variable $binary (can be "any xml" type) and do an assign like this
    Expression: $your_variable/ctx:binary-content
    Variable: $binary
    You then assign this $binary to the body of the business service as I mentioned on the other post...
    Please let me know if this was helpful...
    Cheers,
    Vlad
    It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts)
    https://forums.oracle.com/forums/ann.jspa?annID=893

  • Any info on CRC, checksum, or other file integity VIs for large binary files?

    Working on send rather large binary files (U16 stream to file) via internet. Would like to check for file integity via CRC or comparable checksum. Would appreciate any comments/suggestions

    Hi Brian,
    You said;
    "Would appreciate any comments/suggestions".
    You did not mention what transport mechanism you plan on using.
    As I understand ALL of the standard mechanism use CRC of some form to ensure the validity of the packet BEFORE it is ever passed up the OSI 7-Layer model.
    TCP/IP based protocols will see to it that all of the segments of a transfer are completed and in order.
    UDP on the other hand is a broadcast type protocol and does not ensure any packets are recieved.
    So,
    At the very worst you should be able to handle your "sanity checks" by simply using a sequence value that is included in your out-going message. The reciever should just have to check if the current seq value is equal to the previous +1.
    I co-developed an app that ut
    ilized this technique to transfer status messages from a RT platform to a Windows machine. The status messages in this app where concidered FYI, so the sequence counter served as a way of determining if anything was missed.
    I am insterested in others thoughts on this subject.
    Ben
    Ben Rayner
    I am currently active on.. MainStream Preppers
    Rayner's Ridge is under construction

  • Reading large binary files into an array for parsing

    I have a large binary log file, consisting of binary data separted by header flags scattered nonuniformly thorughout the data.  The file size is about 50M Byte.  When I read the file into an array, I get the Labview Memory full error.  The design of this is to read the file in and then parse it fro the flags to determine where to separate the data blocks in the byte stream. 
    There are a few examples that I have read on this site but none seem to give a straight answer for such a simple matter.   Does anyone have an example of how I should approach this?

    I agree with Gerd.  If you are working with binaries, why not use U8 instead of doubles.
    If the file is indeed 50MB, then the array should be expecting 52428800 elements, not 50000000.  So if you read the file in a loop and populate an element at a time, you could run out of memory fast because any additional element insertion above 50000000 may require additional memory allocation of the size above 50000000 (potentially for each iteration).  This is just speculation since I don't see the portion of your code that populates the array.
    Question:  Why do you need an array?  What do you do with the data after you read it?  I agree with Altenbach, 50MB is not that big, so working with a file of such a size should not be a problem.

Maybe you are looking for

  • PSE9 installation problem on Mac pro---xmas gift

    Help!!! I am new to PS and received PSE9 as a gift from my sis and b-i-l for Xmas. Just getting around to install it and have received  the following, upon 2 times I tried to install it... Exit Code: 7 -------------------------------------- Summary -

  • Mid 2010 macbook pro panic shutdown

    My mid 2010 Macbook pro is experiencing an increasing number of black screen shut downs.. 3 or 4 a day currently. Often this occurs when the keyboard or mouse is touched after it has been idle for a short period, and sometimes mid use. Ive tried runn

  • In ID CS5 SDK, where are those Preflight and Package go?

    In ID CS5, there are no longer "IPreflightSrcData.h", "IS4SPPackage.h", etc, How am I going to DoPreflight(), SetHiddenLayersFlag(false), etc? Anyone knew? Moreover, when I do Package on CS5 doc with missing font and links by using ID CS5 interface f

  • Placing images causes freeze up.

    I am currently running CS3. Suddenly when I try to place an image the program freezes and I need to force quite. I have tried uninstalling fonts, deleting prefrences, software updates. Nothing is working. Suggestions?

  • Where is the area to look up a phone number?

    Why must Verizon change the way their web page looks and when you do make a change why is it so hard to find things like looking up a phone number?  Since doesn't want to send out phone books to our homes any longer so it should be very clear where t