Large binary data readout from scope

Hi ,
I would like to know how I can readout a large amount of data, 10 MSamples for a Scope trace of 10 us/div and display it on VI.
I am using direct SCPI commands instead drivers, due to the speed I need. After manually configuring the Scope, I run in the loop the following commands
:FORMatATA REAL,32
RUNSingle;*OPC?
:CHANnel1:WAVeformATA?
The queried data is in binary format and I don't know how to display it.
If you have any example program that could do it very fast, please share it.
Many thanks in advance
Y3G (...if there is LTE)

What scope are you using?
As Dennis said, you need to read the manual. It will tell you what the format of the data coming back is. I've seen some just spit back 16 bit data that you then have to convert somehow. Others will give you an actual double precision floating point. And some have additional data they send with the raw data.
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines

Similar Messages

Errors and exceptions in writing large binary data on sockets!!! urgent

hi
I am trying to write large binary data in the form of byte arrays on sockets.
Data is as large as 512KB(== 524288bytes) So i store the data (actually read from a file through FileInputStream ) and then write on the socket with lines like this
DataOutputStream dos =
new DataOutputStream(new BufferedOutputStream(sock.getOutputStream()));
dos.write(b);
/* suppose b is the arrayreference in which data is stored. sometimes i write with that offset + len function*/
dos.flush();
dos.close();
sock.close();
but the program is not stable: sometimes the whole 512KB is read on other side and sometimes less usually 64KB.
The program is unthreaded.
There is another problem : one side(reading or writing) sometimes gives error :
java.net.SocketException: Software caused connection abort: socket write error
please reply and reply soon and give ur suggestions
thanks

hi
I am trying to write large binary data in theform
of byte arrays on sockets.
Data is as large as 512KB(== 524288bytes) So istore
the data (actually read from a file through
FileInputStream ) and then write on the socketwith
lines like this
DataOutputStream dos =
new DataOutputStream(new
BufferedOutputStream(sock.getOutputStream()));
dos.write(b);
/* suppose b is the arrayreference in which datais
stored. sometimes i write with that offset + len
function*/
dos.flush();
dos.close();
sock.close();
but the program is not stable: sometimes the whole
512KB is read on other side and sometimes less
usually 64KB.
The program is unthreaded.
There is another problem : one side(reading or
writing) sometimes gives error :
java.net.SocketException: Software caused
connection abort: socket write error
please reply and reply soon and give ursuggestions
thanksUmm how are you reading the data on the other side?
some of your code snippet might help. Your writing
code seems ok. I've written a file transfer program
in a similar fashion and have successfully testing on
different platforms (AIX, AS400, Solaris, Windows,
etc) without any problems and without needing to set
the buffer sizes with files as large as 600MB and you
said you're testing this on the loopback?
Point here is you should never need to reset any of the default TCP options to get program correctness. The options are more for optimizations and fine tuning. If indeed you need to change the options to get your program to work, then you program wont be able to scale under different load.

How to upload large binary data to dB so it can be read by any app?

Hi everyone,
Short version: how do you upload binary data into a MySQL blob field in such a way that it can be read by any application?
Long version:
I've been struggling with the problem of putting files into database BLOB fields. (MySQL and Database Connectivity Toolkit).
I was initially building a query string and executing the query but was finding that certain binary characters were causing failures (end of string terminators, etc...) So, a working solution was to encode the binary string, and that worked fine, although bloated the dB a fair bit. I could decode in LabVIEW and then save the file as needed.
Now, the customer wants to be able to save the files using other apps, including the MySQL Query Browser, so an encoded file is no good.
I found using a parametrized query allows me to put the unencoded string into the dB, but it appends a 4-byte length at the front of the BLOB before it inserts it into the dB. Some apps ignore these 4-bytes (such as .pdf) but most do not.
A related thread on NI discussion forums: http://forums.ni.com/ni/board/message?boar...ssage.id=354361 has no solution, and my support ticket at NI has been ongoing without answer for a while.
Thanks,
Ben

The problem is the DCT. Using ADO it is fairly easy to insert binary data into a BLOB field. I have not tried it in MySQL, but it works fine in SQL Server, Oracle, Firebird and other free/open source databases I have tried. To get you started, see this thread.
Mike...
Certified Professional Instructor
Certified LabVIEW Architect
LabVIEW Champion
"... after all, He's not a tame lion..."
Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps

Where is the binary data of this icon stored and retrieved from Application server?

Hello guys,
Today I observed one phenomenon and could not explain it per my knowledge.
I have one url which points to an icon in application server:
https://<host name>:44301/sap/public/bc/ur/nw5/themes/sap_corbu/common/libs/Icon/SuccessMessage.gif
I could successfully open it via chrome:
and after that I could see an entry in ICM server cache. Everything works perfectly.
Then I tried to check this icon in mime browser in SE80. To my surprise, the folder /sap/public/bc/ur/nw5/themes is empty.
However, the ICM cache shows that there is a subfolder called "sap_corbu" under "themes" folder. But why I cannot find it in mime browser?
Then I write a report to retrieve the binary data of icon via CL_HTTP_CLIENT, and clear the ICM buffer via tcode SMICM.
I expect this time some database table will be queried to load the content of the icon, since now the buffer is not available.
To my surprise again, in SAT no database table is involved.
So now I am confused: since I have already cleared the ICM server cache, where does the icon binary data come from when I run the report to access the icon?
Best regards,
Jerry

Hello guys,
one colleague today told me that there is a zip file "ur_mimes_nw7.zip" in MIME repository /PUBLIC/BC/UR/ur_mines_nw7.zip. I download it locally and unzip it and indeed find many theme folders including sap_corbu folder and its resource files. So I guess there must be some logic done in web application server which will unzip this archive file and put each theme folder to the corresponding folders in application server. I would assume those logic are done outside ABAP stack side, this is the reason I cannot find any hint of them in ABAP backend via tcode SAT even I clear both client and server side cache.
Best regards,
Jerry

Creating one file per each 50 Mb of data received from PI

Hi Experts,
I have a scenario JMS to FIle.I have to create separate files for each maximum of 50MB received by SAP PI.
For example if PI receive 160 MB data then i have to create 4 files i.e 1st file with 50 MB file data ,2nd file with 50 MB file data ,3rd file with 50 MB file data and 4th file with 10 MB file data. How to acheive this any suggestion.
Regards
Deepak

Hi Deepak,
Following logic can be applied if and only if the data that you are receiving from JMS is binary one(not a structured). In that case, you can break your large binary data file into small small packets of any size.
In SAP PI 7.30/7.31 this fuctionality is available in the File sender and receiver channel. You can directly use it if you are working on the PI 7.30/7.31.
If you are not using 7.30/7.31 then you need to write a adapter module which does same functionality. Logic is simple:
Step 1: Get the XI message payload and convert it into binaryStream object.
Step2: find the length of binaryStream and then calculate the no.of packets that you want to create by dividing binaryStream size with packet's size that you want. eg. if main payload size is 160 MB and packet's size is 50 MB and no.of packets = 160/50 =3.2 round off to 3.
Step 3: Divide the large file size 4 times with given packet size and put remaining data into last packet.
Step5: change all the small binaryStream packet into Files and store them into target directory.
Best Regards,
RK

EJB : Binary data download

Please tell how to download large binary data (100-200Mb) from Db through EJB.

Where is the EJB executing ?.
Are you mentioning about the EJB container of JServer ?.
I do not see anything different compared to the procedure used to retreive data from the database using any Java client. You need to use JDBC and retreive the data from the columns which store the data

Download file problem for binary data?

Dear All,
I have wrote a jsp file to do download page. I have used a piece of code from the JDC to this. This code will prompt the download dialog box each time user clicks the download button. The code itself will set the content type for different application. The code is like below:
try
java.io.File fileobj = new java.io.File(strFolder + strFile);
response.setContentType(application.getMimeType(fileobj.getName()));
response.setHeader("Content-Disposition","attachment; filename=\""
+ strFile + "\"");
java.io.FileInputStream in = new java.io.FileInputStream(fileobj);
int ch;
while ((ch = in.read()) != -1) {
out.write(ch);
out.flush();
in.close();
} catch(Exception e)
The code can download and handle text file correctly when it is openned in the text editor or inside the IE. But when a PDF file or Image is downloaded and openned in the PDF viewer or image viewer, it is corrupted and cannot be viewed. What is the problem? Any ideas?
So, I wonder this code can handle binary data or not. It is seen like there is no different code to handle text and binary data in Java/Jsp.
Thank you very much!
Best Regards,
Rockyu Lee


Add following lines to .tld file (custom tag definition)
<tag>
<name>downloadbinary</name>
<tagclass>org.rampally.DownloadBinaryTag</tagclass>
<bodycontent>JSP</bodycontent>
</tag>
Add following line to JSP files.
In JSP, keep one line of source. Make sure that there are no space and additional line feeds at the any where
in the JSP files except JSP tags.
<%@ taglib uri="/WEB-INF/taglibs/mb.tld" prefix="mytags" %>
<mytags:downloadbinary />
I am hoping that you have all required parameters such as fileName to download, etc.
in your session or request object.
Tag class ....
public class DownloadBinaryTag extends TagSupport {
 public int doEndTag() throws JspException {
 // TODO: get binary data from filename or
 // binary data buffer from datase.
 // I am making it simple .. assume that it is a request parameter for
 // you test easily.
 String fileName = request.getParameter( "filename" );
 java.io.File file = new java.io.File( fileName);
 java.io.DataInputStream dis;
 try {
 dis = new java.io.DataInputStream(new FileInputStream(fileName));
 } catch (FileNotFoundException e) {
 // do error handling ...
 return EVAL_PAGE;
 BinaryUtil.sendBinaryFile( dis, (HttpServletResponse) pageContext.getResponse(), contentType );
 return EVAL_PAGE;
public class BinaryUtil
 static public void sendBinaryFile( DataInputStream dis,
 HttpServletResponse response,
 String contentType ) {
 try {
 response.setContentType(contentType);
 String fileName="test.pdf";
 response.setHeader("Content-disposition", "inline; filename=" + newFileName );
 ServletOutputStream sout = response.getOutputStream();
 int len;
 byte[] data = new byte[128 * 1024];
 while ((len = dis.read(data, 0, 128 * 1024)) >= 0)
 sout.write(data, 0, len);
 sout.flush();
 sout.close();
 } catch (Exception e) {
 System.out.println(e.getMessage());
 static public void sendBinaryFile( byte[] data,
 HttpServletResponse response,
 String contentType ) {
 try {
 response.setContentType(contentType);
 String fileName="test.pdf";
 response.setHeader("Content-disposition", "inline; filename=" + newFileName );
 ServletOutputStream sout = response.getOutputStream();
 sout.write(data);
 sout.flush();
 sout.close();
 } catch (Exception e) {
 System.out.println(e.getMessage());
You may have to change 'inline' to 'attachment' if you do not want IE to inline the document.
That's all!!.. Hope this helps...!

How to store the data captured from oscilloscope into the MS Access database table

Hi All,
In my application, I tried to save the data captured from SCOPE, but could store only 200 bytes. I've taken the Memo data type for the field in database. I want to store all data ( 4 channels) in one field & retrieve back and display on the XY Graph.
Thanks in advance.
Regards,
Shrini

kramish wrote:
Im pretty sure that Access does support JDBCNo it does not. It supports ODBC.
just doing a quick Google came up with some pages:
http://blog.taragana.com/index.php/archive/access-microsoft-access-database-from-java-using-jdbc-odbc-bridge-sample-code/
http://www.javaworld.com/javaworld/javaqa/2000-09/03-qa-0922-access.html
Both articles explains how to use the jdbc-odbc bridge. I think I've seen a pure jdbc driver for access but it wasn't from Microsoft and it wasn't free.
Kaj

Binary Data

Hi,
I'm developing a program that reads and writes data via http. Although I am having a problem with the response that the server is giving me. The server is sending me binary data and I'm unsure how to decode it. For example, part of the below request returns 41 97 33 33, which is supposed to convert to 18.90. Here is the code that I'm using to connect and read the data.
URL urlq = new URL(url);
URLConnection streamrConnection = urlq.openConnection();
streamConnection.setDoOutput(true);
DataInputStream dis = new DataInputStream(streamConnection.getInputStream());
float inputLine;
while ((inputLine = dis.readFloat()) != -1) {
System.out.printf("%f",inputLine);
The output of this code is
0.000000
0.000000
3367254360064.000000
0.000000
-0.000000
-0.000000
-0.000000
-0.000000
0.000000
0.000000
-67013848328296200000.000000
-0.000000
-0.000000
-0.000000
-0.000000
-206013237815188270000000.000000
0.000000
1084495953920.000000
Could anyone tell me the proper way to decode binary data coming from a server over http? Thanks for any help.

jjstuart79 wrote:
In order to print the actual bytes I'm receiving would I just use the int read(byte[] b) or the byte readByte() methods from the dataInputStream class? Maybe just wrap it in a LoggingInputStream?
You can find loads of examples from Google (LoggingInputStream).

Download Binary Data File over Serial Port

I need help setting up a .vi that I can use to download a binary data file from a dos-based system. I will send the system a command, say ascii "DOWNLOAD", and then the remote system will send me a binary data file that will be approx. 600MB. I won't be doing any display/manipulation using labview, I will just need to have the option available in LV to recieve the file.
Any examples would help a programmer that is new to LV and is getting a little desperate.

A VISA Read doesn't care whether the data it's getting is binary or ASCII. Where you might have problems is detecting that file transfer is complete. If you have enable termination character set to True in the VISA Configure Serial Port, the read will stop as soon as the termination character is detected. The default termination character is 0xA or a linefeed. You probably don't want to use this. If the file is terminated with a character or string of characters that you now will be unique, you can use this. If there is no unique termination character at the end of the file, the next best thing is to know the file size exactly and set the byte count of VISA Read to that number. Based on file size and baud rate, you would also need to adjust the VISA timeout value. Another way to do this is to transfer the data in pieces and write to a file as soon as the data is received. The reading of data would then be terminated when there are no more bytes available at the serial port. I've attached a LabVIEW 7.0 program that should give an idea of the last approach.
Attachments:
File Transfer.vi ‏57 KB

Fix for "Graph Acquired Binary Data.vi" in daqmx 7.4's "Measure Voltage.llb". (factory gains are reversed)

While perusing binary data collected from the SCXI 1102 and usb 1600, the gains were found
to be reversed using daqmx writer/reader example code from NI. This bug only surfaces if your using different gains amongst the channels.
http://sine.ni.com/apps/we/niepd_web_display.display_epd4?p_guid=F7199E619CBF4215E0340003BA230ECF&p_node=201208&p_submitted=Y&p_rank=5&p_answer=yes
has the fix for the binary to floating point viewer vi, "Graph Acquired Binary Data.vi".
Enjoy.
Best,
Davy Baker
GAMI

duplicate post
Continue in other thread
Message Edited by smercurio_fc on 11-14-2008 09:10 AM

Why is performance so slow reading binary data from a SQL Azure DB with EF6.x

I'm running a WPF client that hits a SQL Azure DB using EF 6.x. For the most part, everything seems to be working fine. The one exception is when I try to read a large binary column.
I am storing files in the DB as a binary column. When I test using the local DB, everything sings. When I switch to the Azure DB, I get timeouts when I try to read the file contents. I have no problem saving the binary data to the DB, just
reading it.
I don't know how to troubleshoot this. I looked at the Query Performance page in the Azure portal, but it doesn't time stamp anything in there and you can't clear it, so I can't correlate what's running with the queries that show up there.
I tried to start SQL profiler against the DB, but was denied because I'm not a member of the sysadmin fixed server role.
If I query for the data directly, it comes back quickly. So this seems to be an Azure via EF issue.
Any help is appreciated.
http://digitalcamel.blogspot.com/

Hi Digital Camel,
Since I don't know what your scenario is, I won't argue too much about not storing binaries in your SQL DB, but still: don't store binaries in your SQL DB :). The main reason is simple: first and foremost, in both the current and future pricing tier your
levels are defines on the size of the DB. Basically, you pay way more by storing your binaries on your SQL layer rathern than storing them elsewhere, such as Azure Storage. Second, the protocol your binaries would be downloaded over the wire is prone to network
connectivity issues: you could use HTTP(S) or FTP instead, if you'd use Azure Storage. Last but not least, when you download the binary from your DB, you keep a connection open which in the end is a connection other users might have used to query data instead.
However, in regard to your question, how did you "query for the data directly"? Did you try to query the data using SSMS with the Client Statistics option on? This could tell you if the problem is network, server or client related.
Hope this helps!
Alex

How can I transfer binary data from a database to another database?

Hi all.
I want to transfer binary data from a MS SQL Server 2000 to anohter SQL Server 2000.
I created JDBC(table) to JDBC(stored procedure) scenario,and
I uploaded a JPG image file to the sender table using the java program I developed.
The JPG data was transfered to receiver,but the transfered data was broken.
I can't not open the file correctly.
Can XI transfer binary data using JDBC adapter?
The sender table structure is following.
column (data type)
id (int 4)
binary (binary 8000)
flag (int 4)
The receiver stored procedure parameter is following.
parameter (data type)
id (smallint)
binary (binary 8000)
flag (smallint)
Regards.
Yuuki

Hi,
Can XI transfer binary data using JDBC adapter?
Ans: Yes
Supported JDBC Types
http://help.sap.com/saphelp_nw04s/helpdata/en/16/9dc9ac8bc72a48b80e639abaa2e497/frameset.htm
http://help.sap.com/saphelp_nw2004s/helpdata/en/2e/96fd3f2d14e869e10000000a155106/content.htm
Mapping JDBC types to Java types
http://help.sap.com/saphelp_nw04/helpdata/en/7d/79dfa72d1049bc963f4f272bb1638e/frameset.htm
Regards,
Prateek

Writing binary data to ASP file from applet through URLConnection

Hi Everybody,
I am facing a proble with HttpURLConnection.I want to write some binary data from applet to an ASP file.The other end ASP file read this binary data and process , Here problem is I have opened URLConnection to the page and Created OutputStream and writing byte by Write() method But other end we are not getting bytes...we are not getting error too at java side..can any body help me..do we need to set any property to URLConnection...here I am giving sample code...
OutputStream os;
URL uConnect2;
HttpURLConnection hucConnect2;
uConnect2= new URL("http://webserver/vnc/sendtoserver.asp?"); hucConnect2=(HttpURLConnection)uConnect2.openConnection();
hucConnect2.setDoOutput(true);
hucConnect2.setRequestMethod("POST")
os=new DataOutputStream(hucConnect2.getOutputStream());
os.writeBytes("Hello");
Thanks in Advance
Madhav

Do you remember to flush() and close() the stream?

Seeking recommendations for handling large binary documents with security(preferable) for inbound and outbound scenarios from OSB- SOA and SOA- OSB

Hi,
I am currently working on a project with the following requirements
1. Client transfers binary document (between 1-20MB in size) from OSB proxy to SOA composite to Content Management system
2. Client retrieves binary document (between 1-20MB in size) from Content Management system to SOA composite to OSB proxy
In otherwords, a inbound and outbound integration.
What I have tried so far and my results:
Scenario A
1. Enabled MTOM on SOA composite by attaching wsmtom policy
2. Created an OSB business service and consumed the SOA composite application
3. Enabled MTOM on OSB proxy and business service and configured it to pass by reference
Scenario B
1. Enabled MTOM and security on SOA composite by attaching wsmtom policy and SAML policy
2. Created an OSB business service and consumed the SOA composite application
3. Enabled MTOM on OSB proxy and business service and configured it to pass by reference
I have a demo integration setup that writes a binary document to a file using the above steps. My SOA composite has a file adapter that writes the binary data to an external file and it is exposed as a web service with a simple WSDL definition that has an inline XSD schema with an single element of base64binary type. I have added a mediator that maps this base64binary element node to the file adapter's input node.
Result for Scenario A with file size less than 1 MB:
Flawless execution with sub-second response times
Result for Scenario A with file size of 8MB
First attempt: SOA composite faults with database transaction related error, solved by increasing JTA timeout
Second attempt: Flawless execution, but file transfer took over 100 seconds to complete. This is very poor performance and my suspicions are that this cannot be the expected behaviour, but I dont know the internal workings of the SOA composite and why its taking this long.
Result for Scenario B:
The OSB business service does not accept/recognize the SAML policy in the WSDL and suggests to configure OWSM policies manually, but OWSM policy in OSB does not have the wsmtom policy. Regardless of this, any permutation of MTOM + WSS security in this integration scenario either did not work outright or MTOM optimization was not happening ie binary data was materalizing in the message body.
I have only about 3 weeks left to implement a viable solution and the closest ive come to a solution is Scenario A but that +100 second response time for an 8MB file is really worrying.
I would appreciate any level of guidance, recommendations or suggestions as to how I go about tackling this problem.
Thanks
regards,
Johnny

I think this is due to the underlying mechanism of weblogic classloading..
You can contact oracle support @ https://support.oracle.com to report issues. Roughly this is the process .
1- get the Oracle Customer Support Identifier (CSI) for the client you are working for.
2- Create a user profile quoting the CSI. This will send an approval request to oracle support admins at your client.
3- Get the oracle support admins at your client site to approve your request for support access.
4-Once they approve , you can access the support site and raise service requests.

Large binary data readout from scope

Similar Messages

Maybe you are looking for