How to remove noisy data points read from a text file

Reading data measurements taken in from a txt file. How do I get rid of noise aside from going into the text file and deciding point by point what to delete.

Well going in point by point and deleting is certainly one way of going about it. Of course that would defeat the entire purpose of having this great programming enviroment that is capable of doing that kind of thing for us.
Is your text file small enough to upload? Obviously you know what the criteria are for judging whether or not a data point is acceptable so it should be simple enough to program. Give us a bit more information and I can assure you there will be a race between LabVIEW experts to see who can post the cleanest, simplest, and fastest piece of code that will do what you need. My wager is on altenbach, but there are a few others here that are almost as impressive.

Similar Messages

HOW TO WRITE AND READ FROM A TEXT FILE???

How can I read from a text file and then display the contents in a JTextArea??????
Also how can I write the contents of a JTextArea to a text file.
Extra Question::::::: Is it possible to write records to a text file. If you have not idea what I am talking about then ignore it.
Manny thanks,
your help is much appreciated though you don't know it!

Do 3 things.
-- Look through the API at the java.io package.
-- Search previous posts for "read write from text file"
-- Search java.sun.com for information on the java.io package.
That should clear just about everything up. If you have more specific problems, feel free to come back and post them.

How to read from a text file one character at a time?

Hello
I wish to read from a text file in a for loop and that on every iteration i read one charachter and proceed to the next one.
can anyone help me?
Lavi

lava wrote:
I wish to read from a text file in a for loop and that on every iteration i read one charachter and proceed to the next one.
can anyone help me?
Some additional comments:
You really don't want to read any file one character at a time, because it is highly inefficient. More typically, you read the entire file into memory with one operation (or at least a large chunk, if the file is gigantic) and then do the rest of the operations in memory. One easy way to analyze it one byte at a time would be to use "string to byte array" and then autoindex into a FOR loop, for example.
Of course you could also read the file directly as a U8 array instead of a string.
Message Edited by altenbach on 06-10-2008 08:57 AM
LabVIEW Champion . Do more with less code and in less time .

Reading from a text file into a 2D array

How do you read from a text file and put it into a 2D array? Or if someone could guide me to where I can find the information?

This tutorial shows how to read a file:
http://java.sun.com/docs/books/tutorial/essential/io/scanfor.html
This tutorial shows how to create arrays with multiple dimensions:
http://java.sun.com/docs/books/tutorial/java/nutsandbolts/arrays.html

Getting repeated values when reading from a text file.

I need to read from a text file. When the token encounters a particular word (command) I need to read the next line and perform some actions. However, this part is working but it is repeating the values again and again until it encounters the next particular word (command). Hope that someone will help me out, as always when I posted a problem in these forums.
SetOperations class - contains the set methods
// Imported packages.========================================================
import java.util.Vector;
import java.util.Iterator;
// Public class SetOperations.===============================================
public class SetOperations
     // Instance variables.===================================================
     private Vector v = null; // Creates new instance of vector.
     protected int memberCount;
     // Constructor.==========================================================
     public SetOperations()
          v = new Vector();
     } // end constructor.
     // Method isMember.======================================================
     * Checks whether the element is already a member of the set.
     * @return True if Vector v contains Object member.
     public boolean isMember(Object member)
          if (member != null) // only if Object member is not null.
               return v.contains(member); // returns true if vector already contains member.
          else
               return false; // returns false if vector does not contain member.
     } // end public boolean isMember(Object member).
     // Method addMember.=====================================================
     * Adds a member to the set.
     * @return Adds Object member to Vector v.
     public void addMember(Object member)
          //if (! v.contains(member)) // only if element is not already a member.
          if (isMember(member) == false) // only if element is not already a member.
               v.add(member); // adds a member.
     } // end public void addMember(Object member).
     // Method countMember.===================================================
     * Returns the number of members present in the vector.
     * @return Number of elements present in the vector.
     public int countMember()
          return v.size();
     } // end public int countMember().
     // Method isSetEmpty.====================================================
     * Returns true if set is empty.
     * @return True if no elements are present in Vector v.
     public boolean isSetEmpty()
          return v.size() == 0; // returns 0 if no elements are present in the vector.
     } // end of public boolean isSetEmpty().
     // Method printMember.===================================================
     * Displays member/s of the set.
     * @return Prints element/s present in the vector.
     public void printMember()
          for (int i = 0; i < v.size(); i++) // iterates through present members.
               System.out.println("[" + i + "] " + v.get(i)); // displays member/s present in the vector.
     } // end of public void printMember().
} // end public class SetOperations.
SetTextLauncher class - reads from a text file and implements the set operations
// Imported packages.========================================================
import java.util.*;
import java.io.*;
// Public class SetTestLauncher.=============================================
public class SetTestLauncher
     // Main method public static void main(String args[]).===================
     public static void main(String args[])
          displayFile("test.txt"); // outputs result from text file.
     // method to display a file on screen
     public static void displayFile (String textFile)
          // Instance variables.===============================================
          // Creates new instances of SetOperations.
          SetOperations setA = new SetOperations();
          SetOperations setB = new SetOperations();
          SetOperations setC = new SetOperations();
          SetOperations setD = new SetOperations();
          SetOperations setE = new SetOperations();
          // Initialisation.
          String line = "", nextLine = "";
          FileReader fr = null;
          try
               // Opens the file with the FileReader data sink stream.
               fr = new FileReader(textFile);
               // Converts the FileReader input stream with the BufferedReader processing stream.
               BufferedReader br = new BufferedReader(fr);
               // Iterates through text file reading lines until end of text lines.
               while (line != null)
                    line = br.readLine(); // reads one line at a time.
                    if(line == null) break; // when the line is null break the loop.
                    // Creates a new instace of StringTokenizer.
                    StringTokenizer st = new StringTokenizer(line);
                    // Loops until there are no more tokens.
                    while (st.hasMoreTokens())
                         String token = st.nextToken(); // reads next token.
                         // Only if the token encounters the String "membera".
                         if(token.equals("membera"))
                              nextLine = br.readLine(); // gets next line.
                              setA.addMember(nextLine); // adds a member to the set.
                              // Displays members present in the set if vector is not empty.
                              if (! setA.isSetEmpty())
                                   setA.printMember(); // print members present.
                              // Displays the number of member/s present in the vector.
                              System.out.println("Number of set members: " + setA.countMember());
          // Catches and displays exceptions.
          catch (FileNotFoundException exp)
               System.out.println(exp.getMessage());
               exp.printStackTrace();
          catch (IOException exp)
               System.out.println(exp.getMessage());
               exp.printStackTrace();
          finally
               try
                    // if file is found
                    if (fr != null)
                         // close file
                         fr.close();
               catch (IOException exp)
                    exp.printStackTrace();
     } // end public static void main(String args[]).
} // end public class SetTestLauncher.

Thanks for your interest. Please ignore SetOperations class, it is just the class containing the methods and it works correctly since I checked it without reading from a text file. I marked the part where I think lies my problem in class SetTestOperations.
The information in the text file is as follows:
membera
Hillman
membera
Skoda
membera
Honda
membera
Toyota
and the result is:
[0] Hillman
Number of set members: 1
[0] Hillman
[1] Skoda
Number of set members: 2
[0] Hillman
[1] Skoda
[2] Honda
Number of set members: 3
[0] Hillman
[1] Skoda
[2] Honda
[3] Toyota
Number of set members: 4
instead of just one set:
[0] Hillman
[1] Skoda
[2] Honda
[3] Toyota
Number of set members: 4
Hope it is easier to understand like this.
Regards
Marco
I need to read from a text file. When the token
encounters a particular word (command) I need to read
the next line and perform some actions. However, this
part is working but it is repeating the values again
and again until it encounters the next particular
word (command). Hope that someone will help me out,
as always when I posted a problem in these forums.
SetOperations class - contains the set
methods
// Imported
packages.=============================================
===========
import java.util.Vector;
import java.util.Iterator;
// Public class
SetOperations.========================================
=======
public class SetOperations
// Instance
e
variables.============================================
=======
private Vector v = null; // Creates new instance of
f vector.
     protected int memberCount;
Constructor.==========================================
================
     public SetOperations()
          v = new Vector();
     } // end constructor.
// Method
d
isMember.=============================================
=========
* Checks whether the element is already a member of
f the set.
     * @return True if Vector v contains Object member.
     public boolean isMember(Object member)
if (member != null) // only if Object member is not
ot null.
return v.contains(member); // returns true if
if vector already contains member.
          else
return false; // returns false if vector does not
not contain member.
     } // end public boolean isMember(Object member).
// Method
d
addMember.============================================
=========
     * Adds a member to the set.
     * @return Adds Object member to Vector v.
     public void addMember(Object member)
//if (! v.contains(member)) // only if element is
is not already a member.
if (isMember(member) == false) // only if element
nt is not already a member.
               v.add(member); // adds a member.
     } // end public void addMember(Object member).
// Method
d
countMember.==========================================
=========
* Returns the number of members present in the
e vector.
     * @return Number of elements present in the vector.
     public int countMember()
          return v.size();
     } // end public int countMember().
// Method
d
isSetEmpty.===========================================
=========
     * Returns true if set is empty.
* @return True if no elements are present in Vector
r v.
     public boolean isSetEmpty()
return v.size() == 0; // returns 0 if no elements
ts are present in the vector.
     } // end of public boolean isSetEmpty().
// Method
d
printMember.==========================================
=========
     * Displays member/s of the set.
     * @return Prints element/s present in the vector.
     public void printMember()
for (int i = 0; i < v.size(); i++) // iterates
es through present members.
System.out.println("[" + i + "] " + v.get(i)); //
// displays member/s present in the vector.
     } // end of public void printMember().
} // end public class SetOperations.
SetTextLauncher class - reads from a text file
and implements the set operations
// Imported
packages.=============================================
===========
import java.util.*;
import java.io.*;
// Public class
SetTestLauncher.======================================
=======
public class SetTestLauncher
// Main method public static void main(String
g args[]).===================
     public static void main(String args[])
displayFile("test.txt"); // outputs result from
om text file.
     // method to display a file on screen
     public static void displayFile (String textFile)
// Instance
ce
variables.============================================
===
          // Creates new instances of SetOperations.
          SetOperations setA = new SetOperations();
          // Initialisation.
          String line = "", nextLine = "";
          FileReader fr = null;
          try
// Opens the file with the FileReader data sink
ink stream.
               fr = new FileReader(textFile);
// Converts the FileReader input stream with the
the BufferedReader processing stream.
               BufferedReader br = new BufferedReader(fr);
// Iterates through text file reading lines until
til end of text lines.
               while (line != null)
line = br.readLine(); // reads one line at a
at a time.
if(line == null) break; // when the line is null
null break the loop.
                    // Creates a new instace of StringTokenizer.
                    StringTokenizer st = new StringTokenizer(line);
                    // Loops until there are no more tokens.
                    while (st.hasMoreTokens())
String token = st.nextToken(); // reads next
next token.
// Only if the token encounters the String
tring "membera".
                         if(token.equals("membera"))
                              // *****THE PROBLEM LIES HERE....I GUESS
// need to read the next line after encountering the word membera in text file
nextLine = br.readLine(); // gets next line.
setA.addMember(nextLine); // adds a member to
ber to the set.
// Displays members present in the set if
set if vector is not empty.
                              if (! setA.isSetEmpty())
                                   setA.printMember(); // print members present.
// Displays the number of member/s present in
ent in the vector.
System.out.println("Number of set members: " +
s: " + setA.countMember());
          // Catches and displays exceptions.
          catch (FileNotFoundException exp)
               System.out.println(exp.getMessage());
               exp.printStackTrace();
          catch (IOException exp)
               System.out.println(exp.getMessage());
               exp.printStackTrace();
          finally
               try
                    // if file is found
                    if (fr != null)
                         // close file
                         fr.close();
               catch (IOException exp)
                    exp.printStackTrace();
     } // end public static void main(String args[]).
} // end public class SetTestLauncher.

How to bulk import data into CQ5 from MySQL and file system

Is there an easy way to bulk import data into CQ5 from MySQL and file system? Some of the files are ~50MB each (instrument files). There are a total of ~1,500 records spread over about 5 tables.
Thanks

What problem are you having writing it to a file?
You can't use FORALL to write the data out to a file, you can only loop through the entries in the collection 1 by 1 and write them out to the file like that.
FORALL can only be used for SQL statements.

Reading from a text file in to an array, help please

I have the following
public class date extends Loans{
public int dd;
public int mm;
public int yyyy;
public String toString() {
return String.format( "%d,%d,%d", mm, dd, yyyy );
public class Loans extends Borrowing {
public String name;
public String book;
public date issue;
public char type;
public String toString(){
return String.format( "%s, %s, %s, %s", name, book, issue, type );
import java.util.Scanner;
import java.io.*;
public class Borrowing extends BorrowingList {
private Loans[] Loaned = new Loans[20];
if i want to read in from a text file in to that array how do i do it?

sorry to keep bothering you and thanks loads for your help but now I am getting the following error mesage
C:\Documents and Settings\MrW\Menu.java:43: cannot find symbol
symbol : class IOException
location: class Menu
}catch(IOException e){
Note: C:\Documents and Settings\MrW\Borrowing.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
1 error
BUILD FAILED (total time: 0 seconds)
for this line
}catch(IOException e){

Import data into oracle from a text file?

hi guys,
How can we import data into oracle9i release 1 from a text file with comma seperated or tab seperated delimeters?
please help,
Imran

table is already created, just have to populate data into table through a dat or text file. As suggested, you would either:
1). use SQL*Loader to load the data into this table.
2). create external table on that data file and then do:
INSERT INTO your_real_table
SELECT * FROM that_external_table ;

Reading from a text file and displaying the contents with in a frame

Hi All,
I am trying to read some data from a text file and display it on a AWT Frame. The contents of the text file are as follows:
pcode1,pname1,price1,sname1,
pcode2,pname2,price2,sname1,
I am writing a method to read the contents from a text file and store them into a string by using FileInputStream and InputStreamReader.
Now I am dividing the string(which has the contents of the text file) into tokens using the StringTokenizer class. The method is as show below
void ReadTextFile()
                    FileInputStream fis=new FileInputStream(new File("nieman.txt"));
                     InputStreamReader isr=new InputStreamReader(fis);
                     char[] buf=new char[1024];
                     isr.read(buf,0,1024);
                     fstr=new String(buf);
                     String Tokenizer st=new StringTokenizer(fstr,",");
                     while(st.hasMoreTokens())
                                      pcode1=st.nextToken();
                           pname1=st.nextToken();
          price1=st.nextToken();
                          sname1=st.nextToken();
     } //close of while loop
                } //close of methodHere goes my problem: I am unable to display the values of pcode1,pname1,price1,sname1 when I am trying to access them from outside the ReadTextFile method as they are storing "null" values . I want to create a persistent string variable so that I can access the contents of the string variable from anywhere with in the java file. Please provide your comments for this problem as early as possible.
Thanks in advance.

If pcode1,pname1,price1,sname1 are global variables, which I assume they are, then simply put the word static in front of them. That way, any class in your file can access those values by simply using this notation:
MyClassName.pcode1;
MyClassName.pname1;
MyClassName.price1;
MyClassName.sname1

How to remove values data points from Apex3 Flash Chart

Hi
I am using a Apex 3.2 and I have to put Flash Charts in my application. But since the charts have are smaller in size, I do not want to have the data points coming up in the chart. I have planned to show them using hints. But unfortunately, I am not able to hide the Data Points. Can you please help. Thanks Sahcin. Here is my custom XML.
<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<root>
     <type>
          <chart type="Stacked Horizontal 2DColumn">
               <animation enabled="no"/>
               <hints enabled='yes' auto_size='no' width='200' height='20' horizontal_position='left' vertical_position='top'>
                    <text><![CDATA[{NAME}, {VALUE}]]></text>
                    <font type="Verdana" size="10" color="black"/>
                    <background color="0xF4F4F4"/>
               </hints>
               <arguments show="no"/>
               <names show='yes' position='top'/>
               <values show="no" prefix="$" postfix="" decimal_separator="." thousand_separator=',' decimal_places="2"/>
               <column_chart column_space='20' block_space='20' left_space='0' right_space='0' up_space='0' down_space='0' round_radius='0'>
                    <border enabled="no"/>
                    <block_names enabled="yes" placement="chart" rotation="45" x_offset="0" position="left">
                         <font type="verdana_embed_tf" size="8" color="0x000000"/>
                    </block_names>
                    <background type="gradient" gradient_type="linear">
                         <alphas>
                              <alpha>100</alpha>
                              <alpha>100</alpha>
                              <alpha>100</alpha>
                         </alphas>
                         <ratios>
                              <ratio>0</ratio>
                              <ratio>120</ratio>
                              <ratio>0xFF</ratio>
                         </ratios>
                    </background>
               </column_chart>
          </chart>
          <workspace>
               <background enabled="yes" type="solid" color="0xF4F4F4" alpha="0"/>
               <base_area enabled="no"/>
               <chart_area enabled="yes" x="100" y="50" width="600" height="300" deep="0">
                    <background enabled="yes" type="solid" color="0xCCFF99"/>
                    <border enabled="yes" size="1"/>
               </chart_area>
               <x_axis name="Region" smart="yes" position="left_center">
                    <font type="Verdana" size="10" color="0x000000" bold="no" align="center"/>
               </x_axis>
               <y_axis name="Booking Amount (kUSD)" smart="yes" position="center_bottom">
                    <font type="Verdana" size="10" color="0x000000" bold="no" align="center"/>
               </y_axis>
               <grid>
                    <values>
                         <lines size='1' color='0x15771A' alpha='100'/>
                    </values>
               </grid>
          </workspace>
          <legend enabled="yes" x="0" y="0" rows="2" rows_auto_count="no">
               <names width='80' enabled='yes'/>
          </legend>
     </type>
     #DATA#
</root>Edited by: user779712 on Nov 3, 2009 4:45 PM
Edited by: user779712 on Nov 3, 2009 4:46 PM

Well going in point by point and deleting is certainly one way of going about it. Of course that would defeat the entire purpose of having this great programming enviroment that is capable of doing that kind of thing for us.
Is your text file small enough to upload? Obviously you know what the criteria are for judging whether or not a data point is acceptable so it should be simple enough to program. Give us a bit more information and I can assure you there will be a race between LabVIEW experts to see who can post the cleanest, simplest, and fastest piece of code that will do what you need. My wager is on altenbach, but there are a few others here that are almost as impressive.

How do I remove certain data being imported from a php file

I have data being loaded from a php into an xml class.
My host (which is free for testing purposes) keeps adding data to the php file which causes errors. I need to know how I can delete this extra text before I put the data into an XML class so I do not get the error. I did a trace of the data and this is what comes up below. I need everything below the </data> tag to be removed but do not know how to do this. Can someone please help me.
<?xml version='1.0' encoding='UTF-8'?><data>
    <google rate='21' />
    <yahoo rate='3' />
    <msn rate='2' />
    <tv rate='10' />
    <diger rate='4' />
</data>

<script type="text/javascript" src="http://analytics.hosting24.com/count.php"></script>
<noscript><a href="http://www.hosting24.com/"><img src="http://analytics.hosting24.com/count.php" alt="web hosting" /></a></noscript>

Thanks,
Jason

in your load complete function:
var s:String=e.target.data;
var xml:XML=XML(s.split("<!-- www.000")[0]));

How to remove the DATA Provider(Query) from the WAD 3.5

Hi,
I want to remove the unused dataprovider(query) from the WAD 3.5,
How to delete the dataprovider.
Please suggest here

Go to HTML tab. You will see all the data providers on top. You can delete the unused ones there.

How do I read from a text file that is longer than 65536 lines and write the data to an Excel spreadsheet and have the data write to a new column once the 65536 cells are filled in a column?

I have data that is in basic generic text file format that needs to be converted into Excel spreadsheet format. The data is much longer than 65536 lines, and in my code I haven't been able to figure out how to carry over the data into the next column. Currently the conversion is done manually and generates an Excel file that has a total of 30-40 full columns of data. Any suggestions would be greatly appreciated.
Thanks,
Darrick
Solved!
Go to Solution.

No need to use nested For loops. No need for any loop anyway. You just have to use a reshape array function. The picture below shows how to proceed.
However, there may be an issue if your element number is not a multiple of the number of columns : zero value elements will be added at the end of the last column in the generated 2D array. Now the issue depends on the way you intend store the data in the Excel spreadsheet : you could convert the data as strings, replace the last zero values with empty strings, and write the whole 2D array to a file (with the .xls extension ) using the write to spreadsheet function. Only one (minimal) problem : define the number of decimal digits to be used;
or you could write the numeric array directly to a true Excel spreadsheet, using either the NI report generation tools or ActiveX commands, then replace the last elements with empty strings.
We need more input from you to decide how to solve these last questions.
Message Edité par chilly charly le 01-13-2009 09:29 PM
Chilly Charly (aka CC)
E-List Master - Kudos glutton - Press the yellow button on the left...
Attachments:
Example_VI.png ‏10 KB

How to remove all of the tags from a HTML file

Hi all,
I am developing a search program.
User will enter a word or some text in a textfield and after click on go button it will search the word from the html file which is reside in c: drive.
What I am trying to do is -- reading file and storing data/contents of the file in a String and so on............then store in a Vector.....so on.......
My question is ----- how can I remove all of the html tags such as: <p>, <b>,</b> <h1>, <strong>, or whatever from the String (where I store the data/contents of the html file) or from a HTML file.
I would appreciate sample code if anyone has any.
please help me in this way.
Thanks in advance
Thanks a lot.
amitindia

Hi dear,
I got the link and have found examples.
thanks for solving my problem.
Thanks for your prompt reply.
amitindia
India

Read from a text file line by line

Hi,
I am new to Labview and I am trying to output a text file line by line. For example if my text file is
START
SETRPM 1000
WAIT 10s
RAMP RPM linear,1000,2000,2 MAF linear,5,7,2
WAIT 5s
RAMP RPM sine,2000,1500,3 MAF sine,7,3,3
END
I want it to output
START
SETRPM 1000
SETMAF 5 ...and so on
I tried modifying this code provided by Altenbach but it is still not working as I want it to. Can anyone direct me toward how I can fix this?
Thank you!

Your program does exactly what you asked it to do. In particular, it will repeat 10 times, at one per second, reading (and storing in String) the (unchanging) data that you bring in on the Shift Register. This data will consist of the first line of the (assumed-)multi-line file you specified.
I suppose your question is "Why is it only showing me one line?" This is where it really pays to "Read the Directions Carefully" (or, in this case, carefully read the Help for Read from Text File).
Bob Schor
P.S. -- I pointed your code at a text file of 7 lines on my PC. When I made a few small changes (including doing away with the silly For loop that shows the same thing over and over) , I got out an array, size 7, containing the lines of text.

How to remove noisy data points read from a text file

Similar Messages

Maybe you are looking for