How to compare 1000 X 512 arrays

Hello there,
I have problem with comparing large amount of arrays. I have 1000 x 512 arrays. That means i have 1000 lines and each line contain 512 elements. I want to compare this 512 elements of each line and short out same one. how can i do? In result i want only the filtered one that means if out of 1000 line if 200 line are same then i want only 800 arrays that means 800 X 512
Thanx in advance,
dipen

Is the 2D array sorted (i.e. are the duplicate rows next to each other)?
Is the duplicate row always the same or can you have several different rows that are duplicate?
What is the datatype of the array?
No matter what, this seems like an easy task. Can you attach a VI containing typical data?
LabVIEW Champion . Do more with less code and in less time .

Similar Messages

How to compare rows in 2D array?

Hi,
I have a 2D array of binary.
- I want to compare all rows against each other.
- Two rows should be compared if they have only one different element.
- The result of comparison should be a row with the different element assigned as 2 (or any number different from 0, 1).
- Continue to compare the result rows against each other.
- Repeat it until no row can be compare (those final rows should be presented).
Any idea will be appreciated!
Solved!
Go to Solution.

sangquang wrote:
I have a 2D array of binary.
"Binary" is not a type. deep down, everything is binary one way or another. What do you actually have?
sangquang wrote:
- Two rows should be compared if they have only one different element.
You have your oder of operations mixed up! You need to compare them first before you know if they have different elements.
sangquang wrote:
- The result of comparison should be a row with the different element assigned as 2 (or any number different from 0, 1).
Please explain
sangquang wrote:
- Repeat it until no row can be compare (those final rows should be presented).
Presented how? To the user? Does that mean all the result of the earlier row comparisons should not be presented? Why not?
You post makes very little sense. Please attach a simple VI that contains a simple example of your 2D array (make current value default before saving). Then tell us what kind of result you would expect.
LabVIEW Champion . Do more with less code and in less time .

How to compare 3 values in array

Hi all
This is my first post so please be tolerant
I need to find "bad values" in array, it will be easier to explain it using example so:
I have array like this: 0 0 0 0 0 0 0 0 5 0 0 0 0 <- so "5" is the bad value, my method is to check two of nearby values so x(i-1) = 0, x(i)=5 x(i+1)=0, and if checked value is more than 25% bigger or smaller it should be replaced by average of neighborhood.
next example: 0 1 2 3 4 9 6 7 8 <- bad value is 9, and result of my filter should be (4+6)/2 = 5
I've done it using formula node (not 20% and not average, but the point is the same) and it's working but now I want to do it without C and I had lots of problems with memory cause the size of array is 10000.
I attached vi and signal thah you can check that it's working fine
Thanks
Mike
Solved!
Go to Solution.
Attachments:
vi+signal.zip ‏62 KB

MeeHow wrote:
next example: 0 1 2 3 4 9 6 7 8 <- bad value is 9, and result of my filter should be (4+6)/2 = 5
Shouldn't e.g. the value 4 be outside too, because the average of 3 and 9 (=5.5) is more that 25% different to 4?
Here is a quick draft comparing three versions (LabVIEW 8.2):
Your formula node version
the same algorithm in G
Something along the lines you are proposing here.
As you can see, the new idea is not quite satisfactory. It needs more thought. Still, these drafts should give you some ideas how to do it. Modify as needed.
Also your data is similar to a square wave and has these large step functions where the value changes dramatically. These should probably be ignored. Maybe you should look at the first derivative and replace parts where a large positive slope is immediately followed by a negative slope of similar size, for example.
You should also look at absolute steps instead of percentages. If you use percentages and the value is zero, everything is outside, because even 5000% of zero is still zero, right?
LabVIEW Champion . Do more with less code and in less time .
Attachments:
filter testMOD.vi ‏41 KB

How to compare array of String with column of a table

Hi,
i have a array of string(say array is of length 1000). I want to
compare those string in array with one table column
        - whether that table column has a string
                        if yes
                                        do nothing.
                        if no
                                        then insert that string into table.
        - whether table has obsolete row i.e, the one present in table and
not in array
                        then delete that row.
How do i go about this, because i see, it is not feasible to loop
through array and search table to find new string OR loop through each
row from table to find some obsolete row
How can i accomplish this task more feasibly(without running query for
each string, for comparission)? Is there any way to find this kind of
problem. I would have been easy if i had to compare two tables(with
UNION and INTERSECT), but it is not the case.
thanks,
kath.

I'm not sure, whether I understand your problem correctly. Only two comments:
- if both arrays are sorted, all can be done running exactly once simultaneously through both arrays.
- if the column is marked as UNIQUE, all column strings will be different. I.e. you cannot insert the same string a second time.
Regards Thomas

How to compare consecutive groups of numbers in arrays

Hi
I require to place the solution into a 1D array.
I need to compare two arrays and save the same numbers that are in both arrays but also save groups of numbers that may be in only one of the two arrays being compared.
In the example l have not been able to place all consecutive groups of numbers 8,9,10,11,12 into a 1D array.
In the example l need to filter out the zeros and the number four.
The numbers in both arrays are always in descending order however may not be in the order of index number of array. That is 15 = 15 index number
A consecutive group of numbers in this example is a group that increase by a value of 1. E.g.. 8,9,0,22,23,24 are two consecutive groups of numbers.
Thank you
Solved!
Go to Solution.
Attachments:
Compare numbers and consecutive numbers in arrays.vi ‏17 KB

Hi Lynn
I did have a look at the consecutive array solution. I have looked and looked l thought l knew how it worked but after a number of separate evaluations with other code l have failed. I am just glad it works. With the consecutive array solution l tried today my own code but l lost either the first number of the last number of a consecutive group of numbers.
I may have confused you but in doing so you have provided a real different view which l am very grateful. You have viewed the consecutive number problem as just a single 1D array problem. By doing this you have opened my eyes to another way to do the job and a way to handle this type of data. However l am also comparing two arrays. For example l have to pick up say two equal values in two columns that the consecutive array does not detect and then correctly locate a value in the final array if the value is not in the final array.
What l have not told you is also l have to be able to identify groups of numbers in two 1D arrays. E.g... Array 1 has 1,2,9,10 next array has 9,10 the final array ends up 9,10 when l would like 0,9,10. When viewing numbers by rows later on l can then detect with a array length vi the length of the 1,2 groups of numbers over a large number of columns. If 9,10 jumps to the front it becomes a wrong length. This is actually my main problem which has caused me a large amount of extra programming. I have gone back to basics to see what l can do differently and you have provided the first clue with the consecutive array. I placed it in my main program today and it filtered a lot variable data which l could not remove without losing real data. The main data lost in your solution was the say 17 number in two columns which in an image is a horizontal line. I know what l have just provided you in this paragraph is all new information but it provides a background as to what l am up to. I am getting pixel data from a 2D array and comparing +1 index 1D array with a normal array. This way l can view the data of the next column to see if there is a pattern. I am actually trying to program an array as how humans view objects in images.
I will have another go at integrating your solution next week
Regards
Michael

How to compare 2 arrays with different operator options using parameters in Teststand

Pls let me know how to compare 2 arrays using different operators like <= or >= or ==......

I am using TS 2010. FYI
ex:
Array XX [ A_Temp,
               B_Temp,
               C_Oil Pressure,
               D_Oilpressure,
Note : A_Temp, B_Temp,C_Oil Pressure,D_Oilpressure all these parameters will be getting numerical values (dynamically) from the simulink models and also in future I may need to add parameters to this array.
Array YY [A_Temp_1,
               B_Temp_2,
               C_Oil Pressure_3,
               D_Oilpressure_4,
Note : A_Temp_1, B_Temp_2,C_Oil Pressure_3,D_Oilpressure_4 all these parameters will be getting numerical values (dynamically) from the simulink models
So my question :
I would like to verify A_Temp >= A_Temp_1
                            B_Temp >= B_Temp_2
                            C_Oil Pressure >= C_Oil Pressure_3 etc

How to compare the same array?

Hello,
The question not how to compare arrays.
I have a method that gives results of an array type int.
for(......){
int [] arrayFunc(int [] input)
return arrayOut;
}I want to compare those arrayOut arrays. I need to find a way to save the first output and then compare it with the newest output. Where do I have to put the temp array to temporary save the array? What should happen if I want to keep track of the results and get comparisons of first, second, third output?
Thanks

Still not 100% sure but I try and help. What you need to do is have two references. After you have generated a result compare it to the last result. After the comparison you need to assign the current result to the last result and then go around the loop again to generate a new current result. Below is some code that uses plain ints but I hope it illustrates what I am trying to explain.
import java.util.Scanner;
class ComparingNumbers {
public static void main(String[] args) {
    Scanner scanner = new Scanner(System.in);
    int current;
    System.out.print("Number: ");
    int last = scanner.nextInt();
    scanner.nextLine();
    for(int index = 0; index < 10; index++) {
      System.out.print("Number: ");
      current = scanner.nextInt();
      scanner.nextLine();
      System.out.println("Difference is " + Math.abs(current - last));
      last = current;
}

How to compare 1D array

I am reading data from inport in hex form and save it in array to compare data with 0100800000D0.. how can i make hex constant array to store 010080000D0... and then compare it with the array that store data from inport.. (Actually it works as check)
Or there is any other good option
timmy
Solved!
Go to Solution.

indo asia wrote:
I am receving data in single byte like 00, 01 or 08.... But my check is 5byte thats why first i store my data in array and than want it to compare. On comparing if its true than i have to send data..
The string diagram constant on your diagram is 10 bytes, not five. Try hex display instead before entering.
Do you (1) stream until five consecutive bytes match the desired pattern, or do you (2) read exactly five bytes, then compare with the constant? In case (2), the outer while loop should probably be a FOR loop. Autoindex at the output tunnel and you get an array with five elements.
What is the purpose of the inner while loop. Should it have a small wait?
You get an I8 value, so doing a logical AND with xFF in the inner loop does not do anything useful. Right?
What's up with all these sequence structures? None are needed. Use the error wire to enforce execution order instead.
You can use "stop if true" so you don't need to invert the boolean.
You forgot to include the subVI. Please attach it.
Here's a quick draft (case 2 above) to get you some ideas. More code is needed to make a complete program, e.g. the inner loop will run forever if there is a problem. Not good.
LabVIEW Champion . Do more with less code and in less time .
Attachments:
Compare5Bytes.png ‏8 KB

How to compare result from sql query with data writen in html input tag?

how to compare result
from sql query with data
writen in html input tag?
I need to compare
user and password in html form
with all user and password in database
how to do this?
or put the resulr from sql query
in array
please help me?

Hi dejani
first get the user name and password enter by the user
using
String sUsername=request.getParameter("name of the textfield");
String sPassword=request.getParameter("name of the textfield");
after executeQuery() statement
int exist=0;
while(rs.next())
String sUserId= rs.getString("username");
String sPass_wd= rs.getString("password");
if(sUserId.equals(sUsername) && sPass_wd.equals(sPassword))
exist=1;
if(exist==1)
out.println("user exist");
else
out.println("not exist");

How to compare two rows in PL/SQL?

Hi All,
How to compare two rows in PL/SQL? Is there any method that I can use instead of comparing them column by column?
Any feedback would be highly appreciated.

PhoenixBai wrote:
Hi All,
How to compare two rows in PL/SQL? Is there any method that I can use instead of comparing them column by column?What "rows" are you referring to?
If you're talking of rows within a PL/SQL associative array there are techniques as described in the documentation... e.g.
SQL> ed
Wrote file afiedt.buf
1 declare
2    type v1 is table of number;
3    r1 v1 := v1(1,2,4);
4    r2 v1 := v1(1,2,3);
5 begin
6    if r1 MULTISET EXCEPT DISTINCT r2 = v1() then
7      dbms_output.put_line('Same');
8    else
9      dbms_output.put_line('Different');
10    end if;
11* end;
SQL> /
Different
PL/SQL procedure successfully completed.
SQL> ed
Wrote file afiedt.buf
1 declare
2    type v1 is table of number;
3    r1 v1 := v1(1,2,3);
4    r2 v1 := v1(1,2,3);
5 begin
6    if r1 MULTISET EXCEPT DISTINCT r2 = v1() then
7      dbms_output.put_line('Same');
8    else
9      dbms_output.put_line('Different');
10    end if;
11* end;
SQL> /
Same
PL/SQL procedure successfully completed.
SQL>If you're talking about rows on a table then you can use the MINUS set operator to find the rows that differ between two sets of data...
SQL> select * from emp;
     EMPNO ENAME      JOB              MGR HIREDATE                    SAL       COMM     DEPTNO
      7369 SMITH      CLERK           7902 17-DEC-1980 00:00:00        800                    20
      7499 ALLEN      SALESMAN        7698 20-FEB-1981 00:00:00       1600        300         30
      7521 WARD       SALESMAN        7698 22-FEB-1981 00:00:00       1250        500         30
      7566 JONES      MANAGER         7839 02-APR-1981 00:00:00       2975                    20
      7654 MARTIN     SALESMAN        7698 28-SEP-1981 00:00:00       1250       1400         30
      7698 BLAKE      MANAGER         7839 01-MAY-1981 00:00:00       2850                    30
      7782 CLARK      MANAGER         7839 09-JUN-1981 00:00:00       2450                    10
      7788 SCOTT      ANALYST         7566 19-APR-1987 00:00:00       3000                    20
      7839 KING       PRESIDENT            17-NOV-1981 00:00:00       5000                    10
      7844 TURNER     SALESMAN        7698 08-SEP-1981 00:00:00       1500          0         30
      7876 ADAMS      CLERK           7788 23-MAY-1987 00:00:00       1100                    20
      7900 JAMES      CLERK           7698 03-DEC-1981 00:00:00        950                    30
      7902 FORD       ANALYST         7566 03-DEC-1981 00:00:00       3000                    20
      7934 MILLER     CLERK           7782 23-JAN-1982 00:00:00       1300                    10
14 rows selected.
SQL> select * from emp2;
     EMPNO ENAME      JOB              MGR HIREDATE                    SAL       COMM     DEPTNO
      7521 WARD       SALESMAN        7698 22-FEB-1981 00:00:00       1250        500         30
      7566 JONES      MANAGER         7839 02-APR-1981 00:00:00       2975                    20
      7782 CLARK      MANAGER         7839 09-JUN-1981 00:00:00       2450                    10
      7788 SCOTT      ANALYST         7566 19-APR-1987 00:00:00       3000                    20
      7839 KING       PRESIDENT            17-NOV-1981 00:00:00       5000                    10
      7900 JAMES      CLERK           7698 03-DEC-1981 00:00:00        950                    30
      7934 MILLER     CLERK           7782 23-JAN-1982 00:00:00       1300                    10
7 rows selected.
SQL> select * from emp
2 minus
3 select * from emp2;
     EMPNO ENAME      JOB              MGR HIREDATE                    SAL       COMM     DEPTNO
      7369 SMITH      CLERK           7902 17-DEC-1980 00:00:00        800                    20
      7499 ALLEN      SALESMAN        7698 20-FEB-1981 00:00:00       1600        300         30
      7654 MARTIN     SALESMAN        7698 28-SEP-1981 00:00:00       1250       1400         30
      7698 BLAKE      MANAGER         7839 01-MAY-1981 00:00:00       2850                    30
      7844 TURNER     SALESMAN        7698 08-SEP-1981 00:00:00       1500          0         30
      7876 ADAMS      CLERK           7788 23-MAY-1987 00:00:00       1100                    20
      7902 FORD       ANALYST         7566 03-DEC-1981 00:00:00       3000                    20
7 rows selected.If you actually need to know what columns data is different on "non-matching" rows (based on your primary key) then you'll have to compare column by column.

How to compare an Object of type class?

Hi,
I got a generic array and want to check which class it contains.
Now i tried to use
Class c = T[0].getClass();and later
if(c instanceof Float){
}but this don't work.
So how to compare two instances of Class?
Maybe by looking for the name of the class and compare them?
regards.
Olek

import java.util.*;
public class WorksForMe {
    public static void main(String[] args) {
        List<Object> list = new ArrayList<Object>();
        list.add(Float.valueOf(17));
        Class<?> cls = list.get(0).getClass();
        System.out.println(Float.class.equals(cls)); //true
        System.out.println(Float.class == cls); //true
}But again, it's best to avoid this kind of case analysis.

How to compare two files using MD5?

Hi,all:
How to compare two files to know if they're the same without any difference?I want to use MD5, but I just konw how get a message digest of a string. How to get a message digest of a file? Or there is other method to compare two files?
Thanks advance!

This is starting to sound rather a lot like a homework problem.
An MD5 message digest is simply a 16 byte array. To compare two message digests...
byte[] md5incoming = ...
byte[] md5comparison = ...
if( md5incoming.equals(md5comparison) ) {
System.out.println("MD5 Checksums match");
}To find out how to generate an MD5 checksum, please look up MessageDigest in the API documentation, and do a google search for "MD5 java"
In a networked scenario, there are two issues - firstly the performance in sending copies of files all over the place (imagine if it's a 10Gb file to be compared over a 14.4K modem link, this would take a while). Secondly, the network link itself might insert an error in the file and you'd get a false miss.
By only sending MD5 digests over the link, you simultaneously reduce the error (shorter files are less likely to be corrupted) and reduce the transmission time (16 bytes takes practically no time to transmit over damp string, let alone any sort of sensible device).
D.

Comparing a String with array elements

i need some help as to how to compare an individual String with each item of a String array.
so far i have:
StringTokenizer drinksOrder = new StringTokenizer(orderLine, "\r");
while (drinksOrder.hasMoreTokens())
     for (int index = 0; index < NUMBER_OF_DRINKS; index++)
             barcode = drinksOrder.nextToken();
                    if (barcode.equals(barcodes[index]))
                                 name = drinks[index];
                                 price = prices[index];
                                 status = drinkStatus[index];
          orderedDrinkBC[j] = barcode;
                                          orderedDrinkName[j] = name;
                                          orderedDrinkPrice[j] = price;
                                          orderedDrinkStatus[j] = status;
          j++;
          break;
[\CODE]
At the moment, no Strings are being put in the orderedDrinkBC, orderedDrinkName, orderedDrinkPrice
and orderedDrinkStatus arrays. the code seems to be failing on the 'barcode.equals(barcodes[index])
part at the moment.
any help would be appreciated
cheers
david

Do this instead (next time post your code in lower case code tags):
StringTokenizer drinksOrder = new StringTokenizer(orderLine, "\r");
while (drinksOrder.hasMoreTokens())
barcode = drinksOrder.nextToken();
for (int index = 0; index < NUMBER_OF_DRINKS; index++)
    if (barcode.equals(barcodes[index]))
      name = drinks[index];
      price = prices[index];
      status = drinkStatus[index];
      orderedDrinkBC[j] = barcode;
      orderedDrinkName[j] = name;
      orderedDrinkPrice[j] = price;
      orderedDrinkStatus[j] = status;
      j++;
      break;
}

How can I pass an empty array to a parameter of type PLSQLAssociativeArray

How can I pass an empty array to a parameter of type PLSQLAssociativeArray in VB? I defined the parameter like this
Dim myArray() as String = new String() {}
Dim myPara as new Oracle.DataAccess.Client.OracleCollectionType.PLSQLAssociativeArray
myPara = 0
myPara.Value = myArray
When I execute my stored procedure giving the above parameter, I got error saying OracleParameter.Value is invalid.
I have tried to give it the DBNull.Value, but it doesn't work either.
Note: everything works fine as long as myArray has some item in there. I just wonder how I can make it works in case I have nothing.
Thank you,

How can I pass an empty array to a parameter of type PLSQLAssociativeArray in VB? I defined the parameter like this
Dim myArray() as String = new String() {}
Dim myPara as new Oracle.DataAccess.Client.OracleCollectionType.PLSQLAssociativeArray
myPara = 0
myPara.Value = myArray
When I execute my stored procedure giving the above parameter, I got error saying OracleParameter.Value is invalid.
I have tried to give it the DBNull.Value, but it doesn't work either.
Note: everything works fine as long as myArray has some item in there. I just wonder how I can make it works in case I have nothing.
Thank you,

How to crate a dynamic size array, collection

Hi,
Can someone point me to some tutorial on how to create a dynamic size array. Actually I have multiple cursors and on different tables and want to loop through each cursor and get some values from each cursor and put it in an array. But don't know how to create or initialize an array as I don't know the size. Is there any other way.
Here is what I am doing I have 6 cursors on different tables, I loop through each cursor and get some specific data that I need to place at one place after looping through all the cursors which then finally needs to be inserted in one table. But before the insert I need to validate each data so want to have all the data in some array or some other place for temporary storage from it's easier to do the validate and insert rather than while looping through the cursors as there may be duplicates which I am trying to remove.
As this procedure will be called multiple times so wanted to save the cursor data in temporary array before inserting in the final table. Looking for some faster and efficient way.
Any help is appreciated.
Thanks

guest0012 wrote:
All the 6 cursors are independent and no relation i.e. can have a join and have one sql as no relationship in tables.If there is no relation, then what are your code doing combining unrelated rows into the same GTT/array?
Now using GTT when I do an insert how do I make sure the same data doesnot already exists. i.e. GTT will only have one column. Then create a unique index or primary key for the GTT and use that to enforce uniqueness.
So everytime I iterate over a cursor I have to insert into GTT and then finally again have to iterate over GTT and then do an insert in the final table which maybe a performance issue Which is why using SQL will be faster and more scalable - and if PL/SQL code/logic can be used to glue these "no relationship" tables together, why can't that not be done in SQL?
that's why i was wondering if can use any kind of array or collection as it will be a collection of numbersAnd that will reside in expensive PGA memory. Which means a limit on the size of the collection/array you can safely create without impacting server performance, or even cause a server crash by exhausting all virtual memory and causing swap space to trash.
and finally will just iterate ovr array and use FOR ALL for insert but don't know what will be the size of the array as I only know after looping the cursors the total number of records to be stored. So wondering if how to do it through collection/array is there a way to intialize the array and keep populating it with the data with defining the size before hand.You cannot append the bulk collect of one cursor into the collection used for bulk collecting another cursor.
Collections are automatically sized to the number of rows fetched. If you want to manually size collection, the Extend() method needs to be used, where the method's argument specifies the number of cells/locations to add to the collection.
From what you describe about the issue you have - collections are not the correct choice. If you are going to put the different tables's data into the same collection, then you can also combine those tables's data using a single SQL projection (via a UNION for example).
And doing the data crunching side in SQL is always superior in scalability and performance, than doing it in PL/SQL.

How to compare 1000 X 512 arrays

Similar Messages

Maybe you are looking for