Float precision

If I had a float that was equal to 0.30289307, how can I truncate it to be 0.3?
Thanks
Jay

i figured it out, the way you give your float, the program thinks it's a double, so he gives an error "possible loss of precision", now the solution is to put an f after your number so java will be forced to treat it as a float
like this:
import java.text.DecimalFormat;
public class Test
     public static void main(String a[])
          float number = 0.30289307f;
          DecimalFormat df = new DecimalFormat("0.0");
          System.out.println(df.format(number));
}

Similar Messages

Polygons with float precision?

Is it possible to use polygons with arrays of floats? I've looked up the source code and it seems that the code is all based around the use of ints.
How would I go about making a polygon use floats so that it can move smoothly around the screen? I've got it moving using ints, but this causes horrible jerky-like movement.
Thanks
Ribot.

g2d.drawOval(circleX, 400, 25, 25);
circleX++;That should move it by 1 pixel on the x axis each time through the loop, unless you have other code that is changing the value (perhaps you could add System.out.println("CircleX = " + circleX) statements before your drawOval statement...
in the same animation loop I feature the following
code which moves the graphics2D object by fractional
amounts across the screen (this is the effect I want
to get with a polygon based shape):It only moves on screen when the value of the integer part of the fraction changes (your monitor would be unable to move it by a fraction of a pixel). Why not use double values and cast them to ints if you want to replicate this?
>
circle.setFrame(550.5+(tickerTest*0.1), 300.5, 50,
60);
Area test = new Area(circle);
g2d.setColor(Color.magenta);
g2d.fill(test);
tickerTest++;
Is there a Graphics2D polygon type object? I've
looked in the API and haven't found anything. how about g2d.drawPolygon()
I have done this without double buffering and it works perfectly... a 20ms delay and there isn't any flicker (P3 600MHz, JDK 1.2.2), so I really don't understand unless you have some massive processing running concurrently... javax.swing.JFrame frame = new javax.swing.JFrame();
frame.setSize(200,200);
frame.show();
java.awt.Graphics2D g2d = (java.awt.Graphics2D)frame.getGraphics();
int x = 50;
int y = 50;
int dx = 1;
int dy = 2;
int width = 20;
int height = 20;
for(int i = 0; i < 1000; i++) {
     g2d.clearRect(0, 0, 200, 200);
     g2d.drawOval(x, y, width, height);
     x += dx;
     y += dy;
     if(x < 0 || x > 180) dx *= -1;
     if(y < 20 || y > 180) dy *= -1;
     Thread.sleep(20);

How to take float precision to two decimal places?

Hi, everybody:
I'm a straight noob...first week in Java programming. Before you bash me for not checking FAQs and such, believe me, I have.
I have tried BigDecimal movePointLeft, but I don't know how to construct it using proper syntax. I also tried currency and toString but I keep messing up my syntax somehow. Four hours into this and nothing is working.
Here is the problem: I have a float. I want to format its output to two decimal places, trying to achieve in Java what C would produce as:
printf("The amount you owe is $%.2f", fltAnyName);
Any help would be appreciated.
Thanks,
Rob

Sorry, guys. I have tried both recommendations and I can't get either to work. I'm getting a compile error pointing to the delineating period between the "out" and "printf" when I try the C-like code. I have 1.5, too. I know your advice is sound so I must be doing something wrong. Can you insert the code DecimalFormat code that will correct this problem where it needs to go? The packages below have been included becasue of all the different solutions I have attempted.
import java.io.*;
import java.math.*;
import java.text.*;
import java.lang.*;
public class CoinCalculator2
     public static void main(String[] args) throws IOException
          String strQuartes, strDimes, strNickels, strPennies;
          int intQuartes, intDimes, intNickels, intPennies;
          float fltValue;
          BufferedReader dataIn = new BufferedReader(new InputStreamReader(System.in));
          System.out.println("THE COIN CALCULATOR");
          System.out.println();
          System.out.print("Enter the number of quarters you have: ");
               strQuartes = dataIn.readLine();
               intQuartes = Integer.parseInt(strQuartes) * 25;
          System.out.print("Enter the number of dimes you have: ");
               strDimes = dataIn.readLine();
               intDimes = Integer.parseInt(strDimes) * 10;
          System.out.print("Enter the number of nickles you have: ");
               strNickels = dataIn.readLine();
               intNickels = Integer.parseInt(strNickels) * 5;
          System.out.print("Enter the number of pennies you have: ");
               strPennies = dataIn.readLine();
               intPennies = Integer.parseInt(strPennies);
          fltValue = (intQuartes + intDimes + intNickels + intPennies) / 100;
          System.out.println();
          System.out.println("The value of your coins is $" + fltValue);
          System.out.println();
}

Float precision, help with fader

i am trying to write a little fader applet here but I can't get a float to actual have a decimal. i have this code to test the values
Float percent = new Float(CurrentFadeAmt/getSize().width);
currfade = new Color(r1 + (1*r3), g1 + (1*g3), b1 + (1*b3));
BackBuffer.setColor(currfade);
BackBuffer.setFont(new Font("Serif",Font.BOLD, 10));
BackBuffer.drawString("c:" + CurrentFadeAmt + " g:" + getSize().width,1,10);
BackBuffer.drawString("p:" + percent,1,getSize().height - 2);
g.drawImage(workspace,0,0,this);
I've tried using float's and Float's . the output is always something like
c:56 g:100
p:0.0
why?

I guess both CurrentFadeAmt and getSize().width are of type int and then an integer division is performed and therefore the result is truncated.
Solution:
You need to cast at least one operand to float before dividing.
float percent = (float) CurrentFadeAmt / getSize().width;

Using float amount in query designer

Hello,
I have an amount key figure of type fltp (float) with unit currency.
When I look at the data in cube or multiprovider the key figure has float precision.
When using the key figure in the query designer the value is rounded for two decimals.
This is independent of the display settings in bex or bex default settings in the infoobject (for example: when setting the value to 5 decimals, the kf will look like y.xx000 - rounded and filled with 0 - in the query).
Same problem when using the key figure in a formula.
Any ideas?
Regards,
Christoph

Hi Abhijeet,
the value is being calculated by a formula in transfer rules (like 5.50 u20AC / 30) and therefore has more than 2 decimals.
As I said using listcube will show the result I need.
When used in querydesigner the value is rounded to 2 decimals.
Christoph

Float type issue

Tyring to do a ELT Oracle DB to Oracle DB.
IKM SQL Incremental Update.
Source -> Float (precision 126) to Target -> Float (precision 126) is not working.
If I remove that mapping, my ELT works.
With that mapping, I get a vague error....
"Too much errors in the Load step: The error limit has been reached. A maximum of 1 errors was allowed."
I looked at the loading table C$_ and that table has the float column correctly populated.
I looked at the integration table I$_ and that is empty. The error table E$_ is also empty.
Any ideas anybody?
Edited by: skhot on Dec 8, 2011 11:42 AM

changed the IKM
from: IKM SQL Incremental Update (row by row)
to: IKM SQL Incremental Update.
Its working now.

Digits of precision on a gauge dig display

Hello all,
Im experiencing a simple problem with my digital indicator on a gauge. I want to set the display to 'Floating Point' with 0 digits of precision but for some reason it keeps defaulting to 1 digit of precision. Im using LV8.2 but its something that I could do in LV7.1.
Any tips would be great.
Thanks,
David

I just came across another workaround....
Select "properties" by right-clicking the DBL indicator, go to "Format and precision" then activate the "Advanced editing mode".
There you can input %d as the formatting for the indicator. It's internally still DBL (useful for saving is you use local variables) but it's represented as an integer.
Thought this might help.
Shane.
PS, this may be what was meant in the previous post, but just to be sure, and because I found it by accident, I thought I'd post......
Message Edited by shoneill on 12-07-2006 01:47 PM
Using LV 6.1 and 8.2.1 on W2k (SP4) and WXP (SP2)
Attachments:
Float precision LV 8.20.PNG ‏14 KB

Why no Polygon2d? Is GeneralPath the alternative?

In Java2D all the old shapes got new Shape versions with
double precision - except for Polygon.
Id like to have a Polygon that uses double precision.
Im thinking that maybe they didnt update Polygon because
GeneralPath should be its replacement in Java2D (it has
float precision)?
For graphics intensive operations - is one "faster" than the other?
Thanks!

this probably does not help you much, but, as the writer of a 225+ FPS game engine, I am proud to say that GeneralPaths seem to not hinder rendering at all (as every shape in my engine is stored as one). I do not think there is much of a loss at all when rendering a GeneralPath as opposed to a Polygon because (correct me if I'm wrong) the data is still stored in sequential order, so that in essence the drawing process does the same thing, just through a different object...
Hope that helps your last question a little
Alex

Need a data type

hi folks
i need to store numbers in this form: x,xx with two fields float precision, i need that because i need to compare float numbers to just two numbers after the come x,XX.
is there a data type for that
thx buddies

On the left side of the screen you will see the word Documentation and directly below that APIs. Click on APIs. Choose you java version (or 1.4.1 if you don't know) Scroll down to NumberFormat, click on it. Instant information.

Regarding deadlock

Hi,
How I can detect if a deadlock occured in my database and what are the sessions that creating the deadlock.
How I can find top sqls' running in my database?
Thanks,
Koushik

Hi,
Thanks for reply.
I have a trace file from /udump and I have applies TKPROF on it to make the file readable format. Here is few lines from it given below :
select '"'||name||'" '||decode(type#,1,decode(charsetform,2,
'NVARCHAR2('||decode(bitand(property,8388608),8388608,decode(spare3,0,1,
spare3)||')','BYTECOUNT=>'||decode(length,0,1,length)||')'),
'VARCHAR2('||decode(bitand(property,8388608),8388608,decode(spare3,0,1,
spare3)||' char)',decode(length,0,1,length)||' byte)')),2,decode(scale,null,
decode(precision#,null,'NUMBER','FLOAT('||precision#||')'),
'NUMBER('||decode(precision#,null,'38', precision#)||','||scale||')'),8,
'LONG',9,'VARCHAR('||(decode(length,0,1,length))||')',12,'DATE',23,
'RAW('||length||')',24,'LONG RAW',69,'ROWID',96,decode(charsetform,2,
'NCHAR('||decode(bitand(property,8388608),8388608,decode(spare3,0,1,spare3)
||')','BYTECOUNT=>'||decode(length,0,1,length)||')'),
'CHAR('||decode(bitand(property,8388608),8388608,decode(spare3,0,1,spare3)
||' char)',decode(length,0,1,length)||' byte)')),97,
'VARCHAR('||(decode(length,0,1,length))|| ')',105,'MLSLABEL',106,'MLSLABEL',
112,decode(charsetform,2,'NCLOB','CLOB'),113,'BLOB',114,'BFILE',115,
decode(charsetform,2,'NCFILE','CFILE'),178,'TIME('||scale||')',179,
'TIME('||scale||') WITH TIME ZONE',180,'TIMESTAMP('||scale||')',181,
'TIMESTAMP('||scale||') WITH TIME ZONE',231,'TIMESTAMP('||scale||') WITH
LOCAL TIME ZONE',182,'INTERVAL YEAR('||NVL(precision#, 0)||') TO MONTH',183,
'INTERVAL DAY('||NVL(precision#, 0)||') TO SECOND('||scale||')',208,
'UROWID('||spare1||')',100,'BINARY_FLOAT',101,'BINARY_DOUBLE','UNDEFINED')
||decode(null$,0,'',' NOT NULL')||decode(bitand(property, 32), 0, ',', '
HIDDEN,'),name, type#, intcol#, null$, bitand(property, 32)
from
col$ where obj#=:1 and (bitand(property,32) = 0 or bitand(property, 4194304)
<> 0) order by col#
call count cpu elapsed disk query current rows
Parse 6 0.00 0.00 0 0 0 0
Execute 6 0.00 0.00 0 0 0 0
Fetch 109 0.00 0.00 0 21 0 103
total 121 0.00 0.00 0 21 0 103
Misses in library cache during parse: 1
Misses in library cache during execute: 1
Optimizer goal: CHOOSE
Parsing user id: SYS (recursive depth: 1)
Rows Row Source Operation
10 SORT ORDER BY (cr=3 pr=0 pw=0 time=143 us)
10 TABLE ACCESS CLUSTER COL$ (cr=3 pr=0 pw=0 time=61 us)
1 INDEX UNIQUE SCAN I_OBJ# (cr=2 pr=0 pw=0 time=12 us)(object id 3)
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
row cache lock 1 0.00 0.00
Can you please explain the above lines.
Thanks,
Koushik

Convert double precision float string to a number

I am a newbie with Labview.
I have a GPIB link with a vector voltmeter and I receive the data as a double precision float string (IEEE standard 754-1985). I would like it to be recognized as a number, but I can't find the proper conversion function. The string to convert is 8 byte long. Does anyone have an idea how to do it? Thank you!

Asumming your data is big-endian, you should be able to simply typecast it to a DBL (see attache LV 7.0 example).
(It is possible that your DBL string is little-endian, in this case it will be slightly more complicated. Let us know )Message Edited by altenbach on 05-27-2005 04:49 PM
LabVIEW Champion . Do more with less code and in less time .
Attachments:
StringToDBL.vi ‏23 KB

Precision with float and double values

Hi, does anyone knows how can i get more precise calculations with floating point numbers? Let's see an example:
public class Teste {
public static void main(String args[]) {
float i = 0;
while (i<=10) {
System.out.println(i);
i=i+0.1f;
/* output
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.70000005
0.8000001
0.9000001
1.0000001
1.1000001
1.2000002
1.3000002
1.4000002
1.5000002
1.6000003
1.7000003
1.8000003
1.9000003
2.0000002
2.1000001
2.2
2.3
2.3999999
2.4999998
2.5999997
2.6999996
2.7999995
2.8999994
2.9999993
3.0999992
3.199999
3.299999
3.399999
3.4999988
3.5999987
3.6999986
3.7999985
3.8999984
3.9999983
4.0999985
4.1999984
4.2999983
4.399998
4.499998
4.599998
4.699998
4.799998
4.8999977
4.9999976
5.0999975
5.1999974
5.2999973
5.399997
5.499997
5.599997
5.699997
5.799997
5.8999968
5.9999967
6.0999966
6.1999965
6.2999964
6.3999963
6.499996
6.599996
6.699996
6.799996
6.899996
6.9999957
7.0999956
7.1999955
7.2999954
7.3999953
7.499995
7.599995
7.699995
7.799995
7.899995
7.9999948
8.099995
8.199995
8.299995
8.399996
8.499996
8.599997
8.699997
8.799997
8.899998
8.999998
9.099998
9.199999
9.299999
9.4
9.5
9.6
9.700001
9.800001
9.900002
*/

http://forum.java.sun.com/thread.jsp?forum=31&thread=357174

How do you set the decimal precision of a float?

Hello,
I am new to Java and have run into a problem. I am trying to truncate an array of floats and save them to a file. I want to save two decimal places with 0's ie: 0 as 0.00
For example:
I have a number 0.9772128 and I want to convert it and store it as 0.98, the following code seems to truncate it but there is a problem.
float d = output_Weights;
d = Math.round(d * 100) / 100.0;
some of my numbers come out as .1 instead of .10 and I can't seem to figure out how to add the 0's on the end of them.
Does anyone have any suggestions or a better way of getting the two decimal precision?
Thanks in advance for any help you might be able to offer.

And if you want to set the decimal precision when you convert the floating point number to text (which is what you are talking about when you say it ends with .1 instead of .10), you use a DecimalFormat object to do that.
(By the way, isn't there supposed to be an apostrophe in Arc'teryx?)

Floating point precision of "Flatten to XML"

It appears that the "Flatten to XML" function (LV 7.1.1) truncates floating point numbers to 5 decimal places. This is a rather annoying limitation, since I'm trying to store a relative time in hours, accurate to the second (chosen by a previous coder that I have to be compatible with - otherwise I'd just use seconds). Is there a workaround to this? (other than multiplying by some power of 10 before flattening, and dividing after unflattening)
Jaegen

Hi Paul and Jaegen,
I checked our databases and found entries of product suggestions and
corrective action requests for the behavior of the limited precision
when flattening to XML. I found an interesting reply from a LabVIEW
developer on the request for further precision:
The Flatten To XML primitive puposefully cuts off all numbers at 5
digits after the decimal. There are 3 main reasons for this:
Information regarding precision is not propagated on the wire.
Therefore, there is no real way to know how many significant digits or
even places past the decimal point is appropriate when data is
flattened to XML.
Bloat. If all floating point values printed all of the possible
decimal digits all of the time, this would provide for some very large
blocks of XML code.
Given the arbitrarily complex nature of LabVIEW data, it is
difficult to provide a method for specifying precision. For example, if
a user has a cluster of clusters, each of which contain a single,
double and extended representing various measurements of differing
accuracy, how can one precision setting be applied to each of these
values? The user would have to unbundle (and index if an array was
involved), flatten, concatenate, and then the reverse on the unflatten
side.
I suggest that you go ahead and file a new product suggestion by using the "feedback" link on www.ni.com/contact.
It would be best if you could give some detailed information on how you
would like LabVIEW to handle different scenarios while getting around
the above issues.
Thanks for the feedback!
- Philip Courtois, Thinkbot Solutions

Precision loss - conversions between exact values and floating point values

Hi!
I read this in your SQL Reference manual, but I don't quite get it.
Conversions between exact numeric values (TT_TINYINT, TT_SMALLINT, TT_INTEGER, TT_BIGINT, NUMBER) and floating-point values (BINARY_FLOAT, BINARY_DOUBLE) can be inexact because the exact numeric values use decimal precision whereas the floating-point numbers use binary precision.
Could you please give two examples: one where a TT_TINYINT is converted to a BINARY_DOUBLE and one when a TT_BIGINT is converted into a DOUBLE, both cases give examples on lost precision? This would be very helpful.
Thanks!
Sune

chokpa wrote:
Public Example (float... values){}
new Example (1, 1e2, 3.0, 4.754);It accepts it if I just use 1,2,3,4 as the values being passed in, but doesn't like it if I use actual float values.Those are double literals, try
new Example (1f, 1e2f, 3.0f, 4.754f);

Float precision

Similar Messages

Maybe you are looking for