floating-accuracy

相关标签：javascript jquery android 多少钱 iPhone

Trying to write a code for finding the machine epsilon

I am trying to find out the precision level for various floating point formats in C (i.e. float, double and long double).Here is the code I\'m using at the moment:[详细]

2023-01-12 00:00 分类：问答
nth root of a number

I wrote a program to calculate nth root of a numberupto 2 decimal places. eg 4th root of 81 is 3., 3rd root of 125 is 5.Its working nicely except for the 2nd root of 4. It\'s giving the output 1.99 in[详细]

2023-01-11 23:27 分类：问答
Handling Massive (high precision) Floats in Ruby

I\'m making an application which is listening to prices being updated regularly, but occasionally my data source throws me something like \"1.79769313486232e+308\". The numbers that get sent will neve[详细]

2023-01-10 23:55 分类：问答
Floating point C++ compiler options | preventing a/b -> a* (1/b)

I\'m writing realtime numeric software, in C++, currently compiling it with Visual-C++ 2008. Now using \'fast\' floating point model (开发者_开发技巧/fp:fast), various optimizations, most of them usef[详细]

2023-01-10 10:07 分类：问答
Objective C Math Formula Fail

noob here wants to calculate compound interest on iPhone. float principal; float rate; int compoundPerYear;[详细]

2023-01-10 09:13 分类：问答
Does Fortran have inherent limitations on numerical accuracy compared to other languages?

While working on a simple programming exercise, I produced a while loop (DO loop in Fortran) that was meant to exit when a real variable had reached a precise value.[详细]

2023-01-09 00:40 分类：问答
My variance function in C# does not return accurate value

The source data : static double[] felix = new double[] { 0.003027523, 0.002012256, -0.001369238, -0.001737660, -0.001647287,[详细]

2023-01-08 20:40 分类：问答
SQLite query where clause with floating point numbers fails?

I\'m putting a 开发者_开发百科float in an Android based SQLite database, like so: private static final String DATABASE_CREATE =[详细]

2023-01-07 08:08 分类：问答
Detecting precision loss when converting from double to float

I am writing a piece of code in which i have to convert from double to float values. I am using boost::numeric_cast to do this conversion which will alert me of any overflow/underflow. However i am al[详细]

2023-01-07 04:53 分类：问答
C++ Precision: String to Double

I am having a problem with precision of a double after performing some operations on a converted string to double.[详细]

2023-01-06 06:14 分类：问答