floating-accuracy
Trying to write a code for finding the machine epsilon
I am trying to find out the precision level for various floating point formats in C (i.e. float, double and long double).Here is the code I\'m using at the moment:[详细]
2023-01-12 00:00 分类:问答nth root of a number
I wrote a program to calculate nth root of a numberupto 2 decimal places. eg 4th root of 81 is 3., 3rd root of 125 is 5.Its working nicely except for the 2nd root of 4. It\'s giving the output 1.99 in[详细]
2023-01-11 23:27 分类:问答Handling Massive (high precision) Floats in Ruby
I\'m making an application which is listening to prices being updated regularly, but occasionally my data source throws me something like \"1.79769313486232e+308\". The numbers that get sent will neve[详细]
2023-01-10 23:55 分类:问答Floating point C++ compiler options | preventing a/b -> a* (1/b)
I\'m writing realtime numeric software, in C++, currently compiling it with Visual-C++ 2008. Now using \'fast\' floating point model (开发者_开发技巧/fp:fast), various optimizations, most of them usef[详细]
2023-01-10 10:07 分类:问答Objective C Math Formula Fail
noob here wants to calculate compound interest on iPhone. float principal; float rate; int compoundPerYear;[详细]
2023-01-10 09:13 分类:问答Does Fortran have inherent limitations on numerical accuracy compared to other languages?
While working on a simple programming exercise, I produced a while loop (DO loop in Fortran) that was meant to exit when a real variable had reached a precise value.[详细]
2023-01-09 00:40 分类:问答My variance function in C# does not return accurate value
The source data : static double[] felix = new double[] { 0.003027523, 0.002012256, -0.001369238, -0.001737660, -0.001647287,[详细]
2023-01-08 20:40 分类:问答SQLite query where clause with floating point numbers fails?
I\'m putting a 开发者_开发百科float in an Android based SQLite database, like so: private static final String DATABASE_CREATE =[详细]
2023-01-07 08:08 分类:问答Detecting precision loss when converting from double to float
I am writing a piece of code in which i have to convert from double to float values. I am using boost::numeric_cast to do this conversion which will alert me of any overflow/underflow. However i am al[详细]
2023-01-07 04:53 分类:问答C++ Precision: String to Double
I am having a problem with precision of a double after performing some operations on a converted string to double.[详细]
2023-01-06 06:14 分类:问答