double-precision

相关标签：javascript jquery android 多少钱 iPhone

Error due to limited precision of float and double

In C++, I use the following code to work out the order of magnitude of the error due to the limited precision of float and double:[详细]

2023-04-12 05:57 分类：问答
Output precision is higher than double precision

I am printing some data from a C++ program to be processed/visualized by ParaView, but I am having a problem with floating point numbers. Paraview s开发者_开发知识库upports both Float32 and Float64 da[详细]

2023-04-09 08:18 分类：问答
Floating point error in representation?

when i make this multiplication 0.94 * 8700 the output is 8177.999999999999 but it should have been 8178[详细]

2023-04-08 19:01 分类：问答
Converting/expressing double number in non-exponent/short form in Javascript

I have a double in Javascript whose value is, for example, 1.0883076389305e-311. I want to express it in the following form, using as example the \'bc\' utility to calculate the expanded/higher precis[详细]

2023-03-21 11:18 分类：问答
Accuracy of double precision multiplication in java?

What is the guaranteedaccuracy of multiplication operator for double values in java? For example, 2.2 * 100 is 220.0000开发者_开发知识库0000000003, but 220 is a double number. 220.00000000000003 is[详细]

2023-03-15 04:48 分类：问答
host to network double?

I\'d like to send some double precision floating point numbers over the network. (standard C, standard sockets) There is no htond or ntohd to convert the data to and from network byte order. What shou[详细]

2023-03-07 18:13 分类：问答
Help in double precision addition

I was testing some of my code, in javascript I added .1+.2 and it gives me .30000000000000004 instead of .3 . I don\'t unde开发者_如何学Pythonrstand this.[详细]

2023-03-07 13:06 分类：问答
What does the "double" do in ceil(double)?

I have a number (let\'s say, 34), and I want to find its next multiple of ten. I can do this by: Dividing the number by 10[详细]

2023-03-05 14:52 分类：问答
Fortran double precision program with a simple MKL BLAS routine

In trying to mix precision in a simple program - using both real and double - and use the ddot routine from BLAS, I\'m coming up with incorrect output for the double precision piece. Here\'s the code:[详细]

2023-03-04 15:11 分类：问答
Doubles returned and bound to list view are truncated

I am query my sqlite data base for my Android app. I then use a simple cursor adapter to bind the data to a list view.[详细]

2023-02-26 20:25 分类：问答