precision's questions - English 1answer

288 precision questions.

I have the source file file = "test.txt" with these values: ...

I had a serious error propagation in my computations (Mathematica 10.4.1 Windows 64 bit). After some investigation, I realized the problem comes from something like this: FullForm[1. - (0.3 + 0.4)] ...

I have code which outputs numbers, for example,(0.2945847, 0.8647834, 1.6*10^-6) and similar. I would like to take these numbers and round them to 4 significant figures, but I can't find a way to do ...

In my current code, I have formed a list of numbers with two different methods. For the first method, I wrote ...

If you run my calculations given below ...

I have a notebook where I have to work with high precision (say, 100). I have tried several methods to define it for the entire notebook, including ...

I am aware that a similar question has been asked, for example, here and here, but none of the proposed solutions solves my problem, so please wait before you mark this question as a duplicate. ...

I would like to know if there is a way to make Mathematica to use at most certain digit number. For example, Suppose I want to calculate 2*Pi.x=N[Pi] y=2*x...

I am continuing to work with GPS data related to trail routes and am trying to optimize the code by removing route points from a GPX file that are very close to each other by setting the accuracy of ...

I am trying to solve a system of three non-linear equations for three unknowns (e1, e2, phi). I am using FindMinimum to solve the system (I am minimizing the norm ...

I want to compute a triple integral. I did it using two codes: the first is ...

Bug introduced in 11.3 or earlier CASE:4075745 I have been experimenting with using Audio and associated functions for data acquisition using an external sound ...

I have a density plot as below:-v = {2, 3}; w = {4, 6}; DensityPlot[Exp[-w.Abs[v - {x, y}]], {x, 0, 5}, {y, 0, 7}]As you can see, the boundary of the white ...

I have a long function composed of polynomials and exponentials that I would like to convert to an appropriate form to cut and paste as an equation into SolidWorks. FortranForm gets me close and with ...

I have fivefold multiple integral and I wanted a speed calculations. I came across on this Question and had already begun the problems. Here is a toy example with simple double integral: ...

When you use SetPrecision to set the precision of say 1.1 you will get some seemingly random numbers padded before the rest will ...

I have two examples of matrices that undergo a similarity transformation: a random matrix, and an exclusion-process inspired matrix. The similarity transformation $\sigma$ is given by an $L \times L$ ...

I'm trying to use regionplot for functions that involve Erfc. A slightly contrived example follows, but it illustrates my difficulties. The command ...

I'm trying to solve nonlinear equations using Newton-type methods with very high accuracy using Mathematica. I found many research papers in which the numerical results are calculated with very high ...

First of all, apologies for the large numbers, I couldn't find a working example for a far lower order and the zeros are necessary... my problem is this: I have a large polynomial (from high-order ...

Task I am trying to evaluate the contour integral of some functions. To have a concrete example, let's use $$ f(z,s) = \frac{1+(4+2s)\, z}{z - \left( 9 + 35s + 24s^2 + 4s^3 \right) z^2 + 8z^3} $$<...

I am a new user in Wolfram language. Please, I am trying to calculate accurate solutions $R$ of an algébric equation which contains the Dawson function. The equation is: $$1+\frac{\theta }{k^2}+\...

My code requires to set some precision to get more accurate results. But I found when I set the precision like 20 or 30, the computation speed would jump 7-10 times slower... Here's an example:<...

I want to define a nice function Φ in 3D that is computed as follows $$ \phi (x, y, z) = - z + \frac{\sqrt{32}}{\pi} \sqrt{\cosh \nu - \cos u} \sum_{n = 1}^\infty ...

As far as I understand, the merit function measures how far the data is from the fitted function. I am calulcating the second partial derivative of a function, and then numerically finding its maxima ...

I have high precision data that I want to do Fourier transform with, but it looks like the precision is lost dramatically. ...

I just want to get a smooth plot but the calculated values are "discrete" which seems to be a precision problem. I tried N[],SetPrecision[],SetAccuary[] without any success. So I paste the Code in its ...

Recently the decimal expansion of a number theoretic constant was searched for, which is the analog of the Landau-Ramanujan constant in a certain context. The constant starts 0.638909... It can be ...

Consider a function ...

I would like to print out an list of reals in a table with perfectly identical number of digits so that they can be perfectly right-aligned. However, once I convert them to strings, ...

I can't see the small changes of my function when I plot it. What can I do? ...

I am solving PDE by means of NDSolve and I am interested in a highly accurate value for the solution at a certain point. For some reason, the solution obtained by ...

I need to solve an ODE with very high precision. I am not sure yet how much precision I need so I have some question before changing the settings. From what I understand, the working precision is how ...

I am trying to evaluate sums involving LegendreQ[n,x], the n-th order Legendre function of the second kind $Q_n(x)$, at large $x>1$. However, the problem is that ...

I'm modeling a quantum tunneling barrier. Because I want to express my quantities in mks units, that means that some of the variables I'm using are pretty small (10^-9). I use NIntegrate for part of ...

When I do something a little bit more complicated than standard documentation examples, I often hit precision problem. Or I accidentally disprove Riemann hypothesis Like this ...

EDIT: I filed a bug report and after a small back-and-forth the support person agreed this is a bug. He said: "I have filed a report with the developers to issue warning messages when the arithmetic ...

I found this and this on this StackExchange as to why Mathematica rounds half to even, which means thatRound[{0.5, 1.5, 2.5, 3.5, 4.5}]gives ...

I have the following codes. Naturally, I expect to get zero. I thought it is due to some possible issues stated as "Machine-precision inputs can give numerically wrong answers on branch cuts:". ...

How to Control the Precision and Accuracy of Numerical Results Arbitrary-Precision Numbers Mathematica works with exact numbers and with two different types of approximate numbers: machine-...

I have an array a with 9 components and when i set precision for this array, components of a also get the precision.however, i want to avoid that and only the number get the precision. for instance, a[...

This is a problem confusing me for years.AccuracyGoal and PrecisionGoal are two options that I never truly understand and, to ...

I use Mathematica mostly for numerical simulation, so most of the time double precision (or machine precision) is enough for me. Mathematica has this nice feature of automatically upgrade to arbitrary ...

I am trying to wrap my head around floating-point precision. Performing the following numeric operation:275./6.*1.03692775514337in Mathematica and C++ and ...

I was looking in Mathematicas documentation and could not find to which point Mathematica includes the IEEE 754 standard? It is mention it in its documentation MachinePrecision under Background & ...

I have this codep = Predict[{1 -> 123456789123456789, 3 -> 987654321987654321}]values are big, more than 15 digits (standard machine precision). when I ...

Suppose I want to numerically evaluate an integral of the form $$\int_{-\infty} ^\infty f(x) \mathrm{d}x $$ with error not exceeding some positive bound $\epsilon$. Is there a way to do this using <...

I have a function f(x) which I would like to see going up for very low values of x: from an asymptotic study, I expect it to go to Infinity for low x; however, I can see an elbow and many oscillations....

This Mathematica tutorial notes some strange behaviour with calculations such as Sin[10^50]: ...

I have data imported from excel file into mathematica but mathematica automatically converts large number into scientific form and when transferring this data to sql string field i get the following .....

Related tags

Hot questions

Language

Popular Tags