precision's questions - English 1answer

297 precision questions.

As specified in documentation center the functions AccountingForm, NumberForm, etc. are useful only to display numbers in ...

I have two expressions, and they are really equal: ...

I am working with a function that has the formExp[-a^2](Erfi[a]-Log[-1/a]-Log[a])/awhere a is complex number. When I tried ...

I would like to use low precision data (based on measurement results with a low precision) to solve a set of inequalities. I have prepared a minimum working example to demonstrate the issue. I am ...

I want to show examples of round-off errors in some numerical algorithms to my student, in order to motivate the study of algorithms with a better behavior. While it is easy in any other language, I ...

I have code that takes an initial guess for a set of parameters to use in a function that I want to minimize, calculates the function, prints the value, recalculates new parameters via the gradient ...

When creating an Interval object, the end points are automatically widened when an end point is an inexact number. For instance: ...

Summary of problem: I'm using Mathematica version 8 to try to integrate the bivariate distribution over a region bounded by a straight line. The two random variables are uncorrelated. When I use ...

I have programmed a function f[x] that seems to be very unstable numerically. More precisely, I noticed that for certain arguments in arbitrary precision, the ...

I have been trying to solve a nonlinear eigenvalue problem, $\mathbf{M}(\lambda) \mathbf{v} = 0$, in Mathematica using Newton's method. The core of the algorithm relies upon an inverse iteration, ...

I know similar questions have been asked before about bugs in Integrate, but I'm not sure what the particular problem is here (and whether or not there is indeed a bug). When I perform the integral: ...

Precision[N[1.0, 20]] Precision[N[1, 20]]MachinePrecision 20.It would be so much more intuitive and less error prone, if <...

The following arbitrary-precision computations, in which arbitrary precision is applied early (to the inputs), both work as expected: ...

I have the source file file = "test.txt" with these values: ...

I had a serious error propagation in my computations (Mathematica 10.4.1 Windows 64 bit). After some investigation, I realized the problem comes from something like this: FullForm[1. - (0.3 + 0.4)] ...

I have code which outputs numbers, for example,(0.2945847, 0.8647834, 1.6*10^-6) and similar. I would like to take these numbers and round them to 4 significant figures, but I can't find a way to do ...

In my current code, I have formed a list of numbers with two different methods. For the first method, I wrote ...

If you run my calculations given below ...

I have a notebook where I have to work with high precision (say, 100). I have tried several methods to define it for the entire notebook, including ...

I am aware that a similar question has been asked, for example, here and here, but none of the proposed solutions solves my problem, so please wait before you mark this question as a duplicate. ...

I would like to know if there is a way to make Mathematica to use at most certain digit number. For example, Suppose I want to calculate 2*Pi.x=N[Pi] y=2*x...

I am continuing to work with GPS data related to trail routes and am trying to optimize the code by removing route points from a GPX file that are very close to each other by setting the accuracy of ...

I am trying to solve a system of three non-linear equations for three unknowns (e1, e2, phi). I am using FindMinimum to solve the system (I am minimizing the norm ...

I want to compute a triple integral. I did it using two codes: the first is ...

Bug introduced in 11.3 or earlier CASE:4075745 I have been experimenting with using Audio and associated functions for data acquisition using an external sound ...

I have a density plot as below:-v = {2, 3}; w = {4, 6}; DensityPlot[Exp[-w.Abs[v - {x, y}]], {x, 0, 5}, {y, 0, 7}]As you can see, the boundary of the white ...

I have a long function composed of polynomials and exponentials that I would like to convert to an appropriate form to cut and paste as an equation into SolidWorks. FortranForm gets me close and with ...

I have fivefold multiple integral and I wanted a speed calculations. I came across on this Question and had already begun the problems. Here is a toy example with simple double integral: ...

When you use SetPrecision to set the precision of say 1.1 you will get some seemingly random numbers padded before the rest will ...

I have two examples of matrices that undergo a similarity transformation: a random matrix, and an exclusion-process inspired matrix. The similarity transformation $\sigma$ is given by an $L \times L$ ...

I'm trying to use regionplot for functions that involve Erfc. A slightly contrived example follows, but it illustrates my difficulties. The command ...

I'm trying to solve nonlinear equations using Newton-type methods with very high accuracy using Mathematica. I found many research papers in which the numerical results are calculated with very high ...

First of all, apologies for the large numbers, I couldn't find a working example for a far lower order and the zeros are necessary... my problem is this: I have a large polynomial (from high-order ...

Task I am trying to evaluate the contour integral of some functions. To have a concrete example, let's use $$ f(z,s) = \frac{1+(4+2s)\, z}{z - \left( 9 + 35s + 24s^2 + 4s^3 \right) z^2 + 8z^3} $$<...

I am a new user in Wolfram language. Please, I am trying to calculate accurate solutions $R$ of an algébric equation which contains the Dawson function. The equation is: $$1+\frac{\theta }{k^2}+\...

My code requires to set some precision to get more accurate results. But I found when I set the precision like 20 or 30, the computation speed would jump 7-10 times slower... Here's an example:<...

I want to define a nice function Φ in 3D that is computed as follows $$ \phi (x, y, z) = - z + \frac{\sqrt{32}}{\pi} \sqrt{\cosh \nu - \cos u} \sum_{n = 1}^\infty ...

As far as I understand, the merit function measures how far the data is from the fitted function. I am calulcating the second partial derivative of a function, and then numerically finding its maxima ...

I have high precision data that I want to do Fourier transform with, but it looks like the precision is lost dramatically. ...

I just want to get a smooth plot but the calculated values are "discrete" which seems to be a precision problem. I tried N[],SetPrecision[],SetAccuary[] without any success. So I paste the Code in its ...

Recently the decimal expansion of a number theoretic constant was searched for, which is the analog of the Landau-Ramanujan constant in a certain context. The constant starts 0.638909... It can be ...

Consider a function ...

I would like to print out an list of reals in a table with perfectly identical number of digits so that they can be perfectly right-aligned. However, once I convert them to strings, ...

I can't see the small changes of my function when I plot it. What can I do? ...

I am solving PDE by means of NDSolve and I am interested in a highly accurate value for the solution at a certain point. For some reason, the solution obtained by ...

I need to solve an ODE with very high precision. I am not sure yet how much precision I need so I have some question before changing the settings. From what I understand, the working precision is how ...

I am trying to evaluate sums involving LegendreQ[n,x], the n-th order Legendre function of the second kind $Q_n(x)$, at large $x>1$. However, the problem is that ...

I'm modeling a quantum tunneling barrier. Because I want to express my quantities in mks units, that means that some of the variables I'm using are pretty small (10^-9). I use NIntegrate for part of ...

When I do something a little bit more complicated than standard documentation examples, I often hit precision problem. Or I accidentally disprove Riemann hypothesis Like this ...

EDIT: I filed a bug report and after a small back-and-forth the support person agreed this is a bug. He said: "I have filed a report with the developers to issue warning messages when the arithmetic ...

Related tags

Hot questions

Language

Popular Tags