Sort by » date activity ▼ answers votes

6 questions

Tagged

floating_point×

215

views

no

answers

no

votes

2022-05-27 08:57:45 +0200 Bubbz

Coordinate chart restriction raising a floating-point-overflow error

564

views

1

answer

no

votes

2019-03-19 22:47:52 +0200 rburing

Converting real numbers to rational format

169

views

no

answers

no

votes

2017-08-05 23:03:25 +0200 Andres Mejia

Is there a way to check whether or not this is a floating point error?

594

views

1

answer

1

vote

2016-02-24 12:45:16 +0200 slelievre

Why do mpmath mpf values compare strangely to Integers?

584

views

1

answer

1

vote

2015-11-30 08:32:22 +0200 slelievre

Rounding error in sqrt(2) in Sage

floating_point

404

views

2

answers

no

votes

2015-02-18 18:23:48 +0200 slelievre

full_simplify produces unexpected result

Contributors

Tags

Copyright Sage, 2010. Some rights reserved under creative commons license. Content on this site is licensed under a Creative Commons Attribution Share Alike 3.0 license.

Powered by Askbot version 0.7.59