Sort by » date activity ▼ answers votes

6 questions

Tagged

floating_point×

168

views

no

answers

no

votes

2022-05-27 08:57:45 +0100 Bubbz

Coordinate chart restriction raising a floating-point-overflow error

450

views

1

answer

no

votes

2019-03-19 22:47:52 +0100 rburing

Converting real numbers to rational format

146

views

no

answers

no

votes

2017-08-05 23:03:25 +0100 Andres Mejia

Is there a way to check whether or not this is a floating point error?

527

views

1

answer

1

vote

2016-02-24 12:45:16 +0100 slelievre

Why do mpmath mpf values compare strangely to Integers?

507

views

1

answer

1

vote

2015-11-30 08:32:22 +0100 slelievre

Rounding error in sqrt(2) in Sage

floating_point

323

views

2

answers

no

votes

2015-02-18 18:23:48 +0100 slelievre

full_simplify produces unexpected result

Contributors

Tags

Copyright Sage, 2010. Some rights reserved under creative commons license. Content on this site is licensed under a Creative Commons Attribution Share Alike 3.0 license.

Powered by Askbot version 0.7.59