12
0.1 + 0.2 (lemmy.ml)
you are viewing a single comment's thread
view the rest of the comments
[-] nyxerus@geddit.social 4 points 1 year ago
[-] MsFlammkuchen@lemmy.blahaj.zone 3 points 1 year ago

Floating point arithmetic

Basically, every floating point number represents a range of numbers. Which can lead to small errors like this. It has also to do with trying to represent a decimal number in binary, which works fine for integers but not for rational numbers.

this post was submitted on 24 Jan 2021
12 points (100.0% liked)

Programmer Humor

32490 readers
530 users here now

Post funny things about programming here! (Or just rant about your favourite programming language.)

Rules:

founded 5 years ago
MODERATORS