[Solved] Computation gives unexpected result

Discuss the spreadsheet application
Post Reply
pino
Posts: 2
Joined: Sat Dec 04, 2021 11:32 am

[Solved] Computation gives unexpected result

Post by pino »

I've found that OOC 4.1.11 will not compute numbers with more than 4 decimal places.

so eg
4.9999 * 19.33 * 1.59 gives 153.601
but
4.99999etc * 19.33 * 1.59 gives 153.604 which is the same as 5 * 19.33 * 1.59 (BUT result should be 153.674)

Solutions please.
Last edited by pino on Sat Dec 04, 2021 8:27 pm, edited 1 time in total.
Open Office 4.1.11 on Win7pro
User avatar
Hagar Delest
Moderator
Posts: 32658
Joined: Sun Oct 07, 2007 9:07 pm
Location: France

Re: computation

Post by Hagar Delest »

Hi and welcome to the forum!

There is a problem with your figures indeed. Here is what I get with LibreOffice:
LO-Calc.png
You should have a look at the topic of this post: £3.04 x 365 Does Not Equal £1,110.46.
Note that you talk about 4 decimal places but you only display 3 of them. There may be a rounding in the formulas.

Please add [Solved] at the beginning of the title in your first post (top of the topic) with the *EDIT button if your issue has been fixed.
LibreOffice 7.6.2.1 on Xubuntu 23.10 and 7.6.4.1 portable on Windows 10
User avatar
Zizi64
Volunteer
Posts: 11359
Joined: Wed May 26, 2010 7:55 am
Location: Budapest, Hungary

Re: Computation precision

Post by Zizi64 »

pino ,

please upload your small, ODF type sample spreadsheet file here.
Tibor Kovacs, Hungary; LO7.5.8 /Win7-10 x64Prof.
PortableApps/winPenPack: LO3.3.0-7.6.2;AOO4.1.14
Please, edit the initial post in the topic: add the word [Solved] at the beginning of the subject line - if your problem has been solved.
pino
Posts: 2
Joined: Sat Dec 04, 2021 11:32 am

Re: Computation precision

Post by pino »

Thanks to both Hagar Delest and Zizi64 for replying.
I made the mistake of not interrogating the output. Apologies for wasting your time.
regards Pino.
Open Office 4.1.11 on Win7pro
Post Reply