I've found that OOC 4.1.11 will not compute numbers with more than 4 decimal places.
so eg
4.9999 * 19.33 * 1.59 gives 153.601
but
4.99999etc * 19.33 * 1.59 gives 153.604 which is the same as 5 * 19.33 * 1.59 (BUT result should be 153.674)
Solutions please.
[Solved] Computation gives unexpected result
[Solved] Computation gives unexpected result
Last edited by pino on Sat Dec 04, 2021 8:27 pm, edited 1 time in total.
Open Office 4.1.11 on Win7pro
- Hagar Delest
- Moderator
- Posts: 32664
- Joined: Sun Oct 07, 2007 9:07 pm
- Location: France
Re: computation
Hi and welcome to the forum!
There is a problem with your figures indeed. Here is what I get with LibreOffice: You should have a look at the topic of this post: £3.04 x 365 Does Not Equal £1,110.46.
Note that you talk about 4 decimal places but you only display 3 of them. There may be a rounding in the formulas.
Please add [Solved] at the beginning of the title in your first post (top of the topic) with the *EDIT button if your issue has been fixed.
There is a problem with your figures indeed. Here is what I get with LibreOffice: You should have a look at the topic of this post: £3.04 x 365 Does Not Equal £1,110.46.
Note that you talk about 4 decimal places but you only display 3 of them. There may be a rounding in the formulas.
Please add [Solved] at the beginning of the title in your first post (top of the topic) with the *EDIT button if your issue has been fixed.
LibreOffice 7.6.2.1 on Xubuntu 23.10 and 7.6.4.1 portable on Windows 10
Re: Computation precision
pino ,
please upload your small, ODF type sample spreadsheet file here.
please upload your small, ODF type sample spreadsheet file here.
Tibor Kovacs, Hungary; LO7.5.8 /Win7-10 x64Prof.
PortableApps/winPenPack: LO3.3.0-7.6.2;AOO4.1.14
Please, edit the initial post in the topic: add the word [Solved] at the beginning of the subject line - if your problem has been solved.
PortableApps/winPenPack: LO3.3.0-7.6.2;AOO4.1.14
Please, edit the initial post in the topic: add the word [Solved] at the beginning of the subject line - if your problem has been solved.
Re: Computation precision
Thanks to both Hagar Delest and Zizi64 for replying.
I made the mistake of not interrogating the output. Apologies for wasting your time.
regards Pino.
I made the mistake of not interrogating the output. Apologies for wasting your time.
regards Pino.
Open Office 4.1.11 on Win7pro