Support Board
Date/Time: Fri, 31 Jan 2025 06:09:39 +0000
Post From: Spreadsheet number precision
| [2019-03-03 10:01:27] |
| ARDAN - Posts: 66 |
|
I use a study which is filling AA column of a spreadsheet study. I use =1/ROUND(1/J21,0) formula to Round the tick size to remove floating point errors in H21 cell as suggested in the documentation. Then I use =MROUND(AA3, $H$21) in the cell AA3, =MROUND(AA4, $H$21) in the cell AA4 and so on. The value in the cell H21 is always 0.1 But some rows in column AA is not rounded and I still see some of them have values such as -7.6000000000000005. I would expect it to be -7.6. How I can overcome this? Thanks. |