Support Board
Date/Time: Fri, 31 Jan 2025 06:05:30 +0000
Spreadsheet number precision
View Count: 2120
| [2013-07-30 18:25:06] |
| joshtrader - Posts: 498 |
|
I am getting quotes on my spreadsheet with a precision of .0001 when I have the spreadsheet set to 0.01 ... I am not sure why this happens, as AAPL should not be quoting to that precision. http://screencast.com/t/r5RilD8H |
| [2013-07-30 18:42:59] |
| |
|
Make sure you select all of the cells and set the number format to .01.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2013-07-31 02:47:22] |
| joshtrader - Posts: 498 |
|
Unfortunately this does not address the issue. All references to this value will reference the same inaccurate number, and I will have to manually truncate the number. Every single number referenced, BEFORE it is used in a calculation, must be truncated. This means that instead of: =E3-E5 I have: =TRUNC(E3,2)-TRUNC(E5,2) Plus, this will necessarily yield incorrect value when using formulas such as MAX() which takes a range, and every number in the range needs to be truncated but can't be. I just don't understand how SC can be introducing data that is not there--where does this come from? How does 454.02 become 454.0214 ? I can understand losing precision in some cases, but the spreadsheet study is adding precision, and I have no idea where that incorrect data is coming from. I know you are working on a new spreadsheet system--will this be addressed in the new code? Date Time Of Last Edit: 2013-07-31 02:52:06
|
| [2013-07-31 03:12:26] |
| joshtrader - Posts: 498 |
|
Actually, I just realized that the problem is worse than I thought. I can not use TRUNC() but must use ROUND() instead. All I can hope is that rounding will yield the actual values. I.E., I have to hope that 454.86 is given in the spreadsheet as greater than or equal to 454.855 and less than 454.865
|
| [2013-07-31 03:47:35] |
| Sawtooth - Posts: 4164 |
|
Here is what I do to round the OHLC to the tick size: 1) Round the tick size to remove floating point errors. Put this in H21: =1/ROUND(1/J21,0) 2) Round the Last price to the tick size multiple: =MROUND(E3,$H$21) Date Time Of Last Edit: 2013-07-31 03:49:02
|
| [2013-07-31 05:33:13] |
| |
|
This data comes from the data feed. So you need to ask the data service you are using about the additional digits.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2019-03-03 10:01:27] |
| ARDAN - Posts: 66 |
|
I use a study which is filling AA column of a spreadsheet study. I use =1/ROUND(1/J21,0) formula to Round the tick size to remove floating point errors in H21 cell as suggested in the documentation. Then I use =MROUND(AA3, $H$21) in the cell AA3, =MROUND(AA4, $H$21) in the cell AA4 and so on. The value in the cell H21 is always 0.1 But some rows in column AA is not rounded and I still see some of them have values such as -7.6000000000000005. I would expect it to be -7.6. How I can overcome this? Thanks. |
| [2019-03-04 07:33:50] |
| ARDAN - Posts: 66 |
|
I've made another test. my data in AQ@3 is 0.9934338927268982. in AR@3 I typed: =MROUND(AQ3,0.01) and I see 0.9900000000000002 as value. How can I overcome this? Thanks. |
| [2019-03-04 12:13:49] |
| |
|
You have to change the Value Format for those cells. Refer to: Working with Spreadsheets: Cell Formatting Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2019-04-09 03:28:25] |
| whats1thingnow - Posts: 407 |
|
when i click Spreadsheet >> Number Format or Spreadsheet >> Cell Properties i do not see a popup/window... i have to hit 'esc' until i can interact with the spreadsheet again i tried: Window >> Reset Windows to reset it back to its default position but still i cannot see it :( please and thank you for the help! |
| [2019-04-09 04:37:03] |
| |
|
Refer to: High CPU Usage | Inactive User Interface | Poor Performance | Long Time to Load Chart Data | Charts Reloading Often: 30.40 - Dialog Windows Do Not Display (Dialog Windows Do Not Display) Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2019-04-09 04:37:21
|
To post a message in this thread, you need to log in with your Sierra Chart account: