Login Page - Create Account

Support Board


Date/Time: Sun, 24 Nov 2024 15:03:36 +0000



Charts updating slow on live data, blasting fast on replay (Denali)

View Count: 2619

[2020-09-17 07:02:29]
User311344 - Posts: 140
Even though I have my chart set at 25ms update interval it's updating like it was 100ms (when I set it to 100ms it looks exactly the same).

BUT when I run replay the chart it works exactly as it should, DOM numbers updating 100x faster, price flickering nice and crisp. I even notice the difference between 10ms and 25ms update setting on replay.

I checked that also with just one clean chart opened with fresh clean sierra start, no studies, just price and DOM bid/ask quantitines.

All worked ok for few months after I switched to Denali. I was overwhelmed by quality and speed. But today it looks terrible and really affects my trading and live data processing.

Build 2150 and few recent ones. My CPU load is ca. 8% so thats not an issue and in general all worked ok for months with no modification of charts or PC/OS.
Date Time Of Last Edit: 2020-09-17 07:07:29
[2020-09-17 08:19:17]
Sierra Chart Engineering - Posts: 104368
There are changes we are making to improve network efficiency, and also we are adding fast compression which will reduce latency to ensure there is no lag at any time. You are also probably about 100 to 150 ms from the server.

The idea is to reduce during busy times latency which potentially now could be in the hundreds of milliseconds, or over a second due to the larger amount of data transmitted. So the plan is to create consistently low latency.

So if you really think this is "terrible" at 100 ms, when you are already over that from the server, we really cannot help with this. There is further improvement we are making over the next few weeks. But we are not going to struggle and bend over backwards to a posting like this. So our advice is please discontinue the Denali data feed. We are not going to struggle and bend over backwards with this kind of posting. Our advice is to discontinue. But we recommend staying for another 1 to 2 months, until we complete all of the related development.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-09-17 08:46:12
[2020-09-17 11:30:49]
User311344 - Posts: 140
Thank you for quick reply.

With all due respect, you're missing the point here.

Yes I am over 100ms from server but I don't mind that latency OFFSET. My problem is very poor CHART UPDATE INTERVAL which even though is set to 25ms it acts like 100ms+ affecting my data analysis process.

So it's like watching ping-pong match and seeing only every fourth racquet strike. I don't mind that I see the match from 100ms ago but I can't be effective with my game analysis seeing only 1/4 data.

My trading is all about close and precise orderflow BEHAVIOUR analysis. I watch HOW volume interacts with liquidity in behavioral terms, not just watching snapshots where it is at given moment. So I need to see not only that something was filled at 100ms snapshots but HOW it was being filled and how depth was interacting through that process. So it's not about being fast with execution but being precise with analysis.

It's about data UPDATING FREQUENCY not about data lagging OFFSET, which I dont mind that much - Im good enough with 2-3 sec execution delay.

And as for your advice to discontinue your service - common guys... Youre the best stuff there is. Ive been with you for last 7 years spending 12h+ every day at sierras interface, coding thousands of lines with ACSIL and enjoying every minute of it. Ive been with you in all your ups and downs so as always I will patiently wait for those network processing improvements cause I know sierra will be only stronger after that. Thank you guys for your tremendous work!
[2020-09-18 14:17:28]
User311344 - Posts: 140
There are changes we are making to improve network efficiency

So to be clear - your current actions regarding network effciency are also server based and may have the impact also on Denali users currently using builds 2150 and lower?

Im sure Denali worked much faster on those previous builds. Chart updating was visibly few times faster than now. Yesterday I tested few versions from 2100-2150 range and this time they all works slow, same as my 2150 now. So I assume your actions are not only client side based, but please confirm. Thank you!
Date Time Of Last Edit: 2020-09-18 16:12:25
[2020-09-18 18:50:37]
Sierra Chart Engineering - Posts: 104368
What we are doing is on the server side and we are not finished. And we also plan to give users a setting to control the buffer timing for their connection. So you will be able to control it that way. This is not yet released. We will get this out next week. We have forgotten about that upcoming setting when we wrote our original post. It is coming.

The data is not snapshot data. You can see all of the activity in the Time and Sales window:
Time and Sales Window

You can also set the option to show Bid and Ask Records.

And all the depth updates are received. The data feed is unfiltered.

And what you say is consistent with what we have heard before from another user that long before any changes that they were seeing updates at 100 ms minimum. So it seems to vary based upon the users connectivity. Anyway we will make this user controllable.

But with the upcoming compression, it would seem to make sense to send out larger blocks of data to get the best compression ratio but we will just have to see.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-09-18 20:27:07
[2020-09-18 22:45:51]
User311344 - Posts: 140
Really appreciate your answer.

The data is not snapshot data.
And all the depth updates are received. The data feed is unfiltered.

Of course I know that. Denali is the best data source there is. No question about it. But if Im not able to process all received data with high frequency processing and I get the update only every 100ms+ it actually feels like snapshots, not consistant linear feed. And as I mentioned before - when I replay same period with chart replay at 1x speed everything works perfectly well and ultra fast as it should. So all data is there but clearly theres some problem with processing the data live and not being able to present it at right time. So probably your compression idea is interesting solution.

And what you say is consistent with what we have heard before from another user that long before any changes that they were seeing updates at 100 ms minimum. So it seems to vary based upon the users connectivity. Anyway we will make this user controllable.

Maybe that has nothing to do with it but this situation reminds me the problem when you were introducing your own timer event process. There was a discussion that you even considered removing chart update interval option at all to allow Sierra for self-adjusting this value. This time there are no interface freezes, but charts act exactly as the update interval was self-adjusted by sierra from low value to 100ms+. Your posts from that time:

Managing Performance with Version 1959 and Higher and the Chart Update Interval
Date Time Of Last Edit: 2020-09-18 22:48:53
[2020-09-28 17:23:41]
User311344 - Posts: 140
OK, so I upgraded to 2175, Use real-time data compression checked. Remote Buffer Delay in ms = 0 (default).

Unfortunately theres no difference to 2150. Chart is still laggy, overall experience is tragic, chart/DOM it updating as the chart update interval is ca. 100-150ms. And still when I replay the same period using standard replay all is running extremaly fast and smooth so the data is there. It just cant be that fast on live data.

My log from heartbeat below. Is there anything I should check/set on my side to finally get back to proper and perfect Denali operation as it was 1-2 months ago?

Is there any way to switch off that ms timestamping? Maybe that remote buffer dalay should be set to some other value?

SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:09:46.555
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=12, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=1006, ActualMessageDelay=0.4 seconds, DataCompRatio=2.09, UncompressedBytes=489604, CompressionTime=0.010699, NumCompressions=970 | 2020-09-28 19:10:00.833
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:10:06.579
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=12, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=142, ActualMessageDelay=0.4 seconds, DataCompRatio=2.09, UncompressedBytes=547712, CompressionTime=0.011830, NumCompressions=1072 | 2020-09-28 19:10:20.848
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:10:26.586
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=12, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.08, UncompressedBytes=596523, CompressionTime=0.012839, NumCompressions=1173 | 2020-09-28 19:10:40.816
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:10:46.580
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=12, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=92, ActualMessageDelay=0.3 seconds, DataCompRatio=2.07, UncompressedBytes=633200, CompressionTime=0.013748, NumCompressions=1273 | 2020-09-28 19:11:00.790
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:11:06.586
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=12, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.4 seconds, DataCompRatio=2.07, UncompressedBytes=676996, CompressionTime=0.014881, NumCompressions=1376 | 2020-09-28 19:11:20.857
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:11:26.582
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=129, ActualMessageDelay=0.3 seconds, DataCompRatio=2.07, UncompressedBytes=725950, CompressionTime=0.015919, NumCompressions=1477 | 2020-09-28 19:11:40.762
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:11:46.591
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=118, ActualMessageDelay=0.3 seconds, DataCompRatio=2.07, UncompressedBytes=786351, CompressionTime=0.017008, NumCompressions=1581 | 2020-09-28 19:12:00.833
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:12:06.579
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.07, UncompressedBytes=847644, CompressionTime=0.018154, NumCompressions=1686 | 2020-09-28 19:12:20.847
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:12:26.588
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=50, ActualMessageDelay=0.3 seconds, DataCompRatio=2.06, UncompressedBytes=879724, CompressionTime=0.018995, NumCompressions=1778 | 2020-09-28 19:12:40.864
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:12:46.585
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.06, UncompressedBytes=908419, CompressionTime=0.019816, NumCompressions=1868 | 2020-09-28 19:13:00.851
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:13:06.594
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.05, UncompressedBytes=935833, CompressionTime=0.020625, NumCompressions=1960 | 2020-09-28 19:13:20.846
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:13:26.596
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=71, ActualMessageDelay=0.3 seconds, DataCompRatio=2.04, UncompressedBytes=967545, CompressionTime=0.021474, NumCompressions=2054 | 2020-09-28 19:13:40.778
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:13:46.584
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=79, ActualMessageDelay=0.3 seconds, DataCompRatio=2.04, UncompressedBytes=995181, CompressionTime=0.022288, NumCompressions=2142 | 2020-09-28 19:14:00.828
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:14:06.600
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.04, UncompressedBytes=1028661, CompressionTime=0.023068, NumCompressions=2231 | 2020-09-28 19:14:20.862
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:14:26.594
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=148, ActualMessageDelay=0.4 seconds, DataCompRatio=2.03, UncompressedBytes=1067885, CompressionTime=0.024156, NumCompressions=2332 | 2020-09-28 19:14:40.890
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:14:46.601
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=1705, ActualMessageDelay=0.3 seconds, DataCompRatio=2.03, UncompressedBytes=1113359, CompressionTime=0.025179, NumCompressions=2428 | 2020-09-28 19:15:00.758
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:15:06.601
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.4 seconds, DataCompRatio=2.04, UncompressedBytes=1199694, CompressionTime=0.026466, NumCompressions=2535 | 2020-09-28 19:15:20.877
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:15:26.599
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=11, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=181, ActualMessageDelay=0.3 seconds, DataCompRatio=2.04, UncompressedBytes=1258948, CompressionTime=0.027567, NumCompressions=2643 | 2020-09-28 19:15:40.832
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:15:46.600
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=171, ActualMessageDelay=0.2 seconds, DataCompRatio=2.04, UncompressedBytes=1310824, CompressionTime=0.028984, NumCompressions=2743 | 2020-09-28 19:16:00.771
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:16:06.610
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=149, ActualMessageDelay=0.4 seconds, DataCompRatio=2.04, UncompressedBytes=1354048, CompressionTime=0.029888, NumCompressions=2838 | 2020-09-28 19:16:20.884
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:16:26.616
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=29, ActualMessageDelay=0.3 seconds, DataCompRatio=2.03, UncompressedBytes=1384031, CompressionTime=0.030808, NumCompressions=2937 | 2020-09-28 19:16:40.834
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:16:46.613
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=111, ActualMessageDelay=0.4 seconds, DataCompRatio=2.03, UncompressedBytes=1424308, CompressionTime=0.031775, NumCompressions=3040 | 2020-09-28 19:17:00.896
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:17:06.613
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.4 seconds, DataCompRatio=2.03, UncompressedBytes=1456832, CompressionTime=0.032576, NumCompressions=3130 | 2020-09-28 19:17:20.880
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:17:26.617
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=253, ActualMessageDelay=0.3 seconds, DataCompRatio=2.02, UncompressedBytes=1498099, CompressionTime=0.033448, NumCompressions=3227 | 2020-09-28 19:17:40.866
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:17:46.616
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.02, UncompressedBytes=1526607, CompressionTime=0.034230, NumCompressions=3322 | 2020-09-28 19:18:00.863
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:18:06.616
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=29, ActualMessageDelay=0.3 seconds, DataCompRatio=2.02, UncompressedBytes=1559188, CompressionTime=0.035075, NumCompressions=3415 | 2020-09-28 19:18:20.821
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=17, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:18:26.603
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=92, ActualMessageDelay=0.4 seconds, DataCompRatio=2.02, UncompressedBytes=1607684, CompressionTime=0.036111, NumCompressions=3517 | 2020-09-28 19:18:40.913
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:18:46.614
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.4 seconds, DataCompRatio=2.01, UncompressedBytes=1631532, CompressionTime=0.036976, NumCompressions=3608 | 2020-09-28 19:19:00.883
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:19:06.617
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=1673402, CompressionTime=0.037898, NumCompressions=3706 | 2020-09-28 19:19:20.869
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:19:26.617
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=10, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=121, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=1704329, CompressionTime=0.038730, NumCompressions=3796 | 2020-09-28 19:19:40.849
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:19:46.627
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=413, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=1735934, CompressionTime=0.039485, NumCompressions=3888 | 2020-09-28 19:20:00.844
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:20:06.643
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=606, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=1780537, CompressionTime=0.040383, NumCompressions=3986 | 2020-09-28 19:20:20.853
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=16, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:20:26.631
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=179, ActualMessageDelay=0.4 seconds, DataCompRatio=2.01, UncompressedBytes=1812476, CompressionTime=0.041215, NumCompressions=4080 | 2020-09-28 19:20:40.888
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=15, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:20:46.626
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=72, ActualMessageDelay=0.4 seconds, DataCompRatio=2.01, UncompressedBytes=1860729, CompressionTime=0.042172, NumCompressions=4179 | 2020-09-28 19:21:00.890
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=15, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:21:06.636
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=157, ActualMessageDelay=0.4 seconds, DataCompRatio=2.00, UncompressedBytes=1896980, CompressionTime=0.043090, NumCompressions=4272 | 2020-09-28 19:21:20.891
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=15, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:21:26.621
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.4 seconds, DataCompRatio=2.00, UncompressedBytes=1918883, CompressionTime=0.043725, NumCompressions=4352 | 2020-09-28 19:21:40.889
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:21:46.623
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=120, ActualMessageDelay=0.4 seconds, DataCompRatio=2.00, UncompressedBytes=1944206, CompressionTime=0.044452, NumCompressions=4434 | 2020-09-28 19:22:00.885
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:22:06.623
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=258, ActualMessageDelay=0.2 seconds, DataCompRatio=2.00, UncompressedBytes=2000845, CompressionTime=0.045535, NumCompressions=4538 | 2020-09-28 19:22:20.765
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:22:26.635
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=100, ServerSendBufferSizeInBytes=266, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=2090844, CompressionTime=0.046778, NumCompressions=4645 | 2020-09-28 19:22:40.782
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.7 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-09-28 19:22:46.634
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=9, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=135, ServerSendBufferSizeInBytes=808, ActualMessageDelay=0.3 seconds, DataCompRatio=2.01, UncompressedBytes=2136822, CompressionTime=0.047717, NumCompressions=4746 | 2020-09-28 19:23:00.866
Date Time Of Last Edit: 2020-09-28 17:24:32
[2020-09-28 17:40:32]
User472511 - Posts: 19
I am experiencing the same.
[2020-09-28 19:55:01]
Sierra Chart Engineering - Posts: 104368
First, when you see a value over 100 ms it is not really correct.
TransmissionDelayInMilliseconds=135,

In most cases the transmission delay is not going to exceed 100 ms and that represents worst case. Not typical.

Set Remote Buffer Delay in Milliseconds to 50 and reconnect to the data feed. But support for that option is not fully released yet across all systems.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-09-28 19:56:18
[2020-09-29 14:44:54]
User311344 - Posts: 140
No difference after setting it to 50. Still laggy.

I must say I dont understand this situation technically cause when I replay the chart it just flies with 10ms update interval and all data is there. But when live all gets so laggy as it was running on 150ms udpate.

But please watch it yourself. I made a short video (50frames/sec) with 5sec ES chart with 20ms update inteval. First half is live data, second part is replay. The difference is just smashing!

Please get my beloved Sierra/Denali back!!!
Date Time Of Last Edit: 2020-09-29 14:45:30
attachmentES lagging live chart vs ultra fast on replay.mp4 - Attached On 2020-09-29 14:45:24 UTC - Size: 10.52 MB - 439 views
[2020-09-30 05:38:52]
User311344 - Posts: 140
Also please note this laggy behaviour on live data has nothing to do with the time of day or current market activity. It's same laggy in the us session and in the middle of the night.

What I dont get is that I dont mind some latency offset (cme to europe + sierra data processing/whatever) which is 100ms+ for sure but then I need the data to have original FREQUENCY and proper chart updating interval! So what I see can be shifted in time thats ok, but why the chart has that constant hiccup regarding it's updateing interval??

Are you sending big packets of data which then are uncompressed/decoded/whatever and presented on chart as those lazy 100ms+ snapshots instead of continuous low granularity data? Cause watching my data processing model Im quite sure I dont lose any data and replay shows it even with naked eye that theres 5x+ data being shown than when the live chart watching so the data is here. Just that constant tragic chart hiccup as on video in previous post.
[2020-09-30 12:38:34]
seandunaway - Posts: 268
It looks buffered.

For most styles of trading.. buffering, batching, compressing, processing, etc data is probably really helpful and more efficient. But for those of us that trade using the character of the market, and not just where it's trading but how it's trading there.. pure unadulterated streaming is essential.

Have you disabled compression?
Date Time Of Last Edit: 2020-09-30 12:39:25
[2020-09-30 14:22:40]
User311344 - Posts: 140
Thanks for chiming in. It does feel batched/buffered. Sometimes it looks like Sierra underestimates how proficient and advanced data processing models can be build by their users using this awesome platform/datafeed. Ms timestamping is a nice candy, but not at price of slowing down 5x or more.

Have you disabled compression?

Yea no difference on and off.
[2020-09-30 18:38:39]
Sierra Chart Engineering - Posts: 104368
Set Remote Buffer Delay Send Time in Milliseconds down to 1 and reconnect to the data feed.. You must always reconnect to the data feed.

And then you can observe with the heartbeat logging, what the actual transmission delay is. It will go up based upon the number of outstanding buffers. There is one adjustment we will make with this last part, which will go into affected this evening.

If you notice there are outstanding buffers of 3 or more, then it does indicate a poor return path, for IP acknowledgments. If you are frequenting noticing something like 5 or more you have a poor quality Internet connection. The higher number of outstanding buffers, the more degraded the Internet connection is.

And you also need to realize, the lower Remote Buffer Delay Send Time in Milliseconds value that you use, you introduce potential for lagging and stopping data due to too many small packets.

More information:
https://en.wikipedia.org/wiki/Silly_window_syndrome


Also please note this laggy behaviour on live data has nothing to do with the time of day or current market activity. It's same laggy in the us session and in the middle of the night.
Of course there are going to be fewer updates because the market is not active at these times or whenever it is less active. There is nothing wrong here at all. Nothing at all. We are not going to say anything further about this.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-09-30 18:57:25
[2020-10-01 06:35:39]
User311344 - Posts: 140
Thank you guys, that solved the problem.

I assume setting that buffer to low values increases the workload on your servers so thats why it's set at 100ms as default value when 0 entered (at least thats my experience). Thanks again it can be now reduced for hardcore users.

Also probably the best practice would be to set this buffer to value not much lower than current chart update interval, cause when chart updates at 100ms+ than theres no use to have the buffer set at 1ms risking increased number of outstanding buffers and not taking much benefit from data compression, and in the name of solidarity - avoid putting too much unnecessary workload on your servers.

Of course there are going to be fewer updates because the market is not active at these times or whenever it is less active.
The issue was clearly visible even on low activity periods (at night), where the market still has some activity bursts and they were buffered to 100ms snapshots. Luckily it looks fine now.

Sierra rocks again!!!!!!!!!!!!
Date Time Of Last Edit: 2020-10-01 06:42:05
[2020-10-01 12:31:38]
Sierra Chart Engineering - Posts: 104368
We would not recommend going less than 50 ms and the minimum allowed is 20 ms. For remote connections, outside of the local network, typically the average has been about 50 ms. It becomes larger with degraded connections.

Adjusting the buffer interval, will only be possible, when using data feed compression.

Understand that lossless data transfer is a two-way communication path and it becomes very inefficient with small and excessive packet transfer. From Wikipedia article linked above:
Since there is a certain amount of overhead associated with processing each packet, the increased number of packets means increased overhead to process a decreasing amount of data. The end result is thrashing.

The concern is not the server load, the compression time is not a problem for our servers. The concern, is excessive packet flow on the network and side effects of that.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-10-01 12:34:30
[2020-10-01 13:20:06]
User311344 - Posts: 140
We would not recommend going less than 50 ms and the minimum allowed is 20 ms

Currently it's possible to set it even at 1ms - do you plan on restricting it to 20ms in future builds? Could you make it 10ms as min then? Same as min chart update interval? Thanks in advance!

Edit:
I looked at my heartbeat log and I see TransmissionDelayInMilliseconds=20 so I guess it's limited @20ms as server side setting? Could it be 10ms to match minimal chart update interval?


SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=15, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=20, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.1 seconds, DataCompRatio=3.12, UncompressedBytes=182877, CompressionTime=0.001731, NumCompressions=156 | 2020-10-01 15:21:01.561
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=0, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.5 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-10-01 15:21:05.915
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=20, ServerSendBufferSizeInBytes=39, ActualMessageDelay=0.0 seconds, DataCompRatio=2.72, UncompressedBytes=209087, CompressionTime=0.003226, NumCompressions=348 | 2020-10-01 15:21:21.546
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.5 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-10-01 15:21:25.917
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=20, ServerSendBufferSizeInBytes=39, ActualMessageDelay=0.0 seconds, DataCompRatio=2.43, UncompressedBytes=244874, CompressionTime=0.004899, NumCompressions=566 | 2020-10-01 15:21:41.550
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.5 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-10-01 15:21:45.916
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=20, ServerSendBufferSizeInBytes=87, ActualMessageDelay=0.0 seconds, DataCompRatio=2.24, UncompressedBytes=300143, CompressionTime=0.006756, NumCompressions=800 | 2020-10-01 15:22:01.537
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.5 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-10-01 15:22:05.924
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=14, NumberOfOutstandingSendBuffers=1, TransmissionDelayInMilliseconds=20, ServerSendBufferSizeInBytes=71, ActualMessageDelay=0.0 seconds, DataCompRatio=2.12, UncompressedBytes=359921, CompressionTime=0.009088, NumCompressions=1032 | 2020-10-01 15:22:21.551
SC Futures Order Routing/Data | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=18, NumberOfOutstandingSendBuffers=0, TransmissionDelayInMilliseconds=0, ServerSendBufferSizeInBytes=0, ActualMessageDelay=0.5 seconds, DataCompRatio=0.00, UncompressedBytes=0, CompressionTime=0.000000, NumCompressions=0 | 2020-10-01 15:22:25.929

Date Time Of Last Edit: 2020-10-01 13:26:11
[2020-10-02 13:52:44]
SC Support - Posts: 1895
If you are looking for 10 ms, we could potentially provide this service, but it would also require at least a Virtual Private Server in the Aurora Data Center (same Data Center as the CME Matching Engines). The cost of this would be roughly $500/month.

As thing stand, we estimate that you being in Central European Time (CET) is costing you over 100 miliseconds in latency.
Please let us know if you would be interested to investigate this more latency focused service?
Date Time Of Last Edit: 2020-10-02 13:53:38
[2020-10-02 14:25:03]
User311344 - Posts: 140
As thing stand, we estimate that you being in Central European Time (CET) is costing you over 100 miliseconds in latency.

OK so I'll explain it again, because you still mix two different things.

I dont mind my 100ms+ LATENCY OFFSET from CME to central europe. It's ok. But I do mind my chart/data/studies being updated with poor FREQUENCY or being BATCHED and BUFFERED as huge 100ms packs of data which then appear almost like 100ms snapshots. Thats why increasing data update interval is crucial for me. And decreasing that buffer value is huge improvement for me cause I finally started getting much more continous data and Im grateful for that.

So thats why I asked if you could decrease it from 20ms down to 10ms cause thats minimal possible chart update interval which is possible to set up. So the data UPDATE FREQUENCY would match chart update frequency. From my understanding theres no use to set chart update interval to 10ms if data is being provided with 20ms frequency batches.
Date Time Of Last Edit: 2020-10-02 14:25:38
[2020-10-30 10:39:34]
User311344 - Posts: 140
After update from 2175 to 2189 Ive started seeing laggy chart again! As I noticed in heartbeat information you probably set the minimal possible TransmissionDelayInMilliseconds from 20ms to 80ms!!! I get 80ms even though it's set to 20ms in SC server settings.

This is so wrong!!! Please revert back to at least those 20ms which were possible before and charts update speed was acceptable even though it should be at last 10ms same as minimal chart update interval.

Everything is going fine up to 2180, but in 2189 seems as you hardcoded 80ms as minimal. Attached are two logs from almost the same moment so theres no change in internet connection or pc/network configuration, etc.

I hope this is only some minor bug or temporary setting cause charts updating at 80ms are laggy as hell.
Date Time Of Last Edit: 2020-10-30 10:44:21
image2175.jpg / V - Attached On 2020-10-30 10:36:24 UTC - Size: 225.45 KB - 293 views
image2189.jpg / V - Attached On 2020-10-30 10:36:33 UTC - Size: 278.48 KB - 287 views
[2020-10-30 13:09:00]
User472511 - Posts: 19
I am seeing the same.
[2020-10-30 18:00:02]
Sierra Chart Engineering - Posts: 104368
This issue is inadvertent. We are not sure of the cause yet. It will be resolved after the market close today. It does not appear to be an issue on the Sierra Chart side, but instead the server-side but we will find out.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-10-30 18:00:50
[2020-10-30 18:21:26]
User311344 - Posts: 140
Phew! I appreciate you acknowledged the problem. Thank you.

Ive been installing several builds today one after another to locate this problem and I noticed at 2180 and before it was stable 20ms, then at 2182 it started to be inconsistant 20ms AND 80ms (see attachment) and then 2189 is stable 80ms. So certainly build/client dependant. But im aware it can be only an echo of server side issue.
Date Time Of Last Edit: 2020-10-30 18:23:09
image2182.jpg / V - Attached On 2020-10-30 18:19:34 UTC - Size: 302.05 KB - 272 views
image2189.jpg / V - Attached On 2020-10-30 18:19:40 UTC - Size: 278.48 KB - 258 views
[2020-10-30 20:21:40]
Sierra Chart Engineering - Posts: 104368
The problem has been identified and we will be doing an update on the server to resolve after the close today.

It relates to how real-time compression is enabled. Newer versions signal this through the encoding request message rather than by using a particular port.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-10-30 20:22:33
[2024-05-23 13:18:03]
BenjFlame - Posts: 324
User311344, can you please clarify what value you finally put on server setting buffer in milliseconds, and the compression level you chose, as well as your chart update interval?

I'm noticing the same issue as you with replays being much smoother than live data.

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account