Support Board
Date/Time: Sun, 24 Nov 2024 02:24:41 +0000
Post From: US Equities/CFE Data Early Morning Weekday Carrier Maintenance Notification
| [2024-11-15 22:22:11] |
| Sierra_Chart Engineering - Posts: 17154 |
|
Update: For some context for the below message, Sierra Chart relocated servers permanently out of Chicago in September 2024. We utilize a 100 Gb wavelength connection for US equities, CFE and CBOE indices, to our new data center location in Michigan. We saw a post, about was why we do not have a backup source for these data feeds. We do not need an additional backup source for these data feeds because the service provider we get the data feeds from out of the Chicago data center, has a fully, highly redundant set up with direct connectivity to the exchanges. We already have more than enough backup and redundancy there. There simply is not a need for anything more. This would only technically complicate the service. The service provider we work with, has always delivered us 100% uptime, with these data feeds we get from them. They are very good with what they do. We know, because we have been in many technical discussions with them, and understand their network and architecture, and hardware, and it is all exceptional. The weak point, is a single 100Gb Wavelength between our data center location and the Chicago data center where the feeds are originating from. We know, this is a vulnerability, but it is not expected, based upon our understanding of a wavelength circuit, and promises made, that an issue like this would occur. Basically we were lied to. We did express concerns, in the beginning but they reassured us, that this is a reliable and stable circuit, which is going to maintain 99.9% uptime per month. There was never any disclosure, of maintenance. Another provider we checked with Cogent, has said that they have had zero maintenance or any other incidents over the last six months for this particular circuit/route if we got it from them. The decision to not use Cogent had to do with them not being ready to deliver the circuit to the particular data center we wanted. So as you can see, there has been an awful lot of research and consideration, but the there are always limitations and issues and we have to find what is the right balance. Cogent is now able to deliver a circuit like this, to the data center that we use. Another issue, that was not told to us, is FCC fees for an interstate connection. They lied to us on price. And other providers, were honest to to us about price, and included these fees, and it made it look as though they were overpriced compared to other providers. The FCC fee issue, is a non-issue though. Although interestingly, it was ruled, in a federal court in July or about then, that these fees are unconstitutional. There are different ways of solving this problem with the connectivity. We could keep servers within Chicago/Illinois area. But that is a very significant infrastructure set up, that will have its own vulnerabilities, unless it is fully redundant including redundant Internet connectivity. And this is exactly what we got away from. We got the hell out of Chicago and very very happy with that. There was an awful lot of, effort and work involved in that, and we did not want to start putting servers back into the Chicago or Illinois area. There is a very strong natural, avoidance to even consider that especially, with all kinds of restrictions being placed upon us with connectivity with who would be hosting the servers. It gets to be a point of, tremendous frustration. But nevertheless it is under active consideration. But it is a significant infrastructure set up to even accomplish with all kinds of technical complications. Another possibility is to use a lower bandwidth secondary connection, over to Chicago as a backup connection. The other possibility is to use, a normalized feed, through an API which has lower bandwidth requirements, and maintain 2 lower bandwidth connections over to Chicago CH2 and NY4. All of these things, have their own issues and complexities. There is no simple answer and this is something which is being gradually, worked out in the coming months . Unfortunately this incident has occurred before, a solution was determined. And taking our time, for the right solution, is very sensible. We want to get this right. We have been actively, looking at, connectivity redundancy for our US equities feeds and indices, and CFE but as of yet we have not come to a definite conclusion as the best arrangement. But we are gradually coming up with some choices that will work well. And we have been very actively looking at all of this including during the past two weeks. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2024-11-16 18:05:44
|