Support Board
Date/Time: Sun, 22 Dec 2024 05:06:22 +0000
OEC Historical Download data failing.
View Count: 1330
| [2015-01-16 03:53:53] |
| User726098 - Posts: 23 |
|
I am experiencing issues when I start up my chartbook and it attempts to download and update the data (YM, ES, RLM). My provider is OEC, basically what I'm seeing is the yellow box that says "Downloading Historical Data..." It can be stuck there for over 10 minutes and only download a few hours of the data, then either "Download Fail" or just stop. It will be incomplete, a task that took less than 1 minute in the past. This has been happening for the past 3 nights and I'm noticing it fixes itself around 11pm Central, later in the evening. If I try between 6pm-10pm, it's nearly impossible to get downloads. Morning is fine, starting at 5am and ending at 9am Central. The qoute board on the other hand updates with no problem, I get the real time info for the 3 symbols... I have tried the troubleshooting steps listed in various links per support, and also contacted OEC. OEC stated they see no issues on their end but could be "internet congestion." Doing speed tests I'm getting about 25-30MB download. Ping tests to various sites shows low latency, so which leads me to believe there is some other issues causing this around that period in the evening. Troubleshooting done: -Uninstalled 3rd party FW and using windows FW. -Disabled antivirus -Rebooted computer, modem, router -Tried port 80 for download historicals -Decrease days to download, currently at 160, tried 30. -Deleted old data and download new for each symbol, when able to download. -Updated to latest version of Sierra *Using tick charts so can't have downloads to time based. Logs that I'm seeing this evening when trying YM. Logs below finished with no success: HD Request # 2 | Receiving Intraday data for YMH5 starting at 2015-01-15 08:46:54 | 2015-01-15 21:14:19 HD Request # 2 | Timestamp of first Intraday data file record written: 2015-01-15 08:46:55 | 2015-01-15 21:14:19 Open E Cry FIX: Received Trade Positions request acknowledgment message. Request Result: 2. Request Status: 1 | 2015-01-15 21:14:21 HD Request # 2 | Error downloading historical Intraday data for YMH5. The download timed out. | 2015-01-15 21:22:42 * Socket (4) | Shutdown and closed. | 2015-01-15 21:22:42 HD Request # 2 | Received 77070 records from 2015-01-15 08:46:54 to 2015-01-15 12:21:34 (3.6 hours) and wrote 77018 records for YMH5 | 2015-01-15 21:22:42 Added 75 Time and Sales records to Intraday data file for YMH5 after download. | 2015-01-15 21:22:42 HD Request # 2 | Intraday download COMPLETE for YMH5. Completion time: 8m 28s. Unique request ID: 1 | 2015-01-15 21:22:42 Removed historical data download ID 1 | 2015-01-15 21:22:42 Real-time Intraday chart data file updates started for YMH5 | 2015-01-15 21:22:42 HD Request # 3 | Downloading Intraday chart data for YMH5 to the file YMH5.scid. Service: oec | 2015-01-15 21:40:41 HD Request # 3 | Download start Date-Time: 2015-01-15 21:23:52.0 | 2015-01-15 21:40:41 HD Request # 3 | Using server: oec.sierracharts.com port 10149 | 2015-01-15 21:40:41 Socket (0) | Resolved address ds4.sierracharts.com to IP 204.11.49.26 | 2015-01-15 21:40:41 Socket (5) | Connected. | 2015-01-15 21:40:45 HD Request # 3 | Sending historical data logon request message. | 2015-01-15 21:40:45 HD Request # 3 | Requesting Intraday data. Start Date-Time: 2015-01-15 21:23:52. Record interval: 0. Symbol: YMH5 | 2015-01-15 21:40:48 HD Request # 3 | Decompressing data. | 2015-01-15 21:40:57 HD Request # 3 | Receiving Intraday data for YMH5 starting at 2015-01-15 21:23:52 | 2015-01-15 21:40:57 HD Request # 3 | Timestamp of first Intraday data file record written: 2015-01-15 21:24:37 | 2015-01-15 21:40:57 Socket (5) | Shutdown and closed. | 2015-01-15 21:40:57 The network socket for historical data has been closed. | 2015-01-15 21:40:57 HD Request # 3 | Received 501 records from 2015-01-15 21:23:52 to 2015-01-15 21:40:01 (16.2 minutes) and wrote 500 records for YMH5 | 2015-01-15 21:40:57 Added 6 Time and Sales records to Intraday data file for YMH5 after download. | 2015-01-15 21:40:57 HD Request # 3 | Intraday download COMPLETE for YMH5. Completion time: 16s. Unique request ID: 1 | 2015-01-15 21:40:57 Removed historical data download ID 1 | 2015-01-15 21:40:57 Real-time Intraday chart data file updates started for YMH5 | 2015-01-15 21:40:57 |
| [2015-01-16 04:24:12] |
| |
|
We just tried now and this is what we got: HD Request # 4 | Received 12769614 records from 2014-11-17 04:33:28 to 2015-01-16 04:22:08 (60.0 days) and wrote 12769614 records for ESH5 | 2015-01-16 04:22:24 HD Request # 4 | Intraday download COMPLETE for ESH5. Completion time: 1m 32s. Unique request ID: 3 | 2015-01-16 04:22:24 There are no problems here. So what this tells us is there is some problem with the network connection between your ISP and the server. Where exactly the problem is we do not know. It does not appear to be specific to your system because we do have some other reports of this. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-01-16 04:29:05] |
| User726098 - Posts: 23 |
|
What would be your recommendation to get this resolved. Is this something that OEC would have to look into with the ISP? Or possibly do some troubleshooting on their servers?
|
| [2015-01-16 04:47:52] |
| |
|
This has nothing to do with OEC. We have to think about this. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-01-17 00:18:41] |
| |
|
We have set up another server to be used for OEC historical data. To retry downloading historical Intraday data, refer to help topic 7: Http://www.sierrachart.com/index.php?page=doc/helpdetails7.html Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-01-17 03:25:11] |
| |
|
Actually, we had not completed everything necessary to bring the other server online for OEC. This is now done. To retry downloading historical Intraday data, refer to help topic 7: Http://www.sierrachart.com/index.php?page=doc/helpdetails7.html Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-01-21 04:12:19] |
| User726098 - Posts: 23 |
|
So far so good, 2 evenings in a row with no issues connecting. Download of historical data are back to normal speeds with no failures. Will continue to monitor. Thanks for looking into this and your prompt replies!
|
| [2015-02-13 03:12:59] |
| User726098 - Posts: 23 |
|
Trying to download intraday data for ES this evening, and it seems to be taking quite a bit of time again. It has been stuck on "Downloading historical bars..." which usually takes less than a minute. It completes after awhile but incomplete data/bars. Not sure if the is the same issue that happened last month. I'm downloading YM and ES, YM seems to download fine but take quite a bit of time, ES just fails. Checking for new symbol settings for oec | 2015-02-12 20:55:26 HTTP connection to www.sierrachart.com:80 (0) | Resolved address sierrachart.com to IP 5.9.8.236 | 2015-02-12 20:55:26 HTTP connection to www.sierrachart.com:80 (1) | Connected. | 2015-02-12 20:55:26 Symbol settings are up-to-date for oec | 2015-02-12 20:55:26 Open E Cry FIX | Connecting to trading server prod.openecry.com:9400. | 2015-02-12 20:55:28 OEC FIX Trading socket (0) | Resolved address prod.openecry.com to IP 64.94.37.206 | 2015-02-12 20:55:28 OEC FIX Trading socket (2) | Connected. | 2015-02-12 20:55:28 OEC FIX Trading socket (2) | Starting SSL connection. | 2015-02-12 20:55:28 OEC FIX Trading socket (2) | SSL connection established. | 2015-02-12 20:55:29 OEC FIX Trading: Sending the Logon message. | 2015-02-12 20:55:29 OEC FIX Trading | Connected to trading server. | 2015-02-12 20:55:29 Open E Cry FIX | Connecting to market data server prod.openecry.com:9301. | 2015-02-12 20:55:29 OEC FAST Data socket (0) | Resolved address prod.openecry.com to IP 64.94.37.206 | 2015-02-12 20:55:29 OEC FAST Data socket (3) | Connected. | 2015-02-12 20:55:29 OEC FAST Data: Sending the Hello message. | 2015-02-12 20:55:29 OEC FAST Data: Sending the Logon message. | 2015-02-12 20:55:29 Open E Cry FIX | Connected to the market data server. | 2015-02-12 20:55:29 Open E Cry FIX | Connected. | 2015-02-12 20:55:29 HTTP connection to www.sierrachart.com:80 (1) | Closed. No error. | 2015-02-12 20:55:31 HTTP connection to www.sierrachart.com:80 (1) | Shutdown and closed. | 2015-02-12 20:55:31 Open E Cry FIX | Starting real-time market data updates for: YMH5. ID: 1 | 2015-02-12 20:55:34 Open E Cry FIX | Starting real-time market data updates for: ESH5. ID: 2 | 2015-02-12 20:55:34 Intraday data recording state for symbol ESH5 is set to download pending. | 2015-02-12 20:55:34 HD Request # 2 | Downloading Intraday chart data for ESH5 to the file ESH5.scid. Service: oec | 2015-02-12 20:55:34 HD Request # 2 | Download start Date-Time: 2015-02-09 09:05:01.0 | 2015-02-12 20:55:34 HD Request # 2 | Using server: oec.sierracharts.com port 10149 | 2015-02-12 20:55:34 Socket (0) | Resolved address oec.sierracharts.com to IP 204.11.49.26 | 2015-02-12 20:55:34 Socket (4) | Connected. | 2015-02-12 20:55:34 HD Request # 2 | Sending historical data logon request message. | 2015-02-12 20:55:34 HD Request # 2 | Requesting Intraday data. Start Date-Time: 2015-02-09 09:05:01. Record interval: 0. Symbol: ESH5 | 2015-02-12 20:55:37 HD Request # 2 | Decompressing data. | 2015-02-12 20:55:37 HD Request # 2 | Receiving Intraday data for ESH5 starting at 2015-02-09 09:05:01 | 2015-02-12 20:55:39 HD Request # 2 | Timestamp of first Intraday data file record written: 2015-02-09 09:05:01 | 2015-02-12 20:55:39 Open E Cry FIX: Received Trade Positions request acknowledgment message. Request Result: 2. Request Status: 1 | 2015-02-12 20:55:44 |
| [2015-02-13 03:23:21] |
| |
|
We do believe it is probably the same network connectivity issue. See if it clears up by morning. There are two servers available , so if one server is slow, due to the connectivity issue, and times out, the historical data download will switch to the other server. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2015-02-13 03:31:16
|
| [2015-02-13 03:30:36] |
| User726098 - Posts: 23 |
|
Is there a resolution for this issue? Rather than just waiting in the morning to see if it clears? If I were to trade the night session now it would be impossible, since it can't pull the information down.
|
| [2015-02-13 03:34:08] |
| |
|
This problem is not within our control. Our servers are running fast and they are in 2 different geographical locations. The general solution to this would be to select File >> Disconnect and File >> Connect to Data Feed. This possibly but not guaranteed, will cause the historical download to go to the other server. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-02-13 03:37:01] |
| User726098 - Posts: 23 |
|
I disconnected/reconnectedt several times and also deleted the .scid file. I deleted it a second time and it was able to download the info in 44 seconds just now. After trying several hours this evening with no success. The network socket for historical data has been closed. | 2015-02-12 21:32:26 HD Request # 3 | Received 23998815 records from 2014-10-01 01:58:15 to 2015-02-12 21:32:18 (134.9 days) and wrote 23998815 records for ESH5 | 2015-02-12 21:32:36 Added 5 Time and Sales records to Intraday data file for ESH5 after download. | 2015-02-12 21:32:36 HD Request # 3 | Intraday download COMPLETE for ESH5. Completion time: 44s. Unique request ID: 2 | 2015-02-12 21:32:36 Removed historical data download ID 2 | 2015-02-12 21:32:36 Real-time Intraday chart data file updates started for ESH5 | 2015-02-12 21:32:36 There has to be a better way to load balance the connections in my opinion. Date Time Of Last Edit: 2015-02-13 03:37:51
|
| [2015-02-13 03:40:03] |
| |
|
At the command line enter this command: ipconfig /flushdns This may switch you to the other server. There is not a load issue. There is some network connectivity issues outside of the server. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2015-02-13 03:40:54
|
| [2015-02-13 18:44:44] |
| User726098 - Posts: 23 |
|
Getting data failure now, as I try to connect in the afternoon. In the morning I did not notice any issues. Now I get the red box "download failed." I've notice also others are reports failures on the board. HD Request # 4 | Error downloading historical Intraday data for YMH5. Historical data logon error: Invalid/missing data for service code: oec| | 2015-02-13 12:41:53 * HD Request # 4 | Received 0 records from 00:00:00 to 00:00:00 (0.0 seconds) and wrote 0 records for YMH5 | 2015-02-13 12:41:54 HD Request # 4 | Intraday download COMPLETE for YMH5. Completion time: 0s. Unique request ID: 3 | 2015-02-13 12:41:54 Removed historical data download ID 3 | 2015-02-13 12:41:54 Real-time Intraday chart data file updates started for YMH5 | 2015-02-13 12:41:54 |
| [2015-02-13 19:16:32] |
| |
|
We need to make a correction to post 11 and 13. There was a server issue with load that was causing the original problem yesterday. at the time we did not know that and this kind of problem is exceptionally unusual. The issue in post 14 is different and is unrelated to any other post you see. It is something which occurred in the last hour and it is now fixed. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-02-13 19:27:34] |
| User726098 - Posts: 23 |
|
It is able to download the data but I'm seeing a gap in the bars, it cuts off at 3am central, and starts again 1pm central. I did the right click and "delete and download data" from the missing point, and it was not able to fill the gap. I also deleted the .scid file and the new download has also gap in data. The new download has the gap starting from 2/13 3am ---> 1pm 2/13. No bars appear between this time period. Date Time Of Last Edit: 2015-02-13 19:34:29
|
| [2015-02-13 19:43:14] |
| |
|
We are working on that missing data issue. It relates to the problem yesterday. This may not all get cleared up until the end of the day.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-02-13 20:11:34] |
| |
|
Missing historical data for OEC is now restored and will now download fast. We do apologize for the delay. The particular issue that occurred yesterday was very serious And the first step was for us to stabilize the problem and then gradually work on the issues which were triggered from it. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2015-02-13 20:37:47] |
| User726098 - Posts: 23 |
|
Thanks. Downloads look good again, will continue to monitor. Appreciate the fast response!
|
To post a message in this thread, you need to log in with your Sierra Chart account: