Support Board
Date/Time: Tue, 25 Feb 2025 04:24:27 +0000
Problems with Receiving Data for Forex Symbols
View Count: 896
[2021-03-27 13:09:58] |
Botan626 - Posts: 294 |
SC v2239, this was first mentioned around 4 p.m. UTC on Thursday. Data receiving speed was extremely slow, took more than 30 mins to download data for around 30 forex FXCM symbols after less than 1 day of non-usage time, and data itself was corrupt. Yesterday it took more than 5 minutes for SC to update data for symbols which get quotes every 15 minutes, like EURZAR. This happened just now: I changed From date for AUDUSD to 2020-03-01, this is how SC downloaded data for it: http://www.sierrachart.com/image.php?Image=161685045849.png Date Time Of Last Edit: 2021-03-27 13:11:42
|
[2021-03-27 13:18:23] |
Botan626 - Posts: 294 |
I changed From date to 2020-02-01 for AUDUSD, now SC is downloading data correctly. This is the second time I see SC downloads data properly from the second try, yesterday was the same case for another symbol. |
[2021-03-27 13:43:17] |
Botan626 - Posts: 294 |
SC had no problems with downloading data after I deleted all scid files in the Data folder on Friday morning. My guess is v2239 has some issues with re-writing/updating data files on the disk. Tried just now: Data for AUDJPY was downloaded from 2021-01-25 up to date, I changed From date to 2021-01-01. SC was like this for several minutes: https://i.imgur.com/5CagSY3.png And after it finished downloading data: https://i.imgur.com/mr5LWg2.png |
[2021-03-27 14:56:54] |
Botan626 - Posts: 294 |
Now it doesn't download data even from 4-th and 5-th try: https://i.imgur.com/cQA2s8V.png https://i.imgur.com/DOkwf6T.png |
[2021-03-29 04:01:50] |
|
Sounds like you have some connectivity issue with the downloading of historical data. Refer to: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Error when Downloading Historical Intraday Data from the Sierra Chart Historical Data Server Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2021-03-29 04:01:57
|
[2021-03-29 06:16:24] |
Botan626 - Posts: 294 |
This setting is in different place now: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Using Port 80
Date Time Of Last Edit: 2021-03-29 06:19:16
|
[2021-03-29 06:24:02] |
Botan626 - Posts: 294 |
Sounds like you have some connectivity issue with the downloading of historical data. Refer to:
Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Error when Downloading Historical Intraday Data from the Sierra Chart Historical Data Server This topic says: Sierra Chart needs to be provided access to ports 10149, 10150 to connect to the historical data server. How can I check manually, that SC has access to ports 10149, 10150? I have only Windows Defender Firewall running, I don't use a router. |
[2021-03-29 06:29:40] |
Botan626 - Posts: 294 |
I set 'Use Port 80 For Historical Data' to true. The downloading speed is still terrible, close to 0.
|
[2021-03-29 06:51:41] |
Botan626 - Posts: 294 |
I set 'Use Port 80 For Historical Data' back to false. This is how SC was downloading data for CADJPY: Triggering next historical data download in queue. | 2021-03-29 09:44:23.951
HD Request # 4 | Downloading Intraday chart data for CADJPY to the file CADJPY.scid. Service: fxcm | 2021-03-29 09:44:23.951 HD Request # 4 | Download start date-time: 2021-03-29 08:55:23.000000. File last date-time: 2021-03-29 08:55:23.389000 | 2021-03-29 09:44:23.951 HD Request # 4 | Using server: ds4.sierracharts.com port 10149 | 2021-03-29 09:44:23.951 Socket (2) | Creating socket. | 2021-03-29 09:44:23.952 Socket (2) | New receive buffer size: 5242880 | 2021-03-29 09:44:23.952 Socket (2) | Connecting to IP: 192.81.56.146. | 2021-03-29 09:44:23.952 Chart #3 has tagged chart #2 for full recalculation. Chartbook: 01.Cht | 2021-03-29 09:44:24.123 Socket (4) | Socket gracefully closed by remote side. | 2021-03-29 09:44:24.145 Socket (4) | Closed. | 2021-03-29 09:44:24.146 HD Request # 4 | Setting DTC encoding to Binary VLS | 2021-03-29 09:44:24.364 HD Request # 4 | Sending historical data logon request message. | 2021-03-29 09:44:24.364 HD Request # 4 | Requesting Intraday data. Start date-time: 2021-03-29 08:55:23. Record interval: 0. Symbol: CADJPY | 2021-03-29 09:44:24.564 CHFJPY[M] 0.120 Range #2 | Performing a full recalculation because it has been tagged. Chartbook: 01.Cht | 2021-03-29 09:44:24.605 HD Request # 4 | Decompressing data. | 2021-03-29 09:44:24.765 HD Request # 4 | Receiving Intraday data for CADJPY starting at 2021-03-29 08:55:23.389000 | 2021-03-29 09:44:25.293 Opened cached Intraday file: C:\SierraChart\Data\CHFJPY.scid. Thread ID: 10524 | 2021-03-29 09:44:26.772 Socket (2) | Close event error. Windows error code 10053: An established connection was aborted by the software in your host machine. | 2021-03-29 09:45:08.113 Socket (2) | Socket gracefully closed by remote side. | 2021-03-29 09:45:08.113 Socket (2) | CloseSocket call. | 2021-03-29 09:45:08.113 Socket (0) | CloseSocket call. | 2021-03-29 09:45:08.113 Socket (2) | Graceful close received or receive error. Shutdown complete. Closing socket now. | 2021-03-29 09:45:08.113 Socket (2) | Closed. | 2021-03-29 09:45:08.113 HD Request # 4 | Error downloading historical Intraday data for CADJPY. The network socket has been closed. Retrying download. | 2021-03-29 09:45:08.116 Added historical Intraday data request for CADJPY to the queue. | 2021-03-29 09:45:08.116 Triggering next historical data download in queue. | 2021-03-29 09:45:08.116 Historical data download thread signaled to stop. | 2021-03-29 09:45:08.116 HD Request # 4 | Timestamp of first Intraday data file record written: 2021-03-29 08:55:40.307000 | 2021-03-29 09:45:08.116 HD Request # 4 | Received 132 records from 2021-03-29 08:55:23.389000 to 2021-03-29 08:58:16.254000 (2.9 minutes) and wrote 131 records for CADJPY | 2021-03-29 09:45:08.117 HD Request # 4 | Completion time: 45s | 2021-03-29 09:45:08.121 HD Request # 5 | Downloading Intraday chart data for CADJPY to the file CADJPY.scid. Service: fxcm | 2021-03-29 09:45:08.121 HD Request # 5 | Download start date-time: 2021-03-29 08:58:16.000000. File last date-time: 2021-03-29 08:58:16.254000 | 2021-03-29 09:45:08.122 HD Request # 5 | Using server: ds12.sierracharts.com port 10150 | 2021-03-29 09:45:08.122 Socket (2) | Creating socket. | 2021-03-29 09:45:08.122 Socket (2) | New receive buffer size: 5242880 | 2021-03-29 09:45:08.122 Socket (2) | Connecting to IP: 204.15.197.14. | 2021-03-29 09:45:08.122 HD Request # 5 | Setting DTC encoding to Binary VLS | 2021-03-29 09:45:08.543 HD Request # 5 | Sending historical data logon request message. | 2021-03-29 09:45:08.543 HD Request # 5 | Requesting Intraday data. Start date-time: 2021-03-29 08:58:16. Record interval: 0. Symbol: CADJPY | 2021-03-29 09:45:09.227 HD Request # 5 | Decompressing data. | 2021-03-29 09:45:09.444 HD Request # 5 | Receiving Intraday data for CADJPY starting at 2021-03-29 08:58:16.041000 | 2021-03-29 09:45:09.967 Socket (2) | Close event error. Windows error code 10053: An established connection was aborted by the software in your host machine. | 2021-03-29 09:45:57.017 Socket (2) | Socket gracefully closed by remote side. | 2021-03-29 09:45:57.017 Socket (2) | CloseSocket call. | 2021-03-29 09:45:57.017 Socket (0) | CloseSocket call. | 2021-03-29 09:45:57.017 Socket (2) | Graceful close received or receive error. Shutdown complete. Closing socket now. | 2021-03-29 09:45:57.017 Socket (2) | Closed. | 2021-03-29 09:45:57.017 HD Request # 5 | Error downloading historical Intraday data for CADJPY. The network socket has been closed. Retrying download. | 2021-03-29 09:45:57.017 Added historical Intraday data request for CADJPY to the queue. | 2021-03-29 09:45:57.017 Triggering next historical data download in queue. | 2021-03-29 09:45:57.017 Historical data download thread signaled to stop. | 2021-03-29 09:45:57.017 HD Request # 5 | Timestamp of first Intraday data file record written: 2021-03-29 08:58:17.352000 | 2021-03-29 09:45:57.017 HD Request # 5 | Received 308 records from 2021-03-29 08:58:16.041000 to 2021-03-29 09:00:49.856000 (2.6 minutes) and wrote 303 records for CADJPY | 2021-03-29 09:45:57.018 HD Request # 5 | Completion time: 49s | 2021-03-29 09:45:57.023 HD Request # 6 | Downloading Intraday chart data for CADJPY to the file CADJPY.scid. Service: fxcm | 2021-03-29 09:45:57.024 HD Request # 6 | Download start date-time: 2021-03-29 09:00:49.000000. File last date-time: 2021-03-29 09:00:49.856000 | 2021-03-29 09:45:57.024 HD Request # 6 | Using server: ds4.sierracharts.com port 10149 | 2021-03-29 09:45:57.024 Socket (2) | Creating socket. | 2021-03-29 09:45:57.024 Socket (2) | New receive buffer size: 5242880 | 2021-03-29 09:45:57.024 Socket (2) | Connecting to IP: 192.81.56.146. | 2021-03-29 09:45:57.025 HD Request # 6 | Setting DTC encoding to Binary VLS | 2021-03-29 09:45:58.069 HD Request # 6 | Sending historical data logon request message. | 2021-03-29 09:45:58.069 HD Request # 6 | Requesting Intraday data. Start date-time: 2021-03-29 09:00:49. Record interval: 0. Symbol: CADJPY | 2021-03-29 09:45:58.803 HD Request # 6 | Decompressing data. | 2021-03-29 09:45:59.007 Socket (2) | Close event error. Windows error code 10053: An established connection was aborted by the software in your host machine. | 2021-03-29 09:45:59.225 HD Request # 6 | Receiving Intraday data for CADJPY starting at 2021-03-29 09:00:49.024000 | 2021-03-29 09:45:59.226 Socket (2) | Socket receive error. Windows error code 10054: An existing connection was forcibly closed by the remote host. | 2021-03-29 09:45:59.227 Socket (2) | CloseSocket call. | 2021-03-29 09:45:59.227 Socket (0) | CloseSocket call. | 2021-03-29 09:45:59.227 Socket (2) | Graceful close received or receive error. Shutdown complete. Closing socket now. | 2021-03-29 09:45:59.227 Socket (2) | Closed. | 2021-03-29 09:45:59.227 HD Request # 6 | Error downloading historical Intraday data for CADJPY. The network socket has been closed. Retrying download. | 2021-03-29 09:45:59.232 Historical data download thread signaled to stop. | 2021-03-29 09:45:59.232 HD Request # 6 | Timestamp of first Intraday data file record written: 2021-03-29 09:00:49.919000 | 2021-03-29 09:45:59.232 HD Request # 6 | Received 136 records from 2021-03-29 09:00:49.024000 to 2021-03-29 09:01:42.351000 (53.3 seconds) and wrote 130 records for CADJPY | 2021-03-29 09:45:59.232 HD Request # 6 | Add time&sales data | Remembered last file record date-time: 2021-03-29 06:01:42.351000 | 2021-03-29 09:45:59.241 Added 241 Time and Sales records to Intraday data file for CADJPY after download. | 2021-03-29 09:45:59.241 HD Request # 6 | Completion time: 2s | 2021-03-29 09:45:59.248 HD Request # 6 | Intraday data download complete for CADJPY. Unique request ID: 35 | 2021-03-29 09:45:59.248 Removing historical data download ID 35. | 2021-03-29 09:45:59.248 Real-time Intraday chart data file updates started for CADJPY | 2021-03-29 09:45:59.248 Intraday chart data file opened for CADJPY | 2021-03-29 09:45:59.248 HD Request # 6 | Enabling Intraday chart updating for symbol. | 2021-03-29 09:45:59.248 |
[2021-03-29 06:59:38] |
Botan626 - Posts: 294 |
HD Request # 4 | Using server: ds4.sierracharts.com port 10149 | 2021-03-29 09:44:23.951
I just saw this line in the log and I tried telnet ds4.sierracharts.com 10149
telnet ds4.sierracharts.com 10150 telnet ds4.sierracharts.com 80 commands in Command Prompt. All ports are opened, I saw only a cursor after executing them. So I guess the problem is on SC side. |
[2021-03-29 07:29:19] |
Botan626 - Posts: 294 |
Also I saw these messages in the log while updating to a newer SC version for the last couple of updates. https://i.imgur.com/FYXaYmw.png https://i.imgur.com/x5JWwDZ.png Date Time Of Last Edit: 2021-03-29 07:32:36
|
[2021-03-29 16:18:06] |
John - SC Support - Posts: 38150 |
With regards to your data, you have multiple of the following errors in your log: Socket (2) | Close event error. Windows error code 10053: An established connection was aborted by the software in your host machine.
So you definitely have a connectivity problem of some kind. Refer to the following: Data/Trading Service Connection and Symbol Issues: 1.2. Network Communication or Server Problem The errors when updating are telling you the same thing, there is a connectivity issue. Although that one is related to HTTP requests, therefore also review the following: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Error when Downloading Historical Intraday Data from the Sierra Chart Historical Data Server For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
[2021-03-29 18:10:56] |
Botan626 - Posts: 294 |
I tried to do this: Data/Trading Service Connection and Symbol Issues: 1.8. Checking Connection Quality to Remote Server by Using Ping I used two different internet connections, but the result is the same in both cases: https://i.imgur.com/ISc6JDu.png Are you sure it's not a problem on your side with something, maybe some connections need to be reseted or refreshed? I see other support requests re this issue with slow/delayed connection, like this one: Binance - Slow data download ETH and BTC And the 1-st time I noticed it was as well around 1 week ago, when I tried to update to a newer version, it was way slower and I saw same messages I showed you in post #11. |
[2021-03-29 18:18:11] |
Botan626 - Posts: 294 |
Or here: Bitmex Intraday data not loading more than 2 weeks on CQG WebAPI He was using the same server ds12.sierracharts.com and had the same Windows error code 10053 today. |
[2021-03-29 18:37:19] |
Botan626 - Posts: 294 |
Btw, not all ping tests fail. Pinging ds1.sierracharts.com, ds3.sierracharts.com, ds5.sierracharts.com, ds7.sierracharts.com servers were fully successful. Date Time Of Last Edit: 2021-03-29 18:39:31
|
[2021-03-30 19:03:29] |
Botan626 - Posts: 294 |
I changed my internet connection one more time this morning, and it seems like all downloads came back to normal so far. I don't see 10053 error codes anymore. But my ping tests still fail, 100% loss. I see in message log SC uses ds4.sierracharts.com and ds12.sierracharts.com servers for historical data downloads. This section Data/Trading Service Connection and Symbol Issues: 1.8. Checking Connection Quality to Remote Server by Using Ping says: A useful way to check the quality of the connectivity between your computer and the server being connected to, is by using the network Ping command from the operating system command line. You will use the server address name with the Ping command.
So it's not good, that my ping tests fail, right? Can you try ping tests to these servers too? And the link in this line 'Refer to this Internet article for instructions to use Ping.' is dead. Date Time Of Last Edit: 2021-03-30 21:14:24
|
[2021-04-01 18:39:38] |
Botan626 - Posts: 294 |
?
|
[2021-04-01 19:12:50] |
John - SC Support - Posts: 38150 |
But my ping tests still fail, 100% loss. I see in message log SC uses ds4.sierracharts.com and ds12.sierracharts.com servers for historical data downloads.
That is because those servers are not setup to respond to ping requests. For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
[2021-04-01 19:42:44] |
Botan626 - Posts: 294 |
Why do you suggest checking the quality of the connectivity between computer and the server by using ping command then?
|
[2021-04-01 21:09:04] |
John - SC Support - Posts: 38150 |
There are some servers, such as ds1.sierracharts.com that is mentioned in that section of documentation, that does support a ping.
For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
To post a message in this thread, you need to log in with your Sierra Chart account: