Support Board
Date/Time: Mon, 24 Feb 2025 19:13:16 +0000
Long delays when downloading data from second instance
View Count: 747
| [2021-03-19 20:33:08] |
| User816220 - Posts: 80 |
|
I tried updating to 2239 both before and after today's session; both times opening a second instance resulted in long delays when trying to download historical data for symbols that weren't tracked in the main instance. Switching back to 2238 resolved the issue. It looks like Sierra Chart re-downloaded all the data for the affected symbols instead of just the few minutes it needed. AUDUSD for example: HD Request # 30 | Received 188769 records from 2020-09-14 16:13:23.009000 to 2021-03-19 16:13:00.755000 (186.0 days) and wrote 188769 records for AUDUSD | 2021-03-19 16:13:27.115
|
 message_log.txt - Attached On 2021-03-19 20:31:23 UTC - Size: 104.2 KB - 348 views |
| [2021-03-19 21:04:18] |
| John - SC Support - Posts: 38146 |
|
What you are saying is the way it works. The first time you open a chart for a symbol, it is going to download the historical data for that symbol, which may take a few minutes. Going back to 2238 did not really resolve the problem, it was just that you had already downloaded the data so it appeared to be faster. For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2021-03-19 21:17:50] |
| User816220 - Posts: 80 |
|
That wasn't the first time I opened the symbol in the sub-instance. I didn't open charts for any new symbols after updating. All the data should have been there except for the few minutes between closing 2238 and reopening with 2239.
|
| [2021-03-22 02:41:20] |
| User816220 - Posts: 80 |
|
Here are logs from the main and sub instances showing the issue with EURUSD. The sub-instance had intraday data through 2021-03-19; the main instance has intraday data but hasn't been updated for a long while. Sub-instance: Triggering next historical data download in queue. | 2021-03-21 21:55:26.873
HD Request # 20 | Downloading Intraday chart data for EURUSD to the file EURUSD.scid. Service: DTCSubInstance | 2021-03-21 21:55:26.873 Socket (1) | Socket gracefully closed by remote side. | 2021-03-21 21:55:26.873 Socket (1) | Closed. | 2021-03-21 21:55:26.873 HD Request # 20 | Download start date-time: 2021-03-19 16:08:43.000000. File last date-time: 2021-03-19 16:08:43.273000 | 2021-03-21 21:55:26.873 HD Request # 20 | Using server: 127.0.0.1 port 11098 | 2021-03-21 21:55:26.873 Socket (1) | Creating socket. | 2021-03-21 21:55:26.874 Socket (1) | New receive buffer size: 5242880 | 2021-03-21 21:55:26.874 Socket (1) | Connecting to IP: 127.0.0.1. | 2021-03-21 21:55:26.874 HD Request # 20 | Setting DTC encoding to Binary VLS | 2021-03-21 21:55:26.896 HD Request # 20 | Sending historical data logon request message. | 2021-03-21 21:55:26.896 HD Request # 20 | Requesting Intraday data. Start date-time: 2021-03-19 16:08:43. Record interval: 0. Symbol: EURUSD | 2021-03-21 21:55:26.900 HD Request # 20 | Data is being downloaded from a remote source. Download will start when this is done. | 2021-03-21 21:55:26.988 Opened cached Intraday file: C:\SierraChart\SierraChartInstance_2\Data\F.US.TYAM21.scid. Thread ID: 4616 | 2021-03-21 21:55:34.715 Opened cached Intraday file: C:\SierraChart\SierraChartInstance_2\Data\F.US.FVAM21.scid. Thread ID: 4616 | 2021-03-21 21:55:34.716 Opened cached Intraday file: C:\SierraChart\SierraChartInstance_2\Data\F.US.USAM21.scid. Thread ID: 4616 | 2021-03-21 21:55:39.716 Opened cached Intraday file: C:\SierraChart\SierraChartInstance_2\Data\F.US.PLEJ21.scid. Thread ID: 4616 | 2021-03-21 21:55:59.718 Opened cached Intraday file: C:\SierraChart\SierraChartInstance_2\Data\F.US.HOEK21.scid. Thread ID: 4616 | 2021-03-21 21:57:04.773 HD Request # 20 | Decompressing data. | 2021-03-21 22:00:06.852 HD Request # 20 | Receiving Intraday data for EURUSD starting at 2021-03-19 16:08:43.273000 | 2021-03-21 22:00:06.875 Socket (1) | CloseSocket call. | 2021-03-21 22:00:06.920 Socket (1) | Shutdown started. Waiting for graceful close. | 2021-03-21 22:00:06.920 Socket (1) | Socket gracefully closed by remote side. | 2021-03-21 22:00:06.922 Socket (1) | Closed. | 2021-03-21 22:00:06.922 Historical data download thread signaled to stop. | 2021-03-21 22:00:06.924 HD Request # 20 | Timestamp of first Intraday data file record written: 2021-03-19 16:08:57.770000 | 2021-03-21 22:00:06.925 HD Request # 20 | Received 22135 records from 2021-03-19 16:08:43.273000 to 2021-03-21 22:00:06.138000 (2.2 days) and wrote 22134 records for EURUSD | 2021-03-21 22:00:06.925 HD Request # 20 | Add time&sales data | Remembered last file record date-time: 2021-03-22 02:00:06.138000 | 2021-03-21 22:00:06.925 Added 9 Time and Sales records to Intraday data file for EURUSD after download. | 2021-03-21 22:00:06.925 HD Request # 20 | Completion time: 4m 40s | 2021-03-21 22:00:06.925 HD Request # 20 | Intraday data download complete for EURUSD. Unique request ID: 20 | 2021-03-21 22:00:06.925 Removing historical data download ID 20. | 2021-03-21 22:00:06.925 Real-time Intraday chart data file updates started for EURUSD | 2021-03-21 22:00:06.926 Intraday chart data file opened for EURUSD | 2021-03-21 22:00:06.926 HD Request # 20 | Enabling Intraday chart updating for symbol. | 2021-03-21 22:00:06.926 Main instance: HD Server Manager | Incoming connection from IP: 127.0.0.1 | 2021-03-21 21:55:26.887
HD Server Manager | Started new historical data server. Count=3 | 2021-03-21 21:55:26.888 HD Server | Thread:5268 (1) | Creating socket. | 2021-03-21 21:55:26.892 HD Server | Thread:5268 (1) | New receive buffer size: 262144 | 2021-03-21 21:55:26.892 HD Server | Thread:5268 (1) | Allocated send buffers: 32 of 4096 bytes. | 2021-03-21 21:55:26.892 HD Server | Setting DTC encoding to Binary VLS | Thread:5268 | 2021-03-21 21:55:26.893 HD Server | Received login. Requesting authorization. | Username: jboeing. | Thread:5268 | 2021-03-21 21:55:26.898 HD Server | Login has been authorized. | Username: jboeing. | Thread:5268 | 2021-03-21 21:55:26.898 HD Server | HD Request #20 | Socket: 1 | Symbol: EURUSD | ServiceCode: DTCSubInstance | RecordInterval: 0 | MaximumDaysRequested: 0 | Start date-time: 2021-03-19 20:08:43 | ClientReqID: 20 | Username: jboeing. | Thread:5268 | 2021-03-21 21:55:26.901 Added historical Intraday data request for EURUSD to the queue. | 2021-03-21 21:55:26.987 Intraday data recording state for symbol EURUSD is set to download 'Pending'. | 2021-03-21 21:55:26.987 Triggering next historical data download in queue. | 2021-03-21 21:55:26.987 HD Request # 42 | Downloading Intraday chart data for EURUSD to the file EURUSD.scid. Service: fxcm | 2021-03-21 21:55:26.987 HD Request # 42 | Performing multistage download. Downloading Minute data first. | 2021-03-21 21:55:26.996 HD Request # 42 | Download start date-time: 2020-09-16 21:55:26.000000. File last date-time: 2020-09-10 17:04:37.345000 | 2021-03-21 21:55:26.996 HD Request # 42 | Disabling Intraday chart updating for symbol. | 2021-03-21 21:55:26.996 HD Request # 42 | Using server: ds4.sierracharts.com port 10150 | 2021-03-21 21:55:26.996 Socket (7) | Creating socket. | 2021-03-21 21:55:26.996 Socket (7) | New receive buffer size: 5242880 | 2021-03-21 21:55:26.996 Socket (7) | Connecting to IP: 192.81.56.146. | 2021-03-21 21:55:26.996 HD Server | Server thread ending. Closing socket. | Username: jboeing. | Thread:5596 | 2021-03-21 21:55:27.032 HD Server Manager | Current server count=2 | 2021-03-21 21:55:27.032 HD Server | Server thread ending. Closing socket. | Username: jboeing. | Thread:3908 | 2021-03-21 21:55:27.032 HD Server Manager | Current server count=1 | 2021-03-21 21:55:27.032 HD Request # 42 | Setting DTC encoding to Binary VLS | 2021-03-21 21:55:27.149 HD Request # 42 | Sending historical data logon request message. | 2021-03-21 21:55:27.149 HD Request # 42 | Requesting Intraday data. Start date-time: 2020-09-16 21:55:26. Record interval: 60. Symbol: EURUSD | 2021-03-21 21:55:27.223 HD Request # 42 | Decompressing data. | 2021-03-21 21:55:27.297 HD Request # 42 | Receiving Intraday data for EURUSD starting at 2020-09-16 21:55:26.001000 | 2021-03-21 21:55:28.103 HD Request # 42 | Timestamp of first Intraday data file record written: 2020-09-16 21:55:26.001000 | 2021-03-21 21:55:29.157 Opened cached Intraday file: C:\SierraChart\Data\F.US.FVAM21.scid. Thread ID: 3396 | 2021-03-21 21:55:34.348 Socket (7) | CloseSocket call. | 2021-03-21 21:55:36.390 Socket (7) | Shutdown started. Waiting for graceful close. | 2021-03-21 21:55:36.390 Historical data download thread signaled to stop. | 2021-03-21 21:55:36.393 HD Request # 42 | Received 185746 records from 2020-09-16 21:55:26.001000 to 2021-03-21 21:55:01.347000 (186.0 days) and wrote 185746 records for EURUSD | 2021-03-21 21:55:36.395 HD Request # 42 | Completion time: 10s | 2021-03-21 21:55:36.395 HD Request # 42 | Intraday data download complete for EURUSD. Unique request ID: 38 | 2021-03-21 21:55:36.395 Added historical Intraday data request for EURUSD to the queue. | 2021-03-21 21:55:36.395 Triggering next historical data download in queue. | 2021-03-21 21:55:36.395 HD Request # 43 | Downloading Intraday chart data for EURUSD to the file EURUSD.scid. Service: fxcm | 2021-03-21 21:55:36.395 HD Request # 43 | Rounding start date-time down to the minute: 2020-09-16 21:55:00.000 | 2021-03-21 21:55:36.396 HD Request # 43 | Download start date-time: 2020-09-16 21:55:00.000000. File last date-time: 00:00:00.000000 | 2021-03-21 21:55:36.396 HD Request # 43 | Using server: ds12.sierracharts.com port 10149 | 2021-03-21 21:55:36.396 Socket (8) | Creating socket. | 2021-03-21 21:55:36.396 Socket (8) | New receive buffer size: 5242880 | 2021-03-21 21:55:36.396 Socket (8) | Connecting to IP: 204.15.197.14. | 2021-03-21 21:55:36.396 Socket (7) | Socket gracefully closed by remote side. | 2021-03-21 21:55:36.463 Socket (7) | Closed. | 2021-03-21 21:55:36.463 HD Request # 43 | Setting DTC encoding to Binary VLS | 2021-03-21 21:55:36.557 HD Request # 43 | Sending historical data logon request message. | 2021-03-21 21:55:36.557 HD Request # 43 | Requesting Intraday data. Start date-time: 2020-09-16 21:55:00. Record interval: 0. Symbol: EURUSD | 2021-03-21 21:55:36.631 HD Request # 43 | Decompressing data. | 2021-03-21 21:55:36.724 HD Request # 43 | Receiving Intraday data for EURUSD starting at 2020-09-16 21:55:00.660000 | 2021-03-21 21:55:36.967 HD Request # 43 | Rounded first tick record Date-time down to minute: 2020-09-16 21:55:00 | 2021-03-21 21:55:36.967 HD Request # 43 | Truncated Intraday data file at 2020-09-16 21:55:00 while receiving initial tick data during multistage download. | 2021-03-21 21:55:36.974 HD Request # 43 | Date-time after truncate 2020-09-10 17:04:37 | 2021-03-21 21:55:36.974 HD Request # 43 | Timestamp of first Intraday data file record written: 2020-09-16 21:55:00.660000 | 2021-03-21 21:55:37.294 Opened cached Intraday file: C:\SierraChart\Data\F.US.USAM21.scid. Thread ID: 3396 | 2021-03-21 21:55:39.349 Opened cached Intraday file: C:\SierraChart\Data\F.US.PLEJ21.scid. Thread ID: 3396 | 2021-03-21 21:55:59.350 Opened cached Intraday file: C:\SierraChart\Data\F.US.HOEK21.scid. Thread ID: 3396 | 2021-03-21 21:57:04.360 Socket (8) | CloseSocket call. | 2021-03-21 22:00:06.281 Historical data download thread signaled to stop. | 2021-03-21 22:00:06.281 Socket (8) | Shutdown started. Waiting for graceful close. | 2021-03-21 22:00:06.281 HD Request # 43 | Received 34688802 records from 2020-09-16 21:55:00.660000 to 2021-03-21 22:00:03.151000 (186.0 days) and wrote 34688802 records for EURUSD | 2021-03-21 22:00:06.282 HD Request # 43 | Add time&sales data | Remembered last file record date-time: 2021-03-22 02:00:03.151000 | 2021-03-21 22:00:06.282 Added 19 Time and Sales records to Intraday data file for EURUSD after download. | 2021-03-21 22:00:06.282 HD Request # 43 | Completion time: 4m 30s | 2021-03-21 22:00:06.282 HD Request # 43 | Intraday data download complete for EURUSD. Unique request ID: 38 | 2021-03-21 22:00:06.282 Removing historical data download ID 38. | 2021-03-21 22:00:06.282 Real-time Intraday chart data file updates started for EURUSD | 2021-03-21 22:00:06.282 Intraday chart data file opened for EURUSD | 2021-03-21 22:00:06.282 HD Request # 43 | Enabling Intraday chart updating for symbol. | 2021-03-21 22:00:06.282 Triggering next historical data download in queue. | 2021-03-21 22:00:06.282 No download requests in the queue to start downloads for. | 2021-03-21 22:00:06.282 Socket (8) | Socket gracefully closed by remote side. | 2021-03-21 22:00:06.355 Socket (8) | Closed. | 2021-03-21 22:00:06.355 HD Server | HD Request | Socket: 1 | Symbol: EURUSD | ServiceCode: DTCSubInstance | RecordInterval: 0 | Records Served: 22135 | ClientReqID: 20 | Username: jboeing. | Thread:5268 | 2021-03-21 22:00:06.904 HD Server | Thread:5268 (1) | Socket gracefully closed by remote side. | 2021-03-21 22:00:06.920 HD Server | Thread:5268 (1) | CloseSocket call. | 2021-03-21 22:00:06.920 HD Server | Thread:5268 (0) | CloseSocket call. | 2021-03-21 22:00:06.921 HD Server | Thread:5268 (0) | CloseSocket call. | 2021-03-21 22:00:06.921 HD Server | Thread:5268 (1) | Graceful close received or receive error. Shutdown complete. Closing socket now. | 2021-03-21 22:00:06.921 HD Server | Thread:5268 (1) | Closed. | 2021-03-21 22:00:06.921 |
| message_log_main.txt - Attached On 2021-03-22 02:37:32 UTC - Size: 247.37 KB - 308 views message_log_sub.txt - Attached On 2021-03-22 02:37:42 UTC - Size: 178.39 KB - 317 views |
| [2021-03-22 02:59:00] |
| |
|
Check your system for a problem. This is not a Sierra Chart issue. HD Request # 2 | Downloading Intraday chart data for EURUSD to the file EURUSD.scid. Service: DTCSubInstance | 2021-03-21 22:55:30.106
HD Request # 2 | Download start date-time: 2020-09-16 22:55:30.000000. File last date-time: 00:00:00.000000 | 2021-03-21 22:55:30.107 HD Request # 2 | Using server: 127.0.0.1 port 11105 | 2021-03-21 22:55:30.107 Socket (2) | Creating socket. | 2021-03-21 22:55:30.107 Socket (2) | New receive buffer size: 5242880 | 2021-03-21 22:55:30.107 Socket (2) | Connecting to IP: 127.0.0.1. | 2021-03-21 22:55:30.107 HD Request # 2 | Setting DTC encoding to Binary VLS | 2021-03-21 22:55:30.122 HD Request # 2 | Sending historical data logon request message. | 2021-03-21 22:55:30.122 HD Request # 2 | Requesting Intraday data. Start date-time: 2020-09-16 22:55:30. Record interval: 0. Symbol: EURUSD | 2021-03-21 22:55:30.123 HD Request # 2 | Data is being downloaded from a remote source. Download will start when this is done. | 2021-03-21 22:55:30.245 HD Request # 2 | Decompressing data. | 2021-03-21 22:55:55.592 HD Request # 2 | Receiving Intraday data for EURUSD starting at 2020-09-16 22:55:30.047000 | 2021-03-21 22:55:55.620 HD Request # 2 | Timestamp of first Intraday data file record written: 2020-09-16 22:55:30.047000 | 2021-03-21 22:55:55.705 EURUSD 80 Min #1 | Reloading chart. | 2021-03-21 22:56:29.021 Socket (2) | CloseSocket call. | 2021-03-21 22:57:21.622 Historical data download thread signaled to stop. | 2021-03-21 22:57:21.622 Socket (2) | Shutdown started. Waiting for graceful close. | 2021-03-21 22:57:21.622 HD Request # 2 | Received 34683777 records from 2020-09-16 22:55:30.047000 to 2021-03-21 22:57:16.508000 (186.0 days) and wrote 34683777 records for EURUSD | 2021-03-21 22:57:21.623 Socket (2) | Socket gracefully closed by remote side. | 2021-03-21 22:57:21.623 Socket (2) | Closed. | 2021-03-21 22:57:21.623 HD Request # 2 | Add time&sales data | Remembered last file record date-time: 2021-03-22 02:57:16.508000 | 2021-03-21 22:57:21.630 HD Request # 2 | Completion time: 1m 51s | 2021-03-21 22:57:21.630 HD Request # 2 | Intraday data download complete for EURUSD. Unique request ID: 2 | 2021-03-21 22:57:21.630 Removing historical data download ID 2. | 2021-03-21 22:57:21.630 Real-time Intraday chart data file updates started for EURUSD | 2021-03-21 22:57:21.631 6 months of data took about 1.5 minutes in our test. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2021-03-22 02:59:23
|
| [2021-03-22 03:33:22] |
| User816220 - Posts: 80 |
|
I let 2239 finish downloading the data. Previously, I had been interrupting the download before it finished. With 2239, and the data fully downloaded, the sub-instance now opens as expected. Looking at the .scid file timestamps, it looks like there was a behavior change. Before I opened the sub-instance today, the timestamp for EURUSD in the main instance showed the file hadn't been updated since last year. With 2239, the main instance is now storing a full copy of the data, even without having a chart open for it. It looks like I just needed to let it finish doing the download. |
To post a message in this thread, you need to log in with your Sierra Chart account: