Support Board
Date/Time: Thu, 28 Nov 2024 18:52:40 +0000
Main Instance Data Folder Duplicate .SCIDs
View Count: 548
| [2023-03-25 17:20:05] |
| user_xyz - Posts: 416 |
|
I just noticed duplicate downloads of .SCID files. Main instance of SC is used only for futures. A 4th instance has ~30 stocks. The .SCID files are being download in both locations. I don't think this is by design I have a 2nd instance with symbols not in main instance. Where can I troubleshoot to not duplicate the downloads? Are message logs completely independent across instances? Meaning I should NOT see requests for stocks, errors etc in Main Instance FROM instance #4? <MAIN FUTURES ONLY> C:\SierraChart\Data ES-202303-GLOBEX.scid NQ-202303-GLOBEX.scid aapl-nqtv.scid tsla-nqtv.scid xom-nqtv.scid etc. etc. <STOCKS> C:\SierraChart\SierraChartInstance_4\Data aapl-nqtv.scid tsla-nqtv.scid xom-nqtv.scid etc. etc. Date Time Of Last Edit: 2023-03-25 17:46:58
|
| [2023-03-27 14:45:19] |
| John - SC Support - Posts: 36350 |
|
All instances are independent. So as long as you are not requesting data for a symbol within an instance, then you should not see a download for it. Conversely, if you are seeing a download for a symbol in an instance, then something is asking for that data. Go through the items at the following link which will give you the places to look for symbols being requested, and remove anything that you do not need from each instance: Chart Data and Chart Data Files: Cleaning Up Old and Unused Symbols for Efficiency For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-03-27 16:36:12] |
| user_xyz - Posts: 416 |
|
I went through the items in that list no luck. As a test in Instance #4 I added a symbol to the quoteboard that I've never looked at IAA-NQTV. IAA-NQTV.dly started to download in the main instance and instance #4 data folders. Cleared the logs and tried another KEY-NQTV and same result. <Log Output from MAIN Instance Not #4 Where the request was made> DTC client #38. Sierra Chart. 127.0.0.1 | Received subscribe to market depth for symbol KEY-NQTV | 2023-03-27 08:29:34.903 Requesting market depth updates for: KEY-NQTV if supported. | 2023-03-27 08:29:34.903 CQG WebAPI | Starting market orders updates for: KEY-NQTV. MinimumMarketByOrderQuantity: 0. Service code: nasdaq_exchange.data | 2023-03-27 08:29:34.903 DTC client #38. Sierra Chart. 127.0.0.1 | Received subscribe to market orders for symbol KEY-NQTV | 2023-03-27 08:29:34.903 Denali Data Feed | Clearing market depth for KEY-NQTV | 2023-03-27 08:29:35.034 Unsubscribed from market depth data for IAA-NQTV | 2023-03-27 08:29:35.588 CQG WebAPI | Stopping market orders updates for: IAA-NQTV. Service code: nasdaq_exchange.data | 2023-03-27 08:29:35.588 HD Server Manager | Incoming connection from IP: 127.0.0.1 | 2023-03-27 08:29:57.488 HD Server Manager | Started new historical data server. Count=1 | 2023-03-27 08:29:57.488 HD Server | Thread:19180 (2) | Creating socket. | 2023-03-27 08:29:57.503 HD Server | Thread:19180 (2) | New receive buffer size: 262144 | 2023-03-27 08:29:57.503 HD Server | Thread:19180 (2) | Allocated send buffers: 32 of 4096 bytes. | 2023-03-27 08:29:57.503 HD Server | Setting DTC encoding to Binary VLS | Thread:19180 | 2023-03-27 08:29:57.503 HD Server | Received login. Requesting authorization. | Username: xxx | Thread:19180 | 2023-03-27 08:29:57.504 HD Server | Login has been authorized. | Username: xxx | Thread:19180 | 2023-03-27 08:29:57.504 HD Server | HD Request #627 | Socket: 2 | Symbol: KEY-NQTV | ServiceCode: DTCSubInstance | RecordInterval: 86400 | MaximumDaysRequested: 0 | Start date-time: 1973-03-27 04:29:57 | ClientReqID: xxx | Username: xxx | Thread:19180 | 2023-03-27 08:29:57.504 Added historical Daily data request for KEY-NQTV to the queue. | 2023-03-27 08:29:57.524 Triggering next historical data download in queue. | 2023-03-27 08:29:57.524 HD Request # 792 | Downloading Historical Daily chart data for KEY-NQTV. Starting date: 1973-03-27. Service: nasdaq_exchange.data | 2023-03-27 08:29:57.524 HD Request # 792 | Requesting historical Daily data for KEY starting at 1973-03-26. SC External HD service. | 2023-03-27 08:29:58.554 HD Request # 792 | Receiving historical Daily data for KEY-NQTV starting at 1987-10-01. | 2023-03-27 08:29:58.933 HD Request # 792 | Writing historical Daily data to the file KEY-NQTV.dly. | 2023-03-27 08:29:58.933 HD Request # 792 | Bytes received: 420945 | 2023-03-27 08:29:59.167 HD Request # 792 | Received 8941 Daily data records from 1987-10-01 00:00:00 to 2023-03-24 00:00:00 (35.5years) and wrote 8941 records for KEY-NQTV | 2023-03-27 08:29:59.167 HD Request # 792 | Completion time: 2s. | 2023-03-27 08:29:59.167 HD Request # 792 | Daily data download complete for KEY-NQTV. Unique request ID: 793 | 2023-03-27 08:29:59.167 Removing historical data download ID 793. | 2023-03-27 08:29:59.167 Triggering next historical data download in queue. | 2023-03-27 08:29:59.167 No download requests in the queue to start downloads for. | 2023-03-27 08:29:59.167 HD Server | HD Request | Socket: 2 | Symbol: KEY-NQTV | ServiceCode: DTCSubInstance | RecordInterval: 86400 | Records Served: 8941 | ClientReqID: xxx | Username: xxx | Thread:19180 | 2023-03-27 08:29:59.554 HD Server | Thread:19180 (2) | Socket gracefully closed by remote side. | 2023-03-27 08:29:59.694 HD Server | Thread:19180 (2) | CloseSocket call. | 2023-03-27 08:29:59.694 HD Server | Thread:19180 (0) | CloseSocket call. | 2023-03-27 08:29:59.695 HD Server | Thread:19180 (2) | Graceful close received or receive error. Shutdown complete. Closing socket now. | 2023-03-27 08:29:59.695 HD Server | Thread:19180 (2) | Closed. | 2023-03-27 08:29:59.695 HD Server | Thread:19180 (0) | CloseSocket call. | 2023-03-27 08:29:59.695 HD Server | Server thread ending. Closing socket. | Username: xxx | Thread:19180 | 2023-03-27 08:29:59.843 HD Server Manager | Current server count=0 | 2023-03-27 08:29:59.843 Date Time Of Last Edit: 2023-03-27 16:38:50
|
| [2023-03-27 17:16:35] |
| John - SC Support - Posts: 36350 |
|
The Main Instance is going to show the downloads for all Sub-Instances. The data feeds through the main instance to the sub-instances (again, just those started using File >> New Instance). So seeing the symbols in the main instance is normal, if there is any sub-instance that uses that symbol.
For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-03-31 09:44:33] |
| user_xyz - Posts: 416 |
|
John good morning. I've been testing this out and included the log message above to see if this would provide any clues for you all. Original message still stands. I've gone through all the settings in my main instance per your link and ALL the symbols in Instance #4 are downloading large .SCID files in SC\Data & SC\SC4\Data. Date Time Of Last Edit: 2023-03-31 09:45:48
|
| [2023-03-31 17:27:29] |
| John - SC Support - Posts: 36350 |
|
We are still not sure exactly the scenario you are describing. Again, the main thing to keep in mind is that when you are using Sub-Instances (started using File >> New Instance) any data that is requested in a Sub-Instance will process through the Main Instance, so the Main Instance will have all the files for any data that is requested from any sub-instance. The Sub-Instances will also have these data files. If you are seeing data in a sub-instance for which there is not a request, then that would be confusing. If this is the case, please get us the Message Log from the sub-instance that shows this occurring. We will need to see the entire log. For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-04-01 18:31:59] |
| user_xyz - Posts: 416 |
|
Answering your question I'm seeing files in the Main Instance that are not requested. To clarify if a Sub-Instances has 30 stock charts downloading 8GB of .SCID files the Main Instance will also download same 30 symbols 8GB of .SCID files in duplicate even though is does not have those charts/symbols? That's a lot of data being downloaded in duplicate when the main instance isn't even referencing the files. Is there anyway to change this behavior? Expected results *Main Instance Data\1 ES Chart .scid 486MB *Sub-Instance #2 Data\30 stock chart .scid files 8GB *Sub-Instance #3 Data\30 futures charts .scid files 8GB *Sub-Instance #4 Data\Market Internals UVOL etc .scid files 10GB Actual results *Main Instance Data\1 ES Chart .scid 26.5GB (duplicate .scid from every instance below) *Sub-Instance #2 Data\30 stock chart .scid files 8GB *Sub-Instance #3 Data\30 futures charts .scid files 8GB *Sub-Instance #4 Data\Market Internals UVOL etc .scid files 10GB Date Time Of Last Edit: 2023-04-01 19:36:19
|
| [2023-04-02 08:46:59] |
| Sierra_Chart Engineering - Posts: 17206 |
|
We cannot reproduce this. We confirmed that the sub instances do download data directly from the Sierra Chart servers and not the main instance. Delete the extra files in the main instance. Go to a sub instance started with File >> New Instance and follow these instructions for an Intraday chart: Follow the instructions here to clear the Message Log: Message Log: Clearing the Message Log Fully re-download the data in the chart by going to the chart and selecting "Edit >>Delete All Data and Download". Or, in the case of a Continuous Futures Contract chart, follow these instructions: Continuous Futures Contract Charts: Re-Downloading Continuous Futures Contract Data After about a minute provide a copy of the Message Log following these instructions: Support Board Posting Information: How to Post Your Message Log (Required In Some Cases) We will then determine what the problem is. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-04-02 18:54:50] |
| user_xyz - Posts: 416 |
|
Steps I performed: 1. Removed Global -> General -> Instances to run on startup 2,3,4 (set to blank). 2. Shut down SC Main and restarted. 3. Removed all extra files in main instance\data 4. Restarted main instance \data (no new files appeared all as expected) 5. File >> New Instances 2,3 & 4. 6. Main instance\data immediately starts downloading .dly and .scid files from symbols/charts located in in 2,3,4 7. Sub Instance #4 --> Clear Log. Selected chart aapl-nqtv --> Edit>>Delete All Data and Download 8. Sent Log for Analysis. NOTE: In Main Instance. I also cleared the log first first and watched as I performed steps in Sub Instance #4 and nothing appeared. However all the .scid & .dly files had already populated from all sub instances upon startup that I had removed in Step 3 above. Date Time Of Last Edit: 2023-04-02 18:56:15
|
| [2023-04-03 07:36:55] |
| Sierra_Chart Engineering - Posts: 17206 |
|
We will check on this.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-04-03 09:20:40] |
| Sierra_Chart Engineering - Posts: 17206 |
|
We think we may have this issue resolved. It is not easily debugged because this is very timing sensitive and it is another instance of Sierra Chart which we are not able to immediately debug and by the time we can debug it, it is too late. We will have a new release out before morning. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2023-04-03 09:21:07
|
| [2023-04-04 02:08:45] |
| user_xyz - Posts: 416 |
|
I didn't see an update in this thread but noticed a pre-release so I tried it. Downloaded 2489 and followed exact same steps in post #9. It was 95% successful. However, 3 symbols from Instance #3 that all happen to be on a single chart leaked into Main Instance\Data & Sub Instance3\Data These symbols are 100% not in the Main Instance. Odd... Date Time Of Last Edit: 2023-04-04 02:21:57
|
| [2023-04-08 18:52:36] |
| user_xyz - Posts: 416 |
|
I'm doing some research in Instance #3 and pulling up unique symbols, still seeing a flood of duplicate .DLY files in Main Instance. Have you all had a chance to check on this?
|
To post a message in this thread, you need to log in with your Sierra Chart account: