Support Board
Date/Time: Thu, 26 Dec 2024 15:21:13 +0000
Post From: Intraday and historical data downloading robustness
| [2015-12-04 16:45:09] |
| i960 - Posts: 360 |
|
Countless times I've seen situations where an interrupted download results in partial data being inserted into intraday and historical data files. This has happened for multiple reasons for me (resuming a laptop and having the battery die mid-download on a bunch of charts as an example). The fix is not fun - it requires nuking every intraday and daily file since the downloads started as they're all effectively missing data and it won't be noticed (at least in the current session). Is Sierra blindly inserting data right into the data file as it's downloading data for it? Surely that's not going to work so well if these files aren't checksummed in any way and just blindly trusted by SC to have complete data when they might be missing sections of it (particularly intraday data files). IMO the issue here is in writing interim data directly to files without any strong error checking available for them. Based on what I see here: http://www.sierrachart.com/index.php?page=doc/doc_IntradayDataFileFormat.html I see no provision for actual error detection or defense against multiple intraday records being written out with any kind of gap detection (gap as in data wasn't downloaded, but new data is still appended). Are there any plans to increase the robustness of how this data is updated from the server side? |