Login Page - Create Account

Support Board


Date/Time: Sat, 23 Nov 2024 23:37:39 +0000



data file size

View Count: 1095

[2017-10-05 14:53:12]
User98657 - Posts: 327
i'm starting up a new machine and transferring SC to the new PC. During the process i noticed my Data file/folder in SC was pretty large - 99.5 GB.

Since i'm running Sierra on my C drive (and i'd like to leave it there), it's probably time for me to start looking at managing the size of that data file.

I'm looking for suggestions as to how to best manage the size of that file, or could you please point me to the articles I need to review to make that decision.
[2017-10-05 18:25:46]
Sierra Chart Engineering - Posts: 104368
Use the Intraday Data File Management feature:
http://www.sierrachart.com/index.php?page=doc/DataSourceSettings.php#IntradayDataFileManagement

First update to the current version of Sierra Chart following the instructions here:
Software Download: Fast Update
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2024-07-22 09:20:45]
Fabio - Posts: 115
I've got a question related to the Intraday Data File Management function:
https://www.sierrachart.com/index.php?page=doc/IntradayDataFileManagement.php#IntradayDataStorageTimeUnit

At the very top of this settings, there is a function called "Delay Between Processing Record Batch in MS" which can be manually changed. However, I found no explanation of what that means. Can you please let me know what that number represents?

Another important thing I'd like to know is the following;

I use 1-Tick as Intraday Data Storage Unit for maximum accuracy. However, I just need maximum accuracy at the hard right edge, so to speak, where I use a volume based chart.

My analyses are all based on time-based charts instead (30 min or higher).

If I do use the Intraday Data File Management with the "Compress Records Older Than" option Set to 30 Days, will the remaining days be 1-tick accurate?

Sorry but English is not my first language and the explanation I found seems a bit tricky to be understood.

Thanks for your help.
Date Time Of Last Edit: 2024-07-22 09:40:49
[2024-07-22 15:13:29]
John - SC Support - Posts: 36238
The "Delay Between Processing Record Batch in MS" is a delay that you can put in between processing batches of the file conversion. We do not know why this is there, but there was some reason for it at some point in time is all we can say.

Only the data that is older than what you specify is compressed and then kept at a larger size. The current data is still kept at the "Intraday Data Storage Time Unit" as set in the "Data/Trade Service Settings".

In your example, the data older than 30 days is compressed and stored in the new format (say 4 seconds) and the data within the past 30 days is stored as 1-tick data.
For the most reliable, advanced, and zero cost futures order routing, use the Teton service:
Sierra Chart Teton Futures Order Routing
[2024-07-22 16:06:12]
Fabio - Posts: 115
Hey John, thanks for the explanation.

So knowing that my analyses is done on charts that are equal (or greater) than 30min and do not require tick by tick data (other than execution at the hard right edge), can I safely use 4 seconds (or maybe even higher), for storing data older than 30 days without compromising the quality of my analyses?

Thanks again,
F.
[2024-07-22 17:56:21]
John - SC Support - Posts: 36238
Yes. What time you choose for data storage is up to you. You just want to ensure that the data is going to be in an increment that evenly divides into the time scales you use.

For instance, do not compress your data into 7 second increments if you use 1 minute bars since 7 seconds does not evenly divide into 1 minute.
For the most reliable, advanced, and zero cost futures order routing, use the Teton service:
Sierra Chart Teton Futures Order Routing

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account