Support Board
Date/Time: Fri, 31 Jan 2025 19:05:08 +0000
Slow Compression
View Count: 820
| [2019-05-23 01:29:17] |
| skelcap - Posts: 139 |
|
Hi, I am trying to compress all my old intraday files to 1 sec bars using Data File Management and it is proving unworkably slow. The first file to be compressed is $DOWI.scid which looks like it is already in 1 sec bars, it is 700MB and the .tempcompressed file is being produced at a rate of about 5KB/min, so yeah that would take 97 days! (Actually the first 200KB creates quickly and then it crawls) In the past I have done such compressions in a reasonable timeframe. I tried moving $DOWI.scid out of the the Data folder so the compression would start with the next file $INX.scid, but it was just as slow so doesn't look it is a file problem. I just upgraded to v1919 and am running 64-bit. I checked the Windows Task Manager and the SierraChart process is not using much memory and overall my computer has spare capacity.
|
| [2019-05-23 03:48:59] |
| |
|
Update to the latest prerelease following the instructions here: Software Download: Fast Update This issue has been resolved. But the compression rate is going to be a little slower in order to not overload the file I/O on the system too much. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2019-05-23 03:49:25
|
| [2019-05-23 04:36:31] |
| skelcap - Posts: 139 |
|
Ok thanks that is faster, but yes still quite a lot slower than it used to be. What was the issue? I didn't seem to have a problem with I/O overload before, were people complaining?
|
| [2019-05-23 08:47:29] |
| nosast2 - Posts: 73 |
|
Same issue... Very very slow with v1921. Is this now running as a background task automatically? I used to compress the files every weekend manually...
Date Time Of Last Edit: 2019-05-23 08:49:30
|
| [2019-05-24 21:47:46] |
| |
|
We will make the delay between processing a batch of records adjustable so you can speed this back up again. We do notice a problem on our servers which handle large amounts of data. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2019-05-24 21:47:57
|
To post a message in this thread, you need to log in with your Sierra Chart account: