Support Board
Date/Time: Fri, 07 Mar 2025 01:22:46 +0000
[Locked] - Trade Activity Log taking a very long time to return data
View Count: 709
| [2022-02-22 04:01:40] |
| User888593 - Posts: 9 |
|
I've been having the following issues with backtesting and viewing results in the Trade Activity Log: For the past four weeks, I've been backtesting every day and have had no issues viewing backtesting results. Yesterday, I updated SC from 2348 to 2361. I had an issue with the Trade Activity Log that made it unusable (I made another thread about it), so I reverted back to 2348. Ever since, after every back test, the Trade Activity Log takes at least 10 minutes to return data, no matter what type of backtesting I do, and no matter the size of the time period tested, even if I repeat the same tests that I've done for the past six weeks. This never happened before the update and rollback. Also, choosing Trade>Clear Trade Simulation Orders & Data does not clear the data until another bar-based backtest is finished, then the results are cleared immediately upon completion, or the results take at least 10 minutes to clear. Otherwise, results clear only when starting a new bar-based backtest, and then only after a few minutes. I have restarted my computer several times, and I have cleared all files in the TradeActivityLog folder. Neither action makes any difference to these issues. Date Time Of Last Edit: 2022-02-22 05:26:27
|
| [2022-02-22 10:38:37] |
| |
|
Issues like this are explained here: Trade Activity Log: Trade Activity Not Displaying or Clearing (Improving Trade Activity Query Performance) and I have cleared all files in the TradeActivityLog folder If you really have cleared all of the Trade Activity files, this definitely will resolve the issue. Otherwise, this is just not making any sense.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2022-02-22 10:39:15
|
| [2022-02-22 14:48:09] |
| User888593 - Posts: 9 |
|
I had a feeling you would post that link. I've read everything on that page several times and done whatever it advises. I have cleared those files several times. Is there something more I can do to work with y'all to find a solution? This issue makes it impractical to backtest. Edit: I noticed this morning that the first backtest had no issues. Subsequent backtests have had the described issue. I have sent the Message log. Date Time Of Last Edit: 2022-02-22 15:36:10
|
| [2022-02-22 22:00:26] |
| User888593 - Posts: 9 |
|
I have the TradeActivityLogs folder open, and I'm watching it after a new backtest has started. The files are disappearing one at a time, about one per second, from the oldest date to the youngest date; the Trade Activity Log Statistics page still has not updated (query count 3), and the Trade Service Log is still displaying old data since it returned, "Cleared trade data...". Immediately after the last file in the TradeActivityLogs folder disappeared, The Trade Service Log updated. It now says, "TradeActivity files query time: 873.300234 seconds...," and the TradeActivityLogs folder is now filled with files whose dates correspond to the time period tested. The Trade Activity Log summary page is now blank, and the query count is zero. Entering dates and clicking Apply returns the results as usual. It seems this >800 second delay is stemming from SC taking almost one second per file to delete each trade activity file from the previous backtest, rather than it deleting them all at once. To test this, I emptied the TradeActivityLogs folder and ran the same test again. The results returned immediately after the backtest completed, proving that the issue is as follows: 1. Upon startup, the TradeActivityLog folder is empty. Upon completion of a backtest, the folder is full and results appear within one second. 2. When a subsequent backtest is started, SC begins deleting the prior TradeActivityLogs files one by one, taking between 0.5 and 1 second each. 3. When the final prior backtest log file is deleted and the newest backtest has finished, the TradeActivityLogs folder is immediately filled with files from the new backtest, and the results appear in the Trade Activity Log window. 4. The delay in the appearance of the new results corresponds directly with how many prior backtest files SC has to delete and how long it spends deleting each one. My backtest generated 1,252 files. The Trade Service Log reported that it took 873.300234 seconds to delete all of them, corresponding to 0.69 seconds per file. I also verified that selecting Clear Trade Simulation Orders & Data deletes the files one at a time, taking around one second to delete one file. Date Time Of Last Edit: 2022-02-22 22:26:20
|
| [2022-02-23 02:00:48] |
| |
|
First before starting new back test, make sure the existing data is cleared. You can tell by looking at the query count: https://www.sierrachart.com/images/TradeActivity_QueryCount.png There potentially would be issues, having both operations going on at the same time. How long this takes, is dependent on your system hardware ( CPU and storage system): 2. When a subsequent backtest is started, SC begins deleting the prior TradeActivityLogs files one by one, taking between 0.5 and 1 second each.
This cannot be done: rather than it deleting them all at once.
These files hold data for different symbols.Go into the Backups subfolder in the Sierra Chart installation folder and clear the files from there. There probably are a lot of them. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2022-02-23 02:01:33
|
| [2022-02-23 04:09:38] |
| User888593 - Posts: 9 |
|
First before starting new back test, make sure the existing data is cleared. You can tell by looking at the query count:
For the past month, this always took a second or two after clicking Clear Trade Simulation Orders & Data, no matter what kind of testing I had done, or the timespan. This is no longer the case, and the only thing that has changed in that span of time is rolling back the version. After the rollback, it takes ten to fifteen minutes. https://www.sierrachart.com/images/TradeActivity_QueryCount.png How long this takes, is dependent on your system hardware ( CPU and storage system):
Again, for the past month, before the rollback, this always took the same amount of time: a second or so. This was the timeline:2. When a subsequent backtest is started, SC begins deleting the prior TradeActivityLogs files one by one, taking between 0.5 and 1 second each. > Perform Backtest X (same backtest that has been run every day, multiple times a day, for one month, with very minor differences between tests). > When backtest finishes, results appear in less than one second, as always. > Update from version 2348 to version 2361. > Discover issue with Trade Activity Log "To" date. > Roll back to version 2348. > Perform Backtest X. > Results appear only after at least ten minutes. > Only resolution is manually wiping the TradeActivityLogs folder after each backtest. Go into the Backups subfolder in the Sierra Chart installation folder and clear the files from there. There probably are a lot of them.
There were over one million. Is it normal for SC to keep so many redundant backups?
|
| [2022-02-23 09:54:59] |
| |
|
Absolutely this is going to be an issue on your side with system performance. Nothing has changed with this in the Sierra Chart software: This is no longer the case, and the only thing that has changed in that span of time is rolling back the version. After the rollback, it takes ten to fifteen minutes. Rolling back a version, back to the version you had before, means that everything is the same. That is with 110% certainty. That is overwhelmingly clear this is not a Sierra Chart software issue. But an issue with your system with lower performance. Once again this is 100% certain. And why there is a difference when you rolled back, only you can make that determination. We do not know. We cannot know the behavior of users systems.Use a dedicated solid-state drive: High CPU Usage | Inactive User Interface | Poor Performance | Long Time to Load Chart Data | Charts Reloading Often: 30.29 - Solid State Drives / SSD Backups are not deleted, and depending upon what you do there can be a lot of files. Is it normal for SC to keep so many redundant backups?
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2022-02-23 10:07:08
|
To post a message in this thread, you need to log in with your Sierra Chart account: