Support Board
Date/Time: Wed, 27 Nov 2024 13:07:59 +0000
[Locked] - Linux: Extremely slow data-downloads
View Count: 1273
| [2022-09-02 10:31:39] |
| Usuario - Posts: 19 |
|
Hello there. I've recently migrated from CQG Datafeed to Denali Datafeed. I don't use market depth data in my trading, so Top of Book is enough for me. Note that my charts are based on ticks/trades/volume by bar. Data in Denali is extremely slow to download. I am aware of "Edit -> Translate Symbols to current service". In addition to that, I have tried deleting all the Data on the SSD, to reset. Of course, I've modified "Days to load", reducing it to 1 day for "Intraday Data", in case that was the factor. It still downloads very slowly. Ok, maybe my study/indicators CPU load? Then, I've created a new Chartbook, without indicators, to use it only to download the data. Result: many minutes for only these two MicroNasdaq contract days of September. And when I loaded the last 10 days... well, it takes 20 minutes and it's still there. Time-based charts use to show before tickdata based charts. It's the same configuration and chartbooks I had with CQG and there it took seconds to load everything. (SC ver 2348). Now if I leave it for hours, it finally ends up showing the data. --- Lastly, after several minutes my data is downloaded. Ok, the very first time could be an slow process, but then always good. But it's not. I open a chartbook and loads fine, on seconds, seems to be "Real time" data, but yellow box message "Waiting to Download Historical Data" still there for minutes. Sometimes it disappear after several minutes, sometimes stuck forever. Some additional info: SC ver. 2430. 300 Mb symetrical fiber optic connection. Intraday Storage time unit: (1 tick) Allow support for SC feeds: yes. Running on Linux Manjaro under Wine (ultra fast perfomance always). Overnight trading hours Any idea? Thank you EDIT: Few hours later, download seems to be better. No optimal, but better. I've the same settings, so maybe a server side issue?? In any case, sometimes the yellow box message "Waiting to Download Historical Data" appear stuck for a few minutes.[/i] Date Time Of Last Edit: 2022-09-02 11:53:50
|
| [2022-09-02 16:08:25] |
| Sierra_Chart Engineering - Posts: 17191 |
|
No it is not a server-side issue. This has to do with the amount of data to download, the operating system, and the speed of the connection between your computer and the server. This is the problem!: Running on Linux Manjaro under Wine (ultra fast perfomance always).
We have heard from other users, about this problem when using Wine. Network socket performance is not good at the operating system level for unknown reasons. To improve performance, refer to: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Improving Historical Intraday Data Downloading Performance Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2022-09-02 16:08:59
|
| [2022-09-02 17:26:19] |
| Usuario - Posts: 19 |
|
Thanks. I've been using Linux + SierraChart for 2+ years actually. My charts are the same for several months. In fact, I eventually run some stress tests with heavier workloads and SC moves them perfectly. No single issue, no single bottleneck. Never. And my second day with Denali everything goes wrong... curious. Performance on Linux is great, much better than W10. Even some problems with SC-OpenGL on W10, disappeared on Linux. Actually, few hours after my support board post, everything works fine apparently. Same settings, same charts, same CPU 100% dedicated exclusively to SC, same internet band (also tried with mobile data by tethering, just in case). I did nothing and now it's solved. In fact, Denali works great, is fast and accurate. It was not normal that downloading 1 day of data (without indicators) took 10 minutes. At the same time, some people with problems with Historical data, like this guy: Unable to download historical data on Denali feed solved the problem suddenly, without touching anything. You say is not server-side puntual problem. Ok. PS. Please, test SierraChart with Linux on your own, and you will notice that SC works fast and smoothly. Much better than W10 (about x2 or x3 times faster in almost every field). Extremely stable. People who test SC on Linux never go back to Windows Thank you :) Date Time Of Last Edit: 2022-09-02 17:56:30
|
| [2022-11-01 10:31:42] |
| User687917 - Posts: 75 |
|
Same problem here I come from using SierraChart with AMP (CQG Data + Order Routing) After being forced to switch to pack 10 with Denali data, my charts, which ONLY include Price and volume, (with "Top of Book" data) take a long time to load. More than 5 minutes until everything loads. With CQG Data and pack 3 in 2 minutes or less since I opened Sierra Chart, I had everything ready and updated. I only load 1 chartbook with 4 daily charts (SP500, NQ, Russell and DOW) of price and volume, and another chartbook with 4 charts of 5 minutes and 10 days of loading. And if I try to load a 5 minute "watchlist" chartbook (10 days load), with a "Quoteboard Spreadsheet", it takes a LONG time to load even the above mentioned indices (that data is supposed to be already downloaded..). I also use Manjaro with Wine (until the change from CQG to Denalli, I haven't touched anything different in my configuration). |
| [2022-11-02 13:04:59] |
| Sierra_Chart Engineering - Posts: 17191 |
|
We apologize for the delay. We are preparing a response for this.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2022-11-02 13:20:11] |
| Sierra_Chart Engineering - Posts: 17191 |
|
Refer to this particular section: High CPU Usage | Inactive User Interface | Poor Performance | Long Time to Load Chart Data | Charts Reloading Often: 30.12 - Intraday Data Storage Time Unit. Historical Data Record Time Frame. And this particular section: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Improving Historical Intraday Data Downloading Performance We have updated these sections with this information: In the case of CQG historical data provided by CQG, since Sierra Chart has only supported 1 minute data, or limited amount of tick by tick data from CQG, this is why when using CQG data, charts will load faster. Since there is less, a lot less, tick by tick data. You can solve this problem by using an Intraday Data Storage Time Unit of 1 Second or 2 Seconds or higher.
We have had numerous reports, that when using Sierra Chart on WINE and Linux, that network I/O performance, in particular with receiving data is very slow/poor and receiving historical data when using WINE, in particular tick by tick data, is very very slow. We do not know why this is the case. Perhaps it has something to do with the large receive buffer sizes that Sierra Chart uses. However, WINE should not have this issue. Part of the problem you may be having may be related to WINE.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2022-11-02 13:20:56
|
| [2022-11-02 13:22:37] |
| Sierra_Chart Engineering - Posts: 17191 |
|
Thank you this is very good to know!: PS. Please, test SierraChart with Linux on your own, and you will notice that SC works fast and smoothly. Much better than W10 (about x2 or x3 times faster in almost every field). Extremely stable.
People who test SC on Linux never go back to Windows But there may still be a performance problem with the downloading of historical data on WINE related to buffers. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-07-16 12:14:19] |
| VLiviu - Posts: 223 |
|
Hello Reopening the subject... Running Arch linux + wine, SC doesnt download anything, my charts are opened for 2 hours, no luck... attached a shoot Anything we can do? Appreciate it. PS 1 GB Lan here, everything works great, except SC |
 SC_wine_archlinux.png / V - Attached On 2023-07-16 12:13:22 UTC - Size: 940.75 KB - 77 views |
| [2023-07-16 13:30:28] |
| Sierra_Chart Engineering - Posts: 17191 |
|
What version of Wine are you running? You need to be running 8.12 or higher when using Sierra Chart version 2524 or higher.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2023-07-16 13:30:34
|
| [2023-07-16 13:37:23] |
| VLiviu - Posts: 223 |
|
[liviu@bobdenaut ~]$ wine --version wine-8.12 [liviu@bobdenaut ~]$ SC ver: 2524 |
| [2023-07-16 14:35:38] |
| VLiviu - Posts: 223 |
|
tried everything, charts are not coming ! (left my computer for 3 hours to load the charts) ... reinstalled bottles, wine and even crossover....no idea tried also with a bigger MTU, nothing Date Time Of Last Edit: 2023-07-16 14:36:04
|
| [2023-07-16 15:52:21] |
| Sierra_Chart Engineering - Posts: 17191 |
|
Ok, we are not sure how to help with this. We have noticed very very poor network I/O performance using Wine. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2023-07-16 18:20:36
|
| [2023-07-16 15:55:52] |
| VLiviu - Posts: 223 |
|
Indeed, back to windows11 now :(
|
| [2023-07-20 11:07:28] |
| VLiviu - Posts: 223 |
|
Sorry, I need to continue this thread. Now in windows via Teton CME, 4H chart without any indicator and waiting for 30 min already (90 days length) Are there network issues/congestions ? |
| [2023-07-20 16:50:24] |
| John - SC Support - Posts: 36309 |
|
There are no particular issues at this point. If this is the first time you are downloading the data, it can take awhile, although we will admit that 30 minutes for 90 days does seem excessive, but it also depends on your Internet speed and hard drive, etc. So it is possible. Let us know if you are still having an issue at this time. For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-07-20 17:10:12] |
| VLiviu - Posts: 223 |
|
not the first time :) using this chart for 2 months now, so today took me 30+ min to load the 4h chart then I went to 30 min now back to 4h and took me 10 min |
| [2023-07-20 17:11:04] |
| VLiviu - Posts: 223 |
|
1 Gbit ethernet, SSD hd, cpu i9, 16gb ram
|
| [2023-07-20 17:23:51] |
| Sierra_Chart Engineering - Posts: 17191 |
|
Are you using Windows or Wine?
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-07-20 17:25:07] |
| VLiviu - Posts: 223 |
|
back to windows11, wine is not working for me
|
| [2023-07-20 17:44:08] |
| Sierra_Chart Engineering - Posts: 17191 |
|
We will do some testing.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-07-20 17:45:45] |
| VLiviu - Posts: 223 |
|
best team. thanks! |
| [2023-07-20 19:27:21] |
| Sierra_Chart Engineering - Posts: 17191 |
|
We did some performance testing with downloading historical Intraday data. This is over a Wi-Fi connection. Approximately with version 2524 and higher, there is a change with how receive buffers are done with network I/O. This does not have any negative performance impact: With version 2524: HD Request # 44 | Received 66481991 Intraday data records from 2022-01-04 11:22:24.845000 to 2023-06-16 09:29:59.999000 (527.9 days. Delay: 34.2 days) and wrote 66481991 records for ESM23-CME | 2023-07-20 15:15:05.687
HD Request # 44 | Add time&sales data | Remembered last file record date-time: 2023-06-16 13:29:59.999000 | 2023-07-20 15:15:05.687 HD Request # 44 | Completion time: 3m 43s. | 2023-07-20 15:15:05.687 Prior to version 2524: HD Request # 2 | Received 66481991 Intraday data records from 2022-01-04 11:22:24.845000 to 2023-06-16 09:29:59.999000 (527.9 days. Delay: 34.2 days) and wrote 66481991 records for ESM23-CME | 2023-07-20 15:23:32.493 HD Request # 2 | Add time&sales data | Remembered last file record date-time: 2023-06-16 13:29:59.999000 | 2023-07-20 15:23:32.494 HD Request # 2 | Completion time: 3m 42s. | 2023-07-20 15:23:32.494 You can see the completion time is identical. Therefore in your case to improve performance, refer to: Historical Intraday Data (Missing Data / Download Errors / Viewing More Data): Improving Historical Intraday Data Downloading Performance Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2023-07-20 19:33:15] |
| VLiviu - Posts: 223 |
|
Will read the link and I will try, appreciate it! (until yesterday I've never had any issue so far) |
| [2023-07-20 23:13:16] |
| VLiviu - Posts: 223 |
|
See attached. Reinstalled Mint Linux and I got some speed :), it's a bit better Running it with bottles |
| [2023-07-21 08:25:45] |
| VLiviu - Posts: 223 |
|
Reinstalled wine64-development and now works :D download as normal |
To post a message in this thread, you need to log in with your Sierra Chart account: