I noticed that NT can be quite a memory hog in some situations.
In particular, when you load a lot of historical data, NT seems to allocate a lot of memory.
(And when I say a lot, I mean it can blow up until it crashes)
If I had to guess, I would say you try to download all the data to memory and then dump it to disk afterwards (as is done in other places as well, e.g. when exporting data).
Now, I don't know if this is done by design or mistake, but clearly, fillling a limited-size buffer and dumping it to disk every once in a while when it fills would be a better strategy (especially considering the sequential nature of the data.
redwoood
Comment