I tried to import 10 years of historical tick data for EUR/JPY . It was too much for Ninja , eventually the system entered thrashing ( for non-tech , a situation when pieces of memory are copied from RAM to disk and vice versa , the system cannot do anything useful and eventually freezes).
I have 8GB of physical RAM , with committed memory of16GB .
During importing , NinjaTrader took > 12GB of committed memory , working set was between 5-6GB.
I killed NinjaTrader process , restarted my computer and now I am importing this 10 years data piece by piece, which is feasible.
I guess , Ninja is trying to import all my data at once.
I don't complain , I understand I put Ninja under very heavy load.
However it would be good to publish recommendations regarding amount of data to be imported at once.
It would be even better to change mode of importing - once Ninja importing mechanism sees there is too much data to import at once - importing will be done piece by piece internally. Please transfer this suggestion to developers.
Thanks.
Comment