data lag of 3 minutes - never catches up

[stafe]

how could this happen ?
when i log on to my Ninja Brokerage account ( i pay for two data feeds ) one of my machines data is 3 minutes behind the market and never catches up -- i can't video the screen for you becase the sharpDX screws with my video capture program....


i uninstalled NT8
wiped all historical data


and when i reinstall then log back into my account the data lag is un-usable - as if it were on a 15 minute delay or something....


the delay right now on "machine #1" is 6 minutes and getting longer


WHAT IS GOING ON ????????????????

[NinjaTrader_ChelseaB]

Hello stafe,

It could be that the CPU core this chart is running on is maxed out and the chart is struggling to keep up.

Please close all open workspaces (a new blank workspace will automatically open once all the other workspaces are closed).

Open a new chart to the same instrument and ensure no template is applied. Do not add any indicators to the chart.

Are you able to reproduce the behavior on a chart with no indicators in new blank workspace with all other workspaces closed?

[stafe]

amazing - after 1 uninstall and reinstall and 3 or 4 restarts
and after using Autoruns to make sure there are no suspicious actors on my machine
and more NT8 restarts
still horribly lagging data
i post an issue ticket and restart after your reply and everything clears up...
it's astonishing to me the number of problems i've had trying to run NT8
it's working fine now with the same workspace it wasn't working fine with before


this has happened before on many occasions
the platform has been running all night on live data and was fine when i went to bed
i come in and sit down in the morning
and there's a crazy data lag
and so i shut down and restart and it runs fine
THIS TIME WAS INFURIATINGLY DIFFERENT
i've wasted 3hours trying to get this thing back to normal

[NinjaTrader_ChelseaB]

Hello stafe,

Its very likely that the behavior you are experiencing is being caused by the 3rd party scripts that are loading in the workspace are causing heavy resource use.

When the CPU is overloaded the chart will begin to lag and this is the behavior you have described.

Below is a link to a forum post with tips about reducing the workspace to reduce demand on resources.

https://ninjatrader.com/support/forum/showthread.php?p=532961#post532961

Please let me know if you are able to reproduce the behavior on a chart with no indicators in a blank workspace with all other workspaces closed as this would indicate an issue with the NinjaTrader Platform itself.

[stafe]

wow, you didn't even read my post....


it's working fine again now
running all the same stuff it was running last night when it was working fine also

[NinjaTrader_ChelseaB]

Hello stafe,

I did read your post and I am understanding it is working now with your original workspace.

I am saying that the issue is still likely an overloaded CPU (when the issue is occurring).

If the issue returns, please take the directed steps to test in a blank workspace and let me know if you can reproduce.

[stafe]

narrowed it down this morning to a corrupted workspace - and a specific chart that is corrupted somehow...


i must have been sleep coding again... stumbling into the studio at 3am and modifying the workspace xml file and messed up... yeah that's it...



would you like the workspace files ?


i wouldn't be posting unless this is a HIGHLY IRREGULAR issue....
it's not an overloaded cpu


4minutes till the fed.... gotta go

[NinjaTrader_ChelseaB]

Hello stafe,

To confirm, you are able to reproduce the behavior using a new blank workspace on a new chart with no indicators applied with all other workspaces closed, is this correct?

Is your PC clock in sync with internet time?

https://ninjatrader.com/support/forum/showthread.php?p=516140#post516140

[stafe]

to confirm:
narrowed it down this morning to a corrupted workspace - and a specific chart that is corrupted somehow...


here's the workspaces
the good one is: 2018 08 01 no lag on this workspace - saved with v15
the bad one that causes lag is: 2018 08 01 - nope -- starts lagging again -- too slow


and a stuffed folder with all the screen shots of the discovery process for your entertainment....


well, can't upload the images for some reason... even broke them into two stuffed files - still couldn't - it would have been entertaining 4sure

[stafe]

here's the upload error msg

[stafe]

probably the most interesting picture was the one of taskmanager performance showing all the memory being chewed up and not released when the corrupted workspace was loaded.... with nothing but NT8 running....

[stafe]

here's one shot with a corrupted workspace loaded


the second shot is with a workspace loaded that isn't causing and irregular behavior


note the CPU avg usage on PerfMon

[NinjaTrader_ChelseaB]

Hello stafe,

It looks like the individual core (in a multi-core machine) that thread is running on is maxed out. You have a lot of calculations going on.

A single thread only runs on a single core.

Let me know if you are able to reproduce the behavior with a chart that has no indicators in new workspace with all other workspaces closed.

When you say the workspace is corrupted do you mean it won't open?

[stafe]

sorry i haven't been able to attend to your last post... too many other distractions


next time i get the lag issue set in i'll be sure to get a shot of the individual cores using Task Manager Performance - but unfortunately for someone, there's no dramatic difference between cores with the lag issue and there is certainly not a single core that is "maxed out"



- as i've shown the difference between a normal happy workspace CPU usage and a torubled lagging workspace CPU usage is about double... so normal is 4-6 percent and double is 10+ average


i'll post a shot of the seperate core CPU usage as soon as lag sets back in - i've already taken some screenshot this morning that show all kinds of interesting things i've got to share...

[NinjaTrader_ChelseaB]

Hello stafe,

Just a reminder, I have inquired if you are able to reproduce the behavior with all workspaces closed with a new chart that has no indicators applied.

I look forward to further assisting.