Historical Data lost every day at same time

[aquila]

Hi guys

I have a demo account with Mirus which is near it's end and I need to make a decision to trade live.

Every day for the last week including today my NT seems to freeze and will not load historical data that is already loaded. If I restart the app then all historical data is gone. I only get a live Zenfire feed.
My system loses data at exactly 6 am Eastern time and I can only get it again 4 hours later at 10 am Eastern time.

Anything I try and do in the interim just tells me the data server is busy please try again later. Yet I can see the live feed and the chart only shows current data
Hope you can help

[NinjaTrader_Jason]

Hello aquila,

Once you have historical data loaded, it is present in NinjaTrader and should be displayed in a chart.

Can you please go to Control Center-->Tools-->Historical Data Manager-->Edit-tab and check if you have historical data present.

Does it make a difference if you create a brand new chart between 6:00 AM and 10:00 AM EDT?

Do you perhaps experience an error message at 6:00 AM EDT?

[aquila]

Thx Jason

Nothing seems to make a difference. I have checked all the tabs and the historical data is present.
Creating a new workspace and creating a new chart gives the same problem. I even formatted my hard drive and reinstalled Windows7 and NT last night but again this moring the same problem like clockwork. I have checked with my ISP and they have no issues on their side.
The only joy I get is to replace all the database data with data I have backed up.
I can then see the historical data on the chart but as soon as I connect to Mirus I lose the data again and only get a bar of the current activity.

[NinjaTrader_Jason]

Please go to Control Center-->Tools-->Options-->Data-tab and check if 'Get data from server (if available)' is enabled. Make sure 'Save chart data as historical' is disabled.
Try creating a new chart once more.

If the issue remains, can you please send me your log and trace files for today. You can find log and trace files at the following locations.

Start Menu--> My Documents--> NinjaTrader 7--> Log--> log.20110509 for today. (log.yyyymmdd for any other date)

Start Menu--> My Documents--> NinjaTrader 7--> Trace--> trace.20110509 for today. (trace.yyyymmdd for any other date)

Please send it to support[at]ninjatrader[dot]com. Put 'Attn Jason' in the subject header and reference this forum thread.

[aquila]

Hi Jason

I did the following which seems to have solved the problem.
I deleted everything in the db folder, started NT, closed all workspaces except blank default, removed all instruments except one (CL) then used the historical data manger to reload historical data for this one instrument for a 1 month period. All working fine now thanks.

As a matter of interest why should the "save chart data as historical " be disabled ? I have always had it enabled with no problem. One of the error messages I was getting was "server busy please try again later"

[NinjaTrader_Jason]

Good to hear all is working fine again.

If you connect to a data feed that supports historical data, we advise to disable this option since you have access to historical data. This option is intended for customers that use data feeds that do not provide historical data.

The 'server busy' error can occur from time to time. It indicates there were too many requests to load historical data. Please wait a few moments and try again.

[aquila]

Good to hear all is working fine again.

If you connect to a data feed that supports historical data, we advise to disable this option since you have access to historical data. This option is intended for customers that use data feeds that do not provide historical data.

The 'server busy' error can occur from time to time. It indicates there were too many requests to load historical data. Please wait a few moments and try again.

Jason

The problem continues. I have noticed that the following connections to NT are just dead :
199.30.196.177
64.202.118.179
199.8.242.145

My ISP assures me they have no issues and all my other connectivity is fine.
Where are these servers and where is the historical data located. Should I contact Mirus ? Are they perhaps putting demo accounts on a slower connection ?

[NinjaTrader_Jason]

Hello aquila,

Please note that Zen-Fire does not support historical data itself. As a courtesy, we allow Zen-Fire users to load historical data form our historical data server.

The IP address and port of the historical data server are somehow blocked on your end. I can connect to the historical data server without issue nor did we receive reports from all other Zen-Fire users. Please check your computer (anti-virus and firewalls) or internet connection setup (modem, router) if the IP address and port in question are blocked. If you are not sure how to check this, I recommend to contact an IT guy.

[aquila]

Thx Jason. I have an IT degree so I wouldn't contact you unless I had a real issue.
My firewall and AV are disconnected.
If the historical data is only a courtesy then how is one supposed to draw trend lines and plot fib ratios etc from just the current data ?
Should I be looking for another platform when I go live ?
Could you let me know where the servers are located so I can take this up with my ISP again.

[NinjaTrader_Jason]

The reason I informed you that historical data is provided by us, is because you do not have to contact Mirus Futures regarding the issue. If your data feed does not proivde any historical data at all, you can save real-time chart data in NinjaTrader. Subsequently you can draw lines and other drawing objects.

You should be able to load historical data. It works for me and other Zen-Fire users as well. Likely, something on your end blocks access to the historical data server, so it cannot be loaded.

199.30.196.177 - located in Chicago, Illinois
64.202.118.179 - located in Chicago, Illinois
199.8.242.145 - located in Indianapolis, Indiana

[aquila]

Thx Jason I'll follow up on my end.
Incidentally when I disable the "get datas from server" and use saved charts as historical the the P/L bar on chart trader showing the actual order remains at zero but the one on the side above the account name shows the P/L real time. Confusing as it's never happened before.

[NinjaTrader_Jason]

Can you please tell me if this issue occurs consistently.

What NinjaTrader version do you have installed? You can check this at Control center-->Help-->About.

I just tested a bit on my end, however I did not note a discrepancy between the two PnL displays so far when using the data settings as you mention.

[aquila]

Hi
The version is 7.0.1000.4

As I say the historical data from server issue only started about 10 days ago and has persisted. Up until then I had not a single issue. The P/L issue is new as of today and happened the minute I disabled the serverside historical data and used chart data as historical.

Incidentally I have asked several people who use different ISP's to ping the servers I mentioned earlier and they all report timeouts.

[aquila]

Hi Jason

This what I get from a trace route to the historical data servers :
Tracing route to ritpz02514.rithmic.com [199.30.196.177]
over a maximum of 30 hops:

3 24 ms 21 ms 23 ms 196.6.121.50-backbone.cybersmart.co.za [196.6.121.50]
4 23 ms 48 ms 22 ms 196.6.121.114-backbone.cybersmart.co.za [196.6.121.114]
5 229 ms 248 ms 238 ms 217.78.88.17
6 * 236 ms 234 ms 217.78.88.38
7 245 ms * 244 ms if-2-0-6.core4.LDN-London.as6453.net [195.219.195.225]
8 * * 229 ms Vlan53.icore1.LDN-London.as6453.net [80.231.76.73]
9 302 ms 227 ms 225 ms te4-2-10G.ar7.lon3.gblx.net [64.215.195.237]
10 371 ms 320 ms 328 ms BROADBANDONE.TenGigabitEthernet1-4.ar5.CHI2.gblx.net [64.212.109.230]
11 322 ms 327 ms 344 ms 64.127.129.2
12 * * * Request timed out.
13 * * * Request timed out.
14 * * * Request timed out.
15 * * * Request timed out.
16 * *

And

Tracing route to www2.7ticks.com [64.202.118.179]
over a maximum of 30 hops:

3 73 ms 68 ms 71 ms 196.6.121.38-backbone.cybersmart.co.za [196.6.121.38]
4 71 ms 67 ms 67 ms ct4-vlan121.cybersmart.co.za [196.6.121.58]
5 205 ms 209 ms 229 ms 217.78.89.17
6 275 ms 522 ms 379 ms gi9-32.mpd01.lon01.atlas.cogentco.com [149.6.185.233]
7 196 ms * * te3-2.ccr01.lon01.atlas.cogentco.com [130.117.1.73]
8 253 ms 253 ms 251 ms te0-0-0-4.ccr22.bos01.atlas.cogentco.com [130.117.0.46]
9 * * * Request timed out.
10 * 253 ms 255 ms te0-2-0-6.ccr21.jfk07.atlas.cogentco.com [154.54.1.218]
11 247 ms 248 ms 247 ms ntt.jfk07.atlas.cogentco.com [154.54.12.66]
12 252 ms 252 ms 254 ms ae-2.r23.nycmny01.us.bb.gin.ntt.net [129.250.4.148]
13 * * 278 ms ae-3.r20.chcgil09.us.bb.gin.ntt.net [129.250.2.40]
14 275 ms * 281 ms ae-1.r06.chcgil09.us.bb.gin.ntt.net [129.250.4.146]
15 277 ms 276 ms 273 ms xe-6-0-2.ar2.ord1.us.nlayer.net [69.31.111.212]
16 283 ms 281 ms 284 ms as10625.xe-4-0-6.ar2.ord1.us.nlayer.net [69.31.110.178]
17 * * * Request timed out.
18 * * * Request timed out.
19 *

and

Tracing route to 199.8.242.145 over a maximum of 30 hops

3 24 ms 23 ms 22 ms 196.6.121.50-backbone.cybersmart.co.za [196.6.121.50]
4 22 ms 21 ms 22 ms 196.6.121.114-backbone.cybersmart.co.za [196.6.121.114]
5 237 ms 241 ms 233 ms 217.78.88.17
6 250 ms * 234 ms 217.78.88.38
7 * 259 ms 260 ms if-2-0-6.core4.LDN-London.as6453.net [195.219.195.225]
8 * 304 ms 314 ms if-2-1571.tcore1.NYY-NewYork.as6453.net [80.231.76.238]
9 316 ms 313 ms 313 ms if-0-0-0-1582.core2.CT8-Chicago.as6453.net [116.0.84.65]
10 326 ms 367 ms 320 ms 63.243.129.26
11 312 ms 322 ms 308 ms Vlan889.icore1.CT8-Chicago.as6453.net [66.110.27.2]
12 315 ms * 314 ms Vlan552.icore1.CT8-Chicago.as6453.net [206.82.141.98]
13 321 ms 320 ms 324 ms ind1-ar3-ge-0-0-0-0.us.twtelecom.net [206.222.120.222]
14 314 ms 314 ms 315 ms tge-8-3.2009.rtsw.ipiu.ilight.net [199.8.220.74]
15 * * * Request timed out.
16 * * * Request timed out.
17 * * * Request timed out.
18 * * * Request timed out.
19 * * * Request timed out.

[NinjaTrader_Jason]

Can you please send me your log and trace files for yesterday and today. You can find log and trace files at the following locations.

Start Menu--> My Documents--> NinjaTrader 7--> Log--> log.20110509 for today. (log.yyyymmdd for any other date)

Start Menu--> My Documents--> NinjaTrader 7--> Trace--> trace.20110509 for today. (trace.yyyymmdd for any other date)

Please include what time zone is used as per your PC clock.

You can send it to support[at]ninjatrader[dot]com. Please put 'Attn Jason' in the subject header and reference this forum thread.