Historical Data Missing From Charts

[laocoon]

You are right, but this is not a new issue to them!

That's the main point here. I have a tremendous amount of respect for Ninja in general and the support staff in particular. But in this case, I feel like I'm having a déjà vu almost every week since February. How hard can it be to set up a redundant historical data server (or whatever else is needed to solve this issue once and for all)?

[BigAAPL]

I just disconnected from CQG, restarted NT, reconnected, then reloaded historical data. All my data has been backfilled and works fine. I recommend others do the same.

[NinjaTrader_James]

Hello Lacoon,

These recent issues were unrelated, so this most recent missing data was a new item.

We actually do have several redundant servers. Switching between them takes proper oversight and diligence and we will not sacrifice the necessary quality assurance when we switch to a new server.

[Islander]

Hello James
Thanks for the update. Is this issue only related to Continuum/CQG?

[laocoon]

Hello Lacoon,

These recent issues were unrelated, so this most recent missing data was a new item.

We actually do have several redundant servers. Switching between them takes proper oversight and diligence and we will not sacrifice the necessary quality assurance when we switch to a new server.

Thanks for your reply James. I'm not an IT specialist but I can certainly appreciate the fact that there are many moving parts involved in getting a data solution to work properly. My concern is that it is taking way too long to restore the data once there is an issue. I have worked with many data providers over the years and they all had their issues, but in such a situation it is of utmost importance that the problem is solved very quickly, which is currently not the case with Ninja.

[NinjaTrader_James]

Hello Islander,

This recent data item only affected users on CQG/Continuum. It is important to keep in mind missing data was on the Historical Data Servers and was not a result of CQG/Continuum.

[tderrick]

Brother James,

I'm afraid that's not very comforting. Now, instead of just a single problem, it
appears we have a myriad of pit falls lurking in the data universe.

I see why it is so hard to repair. It may be out of your hands.

I see one workaround.

New platform
New data
New Broker

I'm starting over

Hello All,

It is important to keep in mind that many things can occur when recording and distributing large amounts of data and that none of the recent these data items were related, despite the proximity in the timeline and data issues manifesting themselves in the same way. The infrastructure to maintain this service is huge with many moving parts along a chain involving many parties starting with the exchange and ending at the user. All of these parties have failure points and even with proper redundancy some of these items will appear due to things like major ISP backbone outages, power outages, and even problems at the exchange directly.

We will continue to keep looking for ways to increase redundancy, improve communication, and to continue to offer the best support possible.

Please report any items on individual systems directly to support[at]ninjatrader[dot]com.

[laocoon]

Hello Islander,

This recent data item only affected users on CQG/Continuum. It is important to keep in mind missing data was on the Historical Data Servers and was not a result of CQG/Continuum.

This is also something that puzzles me. In an earlier post you mentioned that the problem can be at the ISP, or a power outage, or at the exchange directly, etc,

But surely this can't be the case here because it wouldn't only affect CQG users then, or am I missing something?

[ttmag]

Hello James,

thank you for your Information. I contact the Support then after the Restart
it works not for me and I sill miss the Data on the ES Minute-Chart....
But the real Question is: Why do you answer us Members 15 hours after
the Error occur. Its a nightmare for me, then iam a Mirusmember too and that
remembers me strong on the dark days in January.

Iam 10 years with Ninja, its the first time that you dont answer the people.
I hope that was a onetime Failure.

[NinjaTrader_James]

Hello tderrick,

While my post was simply meant to be factual, I understand your concern. Unfortunately, nothing in life is immune to issues and trading is no different. In all of my years in this industry and with all of my interactions with our countless users, I have never once found an ISP, software, data feed, broker, computer, tech support team, etc. with 100% reliability.

The workaround I recommend, (which isn't a workaround at all, but what should be standard practice) is to ensure that just as every other component of trading has redundancy, so should you. A back up data feed can absolutely prove to be an integral tool for any person earning their living as a trader. Adding the security a back up data feed provides should prove to be a far better option than scrapping everything and starting over.

Whether or not this is an option for you or for anyone else reading is completely up to your trading needs; I am simply making a well informed recommendation based on my aforementioned experience.

[NinjaTrader_James]

Hello lacoon,

This is also something that puzzles me. In an earlier post you mentioned that the problem can be at the ISP, or a power outage, or at the exchange directly, etc,

But surely this can't be the case here because it wouldn't only affect CQG users then, or am I missing something?

Let me give you an example of why this is not a complete understanding of the issue.

Suppose an ISP in Chicago providing service to a data feed fails, but a server located elsewhere for another company is unaffected because it is using another ISP, then only the first data feed would be affected. Simply put, not everyone is using the same technology. I lost cable while watching hockey last week, but my buddy with a satellite service didn't.

[NinjaTrader_James]

Hello ttmag,

Hello James,

thank you for your Information. I contact the Support then after the Restart
it works not for me and I sill miss the Data on the ES Minute-Chart....
But the real Question is: Why do you answer us Members 15 hours after
the Error occur. Its a nightmare for me, then iam a Mirusmember too and that
remembers me strong on the dark days in January.

Iam 10 years with Ninja, its the first time that you dont answer the people.
I hope that was a onetime Failure.

I apologize that this thread was not updated during that time. It was not intended and I will do my very best to ensure our support team is always able to meet and exceed the expectations we have established in the past.

Per the minute data, please send us an email (if you haven't already) and we will be more than happy to get you up and running.

[peterhxu7]

es 06-14 data still not restored

es 06-14 data still not restored from my side, how about you guys?

[laocoon]

Hello lacoon,


Let me give you an example of why this is not a complete understanding of the issue.

Suppose an ISP in Chicago providing service to a data feed fails, but a server located elsewhere for another company is unaffected because it is using another ISP, then only the first data feed would be affected. Simply put, not everyone is using the same technology. I lost cable while watching hockey last week, but my buddy with a satellite service didn't.

I understand what you're saying, but if the same issue happens again and again almost every week for a couple of months in a row and always only to CQG users, then I have a hard time accepting that. No one expects 100% uptime, but in this case we're very, very far away from even a 99% solution.

[NinjaTrader_James]

but if the same issue happens again and again

This is what I think you may be missing. It is not the same thing that has caused the missing data, they are different items all addressed separately. The timing was unfortunate, but they were unrelated.