I would like to know whether or not there will be any changes in NT8 to the inflexible data storage options (alternate partitions, etc.) and the seemingly poor compression used in NT7.
I would also like to know if there will be any way to create add-ins that handle Historical Data Management and Replay data in a better way. (I was very pleased to hear that replay of historical data will be possible).
I know there must be commercial reasons for not exposing more of the API surface area. However, the Import/Export/Archiving integration with external systems is absurdly constraining for all but the most trivial of "retail day-trader" operations.
Perhaps the thought is that more serious clients may gravitate to cloud-based services at some point in the distant future. But given the glacial progress on this new desktop platform, I won't be holding my breath. (Yes, I know it's not easy, I'm a professional developer myself).
As for compression, there is absolutely no excuse for the amount of space currently used by NT7.
I can store a million ticks (DateTime, Double) in less than one megabyte (17x). It encodes in about 100ms and decodes in about 50ms on a outdated 4-core i5 machine.
I won't even go into the network latency incurred when downloading the data!
If you need a little help in that area, or you just want to see the performance comparisons for yourself, help yourself to my open source code!...
http://deltacodec.codeplex.com
I plan on adding tests that show the compressed size of data exported from NT7 when I get a chance.
Anyway, sorry for the rant. I think NT8 looks really great. I will definitely be converting to the lifetime license when it finally gets released, even if I have to hack together my own data management drivers (using System.Windows.Automation).
Or maybe you should just hire me as a data architecture consultant.
Comment