Announcement

Collapse
No announcement yet.

Partner 728x90

Collapse

Benchmark for NT

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Benchmark for NT

    Guys,

    Don't laugh at my terrible C# coding, but I have put together a very simple benchmark for NT.

    I wanted to do this with hopes that users of the forum would post their results, along with their system configuration like which processor they have, and then we can compile these results into a table where we can rank NT performance by processor type.

    I welcome improvements to the code, I am sure there are numerous ones! To be honest, I am not even sure if the math calculations I am using will realistically represent NT results, so I am hoping to get some official input from the NT team here on this one.

    Personally, I am running an Intel E6850 Core 2 Duo overclocked to 3.51 ghz with 8GB of ram, and I use VMware Workstation to 'maximize' my NT backtesting by running more than one instance of NT simultaneously. I am eagerly anticipating two things: a) Intel's Core i7 965 Extreme processor, due out any day, and b) NT 7 which will be multi-threaded.

    But, I found myself wondering "how much faster will the Core i7 965 be with Ninja vs my current setup? Or vs a cheaper Core 2 Quad?". This benchmark was written to try and answer that question, by letting the users of this forum participate.

    To run the benchmark, just install it and select any symbol in the strategy analyzer, select 1 minute interval, and set the time range to just one market day. The benchmark uses math to decide the speed of the system, it does not depend on how much tick data you feed it.
    Attached Files
    Last edited by ctrlbrk; 11-08-2008, 02:31 AM.

    #2
    Please download the attachment, import the script using File -> Utilities -> Import, and then backtest against the strategy "benchmark" using any instrument of your choice, using a 1 minute time frame and one single day for the time period (ie start date today end date today). Be sure to have your Output Window open first!

    Results table:

    01m 46s: Intel Core i7 920 @ 4.2GHz / 12GB, Seven x64, NT 6.5.1000.10 (sefstrat)
    01m 57s: Intel Core i7 920 @ 3.8GHz / 12GB, Seven x64, NT 6.5.1000.9 (ctrlbrk)
    02m 04s: Intel Core i7 920 @ 3.56GHz / 6GB, Seven x64, NT 6.5.1000.9 (whitmark)
    02m 18s: Intel Core i7 920 @ 3.4GHz / 6GB, Vista, NT 6.5.1000.10 (KrisS)
    02m 47s: Intel E6850 C2D @ 3.51GHz / 8GB, Vista x64, NT 6.5.1000.7 (ctrlbrk)
    02m 49s: Intel E7300 C2D @ 3.4GHz / 2GB, XP, NT 6.5.1000.9 (dennho)
    02m 50s: Intel E8400 C2D @ 4.05GHz / 4GB, XP, 6.5.1000.9 (whittod)
    03m 08s: Intel E8400 C2D @ 3.87GHz / 4GB, XP, 6.5.1000.9 (whittod)
    03m 14s: Intel Q6600 C2Q @ 3.0GHz / 4GB, Vista x64, NT 6.5.1000.7 (TraderGuy)
    03m 19s: Intel Q9450 C2Q @ 3.3GHz / 4GB, Vista, NT 6.5.1000.10 (KrisS)
    03m 32s: AMD Athlon 5200+ @ 2.9GHz / 4GB, XP, NT 6.5.1000.10 (eDanny)
    03m 55s: Intel T9300 C2D @ 2.5GHz / 2GB, Seven, 6.5.1000.9 (honvl)
    03m 58s: Intel E8400 C2D @ 3.0GHz / 4GB, XP, NT 6.5.1000.9 (whittod)
    04m 00s: Intel X6800 C2X @ 2.93GHz / 8GB, Vista x64, NT 6.5.1000.9 (jdfagan)
    04m 01s: Intel T9600 C2D @ 2.80GHz / 2GB, XP, NT 6.5.1000.8 (heech)
    04m 04s: Intel E4600 C2D @ 2.4GHz / 2GB, XP, NT 6.5.1000.9 (whitmark)
    04m 04s: AMD Opteron 280 @ 2.4GHz / 8GB, XP x64, NT 6.5.1000.10 (sam028)
    04m 07s: AMD Opteron 280 @ 2.4GHz / 1GB, VirtualBox XP, NT 6.5.1000.10 (sam028)
    04m 24s: AMD Athlon 3500+ @ 2.2GHz / 3GB, XP, NT 6.5.1000.9 (WhoKnows)
    04m 39s: Intel Q6600 C2Q @ 2.4GHz / 8GB, Server 2008, NT 6.5.1000.9 (ctrlbrk)
    04m 40s: Intel E6420 C2D @ 2.13GHz / 1GB, RedHat FC9 x86 w/VirtualBox XP, NT 6.5.1000.10 (sam028)
    04m 42s: Intel Q6600 C2Q @ 2.4GHz / 8GB, Vista x64, NT 6.5.1000.9 (zoltran)
    04m 52s: Intel X3220 Xeon @ 2.4GHz / 2GB, Server 2003, NT 6.5.1000.10 (heech)
    04m 55s: AMD Athlon 64 X2 @ 2.10GHz, Vista, NT 6.5.1000.10 (sam028)
    05m 00s: Intel Q9300 C2Q @ 2.5GHz / 8GB, Vista x64, 6.5.1000.9 (roonius)
    05m 03s: Intel E5345 Xeon @ 2.33GHz / 2GB, Amazon EC2 Server 2003 R2, NT 6.5.1000.10 (heech)
    05m 12s: Intel Pentium 4 @ 2.66GHz / 2GB, XP, NT 6.5.1000.9 (whittod)
    05m 12s: Intel Pentium 4 @ 3.0GHz / 3GB, XP, NT 6.5.1000.9 (astra)
    05m 40s: Intel Pentium 4 @ 2.80GHz / 4GB, XP, NT 6.5.1000.10 (tortexal)
    05m 41s: Intel T7300 C2D @ 2.0GHz / 4GB, Vista, NT 6.5.1000.9 (laserdan)
    05m 42s: Intel Pentium 4 @ 3.0GHz / 2GB, XP, NT 6.5.1000.10 (rt-trader)
    05m 43s: Intel Pentium 4 @ 3.2GHz / 2GB, XP, NT 6.5.1000.9 (whitmark)
    05m 51s: Intel T5850 C2D @ 2.17GHz / 3GB, Vista, NT 6.5.1000.10 (darckeen)
    07m 27s: Intel Pentium 4 @ 2.41GHz / 1GB, XP, NT 6.5.1000.10 (darckeen)
    09m 15s: AMD Athlon XP 2000+ @ 1.67GHz / 512MB, XP SP3, NT 6.5.1000.9 (roonius)
    12m 44s: AMD Turion 64 TL-50 @ 1.6GHz / 2GB, Vista x64, NT 6.5.1000.9 (roonius)
    Last edited by ctrlbrk; 06-17-2009, 06:21 AM.

    Comment


      #3
      I applaud your efforts, ctrlbrk, to collect some comparative info on this. To clarify, you only need to use backtest (vs optimize) in the Strategy Analyzer, and since the strategy prints out the elapsed time, make sure you have your Output Window open. Here are some more observations using 6.5.1000.9.

      Intel Core 2 Duo, E4600 @ 2.4 GHz, 2GB RAM
      Elapsed time: 4 minutes, 4 seconds

      Intel Pentium 4, 3.2 GHz, 2GB RAM
      Elapsed time: 5 minutes, 43 seconds

      Any i7 users care to conduct the benchmark test and report their results?

      Regards,

      Whitmark
      Last edited by whitmark; 03-28-2009, 07:00 AM.
      whitmark
      NinjaTrader Ecosystem Vendor - Whitmark Development

      Comment


        #4
        Thanks whitmark.

        I own a i7 920 now. I've updated the second post above to show a results table.

        I also added my Q6600 to the list. it's not overclocked, it's a production server (Server 2008). Probably Vista and almost definitely XP with Q6600 would be faster.

        Mike
        Last edited by ctrlbrk; 03-28-2009, 08:40 AM.

        Comment


          #5
          Thanks for the update. Btw, the boxes I've tested are running XP. Guess you have a resounding answer to your initial question "a". Now that you have an i7 box, are you finding that the performance differences from running the benchmark to be a good proxy for performance differences one might expect when performing optimization work?

          Thanks,

          Whitmark
          whitmark
          NinjaTrader Ecosystem Vendor - Whitmark Development

          Comment


            #6
            Originally posted by whitmark View Post
            Thanks for the update. Btw, the boxes I've tested are running XP. Guess you have a resounding answer to your initial question "a". Now that you have an i7 box, are you finding that the performance differences from running the benchmark to be a good proxy for performance differences one might expect when performing optimization work?

            Thanks,

            Whitmark
            Yes I would say it is pretty dang accurate actually to a "real" optimization job. There is massive headroom here, my C2D @ 3.51GHz usually had both cores around 70% during a backtest/optimization. The i7 920 @ 3.8GHz is barely taxed at around 15% on just one single core.

            So, when NT7 comes out, if it truly takes advantage of multi-core, then it should peg all cores @ 100% and if you extrapolate that out it means the optimization could be about 5-6x faster. I guess the big question is, will NT7 do this, or not.

            Mike

            Comment


              #7
              Interesting, here is another one.

              Intel Q6600, 3.0Ghz (OC), 4 Gig RAM, Vista 64, NT 6.5.1000.7

              Elapsed Time
              3 Minutes 14 Seconds

              CPU was showing 25% - 33% on Task Manager during the test.

              Regards,
              Guy
              TraderGuy
              NinjaTrader Ecosystem Vendor - EMS

              Comment


                #8
                Originally posted by TraderGuy View Post
                Interesting, here is another one.

                Intel Q6600, 3.0Ghz (OC), 4 Gig RAM, Vista 64, NT 6.5.1000.7

                Elapsed Time
                3 Minutes 14 Seconds

                CPU was showing 25% - 33% on Task Manager during the test.

                Regards,
                Guy
                Thanks for the feedback! Interesting to see two Q6600's side-by-side, and the major difference between stock & overclock. Probably some difference due to Server 2008 vs Vista as well.

                I updated the reference post above.

                Mike

                Comment


                  #9
                  Intel Core Quad Q9300 (2.5 GHz - not OC); 8GB RAM; Vista Ultimate x64; NT 6.5.1000.9;
                  5 mins 0 secs

                  AMD Athlon XP 2000+ 1.67 GHz; 512MB RAM; XP SP3; NT 6.5.1000.9
                  9 min 15 sec

                  Comment


                    #10
                    Originally posted by roonius View Post
                    Intel Core Quad Q9300 (2.5 GHz - not OC); 8GB RAM; Vista Ultimate x64; NT 6.5.1000.9;
                    5 mins 0 secs

                    AMD Athlon XP 2000+ 1.67 GHz; 512MB RAM; XP SP3; NT 6.5.1000.9
                    9 min 15 sec
                    Awesome, thanks for your help roonius.

                    Mike

                    Comment


                      #11
                      On the notebook:

                      AMD Turion 64 Dual Core TL-50 (1.6 GHz) 2GB RAM; Vista 64; NT6.5.1000.9

                      12min 44 sec

                      Comment


                        #12
                        Updated, thanks roonius.

                        Comment


                          #13
                          2mins 50sec
                          Intel E8400 @ 4.05GHz OC, 1800MHz FSB, 4GB, XP, NT .9

                          3min 8sec
                          Intel E8400 @ 3.87GHz OC, 1720MHz FSB, 4GB, XP, NT .9

                          3min 58sec
                          Intel E8400 @ 3.0GHz, 1333MHz FSB, 4GB, XP, NT .9

                          ***********************
                          5min 12sec
                          Intel P4 @ 2.66Ghz, 533Mhz FSB, 2GB, XP, NT.9
                          Last edited by whittod; 04-24-2009, 02:42 PM.

                          Comment


                            #14
                            Updated!

                            Mike

                            Comment


                              #15
                              4:42 - Q6600 C2Q @ 2.4Ghz ... pretty much the same as yours
                              Vista64, 8gig ram

                              Comment

                              Latest Posts

                              Collapse

                              Topics Statistics Last Post
                              Started by sidlercom80, 10-28-2023, 08:49 AM
                              170 responses
                              2,271 views
                              0 likes
                              Last Post sidlercom80  
                              Started by Irukandji, Yesterday, 02:53 AM
                              2 responses
                              17 views
                              0 likes
                              Last Post Irukandji  
                              Started by adeelshahzad, Today, 03:54 AM
                              0 responses
                              3 views
                              0 likes
                              Last Post adeelshahzad  
                              Started by CortexZenUSA, Today, 12:53 AM
                              0 responses
                              3 views
                              0 likes
                              Last Post CortexZenUSA  
                              Started by CortexZenUSA, Today, 12:46 AM
                              0 responses
                              1 view
                              0 likes
                              Last Post CortexZenUSA  
                              Working...
                              X