I am running a WFO in strategy analyzer and the Walk Forward tab has the test period results listed but the test periods are overlapping. It is testing days multiple times and adding that into the overall results. I am doing optimize over 3 days and then test over 2. Is my optimize test period messing it up or are these results expected?
Announcement
Collapse
No announcement yet.
Partner 728x90
Collapse
NinjaTrader
WFO Test periods overlapping?
Collapse
X
-
WFO Test periods overlapping?
Hello,
I am running a WFO in strategy analyzer and the Walk Forward tab has the test period results listed but the test periods are overlapping. It is testing days multiple times and adding that into the overall results. I am doing optimize over 3 days and then test over 2. Is my optimize test period messing it up or are these results expected? -
Hello TOOLMachine462,
The overlap is expected if the Optimization period is larger than the test period. The optimization period is the data used for the next walk forward test over the test period.
So if you have the optimization period set to 3 and the test period set to 1, there will be a 1 day overlap with each test as the input data will be 3 days and the test period will be 2 days.
As this walks forward, each test will use 3 days for the optimization and will apply that to each 2 day test.Chelsea B.NinjaTrader Customer Service
-
I thought it would optimize over 3 days then test over 2, then optimize over 3 more days which would include the 2 that it just tested over plus the day before, then test over the next 2 days, and so forth.
So your saying to get accurate results, I need to WFO over an equal number of optimization and test days?
Is there a phone number I can call to talk to a support tech about how to use the WFO usefully and to it's designed intent?
Thanks
Comment
-
Hello TOOLMachine462,
NinjaTrader Support is outbound only. You can send an email to platformsupport [at] ninjatrader [dot] com and request a call.
"So your saying to get accurate results, I need to WFO over an equal number of optimization and test days?"
Using 3 days for the optimization and 2 days for the test would cause a day of overlap, however, I do not agree that is is not accurate for the settings used.Chelsea B.NinjaTrader Customer Service
Comment
-
Ok thanks. Is there a way to run a test to simulate an optimization period of so many days, then a test period of so many days, but not have the test days overlap? I want to see the results of the optimization schedule without overlaps. How can you tell if a strategy is working when you have the same period being tested multiple times with different parameters and then added into the final results? How is this useful? Thanks
Comment
-
Actually it was just a bad session template causing it to test days multiple times. Also want to watch out for starting session too early. The indicators don't build correctly for first part of session if there isn't enough time before session starts. Just fyi. Thanks!
Comment
-
Originally posted by NinjaTrader_PatrickH View PostHello TOOLMachine462,
Thank you for your response.
I do not see overlap in the Walk Forward Test results. Can you provide a screenshot of the overlap you are seeing are you end?Last edited by TOOLMachine462; 05-15-2016, 12:49 AM.
Comment
-
Stategy analyzer BUG
Originally posted by NinjaTrader_PatrickH View PostHello TOOLMachine462,
Thank you for your response.
I do not see overlap in the Walk Forward Test results. Can you provide a screenshot of the overlap you are seeing are you end?
If you note the date range of the highlighted row at the top area, and the date range of the trades taken for that period are not the same range. When you correct the session template, the dates of trades are within the appropriate period range and you get different P&L. Has this been brought to the attention of the development department?Last edited by TOOLMachine462; 05-19-2016, 07:49 AM.
Comment
-
Hello TOOLMachine462,
Thank you for your response.
Can you provide details on the following?
The Performance window in your screenshot, what is this from? Is this the Optimization or Walk Forward trades?
For the settings you changed can you provide the results with one setting and results with the other? Please make sure to include the settings. Changing settings will change the profit and loss, so this would be expected.
Comment
-
The Performance window is from the upper highlighted WF trades.
If I run the same WFO with the same parameter ranges I will get different results. It doesn't ever give the same results twice, so I can not reproduce the results with different session templates. You can reproduce this yourself with any WFO. Just analyze the trades for each period under the WF tab. In my experience, if you change the session template to start at 12:00AM and end at 11:59pm, it changes everything in WFO. Try the default set to 12am to 12am and then try 12am to 11:59pm. Make sure you look at the trades taken for each period. They will not match the date ranges for that period when using default session template. Surely I'm not the first one to point this out but I can't find a related thread.
Thanks,
LandonLast edited by TOOLMachine462; 05-19-2016, 09:30 PM.
Comment
Latest Posts
Collapse
Topics | Statistics | Last Post | ||
---|---|---|---|---|
Started by habeebft, Today, 07:27 AM
|
0 responses
1 view
0 likes
|
Last Post
by habeebft
Today, 07:27 AM
|
||
Started by Tim-c, Today, 03:54 AM
|
1 response
7 views
0 likes
|
Last Post Today, 07:26 AM | ||
Started by rocketman7, Today, 01:00 AM
|
1 response
10 views
0 likes
|
Last Post Today, 07:22 AM | ||
Started by wzgy0920, 04-23-2024, 09:53 PM
|
3 responses
76 views
0 likes
|
Last Post Today, 07:22 AM | ||
Started by JonesJoker, 04-22-2024, 12:23 PM
|
9 responses
46 views
0 likes
|
Last Post Today, 07:21 AM |
Comment