selection bias

scroll ↓ to Resources

Note

  • It is trivial to generate good-looking technical analysis (TA) strategies, when you run computer simulations on data without any constraint from rigorous theory. That is how technical analysts produce thousands of examples of presumed “successes.” But of course, for each TA success, there are millions of counter-examples where the same pattern leads to a loss. So the next time someone throws you a TA chart, think about the millions of alternative charts that this person is not showing you, based on alternative model configurations. Under that light, even a Sharpe ratio as high as 5 is to be expected.
  • The reason is Backtest Overfitting: When selection bias (picking the best result) takes place under multiple testing (running a computer program that explores many alternative configurations), the outcome is very likely to be a false discovery. Finance books, academic journals and TV financial news channels are filled with false discoveries. The retraction rate for journal articles in the finance field is essentially null, compared to thousands of papers retracted in other fields.

Resources


table file.inlinks, file.outlinks from [[]] and !outgoing([[]])  AND -"Changelog"