SageFusion
  • Research access
  • Firms
  • Insights
  • Podcast
  • The Wealth Almanac
  • About
  • Contact Us
  • Login
Home›Research›Research log
Research log

We publish the trading ideas that failed

Backtests look better than they should because the failures usually vanish. SageFusion keeps every study in its research log, newest first, including the ones that failed or were retracted, with the reason written next to each.

Join the research waitlist Request a sample

Key points

  • Every study stays in the log, newest first
  • Three labels, spelled out
  • Retractions keep their reason
  • Firms can audit it with a sample

The file drawer problem

Most tested trading ideas fail. The problem is that the failures rarely get written down. They go in a drawer, and only the survivors are shown, which makes the survivors look far better than they are.

Academic research has the same issue. McLean and Pontiff (Journal of Finance, 2016) found that many published stock market patterns weakened after they were published, part of it because some had been found by searching rather than by a real effect. Keeping the failures visible is the simplest guard against fooling yourself.

What is in the research log

Every study goes into the research log, newest first. Each one carries a plain-language question, what was tested, the result and the caveats, plus one of three labels:

VerifiedVerified (no edge)Failed / retracted
  • Verified: held up on later, unseen data. It is not a claim that the idea will make money.
  • Verified (no edge): tested cleanly, no usable effect.
  • Failed / retracted: did not hold up, or was withdrawn, with the reason.

Three retractions, in plain words

These are already public on the research page:

  • Machine-learning stock rankings. An early version let future data leak into the test, a look-ahead bug. The study was retracted and superseded by corrected runs.
  • Completed chart patterns over one to six months. The apparent result came from a handful of extreme winners, not a broad effect. Withdrawn as a skew artifact.
  • The old system's chart-pattern alerts. Compared with a fair placebo, the alerts showed no edge, so the earlier headline result was replaced. It stays in the log so the earlier claim can be checked.

Why most backtested strategies fail

  • Too many tries. Test enough versions of an idea and one will look good by chance. SageFusion discounts the best version for the number of tries before it is labelled.
  • Look-ahead bias. Using data that was not known at the time. Tests use the date data was actually recorded.
  • Survivorship bias. Using only companies that still exist. Each affected study says so.
  • Costs. Many small edges vanish after commissions and slippage, so score studies are judged after trading costs.
  • No fair comparison. Making money in a rising market is not the test. Our guide to testing a signal against random explains why.

Who the log is for

For investors, the log is a way to see how an idea was tested before trusting it. For research teams at firms, it is a way to audit the method, failures included, before licensing any data. See stock research data that shows what failed.

FAQ

Common questions

Why do most backtested trading strategies fail?

Usually because the backtest found luck rather than an effect. Testing many versions of an idea, using data that was not known at the time, leaving out companies that disappeared and ignoring trading costs all make a backtest look better than reality. When those are corrected, most ideas stop working.

What does 'retracted' mean in a research log?

A retracted study is one whose earlier result was withdrawn because a problem was found, such as future data leaking into the test. In SageFusion's research log it keeps its place with the label Failed / retracted and the reason written next to it, so the earlier claim can still be checked.

Is backtesting a waste of time?

No, but an unchecked backtest can be worse than none because it creates false confidence. Backtesting is useful when the rules are fixed in advance, results are compared with random picks, the idea is judged on years it never saw, costs are included and the failures are kept.

Keep reading

Related pages

How to tell if a trading signal is just luck

The placebo test: compare a signal with random picks traded the same way.

Read more

Stock research data that shows what failed

Licensable research data with the research log behind it.

Read more

Does copying Congress trades work?

What our test of House members' disclosed trades found.

Read more
Two ways in

Follow the log, or audit it.

Investors can join the research waitlist. Research teams at firms can request a data sample that includes the failed studies.

Join the research waitlist Request a sample

Research tool, not investment advice. Studies use daily prices of today's listed stocks unless stated. Legal disclosure

SageFusion

by Investment Science LLC

Product

  • Firms
  • Research access
  • Insights
  • Podcast
  • The Wealth Almanac

Company

  • About
  • Contact
  • Sign in
  • Legal
  • Privacy

Learn

  • How we test
  • Evening shortlist
  • Research log
  • Congress trades
  • Data licensing

Contact

[email protected]

+1 (917) 512-9523

99 Wall Street Suite 1672, New York, NY 10005

Schedule a meeting

SageFusion is a research product of Investment Science LLC. Content on this website is for information only and is not investment advice, a recommendation, or an offer to buy or sell any security. Research results are historical, can be affected by data limitations (including survivorship bias), and do not guarantee future results. Investing involves risk, including possible loss of principal. Legal disclosure

© 2026 SageFusion® · Investment Science LLC · Research tool, not investment advice.

  • Research access
  • Firms
  • Insights
  • Podcast
  • The Wealth Almanac
  • About
  • Contact Us
  • Login