Capital CasebookStock Market Wizards

All analyses

Discipline needs a maintenance plan

Separate following a live rule from researching its replacement.

Open the interactive lesson & exercises ↗

Illustration for: Discipline needs a maintenance plan
Conceptual illustration · not a historical photograph or market data

The Ultimate Trading System

Lescarbeau gives little detail about the systems themselves, but describes extensive research and consistent execution of their signals. The absence of disclosed rules matters: readers cannot reproduce his results from this interview. The transferable issue is organisational—how research, monitoring and action fit together when a method requires regular attention.

Our interpretation is to distinguish a planned research review from an improvised override. If a live model says exit, ignoring it to avoid admitting a loss changes the strategy without a test. Yet blindly keeping a broken data feed is not discipline either. A sound operating plan specifies checks for data failure, who can suspend operation and how a revised model is evaluated before use.

Reacting rather than predicting

Lescarbeau trades mutual funds in the interview period, moving between exposure and cash according to his systems. He rejects the idea that he is forecasting where an index will be months later. His distinction is between predicting a future price and responding to observed conditions. Although he withholds his proprietary rules, he discusses sector funds and explains that the vehicle and operational arrangements matter. This is not a ready-made system the reader can reconstruct from the chapter, nor a statement about what present-day funds permit.

The nuance: systematic does not mean no judgement

The interview makes a distinction the brief lesson previously missed. Lescarbeau says he follows a system’s liquidation signal, but he still exercises judgement over which systems to use and how much exposure to take. He may reduce size when his equity curve has run unusually far above its longer-term trend. He also favours systems with strong recent performance and replaces those he regards as inferior. Thus discretion operates around the system-selection and allocation layer; it is not simply an excuse to ignore an inconvenient exit.

The book’s examples: capacity and decay

He describes returning outside capital partly because switching substantial sums among funds became logistically difficult and because client demands added pressure. He also argues that a method can lose effectiveness when too much money follows it. The discussion of published strategies and managed-futures systems illustrates his concern about crowding; it does not prove that publication alone caused any particular strategy’s decline. The practical implication in his account is continual research and a reluctance to disclose working rules. A good historical record is not, for him, a reason to stop searching.

What Schwager praises—and what remains undisclosed

Schwager stresses confidence, disciplined execution, hard work and attention to small drawdowns. The interview also makes the limits of imitation unusually clear: the central predictive rules are not supplied. A useful reader can study how execution, monitoring, model replacement and capital capacity fit together, but cannot honestly claim to have acquired Lescarbeau’s edge. Compare him with Shaw: both protect research and recognise that competition changes opportunities, yet this chapter emphasises one trader’s operating routine while Shaw describes an institutional research organisation.

Worked example

A fictional model tested 200 times with a 5% false-positive rate could produce about 10 apparent findings under a simplified null model. More searching is not automatically more evidence.

Limits

Reported performance is not a published, independently reproducible system. Constant activity is not the same as useful research.

Case connection

Lescarbeau’s systematic discipline also needs operational reliability. Distinguish a tested rule from a correctly deployed and monitored system.

Knight Capital: a sound idea still needs safe execution

The strategy is only one part of a trading system. Deployment, monitoring and stopping behaviour can determine the outcome.

Forty-five minutes

The SEC reported that on 1 August 2012 Knight Capital’s router sent more than four million orders while attempting to fill 212 customer orders. In the first 45 minutes it traded over 397 million shares and accumulated unwanted positions, producing a loss exceeding $460 million. The regulator linked the event to an incorrect software deployment that activated defective, previously unused functionality. [1]

Interpretation: three separate promises

A research model promises that a rule may have useful statistical properties. An implementation promises that the computer performs that rule. An operating process promises that exposure remains controlled if something goes wrong. Evidence for the first promise does not establish either of the others. A beautiful backtest cannot show that the deployed version matches the tested version, that an alert reaches someone responsible, or that the system stops when an unexpected position appears.

A different kind of feedback loop

An automated process can repeat a mistake much faster than a person can inspect individual trades. That changes the value of independent checks on total orders, position size and unusual activity. The check should examine what the system is actually doing, not merely whether the strategy still forecasts a profit. This is our operational interpretation of the case. It is not an assertion that one simple control would certainly have prevented every part of the historical incident.

Hypothetical: detect the mismatch

Imagine a test harness requesting ten units while a separate position monitor observes one hundred. The interesting question is not whether the trade will eventually make money. It is whether the process exceeded the authorised instruction and whether further activity is halted. A useful rehearsal specifies who receives the alert, how duplicate actions are avoided and how outstanding orders are reconciled. These are invented test conditions, not details of Knight’s internal systems. They turn “be careful” into an observable procedure.

Read the systematic chapters differently

Lescarbeau’s discipline concerns carrying out a tested method, but carrying it out reliably requires checking the machinery too. Shaw’s research emphasis invites a distinction between statistical validation and production validation. Cook’s attention to loss size reminds us that an unusual operational loss may dominate many ordinary profitable trades. None of these connections attributes Knight’s behaviour to an interviewee. They extend the book’s questions to a later setting in which implementation failure, rather than a discretionary forecast, was central.

The wrong conclusion

This event does not prove that every automated strategy is unsound or that manual trading is free from operational mistakes. It also does not show that a research edge had disappeared. The failure category matters: changing a model’s entry threshold cannot by itself repair a deployment process. A fair review separates faulty logic, faulty release, missing supervision and the market cost of unwinding. Otherwise the lesson becomes a vague dislike of technology rather than a specific improvement in control.

The habit to keep

Ask two questions of a system: why should its decisions work, and what contains the damage when its operation does not? Give the second question its own evidence. An emergency procedure that exists only as an intention is not the same thing as a rehearsed response.

Consider

Which check tests execution rather than the investment idea?

Analysis guide

Compare intended orders with observed orders and positions. Specify a trigger, an accountable responder and a tested stop procedure.

SEC · Knight Capital market access enforcement, 2013

Reflection

Which failure would justify suspending the system, and who would verify it?