Operational riskIntermediate

System Failure

System failure is the operational risk that the trader's own infrastructure, hardware, power, network, operating system or strategy software, fails while positions are live, leaving orders unsent, stops unmanaged and exposure uncontrolled.

Quick answer: System failure is the operational risk that the trader's own infrastructure, hardware, power, network, operating system or strategy software, fails while positions are live, leaving orders unsent, stops unmanaged and exposure uncontrolled.

In simple words

System failure is when the machinery you rely on breaks at the worst moment: your computer crashes, the power cuts, your internet drops, or the strategy software freezes while you are holding a position. Automation assumes everything keeps running, so when a piece stops, the algorithm can leave a position naked with no stop watching it. The danger is not just the loss on the position but that you may not even know what state you are in. Professionals plan for this the way an airline plans for engine failure: with redundancy and a manual fallback, not hope.

Purpose

This page exists because automated trading silently assumes its own infrastructure keeps running, so it must confront the reality that hardware, power, networks and software fail, and that a failure mid-position can be far more dangerous than any single bad trade.

Professional explanation

The failure surface is larger than traders think

An automated strategy depends on a long chain: power supply, the physical machine, the operating system, the strategy process, local network, internet link, and everything between it and the exchange. Any link breaking can stop the strategy or, worse, half-stop it, leaving orders sent but unmanaged. A home-run retail algo on a laptop and a domestic broadband line has many single points of failure; a Windows update reboot, a power cut, an overheating CPU, a memory leak that crashes the process. The first discipline is to enumerate this failure surface honestly rather than assuming the common case, everything running, is the only case.

The dangerous state is the unmanaged open position

The worst outcome of system failure is not that the strategy stops taking new trades; it is that it stops managing the trades it already has. If the process dies while holding a position whose stop lives only in the strategy's own logic rather than as a resting order at the exchange, that stop no longer exists, and the position is naked against whatever the market does next. This is why placing protective stops as actual resting orders at the exchange, rather than as software-side logic that fires only while your machine is alive, is a core defence. A stop that depends on your laptop being awake is not a stop.

Redundancy: the standard defence

The professional answer to system failure is redundancy at each critical layer. Compute moves off a home machine to a cloud server or VPS with reliable power and network; a second instance or failover host can take over if the primary dies; power has a UPS and network has a backup link. None of this removes failure, it reduces the probability that any single failure leaves you exposed, and shortens the time to recover when one occurs. Redundancy has a cost and adds its own complexity, a poorly designed failover can double-trade by having both instances act at once, so it must be engineered so that exactly one instance is authoritative at any time.

Detecting failure: heartbeats and watchdogs

You cannot respond to a failure you have not detected, and a frozen process is especially dangerous because it may appear alive while doing nothing. Robust systems use heartbeats, a regular signal each component emits, and a watchdog that trips if the heartbeat stops, so a hung strategy is noticed in seconds rather than discovered when a position has already moved against you. The watchdog should live on separate infrastructure from the thing it monitors, because a watchdog on the same crashed machine dies with it. Detection feeds directly into the kill switch and the recovery plan: the fastest safe reaction to an uncertain system state is often to flatten or hand control to a broker-side square-off.

The manual fallback and knowing your true state

When automation fails, control must fall back to a human, and that human needs two things: a way to reach the broker independent of the failed system, and accurate knowledge of the current position. A phone number for the broker's dealing desk, a separate device that can log into the trading terminal, and a reliable source of truth for positions and orders are the minimum manual fallback. The subtle hazard is state uncertainty: after a crash it may be unclear which orders were sent, filled or cancelled, so reconciling actual positions against the exchange's record before acting is essential, because acting on a stale internal view can double a position or leave a real one unhedged.

System failure vs API failure

AspectSystem failureAPI failure
What breaksYour own hardware, power, network or softwareThe broker or exchange connection and interface
Who controls the fixYou, through redundancy and fallbackLargely the broker or exchange, you plan around it
Typical symptomProcess dies, machine off, stops unmanagedOrders rejected, timeouts, stale acknowledgements
Core defenceRedundant compute, UPS, watchdog, manual fallbackRetries with limits, reconciliation, broker-side stops

Practical example

Illustrative example (Indian market)

A strategy runs on a home laptop trading one lot of Nifty on Rs 5,00,000, with the protective stop implemented in software, the code watches price and sends an exit if Nifty falls 150 points. Mid-session the laptop's power adapter fails and the battery, long degraded, dies within minutes; the process stops while the long lot is open. Nifty then falls 300 points before the trader restores power and reconnects: the software stop never fired because the machine was off, and the loss is about Rs 22,500 instead of the intended Rs 11,250. Had the stop been a resting stop-loss order at the exchange, or the position run on a VPS with a UPS-backed link, the exit would have executed regardless of the laptop's state. The failure converted a planned Rs 11,250 risk into double that, purely from infrastructure.

Retail algos in India often run on a home PC over consumer broadband, where power cuts and ISP drops are routine. Placing stop-loss orders as resting orders at the exchange, and using a broker that offers a server-side or bracket-order stop plus auto square-off, means a protective exit does not depend on your machine staying alive, which is the single highest-value fix for a home setup.

Limitations

  • Redundancy reduces but never eliminates the probability of an exposed failure, and adds its own complexity
  • A poorly engineered failover can double-trade by letting two instances act at once
  • Exchange-resting stops still gap through their level on news, so they cap but do not guarantee the loss
  • A watchdog on the same machine as the strategy dies with it and detects nothing
  • No amount of redundancy helps if the trader cannot determine the true position state after a crash

Common mistakes

  • Implementing protective stops as software logic that only works while your machine is awake
  • Running a live algo on a home laptop with no UPS and a single consumer internet link
  • Placing the watchdog on the same host as the strategy it is meant to monitor
  • Having no independent way to reach the broker or view positions when the system is down
  • Building failover without ensuring exactly one instance is authoritative, risking double trades
  • Acting on a stale internal position view after a crash instead of reconciling against the exchange

Professional usage

Serious systematic operations treat their own infrastructure as a risk to be engineered, not assumed. They run on redundant cloud or co-located compute with UPS-backed power and dual network paths, place protective stops as resting orders at the exchange so they survive a client outage, and monitor every component with heartbeats and an off-host watchdog. They design failover so exactly one instance is authoritative, maintain an out-of-band manual fallback to the broker, and treat post-crash reconciliation against the exchange's record as a mandatory step before any human acts on the book.

Key takeaways

  • System failure is your own infrastructure breaking mid-position, and its worst form is an unmanaged open trade
  • A stop that depends on your machine being awake is not a stop; rest protective orders at the exchange
  • Detect failures with heartbeats and an off-host watchdog, feeding a kill switch or broker square-off
  • Keep an independent manual fallback and always reconcile true position state after a crash before acting

Frequently asked questions

What is system failure in automated trading?
System failure is the operational risk that your own infrastructure, hardware, power, network, operating system or strategy software, fails while positions are live. It can leave orders unsent and stops unmanaged, and its danger lies as much in the uncertainty of your state as in the loss itself.
Why is an open position the most dangerous part of a system failure?
Because when the strategy process dies it stops managing the trades it already holds. If a protective stop lived only in the software rather than as a resting order at the exchange, that stop no longer exists, leaving the position naked against whatever the market does next.
Why is a software-only stop-loss risky?
A software stop fires only while your machine and process are alive. If the laptop loses power or the process crashes, the stop never executes and the position runs unprotected. A stop that depends on your machine being awake is not a real stop.
How do professionals defend against system failure?
With redundancy at each critical layer: cloud or co-located compute instead of a home machine, UPS-backed power, dual network links, and a failover instance. This does not remove failure but reduces the chance any single failure leaves you exposed and shortens recovery time.
What is a heartbeat and watchdog in a trading system?
A heartbeat is a regular signal each component emits to show it is alive; a watchdog trips if the heartbeat stops. Together they detect a hung or crashed process within seconds. The watchdog must run on separate infrastructure, because one on the same crashed machine dies with it.
What should I do the moment I detect a system failure?
The fastest safe reaction to an uncertain system state is often to flatten or hand control to a broker-side square-off, then reconcile. Detection should feed directly into a kill switch or manual fallback so an unmanaged position is not left drifting while you investigate.
How does system failure differ from API failure?
System failure is your own hardware, power, network or software breaking, which you control through redundancy and fallback. API failure is the broker or exchange connection breaking, which the broker largely controls and you plan around with retries, reconciliation and broker-side stops.
What is the single highest-value fix for a home trading setup?
Placing protective stops as resting orders at the exchange, or using a broker offering server-side or bracket-order stops plus auto square-off, so a protective exit does not depend on your machine staying alive. That one change removes the most common way a home algo leaves a naked position.
Can redundancy cause its own problems?
Yes. A poorly engineered failover can double-trade by letting the primary and backup instances act at the same time. Redundancy must be designed so exactly one instance is authoritative at any moment, otherwise the safety mechanism itself creates a new risk.
Why is knowing my true position important after a crash?
After a crash it is often unclear which orders were sent, filled or cancelled. Acting on a stale internal view can double a position or leave a real one unhedged, so reconciling actual positions against the exchange's record before doing anything is essential.
Should I run a live algo on my home laptop?
It is the setup with the most single points of failure: consumer power, one broadband link, and a machine prone to updates and overheating. For anything beyond experimentation, moving compute to a reliable VPS or cloud server with backup power and network sharply reduces exposure.
Does an exchange-resting stop guarantee my loss is capped?
No. A resting stop survives a client outage, but it can still gap through its level on news, so it caps but does not guarantee the loss. It is far better than a software-only stop, yet no stop removes gap risk entirely.
What is a manual fallback for system failure?
It is an independent way to control the book when automation fails: a phone number for the broker's dealing desk, a separate device to log into the terminal, and a reliable source of truth for positions. It lets a human take over when the automated system cannot.

Voice search & related questions

Natural-language questions people ask about System Failure.

What is system failure in trading?
It is when the machinery you rely on breaks mid-trade, your computer crashes, the power cuts, or the internet drops, leaving a position with no stop watching it.
Why is a software stop-loss dangerous?
Because it only works while your machine is on. If the power cuts or the app freezes, the stop never fires and your position runs unprotected.
How do I protect against my computer crashing mid-trade?
Put your stop as a real order at the exchange, not just in your software, and run the algo on a reliable server with backup power instead of a home laptop.
What should I do if my trading system crashes?
Reach your broker by phone or another device, find out your true position from the exchange, and if in doubt, flatten. Do not act on a stale internal view.
Should I run my algo on my home PC?
For anything real, no. Home power and internet fail too often. A reliable cloud server with backup power and network removes most single points of failure.
What is a watchdog in a trading system?
It is a separate program that trips if your strategy stops sending its regular heartbeat. It spots a frozen algo fast. It has to run on a different machine, or it dies with the one it watches.
Does a resting stop at the exchange fully protect me?
It survives your computer crashing, which a software stop does not. But it can still gap through its price on news, so it caps the loss without guaranteeing it.

Sources & references

    Last reviewed 12 July 2026. Educational content only — not investment advice. Markets and rules change; verify current conventions with SEBI, NSE/BSE and your broker.

    Educational content only — not investment advice. Examples use illustrative numbers and simplified models. Risk-management techniques reduce but never remove risk, and trading derivatives involves substantial risk of loss. See our Risk Disclosure and SEBI Disclaimer.