A man in a fedora and a woman with wavy auburn hair study a laptop beside an open black case labeled "ZERO" in a dim boiler room.

Zero to Scale: Would You Notice It Broke?

A missed briefing and a silent platform outage show what I must observe before I trust a product to run again.

Key findings

  • Operational capacity, customer demand, and revenue require separate measurements.
  • A useful walkthrough records every undocumented intervention needed to complete the task.
  • An uncertain write needs reconciliation and enforced idempotency before an automatic retry.
  • A missing-run signal must be able to reach a responder when the watched job cannot start.

The Chief of Staff's weekly briefing failed on July 17, 2026. It stayed failed for six days. The briefing never arrived. I did not check. In my governance account, I wrote: "Nobody noticed. I was the monitoring. I did not open the Actions tab."

As of October 2026, Orbyt Labs has zero paying customers. All three products remain on early access waitlists. I have no paying customers. I cannot claim to have scaled a product from that position. What I can do is name the operating checks I would want before I ask a product to handle repeated use.

A job that exists on a schedule can still disappear without anyone seeing it. That is the failure this checklist starts from.

What did the missed briefing expose?

After the missed briefing, I added a dead man switch that read the platform's run conclusions. It asked whether each agent seat had completed a run inside its expected window. Then I added a job to watch that switch. For eight days after it shipped, the monitor was red and I had not opened the tab. I did not read it. The published account records both misses. A red signal still needs a route to someone who will act on it.

At the end of August, the Actions budget ran out on August 31, 2026. Every job was refused before it could take a step, including the internal alarms. They never started. They could not report their own absence.

The external monitor still ran. It saw no ping arrive and opened an issue the next morning, September 1. That is an observed result: the outside monitor saw a platform outage the inside monitors could not see. The governance paper and datasets document the design and its limits.

The recovery was incomplete by choice. On September 2, 2026 I accepted the month end blackout for now instead of raising the budget. Nothing was automatically sent around the exhausted budget. The last days of a month can still go dark. The heartbeat makes that failure visible. It does not create capacity.

I should have required a destination for the briefing failure before treating the schedule as monitoring. The published governance account records the gap: nobody noticed, and I was the monitoring. I would make the same distinction in a product: a failure event is useful only when someone can see it and knows what to do next.

What would I test on a product path?

My first Building Orbyt account records the initial build. A first working version answers whether I can produce an experience. It cannot tell me whether someone can repeat a useful task while I am away from the keyboard.

I would start with a path I can repeat without supplying hidden steps. I would make its failures visible and expand capacity only when an observed workload requires it.

Take a job application tracker as an illustrative example. I would save an application, return later, change its status, and read the updated record. I would start from a clean account and record every manual database edit, hidden setup step, and unexplained retry needed to finish. I have not run this exercise for this article. The tracker is a proposed test, not an observed Orbyt product result.

The smallest useful record would identify the starting state, action, expected result, actual result, and any intervention. I would repeat the same path after a change to see whether the result still holds. The test suite account explains why a written expectation needs an executable check. I would still read the saved result. The result must survive. A green test of the request alone would not prove the user's record survived.

There are several kinds of scale. Customer growth, revenue, workload, and founder attention are different measurements. A larger codebase cannot substitute for any of them.

What would I need to see when a step fails?

I would distinguish a completed action, a refused action, a failed action, and an action whose result I could not observe. I would give each state a place to appear and a person to inspect it. A success screen and a log line would answer different questions. I would check both against the saved state.

For the illustrative tracker, I would show a failed save to the user and keep enough service evidence to locate it. For background work, I would watch for a missing run. The August outage showed that a job cannot report its own failure if it never starts. A monitor with the same budget and scheduler shares that blind spot.

I would test the observer as well as the action. I would deliberately withhold a scheduled run and check whether a separate signal appears. I would also run a healthy case to see whether the observer stays quiet. These are proposed checks for the tracker. I have not executed them here.

How would I handle an uncertain write?

I would name the recovery owner. I would list safe retries and possible duplicate effects. I would check the saved result before calling recovery complete. A user who sees a timeout does not know whether the write happened.

Here is an illustrative operating card for a tracker I have not built or tested for this article. Its states and actions are proposed:

StateEvidence I would checkAction I would take
Save acceptedI can read the record backI show the saved result
Save rejectedI see a validation or permission refusalI explain the available correction
Save outcome unknownThe request ended without a trustworthy resultI reconcile by the operation's stable identifier; I retry through an enforced idempotent operation or hold for investigation
Background job overdueThe expected run is missingI notify the named operator and preserve the last known state

The unknown row matters. A timeout can leave the caller uncertain about whether a write happened. An existing record might predate this attempt. An absent record might still be in flight.

An idempotent retry reuses the same operation identifier so repetition does not create a second effect. The service has to enforce that behavior. Attaching an identifier to a request is insufficient by itself.

I would check whether the service actually enforces that rule before allowing an automatic retry. If I cannot establish it, I would hold the operation for investigation. An extra record or duplicate effect can be harder to undo than a visible pause.

When would I add infrastructure?

I would add capacity when an observed constraint requires it.

A queue can help separate user-facing work from a slow background operation. It also introduces delayed work, retries, and another state to inspect. A cache can reduce repeated reads. It also creates a freshness problem.

I would add either with a specific before and after test. I would name the workload, response time target, acceptable error behavior, and operating cost. Then I would measure the actual path under that workload.

I would write those targets before the change, then compare the same path afterward. I would count the new failure states as part of the cost. More capacity would be useful only if it removed an observed constraint without making the result harder to recover. I have no such measurement here. I have not made a capacity decision for this article.

Jessica Baolin and Nathen Harvey's DORA analysis (opens in a new tab) connects AI adoption with both greater throughput and greater instability. My practical reading is that faster feature delivery raises the cost of an invisible failure. It does not tell me how much capacity my products need.

What would count as progress?

I would track completed core tasks, failures requiring intervention, time to recover, and my time spent rescuing the path. I would keep the workload and observation period beside every figure. Without them, a count could rise because more attempts occurred, because the path broke more often, or because observation improved.

Infrastructure capacity gets its own measurement. So does demand. A successful load test establishes behavior under the workload tested. It does not establish retention. More registered accounts do not establish that anyone completed the task.

The autonomy ledger records operating outcomes for agent seats. Those outcomes need interpretation before anyone calls them customer value. The failure corpus records discovered incidents and responses. It cannot count failures nobody found. The verification account makes the same practical demand: read the artifact that proves the result.

The briefing incident gives me a narrower, real result. The original failure went unseen for six days. The later external heartbeat caught a different outage and opened an issue. I cannot turn either observation into a claim about product demand, customer retention, or unattended operation.

What to do Next

I would choose one real user path and write down its starting condition and expected result. I would walk it from a clean account. Then I would interrupt it where the outcome becomes uncertain and read the saved state.

I would ask whether the user can recover, whether I can locate the failure, and whether a repeat action is safe. I would record the unanswered questions. I would fix the first break and run the same path again before increasing its workload.

I can prepare a product to repeat a useful task only when I can see its failure and verify its recovery.

Related reading:

Methodology

Practical guide derived from the author's published initial-build and governance accounts, the public failure corpus and autonomy ledger, and DORA's named analysis. The application-tracker path and operating card are illustrative. No load test, customer outcome study, or production recovery drill was conducted for this article.

Limitations

This is an operational playbook, not a claim of achieved market or revenue scale. Workload, reliability targets, and recovery requirements depend on the actual product. Historical monitoring failures are dated source accounts. The retry advice requires a service that enforces idempotent behavior; an operation identifier alone does not provide it.

Sources

  1. Building Orbyt, Part 1: Zero to One in 32 Days Retrieved October 2, 2026.
  2. Governing an agent leadership team Retrieved October 2, 2026.
  3. Governing an Agent Leadership Team: paper and datasets Retrieved October 2, 2026.
  4. Jessica Baolin and Nathen Harvey: Balancing AI tensions (opens in a new tab) Retrieved October 2, 2026.
  5. Orbyt Collective autonomy ledger Retrieved October 2, 2026.
  6. Orbyt Failure Corpus Retrieved October 2, 2026.
  7. The Test Suite Became Orbyt's Only Living Specification. Retrieved October 2, 2026.
  8. Verification Is the New Literacy Retrieved October 2, 2026.

Common questions

What does zero to scale mean in this playbook?

I would make one useful path repeatable without supplying hidden steps. I would check visibility and recovery before expanding capacity against observed workload. I would measure customer growth and revenue separately. A first working experience, a bigger repository, or a load test cannot establish demand or lasting customer value by itself.

What should happen after a write times out?

I would treat the result as uncertain until I reconciled it using the operation's stable identifier. An existing record might predate the request, and an absent record might still be in flight. I would retry only if the service enforces idempotent behavior using the same identifier. Otherwise, I would hold it for investigation.

When should a founder add more infrastructure?

I would add infrastructure when an observed constraint requires it and a before and after test can establish the benefit. I would specify the workload, response target, error behavior, and operating cost. A queue or cache creates new states to manage. I would keep the core path usable and inspectable before expanding the platform.

Justin Bartak

Founder, CEO and Chief AI Officer of Orbyt Labs

Builds software with AI agents across engineering, product, design and go-to-market. Publishes tests, failures and decisions at Orbyt Labs.

Writes The Machine Speaks with the agents that build the product, and The AI-Native Lens (opens in a new tab).

All of The Machine Speaks