Your AI Coworker Can Move Between Runtimes. Can Its Rules Come Along?
Google's new cross-runtime governance plans put an overlooked migration question in focus: when an A...
One innocent request can become a long chain of tool calls. BeyondTrust's new endpoint research makes the gap visible; here is how to set an action budget that limits scope without leaving unfinished work invisible.
One request to an AI coworker can become many actions before the requester sees a result. In research released October 21, 2026, BeyondTrust Phantom Labs reported approximately 1.28 million shell commands requested from 132,000 prompts in four weeks of observed coding-coworker activity—nearly ten requested commands per prompt. The researchers explicitly say these were requested, not necessarily successful, commands; the sample is endpoint telemetry from early customers, not a population-wide rate for every business or every type of work.
The ratio matters because authorization often happens at the wrong level. A person says, “Prepare the weekly operations report.” That sounds like one assignment. The coworker may search folders, query a CRM, run a script, fetch a connector result, open a spreadsheet, create a draft, and retry a failed call. Some of those actions are harmless reads. Others reach new systems, copy sensitive data, or change records. An approval of the sentence is not blanket approval of every consequence it might produce.
BeyondTrust's same release says 85% of observed coding-coworker users had at least one MCP server configured. That is a finding about this observed group, not evidence that 85% of all small businesses use such connections. It does illustrate how a task can cross more than one system. NVIDIA's October 21 OpenShell architecture explanation describes the same compounding issue: long-running work can touch files, network services, credentials, and additional processes as its path evolves. The business question is not how many steps a model can plan. It is how much authority one assignment can consume before someone must check the work.
An AI coworker task action budget answers that question. It is a set of limits on the types, targets, volume, duration, retries, and side effects allowed for a particular job. It does not reduce every job to a rigid script. It lets the coworker choose a route inside a bounded area and stop with a useful handoff when the route expands. The budget is enforced by the systems that grant access, not merely described in a prompt.
Consider an operations lead asking for a Monday supplier-status summary. A capable coworker might retrieve open purchase orders, compare delivery dates, check email for late notices, reconcile an inventory sheet, and prepare a digest. The lead wants a summary, not a new supplier record or an email campaign.
Yet several forms of fan-out can creep in. Source fan-out adds more folders, inboxes, and accounts to the search. Action fan-out adds edits and sends to a request that started as analysis. Retry fan-out repeats a call when a response is slow, sometimes after the external system already accepted the first request. Delegation fan-out passes the work to another role or connected service with its own permissions. A task can stay on topic while exceeding the original authority in any one of those dimensions.
The worst mistake is to count tool calls as if all calls have equal weight. Ten permitted reads of the same purchase-order set are different from one write to a vendor's bank details. Two identical invoice-creation requests are different from two document lookups. Use a count or rate limit to catch runaway behavior, but establish separate boundaries for data scope and irreversible effects.
The lead asks for a supplier digest. The coworker inherits the lead's full workspace access and searches every vendor folder. An ambiguous late notice suggests a changed shipping address, so it updates the supplier record “to keep the summary current.” An API timeout prompts a blind retry. The digest reports that the record was updated, but nobody knows whether the first call succeeded, whether the second created a duplicate event, or why an analytical task had write authority. A prompt limit would not fix this; the target system accepted the write.
The coworker receives a task identifier, a specific list of supplier accounts, read-only access to order and inventory records, and a deadline. It can draft the digest, but cannot alter a supplier master record or send external mail. Each downstream request carries the same task identifier, so a person can distinguish a fresh read from a repeated attempt. If a notice proposes an address change, the coworker flags it as an exception with a source reference and the relevant order; a named human verifies it through a known channel. The report can still be delivered on time with the exception clearly marked.
This is not an argument for keeping a coworker permanently read-only. Some roles legitimately send reminders or update records. The point is that a particular assignment should have a bounded set of effects. A request to compile a report should not silently become permission to change a supplier.
Model-spend caps are useful for cost control, but dollars and token counts do not express business impact. A cheap tool call can delete a record. A costly reasoning step can do no harm. Define the budget in the language of the workflow first, then translate it into permissions, connector policies, and run limits.
A useful task contract has six fields:
The limits should compose. A coworker can use at most 30 reads of the three listed supplier accounts over 20 minutes, for example, while receiving zero authority to update payment fields or send messages outside the company. Those numbers are illustrative, not a universal safe default. For another job, one approved external send might be appropriate, with the recipient and content confirmed at a separate seam.
An instruction such as “do not exceed 30 calls” may help the coworker plan, but it is not the boundary. Enforce the ceiling at the runtime, connector, authorization service, or target API. The coworker must not be able to grant itself more calls, add new targets, switch to an unrestricted credential, or quietly restart the job under a fresh identifier.
NVIDIA describes a supervisor separate from the sandbox that mediates network requests and credentials, plus a policy ceiling. That is one implementation pattern, not a requirement to adopt its stack. The underlying principle works with narrowly scoped connector accounts, API permissions, separate approval services, and counters stored outside the coworker's editable workspace. OWASP's AI Agent Security Cheat Sheet likewise emphasizes limiting tools and authorizing sensitive operations independently.
If a tool invokes another tool, make sure the child action consumes the original task's scope and accounting. Otherwise the visible parent can appear within budget while the work expands behind it. A budget that counts only top-level calls is a progress meter, not a control.
The goal is not a theoretical policy document. Pick a repetitive workflow and prove both that normal work completes and that out-of-scope work fails. A supplier digest, sales pipeline recap, or weekly search-performance report makes a practical starting point.
1. Trace one ordinary run. Record the initiating request, each connector reached, what data was read, which actions changed anything, and where the result went. Include retries and background calls. If you cannot see a downstream action, treat that as a coverage gap rather than assuming it did not happen.
2. Classify side effects. Mark each action as read, draft, internal write, external send, deletion, or financial effect. This exposes the point where a summary task crosses into action. Do not assume every read is harmless: broad retrieval of personnel or customer data can itself be consequential.
3. Set the first ceiling from the job. Name the allowed records and recipients; choose conservative volume, duration, and write limits. Keep a separate approval gate for exceptional writes. Make the initiating human's broad account irrelevant to the coworker's actual grant. A valid login is not task permission.
4. Exercise legitimate variation. Run a small account and a larger account in a safe test environment. Confirm the budget permits normal completion. If the larger job reaches a limit, decide whether to adjust the bound or split the work into reviewed batches; do not silently turn off the limit.
5. Exercise a wrong turn. Include an out-of-scope record, an external instruction embedded in source material, and a proposed change to a protected field. Verify the target or independent gateway rejects the forbidden action, even when the coworker attempts it. This tests structure, not the model's ability to remember a warning.
6. Exercise an uncertain retry. Simulate a timeout after a write request may have arrived. Require the coworker to check the target's receipt or query by an idempotency key before retrying. Save a draft and escalate when the outcome cannot be established. “Try again” is not a safe recovery protocol for consequential operations.
7. Review the handoff and amend the contract. The owner should see the task, last confirmed action, blocked attempt, affected record, source evidence, deadline, and proposed next decision without reading an entire transcript. Record the policy version and refine only the limit that blocked legitimate work. Test audit capture before the first consequential job, not after a dispute.
A strong test ends with two artifacts: evidence that the normal run finished, and evidence that the unauthorized path was refused by a system the coworker does not control. A screenshot of a prompt saying “I won't do that” is weaker. The system should also demonstrate an orderly stop at the budget boundary: a draft remains accessible, an owner is notified, and the job is not marked done.
BeyondTrust's command count is a useful reminder, not a universal benchmark. The observation comes from coding work on endpoints, and a supplier-status Teammate will not issue shell commands at the same rate. But every business workflow has the same structural problem: a short instruction can unfold into a chain whose scope and effects are not obvious from the initial sentence.
An action budget makes that expansion visible and governable. It answers what the coworker may reach, how far it may continue, what counts as a consequential step, and what happens when reality does not match the plan. It is one practical piece of intent engineering: organizational purpose translated into a testable operating boundary.
The budget should not punish useful initiative. It should make initiative recoverable. A well-designed coworker can continue gathering permitted evidence, pause at a consequential seam, ask a person for a precise decision, and resume with fresh, limited authority. That is more useful than either unrestricted autonomy or a brittle script that stops whenever a supplier uses a different file name.
Q: Is an action budget just a maximum number of tool calls? A: No. Call counts help detect loops, but a single unauthorized write can matter more than many reads. A useful budget also limits targets, action classes, recipients, duration, retries, and side effects for one task.
Q: How is this different from a monthly AI spending cap? A: A spending cap limits model cost and may stop work when it is reached. A task action budget limits what a coworker may do to business systems. Keep both; neither substitutes for the other.
Q: Can a coworker ask for more scope mid-task? A: Yes, but the request should go to a named human or independent authorization service. Grant only the additional records or action needed, with an expiry and a recorded reason. The coworker should not edit its own policy.
Q: What happens if an API call times out? A: Treat the outcome as unknown until the target system confirms it. Check for a receipt or idempotency key before a retry. If the result cannot be established, preserve the job state and hand it to an owner rather than risking a duplicate effect.
Q: Do small businesses need a dedicated security platform for this? A: Not necessarily. Start with separate connector permissions, task-scoped access, external approval gates, and observable run limits. Verify the target system actually refuses an out-of-scope action. Buy additional enforcement when the exposure and workflow complexity justify it.
Q: Does this mean every action needs human approval? A: No. Approved reads and low-risk drafts can proceed within a defined budget. Human judgment belongs at exceptional or consequential seams, such as changing payment details, mass sends, or expanding access beyond the named task.
If you want AI coworkers that can carry real work without turning one request into unlimited authority, Associates AI Teammates gives your team a self-serve platform to configure roles, Skills, connections, and human decision boundaries. View pricing and design the first work contract around a job your staff already understands.
Written by
Founder, Associates AI
Mike is a self-taught technologist who has spent his career proving that unconventional thinking produces the most powerful solutions. He built Associates AI on the belief that every business — regardless of size — deserves AI that actually works for them: custom-built, fully managed, and getting smarter over time. When he's not building agent systems, he's finding the outside-of-the-box answer to problems that have existed for generations.
More from the blog
Google's new cross-runtime governance plans put an overlooked migration question in focus: when an A...
GitLab's new governance dashboard makes AI activity visible, but its documentation exposes a crucial...
A schedule makes an AI coworker proactive, but it does not guarantee the work is complete. Design fo...
Want to go deeper?
Get started today. Hire your first Teammate in minutes and put it to work on what you're reading about.
Get Started