When Your AI Coworker's Risk Changes Mid-Task, Freeze the Write—Not the Work
A coworker can start a job with the right permissions and encounter a risky instruction halfway thro...
A new open home for Agent Skills makes procedures easier to reuse across AI products. It does not make the same business procedure safe or reliable everywhere. Here is a practical release test for portable Skills.
On October 22, Anthropic donated Agent Skills to the Agentic AI Foundation. More than 70 products have integrated the format, according to Anthropic. That is real progress for any business that wants its AI coworkers to carry their working procedures between systems instead of rebuilding them inside each vendor's interface.
There is an important qualification in the same announcement: a proposed roadmap includes versioned releases and security guidance. Those are proposals for what comes next, not proof that every Skill installed today is versioned, reviewed, or safe in every runtime. A common way to package a procedure answers the question, “Can this system read it?” It does not answer, “Will this coworker make the right decision with it, under our rules, in this environment?”
Think about a monthly invoice-review procedure. The same document can tell two AI coworkers to collect unpaid invoices, compare payment records, draft reminders, and flag discrepancies. One may have read-only access to current invoices; another may see stale exports and hold a credential that can send reminders immediately. The text moved intact. The work did not.
This is the next practical portability problem. The file is transferable; the outcome depends on data, permissions, execution environment, model behavior, and who can intervene. Businesses need a release process for Skills, not a folder copied from one machine to another.
The Agent Skills specification defines a directory with a required SKILL.md containing a name, description, and instructions. It can also include scripts, references, and assets. Its overview describes loading the description first, reading full instructions when relevant, and accessing bundled resources as needed. This is a useful separation: a procedure becomes a portable artifact rather than an undocumented habit embedded in a chat session.
But the specification also permits optional compatibility notes and an experimental allowed-tools field whose support can vary by implementation. The body can say whatever the author thinks will help. Those facts matter operationally. A Skill can describe how to do a job without guaranteeing that each host grants the same tools, interprets the same restrictions, runs the same script dependencies, or even activates the Skill for the same request.
Format portability means another product can discover and read the folder. This is the standard's immediate promise. It reduces the cost of moving written know-how between products.
Environment portability means the Skill has what it needs to run: supported tools, accessible data, working dependencies, compatible file paths, and a permitted connection to each external service. Copying a script without its runtime or access model does not satisfy this test.
Decision portability means the business gets acceptable results under its own rules. A coworker should pause at the same consequential boundary, cite the same authoritative records, and hand the same unresolved exception to the right person. That is not a property a file extension can confer.
A business can pass the first test and fail the other two. Treat those tests separately in your rollout plan. If you have already mapped how a coworker's rules travel between runtimes, add the procedures that invoke those rules to the migration inventory. The policy may travel while a Skill calls a different connector or interprets a missing field as permission to continue.
A useful Skill describes an outcome, but a production Skill also needs a boundary around the route to that outcome. Write a small operating contract beside the instructions. The contract belongs to the business even if the Skill is published in an open format.
Name the records the coworker may use, their required freshness, and what to do if a record is absent. “Check the customer's balance” is too vague. “Use the current invoice ledger and settled-payment feed; if either is unavailable, prepare an exception instead of a reminder” is testable. A missing source must not quietly become an estimated value.
If a Skill uses reference documents, assign an owner and review date to each one. A portable procedure can still be wrong because it brings last quarter's policy into this quarter's workflow. See our guide to editing an AI coworker's knowledge base for the difference between keeping a document and keeping it authoritative.
Put read, draft, send, payment, deletion, and permission changes in separate categories. A Skill may request an action, but the runtime identity and connected service must enforce whether that action is allowed. Writing “ask before sending” in Markdown is not a substitute for removing unsupervised send access.
For an invoice-review Skill, the coworker can read ledger entries and produce a draft. A person approves the customer-facing reminder after reviewing the balance and recipient. Changing bank details is outside this Skill altogether. That division is an example of trust architecture: the system cannot silently promote a draft into a payment or message just because its instructions sounded confident.
“Invoice reminders prepared” should have a precise meaning: records checked against the source systems, exception list saved, drafts attached to the correct accounts, and no message transmitted. Include an owner for exceptions, an expiry time for the packet, and a marker for any action that might already have happened. The completion record lets a human check the work without replaying a conversation.
What bad looks like: An owner pastes a downloaded Skill into two AI products. Both generate a reminder list, so the migration is called complete. The second product uses an old spreadsheet, silently ignores one missing settlement, and sends to every contact it can reach. The file was portable; the approval and evidence boundary was not.
What good looks like: The owner pins the reviewed Skill revision, maps the required sources and roles in the second product, removes direct send permission, and runs the same sample invoices through both environments. One missing settlement produces a named exception in each; no customer receives a message. Differences in model wording are acceptable. Differences in financial facts or allowed actions are not.
You do not need a large testing department. You need a small, repeatable release gate that someone in operations owns. Apply it whenever a Skill changes, a connector changes, or the underlying runtime or model changes. A file copied into a new host is a candidate for deployment, not the deployment itself.
SKILL.md title. If a third-party package changed without a review, stop the release until the diff is understood.Do not mistake identical prose for identical behavior. A model may select a Skill differently, summarize a reference differently, or interpret a tool failure differently. The tests above focus on business invariants so you can change models without demanding identical sentences. That is the point of a model-agnostic approach: preserve the job and its boundaries while the underlying model changes.
The October 22 donation matters because neutral stewardship makes an open procedure format less dependent on one vendor. Anthropic says the proposed next steps include versioned releases, a proposal process, and security guidance. Those developments are worth following. They will not decide your invoice policy, your source-of-truth hierarchy, or who can authorize a customer message.
This is where intent engineering becomes practical. A Skill answers how a task can be done. The organization must answer why this task exists, which outcomes matter, where the human judgment seam sits, and what failure looks like. The Skill is a reusable expression of work, not a replacement for organizational authority.
Consider a sales follow-up Skill. It can gather account context and draft a reply on any compatible system. It should not decide whether an upset customer receives a promotional sequence or a call from a human account owner. That decision depends on the organization's priorities, live customer state, and escalation rules. A portable procedure without a clear intent boundary may just produce the wrong outcome more consistently.
Assign one named owner to each production Skill. The owner approves revisions, validates dependencies, reviews exceptions, and retires the Skill when the business process changes. This need not be a full-time technical role. In a small business, it may be the person who already owns the underlying process. What matters is that a question about the Skill has an answer more specific than “the AI team handles it.”
Keep a short change record: the prior revision, what changed, the fixtures rerun, the result, the approver, and the rollback path. If a third-party Skill includes executable scripts, review those as code and scope what they can reach. The earlier OpenClaw plugin supply-chain discussion covers why trusted packaging alone is not a runtime permission boundary. The same principle applies to a portable Skill, without treating every package as malicious.
The payoff is not that every coworker produces the same sentence in every app. It is that the business can move a proven procedure and still know which source informed it, which actions it could take, and which person owns the exceptions. A shared format makes that possible to attempt. A release gate makes it credible.
Q: Does the Agent Skills standard guarantee that a Skill works in every AI product? A: No. It standardizes the package and its basic metadata and instructions. Each product may differ in activation, tools, execution environment, and permission enforcement. Test the business outcome in the target environment.
Q: What is the difference between a Skill and an AI coworker's role? A: A Skill is a reusable procedure or domain guide. The coworker's role includes ownership, connected systems, permissions, memory boundaries, escalation rules, and accountability across jobs. One role can use several Skills; one Skill may be used by several roles under different authority.
Q: Should we automatically update a Skill from its source repository? A: Not for consequential business work. Record and review the revision, inspect changed scripts and references, rerun representative tests, then promote it. Automatic intake and automatic production authority are different decisions.
Q: Can we switch models without changing the Skill? A: Often the same package can be loaded, but the outcomes still need testing. Verify selection, tool behavior, source use, denied actions, and exception handling. Keep the business invariants fixed while you evaluate the new model.
Q: What is the minimum test for a small business? A: Choose one normal example, one missing-source example, and one action that must be denied. Confirm the source-backed result, a useful handoff, and an enforced denial in the target environment. Add cases as the cost of a mistake rises.
If you're ready to give your AI coworkers repeatable Skills without handing over the boundaries that make them trustworthy, explore Associates AI Teammates and choose a plan. Build the team on persistent agent servers, with model-agnostic configuration and human review where the work demands it.
Written by
Founder, Associates AI
Mike is a self-taught technologist who has spent his career proving that unconventional thinking produces the most powerful solutions. He built Associates AI on the belief that every business — regardless of size — deserves AI that actually works for them: custom-built, fully managed, and getting smarter over time. When he's not building agent systems, he's finding the outside-of-the-box answer to problems that have existed for generations.
More from the blog
A coworker can start a job with the right permissions and encounter a risky instruction halfway thro...
American Express's new purchase-intent framework makes a useful distinction for small businesses: pe...
A new AgentCore security disclosure puts a practical question in front of every business with multip...
Want to go deeper?
Get started today. Hire your first Teammate in minutes and put it to work on what you're reading about.
Get Started