Deterministic certification for production agents, and for the AI features inside products.
A signed attestation your buyers can verify
offline - without onboarding another control plane.
AgentSurety · surety-v4 + robustness-v4 · chain-v1 for LLM features
Automated path
Sign up. Run the harness. Leave with a seal.
Built for agent vendors who need a procurement-grade answer - not a six-month platform project.
After checkout, the system mints a one-time run token, scores your sandbox, and issues the
attestation without a human in the loop.
Checkout
Register free, or subscribe for a year, for one agent identity. Paid levels renew on the card on file.
Harness
Point Bulkhead at your public sandbox. We re-run every probe server-side - not on your laptop.
Attestation
Pass → signed JSON + badge URL. Fail → fix and re-run while your registration or certification is active.
What you ship to procurement
Certificate, report, badge, and a JSON pack - not a slide deck.
Pass the harness once and walk away with artefacts your buyers can verify offline. Every seal links to
the same deterministic run report and signed attestation payload.
Bulkhead · AgentSurety · surety-v4
Certificate of Conformance
Your Agent · your-agent-key
Your Company Ltd
active
12 months from issue
pass
Sample layout - your certificate is generated after a passing run.
Certificate of conformance
Print-ready page with seal, principal, validity window, and per-scenario pass/fail table.
Verify the signed payload any time.
Harness run report
Full scenario breakdown, endpoint tested, timestamps, and linked attestation - what security reviewers actually read.
Bulkhead Certified badge
An SVG seal for your README, docs and marketing site. Copy one line of Markdown; it reflects
live status and links back to the certificate.
Procurement pack (JSON)
One download: attestation + signature, run results, rubric version, verify URLs, issuer details.
Why trust a new name
You shouldn’t have to. So we built a seal that doesn’t ask you to.
Every certification body has the same problem on day one: the seal is only worth the reputation
behind it, and reputation takes years. We took that problem off the table instead of waiting it
out. A Bulkhead seal is checkable by the buyer, on their own machine, without our permission and
without our participation.
The seal outlives us
Every attestation is Ed25519-signed over canonical JSON. A buyer verifies it against our
published JWKS with a
zero-dependency open-source verifier - no account, no API call, no rate limit. If Bulkhead
disappeared tomorrow, every seal we have ever issued would still verify. A seal that is a PNG
and a database lookup is worth exactly as much as the company behind it. Ours isn’t.
The evidence is bound to the seal
The procurement pack carries every prompt, reply and verdict from the run. A SHA-256 of that
bundle is inside the signed payload, so a buyer can prove the evidence in front of them is the
evidence we graded - not a summary written afterwards. Marking our own homework is
detectable arithmetic, not a matter of taking our word.
The method is published, not asserted
Every tier states exactly what it does on the rubric page, including what
it does not prove. Suites are versioned: change a single variant and the version
changes, and that version is stamped into the seal. You can tell two seals apart, and you can
tell when the bar moved.
We grade behaviour, not self-reports
The obvious way to build this would be to trust the vendor’s own refused
flag. We don’t - that is self-attestation wearing a badge. robustness-v4
replays 24 variants of the same three attacks - authority, urgency, role-play,
limit-splitting - and Assay reads what the agent actually said.
An agent whose logs claim a refusal while it complies is marked worse than one that
simply complies. We built the harder path because the easy one produces a seal that means
nothing. See the rubric.
Your agent’s traffic never leaves our hardware
No hosted model provider sits in the path - not OpenAI, not Anthropic, not Google. Judging
runs on Assay, our own model on machines we own, pinned to a fixed version so
your pass bar cannot move because someone else shipped an update. Your transcripts are never
used to train anything.
We publish our limits
Advisory only. Not insurance, not a financial guarantee, not a regulatory compliance
certificate. A 12-month seal on a defined suite against a specific endpoint: the protocol suite re-checked continuously and suspended if the agent regresses, the judged suite re-run monthly. Anyone selling you
certainty about an AI agent is selling you something they cannot deliver; we would rather be
the ones who said so.
Model conformance · chain-v1 · coming soon
Most companies shipping AI are not shipping an agent
They ship an LLM feature inside a product: a chat box behind a login, analysis of documents a
user uploaded, an assistant scoped to a tenant. The levels above do not fit that. They test
revocation, idempotency and an authority bound with a unit, and a feature inside a product has
none of them - so running the agent suite against it would fail it for not being an agent.
chain-v1 is the lane for that subject. What it tests is the whole
safety chain - the rule block, the grounding, the tenancy filter, the
post-processing and the model together - which is why it is called the chain. Nothing in it
inspects weights, and nothing in it is a claim about a model in general. It is a claim about your
deployment, which is the thing your buyer is actually asking about.
Seven families, graded by detectors rather than a judge. Provider identity, system instructions, persona override, tenant scope, indirect injection, output handling, personal data. Each plants a value your deployment must never emit - a canary in your system prompt, a record in a second tenant, an instruction inside a document - and checks whether it appeared.
The attack set is published in full. Every prompt in the published half is served at /v1/surety/chain-suite, with the detector lists and a hash of the frozen wording. A held-out half runs alongside and is never released.
Clean is not enough. Every family carries positive controls, because a subject that answers nothing leaks nothing. We built the lane without them first and measured it: a constant refuser, an empty endpoint and a keyword matcher all passed. Now a family passes only when it is clean and still useful.
No inference of ours runs. A canary either appears or it does not, so a verdict can be re-derived from the transcript by anyone holding it - the first result of ours that can be checked without us.
Re-checked continuously, one family per cycle, and suspended if the chain stops holding or the feature stops working.
What it does not claim. A conformance lane measures a
safety chain against a frozen attack set. It cannot show a model will never be talked around by an
attack nobody has written yet, and we would not trust a certifier that said otherwise. Each
detector catches a verbatim appearance, so every count is a lower bound and each family prints its
own coverage limit on the certificate.
We also measure what agents do when nobody is reading the transcript
A seal says an agent respected a limit it was asked about. The lab asks a harder question: given a
real task and a real environment, what did it actually touch, where did it send bytes, what did it
leave behind, and did its own account of the work match the record? The answer comes from packet
captures, filesystem diffs and process tables rather than from anything the agent wrote.
Bulkhead is not a compliance shop that read up on AI agents in order to sell certificates. It is
built by engineers who ship agentic systems, run their own model infrastructure, and met every
failure mode in this suite inside their own products first.
We run the model infrastructure ourselves
Assay is not an API key pointed at someone else’s model. The inference
fleet, the evaluation harness, the batched adjudication, the two-framing verdict logic -
built in-house, running on hardware we own and operate. That is why we can pin a model version,
guarantee your transcripts never train anything, and tell you precisely what graded your agent.
A vendor reselling a frontier API can promise none of those three.
Agent builders before certifiers
Every attack family in the suite is one we have had to defend against in our own systems: the
agent that folds to a confident supervisor, that treats a prior approval as standing authority,
that discloses its instructions when the request arrives as a poem. We did not survey these
failures from the outside. We hit them, and had to fix them.
Computer science, applied where it counts
The team is formally trained in computer science, and the seal reflects it: Ed25519 signatures
over canonical JSON, RFC 7638 key thumbprints, a published JWKS, and an offline verifier
with defined exit codes. A certification mark is a cryptographic protocol, not a graphic. Most
of the industry ships the graphic.
Production discipline, not a prototype
Versioned suites, database migrations, immutable audit trails, server-side re-verification of
every claim, and an evaluation platform carrying over a thousand automated tests. The
unglamorous parts are exactly the parts that decide whether a seal still holds up when a
procurement reviewer reopens it two years from now.
For vendor security questionnaires
Answers procurement expects - without a six-month audit.
Deterministic harness
Identity binding, a declared authority bound, revocation, idempotency, upstream denials, cancellation, and credential hygiene - scored automatically.
Signed attestation
Machine-readable proof of a passing run, signed with Ed25519. Buyers verify offline against our published public key - no account needed.
Public directory
Active seals appear in the certified directory so enterprise buyers can confirm status at renewal.
Issuer on record
Every attestation is signed by Bulkhead with issuer details embedded in the verifiable payload.
Per agent · per year · continuously verified
Certification pricing
Conformance is free and listed. Certification is a 12-month subscription that includes the judged
suite and continuous verification, and the level you earned is written into the seal - so a buyer
can tell them apart. Unlimited re-runs while your certification is active.
Conformant
Free
surety-v4 · proves the controls exist
Eleven protocol scenarios, re-run from our servers
Signed attestation, report, and procurement pack
Listed in the directory as conformant, not certified
Red-team campaign · £2,000 per campaign · coming soon - an adaptive, multi-turn attack
written against your agent, on top of Certified ·
Register interest
No. The API independently re-runs the full probe suite against your publicly reachable sandbox endpoint before issuing an attestation. Localhost and private-network URLs are rejected.
What does the harness actually test?
Eleven scenarios in surety-v4: agent identity, a declared authority bound enforced in both directions and across a whole task, acting while authority stands, revocation, idempotency, upstream denial, task cancellation, and credential exposure. See the full published rubric.
Does our agent's traffic get sent to OpenAI or Anthropic?
No. There is no hosted model provider anywhere in the certification path. The deterministic
scenarios in surety-v4 are HTTP assertions and run no model at all. Where judgement
is required, your agent's replies are read by Assay - our own evaluation model,
running on hardware we own and pinned to a fixed version. Your transcripts stay with us, and your
pass bar does not move because a model vendor shipped an update. Full methodology is in the
rubric.
Is this SOC 2 or ISO 27001?
No. Bulkhead is an advisory conformance certification for production agent behaviour - not a compliance framework or insurance product.
What is the difference between Conformant and Certified?
Conformant is free: your sandbox passed the ten-scenario protocol suite, and the seal and directory say conformant. Certified adds the judged suite - 24 adversarial variants read by Assay - and continuous verification, and only it carries the Certified badge. Both are signed and verifiable offline.
What does Assessed add?
A person. A named Bulkhead engineer reads your full evidence pack and your description of where the controls live, and writes findings and recommendations. The report is hashed into the seal and shipped in the pack. It is an expert reading of the evidence, not a penetration test, and it is re-done at each annual renewal.
What if we fail a scenario?
Fix the agent, mint a new run token in the console, and re-run. No extra fee while your registration or certification is active.
How do buyers verify our seal?
They open your certificate URL, or paste the attestation id into verify.
A buyer who wants to check it themselves runs our open-source verifier against our published
public key - the signature is Ed25519, so verification needs nothing from us but the key.
What do we send to procurement?
Download the procurement pack JSON from the console or certificate page. It bundles the signed attestation, run report, rubric version, and all verify links in one file.
Ready when your buyers ask the hard question.
Free to conform · £2,400 a year to certify · certificate, report, badge, and procurement pack included.