Sapien logo
Evaluation Benchmarks · Data Labeling

Sapien

Sapien's PoQ (Proof of Quality) is a verification layer for AI work. Teams define a rubric, an independent panel of human experts and AI agents scores against it, and a signed report is sealed on-chain.

Beta GDPR compliant Contact Sales API available 13+ Verified by Guidaio
Overview

What is Sapien?

Sapien builds PoQ (Proof of Quality), described in its documentation as a verification layer for AI work and presented on the site as the trust layer for AI. It answers a narrow problem: when there is no ground truth, quality has to be judged, and a single judgement can be wrong or inconsistent. PoQ turns that judgement into a measured, repeatable and auditable procedure built on three movements, Rubric, Consensus and Record. A project begins as a plain-language brief in a poq.md file, which the engine compiles into an executable specification, poq.toml. Ingestion normalises CSV, JSON, collections of binary files such as .jpg and .pdf, and Markdown into a canonical table where one row is one datapoint. Validators then score those datapoints: human experts, AI agents, or both, routed as first-class peers on the same rubric and the same evidence. Agreement is computed dimension by dimension and weighted, on the median rather than a plain average; consensus strength runs from 0 to 100%, the default threshold is 70%, a zero-weight dimension is kept as advisory, and split panels escalate to experts. Four deliverables come out: a Quality Score, a Consensus Score, a Proof Report and a PoQ Record. The verdict is sealed on-chain, with contracts live on Base Mainnet and published at github.com/sapien-io/sapien-contracts, and the signed report can be checked offline with poq verify. The site advertises four use families, data quality, model outputs, agent behaviour and prompt quality, while the documentation adds labelling and annotation, AI and agent evaluation, expert and audit review, and internal QC. The Company page claims more than three years in AI data quality, over 195 million tasks completed, more than a million contributors and 110+ countries. Leadership leans crypto: CEO Rowan Stone, co-creator of Base and formerly at Coinbase; CSO Trevor Koverko, founder of Polymath and Polymesh; CTO Kelly Ryan; and a Smart Contracts Lead. An ERC-20 utility token, SAPIEN, backs protocol staking, collateral and slashing, but Sapien is explicit that the token plays no role in how customers buy or use PoQ. Access runs through the poq.sapien.io web app, a REST API and an MCP server, with commercial entry by pilot request.

What it does

  • Define a rubric: criteria, weight per dimension and a passing score
  • Submit a batch of AI work for review, from CSV and JSON to PDF or JPG collections and Markdown
  • Assemble a panel from your own experts, or source one through a Sapien partner
  • Let AI agents triage volume and escalate uncertain items to human experts
  • Collect a Quality Score, a Consensus Score, a Proof Report and a PoQ Record
  • Verify a report offline with the poq verify command, without going back to Sapien
  • Drive the whole flow from the REST API or from the MCP server
Audience

When to use Sapien / When not to

A quick filter to help you decide if Sapien is the right fit.

When to use Sapien

  • AI teams working where there is no ground truth and the right answer depends on expert judgment
  • Data and ML teams that need annotation sets or training data verified before fine-tuning
  • Evaluation and MLOps engineers assessing model outputs, agent behaviour and prompt quality at scale
  • Security, audit and regulatory teams whose conclusions must stand up in front of a client or a reviewer
  • Quality and governance leads replacing random spot checks with a documented, repeatable procedure they can show to an auditor

When not to use Sapien

  • Teams whose work has a deterministic answer key: runnable code or a known source can be checked without PoQ
  • Buyers who want immediate self-service access, since the only entry point is a pilot request
  • Projects that must be costed in advance, as no price, free plan or trial is published
  • Organisations whose policies rule out any blockchain component, because attestations are written to Base
  • Consumers and individual users: PoQ is a business product aimed at AI teams
Get started

How to use Sapien

A typical end-to-end flow, from setup to results.

  1. Request a pilot from the website: PoQ is not open self-service, and access is granted case by case
  2. Sign in with your email at poq.sapien.io, then click New Project on the dashboard
  3. Choose the Custom dataset folder option and point it at a folder holding your artefacts plus a poq.md file describing, in plain language, the validations you want
  4. Iterate on the validator preview until the rubric behaves the way you intend
  5. For programmatic use, create an API key at poq.sapien.io/originator/api-keys; the poq_live_ token is shown only once
  6. Check the key with GET /developer/v1/ping, which should answer {"pong": true}
  7. Create the project with POST /developer/v1/projects, passing a name and a JSON spec
  8. Open an upload session declaring each file with its relPath and size, PUT the bytes to the presigned URLs without an authentication header, call process, then poll status until ingestion completes
  9. Manage the panel over the API: validator roster, per-project assignment, validator classes with rewardCents, stakeWei, consensusWeight and model, and email invitations
  10. For agent workflows, point Cursor, Claude Code or VS Code at the stateless MCP server on https://poq.sapien.io/mcp with the same Bearer key, and start with the get_started tool
Quick read

Pros & Cons

Pros

  • The method is explicit and documented, from the median and the weights to the consensus threshold and the escalation rules, so nothing is a black box
  • The output is independently verifiable: poq verify runs offline, the contracts are public and an example report is open to read
  • Dense, concrete technical documentation covering a quickstart, an API reference, the poq.toml specification, examples and an interactive consensus simulator
  • Three consistent access surfaces, web UI, REST API and MCP server, sharing keys, field names and error vocabulary
  • A native mix of human experts and AI agents, which addresses the cost of expert review head-on
  • A claimed operational track record of more than 195 million tasks, over a million contributors and 110+ countries
  • Smart contracts audited by Quantstamp in May 2024, with a further protocol audit reported in June 2026

Cons

  • No published pricing, no free plan and no announced trial: the only path in is a pilot request
  • An early access product with no self-service sign-up, so it cannot be evaluated independently
  • No postal address, no standalone contact page since /contact redirects to the homepage, and no official social profile
  • A privacy notice dated 11 July 2024, a year older than the terms of service of 7 July 2025, still describing a data labelling business rather than PoQ
  • No customer DPA, no named sub-processor list and no certification such as SOC 2 or ISO 27001 on display
  • Nothing published on whether customer data is used to train models or on any opt-out, and no quantified retention period anywhere
  • A structural crypto component with a token, staking and slashing, alongside terms of service that cover the marketing site only and state they create no binding commercial commitment
Pricing

Pricing & Plans

No pricing is published. Across the pages reviewed there is no pricing page, no amount and no currency, and neither a free plan nor a free trial is announced. Access is commercial only, through a Request a pilot or Request Access enquiry leading to a managed pilot, which places the tool in a contact-sales model. The economic figures that do appear in the documentation, namely rewardCents and stakeWei on validator classes, belong to the protocol layer rather than to a customer price list, and Sapien states that the SAPIEN token plays no role in how customers buy or use PoQ. A starting price can therefore only be obtained from the vendor.

Managed pilot on request
  • the only access route published
  • with no named tier
  • no price
  • no stated duration and no included volume
Prices and plans listed above may evolve. Always check the official pricing page before subscribing.
Trust & Privacy

Data, GDPR & hosting

A consolidated view of how Sapien handles your data.

GDPR overview

The GDPR framework is concrete rather than declarative: nowhere does Sapien write that it is GDPR compliant, but the privacy notice is built on named legal bases, namely contract performance, legitimate interest, consent and legal obligation. A Data Protection Officer is reachable at privacy@sapien.io, and an EU representative based in the Netherlands has been appointed, contactable at the same address, though neither is named. Data subject rights are listed in full: access, rectification, erasure, withdrawal of consent, restriction, objection and portability, with a pointer to the EDPB list of supervisory authorities. International transfers to Canada, the EEA and the United States are covered by appropriate safeguards, a copy of which is available on request. Dedicated California (CCPA) and China (PIPL) sections follow. One caveat: the page is dated 11 July 2024, a year older than the terms of service.

Who owns the data?

Sapien positions itself as a processor rather than an owner. Its privacy notice states that it typically acts as a data processor for the personal data customers may occasionally choose to entrust it with, and that it never sells personal information. On the product side, the homepage is explicit that the PoQ record is yours to keep, validators never see your original files (only the datapoints drawn from the canonical table), and the temporary ingestion tables are discarded once the canonical rows remain. One gap deserves attention: the published terms of service cover the marketing website alone and contain no intellectual-property clause on customer data or on the deliverables.

Reuse rights

The terms of service say nothing about reusing data, because they cover the marketing website alone; what is documented sits in the privacy notice. Personal data is used to deliver the service under contract performance, to handle customer support, to run commercial follow-up and marketing, to assess applications to the global annotator network, to secure and optimise the website, to serve personalised advertising under cookie consent, and to meet legal duties such as anti-fraud and anti-money-laundering checks, accounting and audit. Name, email address, IP address and browsing history feed news, offers and ad targeting, with an opt-out available. Data may be shared with service providers (the examples given are Google Workspace, web hosting, payment providers, marketing agencies and IT systems), with advertising networks under consent, with a potential acquirer in a merger or sale, and with authorities. Under CCPA, Sapien declares having disclosed identifiers, customer records, commercial information, network activity, geolocation and inferences over twelve months, and states that it has not sold any personal information in that period. It also states that it makes no decisions about you based only on automated processing.

Data retention & training

Retention summary
Sapien keeps personal data for as long as necessary to achieve the purposes for which it was collected, and may keep it longer to meet legal obligations or defend legal claims. Retention periods are said to be based on business needs, but they are never quantified in the document. When data is no longer needed it is either irreversibly anonymised or securely destroyed, and an erasure right is provided, with other controllers informed where relevant. To obtain the applicable periods the notice tells you to write to privacy@sapien.com, an evident typo since the rest of the document uses privacy@sapien.io. On the product side, temporary ingestion tables are destroyed once the canonical rows remain. Attestations written to Base, by contrast, are permanent and cannot be erased.
GDPR contact

Hosting summary

Sapien's privacy notice states that, as an organisation with a global workforce including its labelling network, it collects, transfers, stores and processes personal data in different jurisdictions, including Canada, the European Economic Area and the United States. The list is explicitly non-exhaustive, so other jurisdictions are not ruled out. For transfers outside a given jurisdiction the company commits to appropriate safeguards and will provide a copy on request at privacy@sapien.io. No hosting provider is named anywhere; web hosting appears only in a generic list of service-provider examples. The marketing site itself is served by Webflow behind Cloudflare on the anycast address 104.18.28.147, which describes the website's infrastructure and says nothing about where customer data lives. One element is public by construction: attestations and sealed verdicts are written to Base, an Ethereum layer-2 chain, and are therefore immutable and openly readable. No customer-selectable hosting region and no data residency guarantee is published.

Hosting countries
🇨🇦 Canada🇺🇸 United States
Hosting regions
European Economic Area
Watch-outs

Things to keep in mind

Risks and trade-offs to weigh before adopting Sapien.

  • You cannot evaluate the product on your own: access is granted only through a pilot request, and the terms of service state explicitly that they create no binding commercial offer, so anything you intend to rely on has to be written into a separate contract
  • The privacy notice is a year behind the terms of service, 11 July 2024 against 7 July 2025, and still describes a data labelling business: have it confirmed in writing before sending any personal data
  • The retention section points to privacy@sapien.com while the rest of the document uses privacy@sapien.io, an obvious typo that could quietly swallow a rights request
  • An EU representative under Article 27 is appointed but never named, so the only way to reach that representative is Sapien's general address
  • No postal address and no contact page: the only public location markers are a Canada-based organisation statement and Ontario law with courts in Toronto
  • There is a crypto layer, with the SAPIEN token, staking, slashing and an ERC-4626 vault. The vault interface is not available in restricted jurisdictions and may require identity verification, without any country being named, and the advertised staking rewards of up to 20% a year, decreasing over time, concern token holders rather than PoQ customers
  • The token is issued by a separate entity, Sapien International Ltd. in the British Virgin Islands, whose parent is the Sapien Foundation in the Cayman Islands: do not confuse it with the product publisher, Sapien AI Corp. In the same spirit, sapien.io has been registered since 2018 while the company describes itself as founded in 2023, so domain age tells you nothing about the publisher's
Setup

Setup & Integrations

Technical difficulty

Moderate, and gated. The interface path is light: create a project in minutes, drop in a folder of artefacts plus a plain-language poq.md file, then iterate on the preview. The API path runs to six steps (Bearer key, project POST with a JSON spec, upload session, PUT to presigned URLs, process call, status polling) and assumes comfort with HTTP. MCP integration takes a few lines in Cursor, Claude Code or VS Code. The harder part is conceptual and organisational: rubrics, weights, consensus thresholds, validator classes, the poq.toml specification, and access to qualified experts or a Sapien partner.

Deployment

Web appAPI

Integrations

Cursor Claude Code VS Code Base
Company

Behind Sapien

Company name
Sapien AI Corp.
Founded
INFORMATION_NOT_FOUND
Country of origin
🇨🇦 Canada
UBO
INFORMATION_NOT_FOUND
UBO country
INFORMATION_NOT_FOUND
Domain registrar country
🇺🇸 United States
Legal contact

Fundraising

Seed round announced on 10 April 2024: USD 5 million, disclosed through a newswire.ca press release rather than on sapien.io
Investors named in that release: Primitive Ventures, Animoca, Artichoke Capital and Yield Guild Games, with James Ho, Head of Animoca Ventures, quoted alongside co-founder Trevor Koverko, who tied the proceeds to hiring, front-end labelling infrastructure and data quality
The Company page carries a Backed by the best banner without naming any investor, and no later round was found
Official links

Resources

All the official URLs gathered for verification and reference.

FAQ

Frequently asked questions

What is PoQ?
PoQ, short for Proof of Quality, is a verification layer for AI work. You define a rubric, an independent panel scores the work against it, and the agreed verdict is sealed as an on-chain attestation accompanied by a signed proof report.
Does PoQ require a ground truth or an answer key?
No. It exists precisely for work where there is no simple answer key and the right answer depends on judgment. A deterministic answer, runnable code or a comparison against a known source can be checked without PoQ.
Who does the scoring?
Human experts, AI agents, or a mix of both. Agents are treated as first-class validators: the same rubric, the same evidence and the same scoring apply to them as to people, and credentials can be verified for specialised work.
How is disagreement between validators resolved?
Scores are aggregated dimension by dimension on the median rather than a plain average, with a weight per dimension. Consensus strength is expressed from 0 to 100%, the default required threshold is 70%, and split panels escalate to experts.
Which data formats can be submitted?
CSV, JSON including nested arrays and dotted keys, collections of binary files such as .jpg and .pdf, and Markdown split by heading. Everything is normalised into a canonical table where one row is one datapoint.
Is there an API?
Yes. A REST API at /developer/v1 with Bearer authentication covers projects, validators, validator classes, invitations and upload sessions, and the same surface is exposed through a stateless MCP server at poq.sapien.io/mcp.
Can a report be verified without Sapien?
Yes. The signed report can be checked offline with poq verify, and the contracts that seal the verdicts are live on Base Mainnet with the source published on GitHub.
How much does it cost?
No price is published anywhere on the site or the documentation. Access goes through a pilot request, and no free plan or free trial is announced.
Do I need the SAPIEN token to buy or use PoQ?
No. Sapien states that the token is protocol infrastructure and plays no role in how customers buy or use PoQ. It is also issued by a separate entity, Sapien International Ltd., not by the product publisher Sapien AI Corp.
Where is data processed, and who publishes the tool?
The privacy notice names Canada, the European Economic Area and the United States, in a list it describes as non-exhaustive. The tool is published by Sapien AI Corp., a Canada-based organisation, with terms governed by Ontario law and courts sitting in Toronto.
Conclusion

Should you pick Sapien?

Sapien's PoQ is a technical, narrowly aimed tool for teams that have to prove the quality of AI work rather than simply assert it. Its central argument is method: the rubric, the weighting, the median-based consensus, the 70% default threshold and the escalation rules are all documented, and the output can be checked independently, since poq verify runs offline, the contracts are public on Base Mainnet and an example report is open to read. Add three consistent surfaces, a web app, a REST API and an MCP server, plus a panel model that mixes human experts with AI agents, and the product holds together for evaluation, annotation review, agent behaviour and internal QC where no answer key exists. Commercial maturity is another matter. Access is early access by pilot request, no price is published, there is no customer DPA, no named sub-processor list and no security certification on display, and the legal documents are unevenly maintained: a privacy notice last updated on 11 July 2024, still describing a data labelling business, against terms of service effective 7 July 2025 that cover the marketing site alone. Nothing is published on whether customer data trains models, and retention periods are never quantified. The on-chain dimension is deliberate and structural, with attestations, staking and slashing, and it deserves to be weighed against your own internal constraints rather than dismissed or celebrated; note too that the token is issued by a separate entity, Sapien International Ltd., not by the publisher Sapien AI Corp. If you need an auditable trail of how a judgement was reached, PoQ is worth a pilot conversation. If you need a priced, self-service, contractually framed service today, it is too early.