Agent-mediated services · evidence review

Who already built this

Four platforms were checked against their own live data, plus two Reddit corpora and a peer-reviewed detection study. Every core primitive already exists. The demand does not.

0.8%RentAHuman bounty fill rate across 303 bounties
35 / 37"Completed" bounties that released no payment
0Requesters found saying they replaced crowd work with an LLM
33–46%Crowd summaries produced with an LLM, undisclosed
$2Price of an automated design review, no human involved
10 AugDate the incumbent shipped the agent interface

The finding

What a day of primary research actually settled

Supply is easy, discovery is easy, and the primitives were built by one person over a weekend. The one thing nobody has demonstrated is a completed, paid, non-fraudulent transaction where an agent bought work.

Three separate lines of evidence converge on the same gap. RentAHuman proved agents can find a marketplace and post to it, and that almost nothing completes. Upwork proved the incumbent will ship the agent interface itself, free, before an intermediary arrives. And the Reddit corpora proved that buyers complain loudly about trust and matching while never once being observed to pay for a fix.

That is not a reason to stop. It is a reason to stop building and go sell one thing.


Occupied territory

What is already shipped, by whom, and what it costs

Upwork MCP 10 Aug 2026

mcp.upwork.com · OAuth 2.1 · free

Hire or get hired from inside Claude, ChatGPT, Cursor or Codex. Post jobs, search talent, draft offers, submit proposals, manage contracts. Three roles, full lifecycle.

Money stays on Upwork. Funding escrow, accepting an offer and paying a milestone all complete on the website. The agent negotiates; the human pays.

It is free because they monetise the transaction underneath. A third-party layer would have to charge for what they give away.

RentAHuman 2 Feb 2026

Weekend build · Next.js, Firebase, MCP

Agents hire humans for physical tasks. Its API already carries wallet spend controls, escrow, delivery confirmation, disputes, identity switching, and paid "taste" and QA runs.

Every primitive on a v1 requirements list already exists here. The build was never the hard part.

A quarter of live bounties are the operator testing its own product. The top listing is its own payout test.

Tastelint 18 Aug 2026

$40/month · 25 reviews · $2 after

Reads the screenshots on a pull request and returns what looks off, why, and what to change. A Gumroad product.

Fully automated, no human in the loop. Which sets the floor: a human-signed design review has to justify a premium over two dollars, not over nothing.

Mechanical Turk closed 30 Jul 2026

Closed to new customers · existing customers told to leave

The banner now reads: we recommend existing customers migrate to a third-party solution. SageMaker Ground Truth, the supposed destination, is also closed to new customers.

Fees were 20% plus a further 20% at ten or more assignments. Quality was worse than the fees.


What the market says it wants

Two Reddit corpora, eighteen months, buyers and sellers separated

The same three asks appear on both platforms, unprompted, from people with no product to sell. They map almost exactly onto a trust layer.

no way to figure out who is really five star r/Fiverr · buyer · Feb 2026
match the skills with the jobs much more intelligently r/Upwork · client, $250k lifetime spend · Aug 2026

And once, in r/agency, the product specification arrives as a complaint. The thread asks why no alternative exists for quality work, and names the ingredients: vetted pros, real budgets, Stripe escrow, auto contracts.

Confirmed on both platforms

Falsified on both platforms

The assumption that an agent's value is writing the brief. Nobody complains about struggling to describe what they want. Two independent samples, same result. What they complain about is the volume of exchange afterwards: a hundred applications, seventy percent unqualified, thirty interviews to land one hire.

The job is not authoring the first message. It is collapsing the number of messages.

Method and verification

Two Reddit sweeps run through a separate research agent with browser access, weighted to the last eighteen months, with clients and freelancers kept strictly separate because their complaints are near-opposite.

Sourcing was then spot-checked by hand: seven cited threads opened on old.reddit.com, titles compared against the citations, and each attributed quote string searched for in the page it was attributed to. All seven existed; every quote checked was present. One caveat carried forward from the research itself: commenters accused the $250k-spend client post of being written by an AI. The thread is real; that does not validate its author.


The crowd-work collapse

Mechanical Turk closed, and the reason matters more than the closure

A dedicated sweep looked for requesters who had migrated, or who were shopping for a replacement. The useful result was an absence. Requester-side discussion after the shutdown is thin, because migration had largely finished before the announcement arrived.

DestinationMentionsRequester evidenceWhat people say
Prolific13MediumThe default replacement. Better screening, journal-legitimate, more expensive.
CloudResearch Connect12HighStrongest positive migration signal. US-only pool is the catch.
Data-labelling vendors7MediumWanted self-serve; got a quoting and proposal process instead.
Upwork1HighUsed as a workaround by one former requester, who called it a headache.
An LLM0None foundNot one requester said they replaced crowd workers with a model.

That last row is the one worth sitting with. The AI story here is not requesters happily swapping humans for models. It is AI as contamination: requesters fleeing to better-screened human pools because they can no longer tell whether a response came from a person.

about 80 Participants out of 1,000 that one academic judged authentic · r/AcademicPsychology · 2025

What the displaced buyers still cannot get


The disclosure gap

A 2023 EPFL study, and what it licenses you to build

Researchers reran a summarisation task on Mechanical Turk and estimated, through a task-specific classifier validated against keystroke logs, that 33 to 46 percent of submissions were produced with a language model. Workers were paid a dollar a summary. Nobody disclosed anything.

The detection result is the part that changes a design decision. General-purpose detectors failed the same material badly: GPTZero caught six of ten summaries the authors had generated themselves, and OpenAI's own classifier is cited at 26 percent. A classifier trained on that one task hit 97 to 99 percent.

General detection does not work. Narrow, task-specific detection with known-human samples works very well. Which means a no-AI guarantee is sellable only per-task, never as a universal claim.

Better still, the validation method is itself the product: log keystrokes and paste events, then measure overlap between the delivered text and the source the worker was given. Low overlap plus heavy pasting is the signal. That is provenance rather than detection, and it is cheap to build.

Scope of the study

Artificial Artificial Artificial Intelligence, Veselovsky, Horta Ribeiro and West, EPFL, June 2023. Forty-six summaries from forty-four workers, one task, one week, on a preprint that labels itself work in progress. The authors say generalisation to less model-friendly tasks is unclear, and call the result a canary rather than a measurement. Treat it as directionally important and statistically thin.


Verdicts

Every candidate service, scored against buyer type, verifiable delivery, and whether supply can be found at ten sellers

ServiceVerdictReasoning
Reddit research reportFirstThe only candidate where the founder is the supply. Cold start disappears.
3D printingSecondPhysical delivery is the least disputable proof there is. Print APIs already exist to sit behind it.
Design or UX review, signedShipsMust clear a two-dollar automated floor. The signature is the premium.
Ghost writing from samplesShipsExisting tooling, existing voice model, immediate first seller.
Licensed expertise, CPA firstDifferent companyStrongest standalone product, but the buyer is a person, not an agent.
Surveys, app testing, taste panelsCurated onlyOpen listings put you in the 0.8% fill rate. Run the panel yourself or not at all.
Dating profiles, photo ranking, styleCutNo credential behind taste. Photofeeler has held this for a decade.
Reddit posting and commentsCutPlatform terms and the FTC's fake-review rule, at $51,744 per violation.
Model routingCutA proxy call is not a product. No hidden implementation, no margin, already won.
Reselling API accessCutNamed prohibition. Service bureau clauses exist precisely for this.

The survivors cluster in one place: judgment and production with a name attached, plus physical action. Not taste panels, not access resale, not micro-labour.


The exposure nobody prices correctly

Why a single tolerated listing is a company-level event

A marketplace has one payment account, and every listing shares it. Seller risk is concentrated, not diversified. The realistic failure is not a lawsuit; it is a termination that reports the merchant to MATCH, the card-network file that runs five years and that most acquirers decline on sight. That is the ability to take card payments at all, for any venture, gone until 2031.

Against that: a scraping listing earns a few hundred a month. The asymmetry settles it without needing a probability.

The precedents are recent and name intermediaries specifically. Reddit sued Perplexity together with three data-scraping suppliers in October 2025. In hiQ, scraping public data was found not to be a computer crime and still cost the company a $500,000 judgment, a permanent injunction and the deletion of everything it had gathered. And a platform that ships a demographic targeting control becomes the defendant, which is what the Facebook advertising settlement established.

How enforcement actually arrives

Slowly, then all at once. RentAHuman has advertised paid five-star reviews on its homepage since February and is still processing on Stripe six months later, so nobody is proactively scanning listings. But it has also quietly updated its acceptable use policy, added a caveat to its API's population figures, and referenced stablecoin rails alongside the card rails. A marketplace building crypto payouts next to Stripe is preparing for the day Stripe leaves.

The trigger is a complaint from the platform being harmed, or a chargeback spike. So the defence is a takedown path and a listing policy that exists before the first letter, not a scanner that is not looking.


What is still unproven

The questions no amount of further reading will answer

Each of these is settled by one transaction, not by more research. Sell one report, at a real price, to someone who is not a friend.