DEV Community

Jeffrey Turov
Jeffrey Turov

Posted on

I made 19 Apify Actor examples readable by humans and AI agents

A useful API is not enough if people and agents cannot evaluate it safely before running it.

That was the problem I worked on across my 15 public Apify Actors. The tools already had input schemas, README files and pay-per-event pricing. But evaluation still required too much interpretation: which input should I use, what will the output look like, and is this example a real measurement or a technical test?

I now have 19 public Actor task examples. Each one has two surfaces:

  • an HTML page for humans;
  • a Markdown page that agents can read without parsing the full application.

You can browse them from the toolbox:
https://adagasolutions.lu/toolbox/#examples

What a useful public example contains

A good example is not just a saved run with a catchy title. I use this checklist:

  1. A specific user intent, such as monitoring website AI-readiness changes.
  2. A small, valid input built from the Actor's current input schema.
  3. A successful run with a non-empty dataset.
  4. A dataset view containing the fields the reader actually needs.
  5. A title and description that match the output.
  6. A clear dry-run label when the data is only a technical sample.

The last point matters for my AI Brand Visibility Tracker. Its public example does not pretend to measure a real brand. It proves the workflow without calling an AI provider or charging measurement events.

Here is the example:
https://apify.com/travelmonitorlab/ai-brand-visibility-tracker/examples/preview-ai-brand-visibility-measurement

And its Markdown version:
https://apify.com/travelmonitorlab/ai-brand-visibility-tracker/examples/preview-ai-brand-visibility-measurement.md

Why Markdown changes evaluation

An agent can read the example, inspect the input and output, then decide whether the Actor fits the requested workflow. This is more useful than asking it to infer everything from a marketing description.

It also makes the limitations visible. For example, a brand-visibility result belongs to one model, one prompt set and one run date. It is evidence to compare over time, not a universal ranking.

Reliability is still a separate metric

At the time of writing, the public 30-day counters across the 15 Actors show 351 successful runs out of 353. These counters include my own tests and Apify QA. They are useful for reliability monitoring, but they are not customer counts and not proof of recurring adoption.

I track public examples, run outcomes, Store rankings and reviews separately. Combining them into one vanity metric would hide the real bottleneck.

What I am testing next

The technical surface is now complete: 15 public Actors, 19 public examples and a 15-tool MCP facade. The next question is simpler and harder: do these examples help a new user complete a first useful workflow without assistance?

If you try one, send me the point where you hesitate. That is the part I want to fix.

Top comments (4)

Collapse
 
kevinhall profile image
Kevin Hall •

the dry run label is the detail I like, most examples quietly hide that the data is only a sample. I put out a page of saved inputs for my own Actors recently and the part I cared about most was sizing a run for free first, so an agent sees the cost shape before it pays. Do your examples say which runs are free

Collapse
 
jeffreyturov profile image
Jeffrey Turov •

Not consistently yet. Reading any of the 19 examples is free, but replaying the underlying Actor can still trigger its normal pay-per-event charges. Only the AI Brand Visibility Tracker preview currently makes the no-charge case explicit: it is a dry run, calls no AI provider, and charges no measurement events.

The other examples do not yet carry a uniform free/paid label or replay-cost estimate. So an agent can inspect the saved output for free, but it should not infer that re-running it is free. Your saved-input approach captures the right distinction: show the input and estimated event cost before execution, and state dry-run/no-charge separately.

Some comments may only be visible to logged-in visitors. Sign in to view all comments.