Skip to content
ReelyzeReelyze
← All guides

Give your AI agent eyes on short-form video: the Reelyze API + skill

How I exposed Reelyze's frame-by-frame engine as an HTTP API and a drop-in Claude/Cursor skill so your agent can audit a Reel and tell you what's wrong with the hook.

Usama Latif
By Usama Latif, Founder of Reelyze
Founder of Reelyze & weiBlocks · builds AI tools for short-form creators 6 min readUpdated June 2026

Reelyze exposes its short-form video engine as a plain HTTP API plus a drop-in agent skill. Give it a public Reel, TikTok, or Short URL and it analyzes the video frame-by-frame (hook, retention, drop-off seconds, verdict and fixes), transcribes, downloads, or generates scripts. One Bearer key, open CORS - it works from Claude, Cursor, or any backend.

Most social analytics tools hand your dashboard a pile of numbers. None of them let your AI agent look at a video and reason about why it underperformed. I wanted Claude and Cursor to be able to take a Reel URL and tell me what's wrong with the hook - so I exposed the engine behind Reelyze as a plain HTTP API and packaged a drop-in agent skill.

Here's how it works and how to wire it into your own agent.

What the API does

Give it a public Instagram Reel, TikTok, or YouTube Short URL and it can:

  • Analyze the video frame-by-frame - hook strength, the first-3-second retention, scene-by-scene signals, and the exact seconds viewers are predicted to drop off, with a verdict and specific fixes.
  • Transcribe the spoken audio.
  • Download a clean MP4, or extract the audio as MP3.
  • Generate a full timed script (hooks, body, CTA, caption, hashtags, shot list) or a batch of content ideas from a topic.

The transcript, download, and audio tools are free and metered (5 calls/day per key), so you can build against them with nothing but an API key. Analyze, script, and ideas are on paid plans.

Auth

One Bearer key (rk_live_...), created in the Reelyze dashboard under API keys. Base URL is https://api.getreelyze.com. CORS is open, so it works from a backend, a browser tool, or any agent.

bash
export REELYZE_API_KEY=rk_live_xxx
export REELYZE_BASE_URL=https://api.getreelyze.com

The video tools are async (submit then poll)

The analysis isn't instant - it pulls frames, OCRs on-screen text, transcribes, and scores retention - so you submit a job and poll for it.

bash
# 1) Submit
curl -s -X POST "$REELYZE_BASE_URL/v1/analyze" \
  -H "Authorization: Bearer $REELYZE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.instagram.com/reel/XXXX/"}'
# -> {"job_id":"abc...","status":"queued","tool":"analyze","poll":"/v1/jobs/abc..."}

# 2) Poll every ~3s until completed
curl -s "$REELYZE_BASE_URL/v1/jobs/abc..." \
  -H "Authorization: Bearer $REELYZE_API_KEY"
# -> {"job_id":"abc...","status":"completed","report_markdown":"# ...full report..."}

The completed analyze job returns report_markdown - verdict, hook assessment, scene-by-scene retention, and the drop-off timestamps. Transcript, download, and audio use the identical submit-then-poll shape; you just read transcript_text or artifact_url instead.

A tiny Node poller:

javascript
async function analyze(url) {
  const base = process.env.REELYZE_BASE_URL, key = process.env.REELYZE_API_KEY;
  const h = { Authorization: `Bearer ${key}`, "Content-Type": "application/json" };
  const { job_id } = await fetch(`${base}/v1/analyze`, {
    method: "POST", headers: h, body: JSON.stringify({ url }),
  }).then(r => r.json());

  for (let i = 0; i < 60; i++) {
    const job = await fetch(`${base}/v1/jobs/${job_id}`, { headers: h }).then(r => r.json());
    if (job.status === "completed") return job.report_markdown;
    if (job.status === "failed") throw new Error(job.error);
    await new Promise(r => setTimeout(r, 3000));
  }
  throw new Error("timed out");
}

The content tools are synchronous

/v1/script and /v1/ideas return the result directly - no polling.

bash
curl -s -X POST "$REELYZE_BASE_URL/v1/script" \
  -H "Authorization: Bearer $REELYZE_API_KEY" -H "Content-Type: application/json" \
  -d '{"topic":"how I edit reels in 10 minutes","duration_seconds":30,"language":"English"}'
# -> {"script":{ "hooks":[...], "script":[{timecode,label,spoken,on_screen}...],
#              "caption":"...", "hashtags":[...], "shot_list":[...] }}

The agent skill (Claude / Cursor)

Instead of writing the poll loop yourself, drop in the skill file. It's a single self-contained SKILL.md (MIT-0) that teaches the agent the endpoints, the async pattern, and how to read the analysis report. Set one env var and the agent does the rest:

bash
REELYZE_API_KEY=rk_live_xxx

Then you just talk to your agent:

text
> audit this reel and tell me why it flopped: <url>
-> Verdict: strong concept, buried payoff.
-> Hook: weak - lost ~62% by 0:03.
-> Drop-off at 0:11: 3s of B-roll with no narration.
-> Fix: cold-open on the result; cut the intro.

Because it's plain HTTP behind a Bearer key with open CORS, the same skill works from Claude, Cursor, a browser tool, or your own backend - no SDK, no install. Grab it from the repo.

Why expose it as a skill, not just an API

The point isn't one call - it's chaining. An agent with this skill can transcribe, analyze, rewrite the hook, then generate the next script in one flow, or compare two reels' hooks, or audit a competitor's winner and then draft your version informed by what the report found. The analysis becomes a step in a workflow instead of a tab you check.

Try it

The free tools (transcript, downloader, audio) work on any key at 5/day - getreelyze.com. Grab a key from the dashboard, or the skill file from the repo.

If you're building creator tooling, I'd genuinely like feedback on two things: does the drop-off timestamp match what you see in your own retention graphs, and what would make the API more useful inside your own agent? Reply here or find me - Usama.

Frequently asked questions

Is the Reelyze API free?
The transcript, download, and audio tools are free and metered at 5 calls per day per key. Analyze, script, and ideas are on paid plans.
How do I authenticate?
One Bearer key (format rk_live_...), created in the Reelyze dashboard under API keys and sent as an Authorization header. The base URL is https://api.getreelyze.com and CORS is open.
Why are the video tools async?
Analysis pulls frames, OCRs on-screen text, transcribes, and scores retention, so it isn't instant. You submit a job and poll GET /v1/jobs/{id} every few seconds until it's completed. The content tools (script, ideas) return synchronously.
Which platforms does it support?
Public Instagram Reels, TikToks, and YouTube Shorts - paste the URL and the same endpoints handle all three.
Do I need an SDK?
No. It's plain HTTP behind a Bearer key with open CORS, so it works from Claude, Cursor, a browser tool, or your own backend. The drop-in SKILL.md handles the poll loop for agents.

Stop guessing why your reels flop.

Reelyze watches your video frame-by-frame and tells you exactly what to fix.

Grab an API key

Want more Reelyze in your Google AI results? Add us as a preferred source - one tap, no signup.

Newsletter

Get the weekly reel teardown.

One short email a week. We break down a viral short-form video frame by frame, the hook, the retention curve, the edit, so you can steal what works.

No spam. Unsubscribe anytime.

Related guides