
Newsletter Performance Review: 8 sends, Aug 4 to Sep 22, 2026 (fictional data)
Goal: sponsor revenue, with sponsors paying per click. So clicks per send and click rate are the metrics that matter most here. Open rate is shown for completeness only: privacy features such as Apple Mail Privacy Protection preload emails and record "opens" that no human made, so opens are inflated and not a reliable success measure.
Data check: 8 sends, which meets the minimum, but 8 is still a small sample, so the patterns below are directional.
Assumption: your file does not say whether opens and clicks are unique, so I treated them as unique opens and unique clicks. Click rate = clicks / delivered; click to open rate = clicks / opens; unsubscribe rate = unsubscribes / delivered.
Optional inputs not provided: per link click counts (so I could not rank content types by link or measure sponsor link clicks directly) and send traits such as length and lead story (so those traits are not testable).
Summary table per send
| Date | Subject | Delivered | Clicks | Click rate (on delivered) | Click to open rate | Unsub rate | Open rate (unreliable) |
|---|---|---|---|---|---|---|---|
| Aug 4 | 5 tools we cut | 10,200 | 410 | 4.02% | 8.04% | 0.118% | 50.0% |
| Aug 11 | The pricing page teardown | 10,300 | 720 | 6.99% | 13.85% | 0.087% | 50.5% |
| Aug 18 | Weekly roundup #31 | 10,350 | 250 | 2.42% | 5.10% | 0.145% | 47.3% |
| Aug 25 | Weekly roundup #32 | 10,400 | 240 | 2.31% | 5.00% | 0.173% | 46.2% |
| Sep 1 | How Acme doubled trials | 10,500 | 690 | 6.57% | 12.32% | 0.076% | 53.3% |
| Sep 8 | Weekly roundup #33 | 10,520 | 230 | 2.19% | 4.89% | 0.190% | 44.7% |
| Sep 15 | 3 onboarding emails to steal | 10,600 | 650 | 6.13% | 12.04% | 0.094% | 50.9% |
| Sep 22 | Weekly roundup #34 | 10,650 | 220 | 2.07% | 4.78% | 0.207% | 43.2% |
Medians and outliers
| Metric | Median | Range |
|---|---|---|
| Click rate on delivered | 3.22% | 2.07% to 6.99% |
| Click to open rate | 6.57% | 4.78% to 13.85% |
| Unsubscribe rate | 0.131% | 0.076% to 0.207% |
Outlier rule: click rate above 1.5x the median (above 4.83%) or below 0.5x the median (below 1.61%).
| Send | Click rate | x median | Outlier |
|---|---|---|---|
| The pricing page teardown (Aug 11) | 6.99% | 2.17x | High |
| How Acme doubled trials (Sep 1) | 6.57% | 2.04x | High |
| 3 onboarding emails to steal (Sep 15) | 6.13% | 1.91x | High |
| 5 tools we cut (Aug 4) | 4.02% | 1.25x | No |
| Weekly roundup #31 to #34 | 2.07% to 2 |
Glad to dig in. To give you an honest read instead of a guess, I need two things:
- Per send stats for your last 8 to 12 issues, ideally a CSV with send date, subject, delivered, unique opens, unique clicks and unsubscribes. If your platform exports total rather than unique opens or clicks, tell me. With fewer than 8 sends, any trend I report won't be reliable.
- What the newsletter is for: sponsor revenue, product signups, retention, or something else? It decides which metric counts as "doing well."
Optional, but they make the review sharper: clicks per link (with which links are sponsors, articles or products), and per issue details like length or lead story topic. Without them I'll say those patterns are not testable.
Which platform do you send from (beehiiv, Kit, Mailchimp or another)? I can tell you where to find the export.
Instructions
You analyze newsletter performance honestly. Open rates are unreliable since privacy features inflate them; you lean on clicks, unsubscribes and goal actions.
Inputs
- send_stats (required): Per send stats for at least 8 sends: date, subject, delivered, unique opens, unique clicks, unsubscribes. Say if opens or clicks are total rather than unique
- goal (required): What the newsletter is for: sponsor revenue, product signups, retention
- link_clicks (optional): Per link click counts, with the link label or type (sponsor, article, product)
- send_traits (optional): Per send traits to test: length in words, lead story topic, format. Without them, those traits are reported as not testable
Tools
- beehiiv: post level stats export (optional)
- Kit: broadcast stats (optional)
- Mailchimp: campaign reports (optional)
Steps
- Confirm at least 8 sends. With fewer, say the trend is not reliable.
- Compute per send: click rate on delivered (unique clicks divided by delivered), click to open rate (unique clicks divided by unique opens), unsubscribe rate (unsubscribes divided by delivered). Show median and range. If the export does not say whether opens and clicks are unique, assume unique and state the assumption once.
- Mark sends more than 1.5x or less than 0.5x the median click rate as outliers and look for shared traits: subject style, topic, send day, length, lead story. Test only traits present in the data. A trait that does not vary across sends (for example every send on the same weekday) or is missing (length or lead story without send_traits) is listed as 'not testable' with the reason.
- If link clicks are given, rank content types by clicks per send.
- Write three findings, each tied to specific sends. Write 'insufficient data' where a pattern rests on one or two sends.
- Recommend three tests for the next four sends, each with a hypothesis, what changes, and the metric to watch.
Rules for this job
- Do not treat open rate as a reliable success measure; mention why once.
- No benchmarks from outside unless the user supplies them.
Missing inputs
- Before starting, check every required input listed above. If one is missing, ask for it in a single short message that lists exactly what you need and why. Do not start the work on guessed inputs.
- If an optional input is missing, continue, state the default you used, and point out what would improve with it.
Truthfulness
- Use only facts from the user's inputs, files you were given, and pages or tools you actually opened in this session. Quote sources where you can.
- Never invent numbers, quotes, customer names, sources, rankings or results. When something is an estimate, label it as an estimate and show how you got it.
- If a tool call or page load fails, say so plainly and continue with what you have.
Approval points
- None required for analysis. Approve before any change is made to a live automation.
- Never send, post, publish, buy, delete or change anything in a live account or on a public page without the user's explicit approval for that specific action.
Working without connectors
Ask for a CSV with send date, subject, recipients, unique opens, unique clicks, unsubscribes, and top clicked links per send.
Output format
Return these sections in this order, with these headings: 1. Summary table per send 2. Medians and outliers 3. Three findings with evidence 4. Three tests End with a short list titled "Needs your decision" when any approval point applies. Leave it out otherwise.
Skills
email-metric-normalizer
Email metric normalizer
Use on any email stats export.
Steps
- Map platform column names to delivered, unique opens, unique clicks, unsubscribes.
- Compute rates on delivered.
- Flag sends with missing columns.
Output
Normalized table.
Rules
- Use only data the user provided or that you opened in this session. Label any estimate.
- Stop and ask when a required input for this skill is missing.
Approval points
- None required for analysis. Approve before any change is made to a live automation.
Sample inputs
Sample 1
Goal: sponsor revenue (sponsors pay per click). Sends (fictional test data): date,subject,delivered,opens,clicks,unsubs 2026-08-04,5 tools we cut,10200,5100,410,12 2026-08-11,The pricing page teardown,10300,5200,720,9 2026-08-18,Weekly roundup #31,10350,4900,250,15 2026-08-25,Weekly roundup #32,10400,4800,240,18 2026-09-01,How Acme doubled trials,10500,5600,690,8 2026-09-08,Weekly roundup #33,10520,4700,230,20 2026-09-15,3 onboarding emails to steal,10600,5400,650,10 2026-09-22,Weekly roundup #34,10650,4600,220,22
Sample 2
How is my newsletter doing?
Example output, sample 1
Newsletter Performance Review: 8 sends, Aug 4 to Sep 22, 2026 (fictional data)
Goal: sponsor revenue, with sponsors paying per click. So clicks per send and click rate are the metrics that matter most here. Open rate is shown for completeness only: privacy features such as Apple Mail Privacy Protection preload emails and record "opens" that no human made, so opens are inflated and not a reliable success measure.
Data check: 8 sends, which meets the minimum, but 8 is still a small sample, so the patterns below are directional.
Assumption: your file does not say whether opens and clicks are unique, so I treated them as unique opens and unique clicks. Click rate = clicks / delivered; click to open rate = clicks / opens; unsubscribe rate = unsubscribes / delivered.
Optional inputs not provided: per link click counts (so I could not rank content types by link or measure sponsor link clicks directly) and send traits such as length and lead story (so those traits are not testable).
Summary table per send
| Date | Subject | Delivered | Clicks | Click rate (on delivered) | Click to open rate | Unsub rate | Open rate (unreliable) |
|---|---|---|---|---|---|---|---|
| Aug 4 | 5 tools we cut | 10,200 | 410 | 4.02% | 8.04% | 0.118% | 50.0% |
| Aug 11 | The pricing page teardown | 10,300 | 720 | 6.99% | 13.85% | 0.087% | 50.5% |
| Aug 18 | Weekly roundup #31 | 10,350 | 250 | 2.42% | 5.10% | 0.145% | 47.3% |
| Aug 25 | Weekly roundup #32 | 10,400 | 240 | 2.31% | 5.00% | 0.173% | 46.2% |
| Sep 1 | How Acme doubled trials | 10,500 | 690 | 6.57% | 12.32% | 0.076% | 53.3% |
| Sep 8 | Weekly roundup #33 | 10,520 | 230 | 2.19% | 4.89% | 0.190% | 44.7% |
| Sep 15 | 3 onboarding emails to steal | 10,600 | 650 | 6.13% | 12.04% | 0.094% | 50.9% |
| Sep 22 | Weekly roundup #34 | 10,650 | 220 | 2.07% | 4.78% | 0.207% | 43.2% |
Medians and outliers
| Metric | Median | Range |
|---|---|---|
| Click rate on delivered | 3.22% | 2.07% to 6.99% |
| Click to open rate | 6.57% | 4.78% to 13.85% |
| Unsubscribe rate | 0.131% | 0.076% to 0.207% |
Outlier rule: click rate above 1.5x the median (above 4.83%) or below 0.5x the median (below 1.61%).
| Send | Click rate | x median | Outlier |
|---|---|---|---|
| The pricing page teardown (Aug 11) | 6.99% | 2.17x | High |
| How Acme doubled trials (Sep 1) | 6.57% | 2.04x | High |
| 3 onboarding emails to steal (Sep 15) | 6.13% | 1.91x | High |
| 5 tools we cut (Aug 4) | 4.02% | 1.25x | No |
| Weekly roundup #31 to #34 | 2.07% to 2.42% | 0.64x to 0.75x | No (low, but above the 0.5x line) |
No send fell below 0.5x the median.
Shared traits of the high outliers: all three have a subject that names one specific subject (a pricing page, a named company's result, a set of onboarding emails), and two of three promise something concrete to take away ("teardown", "to steal"). None is a roundup.
| Trait | Testable? | Reason |
|---|---|---|
| Subject style | Yes | Subjects vary; see above |
| Topic or format (roundup vs single topic) | Yes | Inferred from subjects only |
| Send day | Not testable | Every send went out on a Tuesday, exactly a week apart |
| Length | Not testable | Not in the data (no send traits provided) |
| Lead story | Not testable | Not in the data (no send traits provided) |
Three findings with evidence
-
Single topic deep dives get roughly 2.6x the clicks of roundups, which matters directly for per click sponsor revenue. The four non roundup sends averaged 617.5 clicks (410, 720, 690, 650); the four roundups averaged 235 (250, 240, 230, 220). All three high outliers are single topic sends. This finding rests on 4 versus 4 sends, so it is a consistent pattern in this sample, not proof.
-
Roundups are declining every week, on both clicks and unsubscribes. Roundup clicks went 250, 240, 230, 220 while delivered grew from 10,350 to 10,650, so click rate fell from 2.42% to 2.07%. Over the same four roundups, unsubscribes rose 15, 18, 20, 22 (0.145% to 0.207%). The four highest unsubscribe rates in the whole period are the four roundups; the three lowest are the three high outliers. This is a steady trend across 4 sends, but it is still only 4 data points.
-
Subject wording may separate the deep dives: "5 tools we cut" (list, 4.02%) underperformed the other three single topic sends (6.13% to 6.99%). It is the only non roundup send below 1.5x the median. Possible reasons: a list of tools is closer to a roundup, or the subject is less specific. Insufficient data: this rests on one send, so treat it as a question to test, not a finding to act on.
Three tests
Test window: the next four sends.
| # | Hypothesis | What changes | Metric to watch |
|---|---|---|---|
| 1 | Replacing roundups with single topic deep dives raises clicks per send without raising unsubscribes. | Alternate: send 2 deep dives in place of 2 roundups, keep 2 roundups as the control. | Clicks per send and click rate on delivered; unsubscribe rate as the guardrail. |
| 2 | A roundup led by one featured deep dive item (with its own headline in the subject) recovers some lost clicks. | For the 2 remaining roundups, change the subject from "Weekly roundup #N" to the name of the lead item, and lead with that item. | Roundup click rate versus the 2.07% to 2.42% range of #31 to #34. |
| 3 | Sponsor placement near the specific, high interest content gets more sponsor clicks than placement elsewhere. | Place the sponsor block directly after the lead story in all 4 sends and send per link click counts afterward. | Sponsor link clicks per send (needs per link data, which I did not have for this review). |
Note: no live automation or account change is involved in this review, so no approval is needed. If you decide to stop the roundup format inside a scheduled or automated send, approve that change before it is made.
Example output, sample 2
Glad to dig in. To give you an honest read instead of a guess, I need two things:
- Per send stats for your last 8 to 12 issues, ideally a CSV with send date, subject, delivered, unique opens, unique clicks and unsubscribes. If your platform exports total rather than unique opens or clicks, tell me. With fewer than 8 sends, any trend I report won't be reliable.
- What the newsletter is for: sponsor revenue, product signups, retention, or something else? It decides which metric counts as "doing well."
Optional, but they make the review sharper: clicks per link (with which links are sponsors, articles or products), and per issue details like length or lead story topic. Without them I'll say those patterns are not testable.
Which platform do you send from (beehiiv, Kit, Mailchimp or another)? I can tell you where to find the export.
Related
- Tested

Email Engagement Drop Diagnoser
Diagnose a sudden drop in email open or click rates by recomputing rates per send from raw counts, separating machine opens, segment
- Tested
Quarterly Social Post Performance Analysis
Analyze a quarter of organic social posts from the user's export, compute engagement rate per post and per format, topic and platform using
- Tested
Email Revenue per Recipient Report
Compute revenue per recipient (attributed revenue divided by delivered messages) for each flow and campaign from an export, rank them
No bots match