The Metrics Question: How Do We Measure Real Success in Grant Writing Education?
A while back, I asked a hard question out loud: how do you actually measure whether a grant writing course works?
The grant writing profession has spent years proving that "success rates" are unfair metrics for evaluating grant professionals. Too many variables sit outside the writer's control: organizational readiness, funder priorities, relationship history, geographic distribution requirements, and timing factors that have nothing to do with proposal quality. And yet prospective students and employers still ask a fair question, one they deserve a real answer to: how do you know if the training actually prepared someone?
I put four possible approaches on the table and asked for feedback. Then I did the part that matters more than asking: I listened. What follows is what I heard, what I changed because of it, and where I've landed. It's not finished, good measurement never is, but it's real, it's built, and it's running in the course right now.
Table of contents
Why measuring grant writing training is so complicated
The grant writing world has rightfully moved away from simplistic success rates. The field now values strategic thinking, relationship building, professional ethics, readiness assessment, and project design.
But that left a harder question unanswered: how do you prove a grant writing training program prepares someone for real work, without falling back on the same success-rate thinking we all agree is flawed?
After being named the best grant writing course in the world by Instrumentl for four years running, I'm confident in what we teach. But confidence in the curriculum isn't the same as evidence of outcomes, and I wasn't satisfied with surface-level metrics. I wanted a way to show that graduates leave genuinely more capable than they arrived, across the full range of roles our students hold: nonprofit staff, freelancers, career changers, volunteers, and lifelong learners.
The four approaches I put on the table
Here's what I originally proposed, so you can see how the thinking evolved.
Option A: Strengthen in-course assessment. Formalize the skill checks we already run, possibly adding letter grades rather than pass/fail, to give employers a clearer performance signal.
Option B: Track graduate career progression. Follow whether graduates land roles, earn promotions, launch freelance businesses, or add grant writing to their responsibilities over time.
Option C: Measure collective impact. Track the total dollars our graduates help raise, with full transparency about all the factors outside a writer's control.
Option D: Forecasting accuracy. Measure whether graduates can build a calibrated grant revenue forecast, assigning probabilities to each opportunity and predicting a realistic annual total. Not "did you raise a set amount," but "can you strategically assess a portfolio and make sound predictions?"
Each told part of the story. None felt complete on its own.
What other programs track
Before I get to the feedback, it's worth looking at how the rest of the field handles this, because the approaches vary widely.
Academic programs tend to track completion rates, continuing education units, test scores, and job placement. Professional training programs often lean on confidence surveys, testimonials, and anecdotal success stories. And some business coaching models track collective impact: Holly Rustick's Freelance Grant Writer Academy, for instance, tracks the total grants her students raise and the revenue their businesses earn, and builds those collective goals into the program's identity from the moment a student enrolls. That works beautifully for a year-long, freelance-focused program with clear entrepreneurial goals, and I admire how intentionally it's designed.
But here's what I noticed looking across the field: some programs are transparent about how they measure learning, and others don't make it clear they evaluate outcomes at all. And there's a meaningful difference between the kinds of things that get measured. Having a student build a prospect research sheet on a single funder is not the same as having them write a complete proposal and receive individual feedback on it. One demonstrates that a student completed a task. The other demonstrates that they can actually do the work. That distinction, task versus skill, sat with me as I thought about what real proof should look like.
No existing model fully fit what Spark the Fire is: a comprehensive course serving career changers, nonprofit professionals, freelancers, volunteers, and lifelong learners all at once. So I asked what you thought, and the responses reshaped my plan in ways I didn't expect.
What I heard, and what I changed
A few clear themes came back, and they were sharper and more useful than anything I'd have arrived at alone.
Collective impact means little to an individual. The feedback on Option C was direct: a big aggregate dollar figure doesn't tell a single student whether the course will help their organization. What matters more is improvement you can see in your own work: a before-and-after comparison, not a headline number that pools everyone together. That reframing was right, and it changed how I think about proof entirely. The goal isn't to advertise a collective total. It's to show growth at the level of the individual learner.
Career progression doesn't fit everyone. Option B assumed a trajectory, a new job, a promotion, but plenty of students take this course to get better at the role they already have and love. Someone can finish, stay exactly where they are, and still walk away transformed in their capability. Any honest measurement had to make room for that, rather than treating "advancement" as the only valid outcome.
Forecasting resonated, as a skill worth teaching. Option D struck a chord as a genuine professional competency. Building an accurate revenue forecast is real, teachable judgment, and it belongs in the course as applied practice, not just as a metric I track from the outside.
And underneath all of it: pacing. The loudest, most consistent theme wasn't about metrics at all. It was that students needed more flexibility and less pressure around time. That feedback prompted a much bigger change than any single measurement decision, which I'll come back to.
What Spark the Fire measures now
Here's what all that listening turned into. Not one headline metric, but a connected system that measures growth at the level of the individual student.
Confidence growth, measured start to finish. Every student now takes a short survey at the very beginning of the course and a matching one at the end, with identical questions about their confidence completing a full proposal, strategizing a funding request, and understanding the grant writing process. Because the questions are the same, the difference between a student's first answers and their last shows real, individual growth, exactly the before-and-after the feedback called for. This is the heart of the system.
Honest role context. The starting survey now asks where each student is coming from: a decision-maker choosing what their organization pursues, a writer supporting someone else, a freelancer serving clients, or someone building toward a future role. That context means I never mistake "didn't get promoted" for "didn't grow." Different students have different goals, and the measurement finally respects that.
Real-world application, honestly qualified. At the end, I ask whether students plan to actually submit the proposal they built, but first I ask whether they're even in a position to submit for an organization. That distinction matters. A career changer who isn't yet in a submitting role shouldn't be counted the same as someone whose proposal wasn't ready. Separating the two gives an honest signal: among students who can submit, how many produced work they intend to put in front of a funder.
Calibrated judgment, built into the course. The grant calendar, where students map a year of opportunities and forecast expected revenue using the probability thinking from Option D, is now a required deliverable, submitted twice so students get feedback along the way, not just at the end. My feedback focuses on strategy, structure, and timing: is the volume realistic, is the mix balanced, is the expected-value logic sound? I'll flag a funder I happen to know is a poor fit, but a full funder-fit assessment is consulting work, not course feedback, and I'm clear with students about that line.
Catching students before they fall away. A midpoint check-in now asks, plainly, how students are feeling about their progress, so anyone stalled or overwhelmed can raise a hand while there's still time to help, rather than quietly disappearing.
What I'm still working on
Two honest admissions.
First, the biggest change didn't come from the metrics conversation at all. It came from hearing, over and over, that students needed more room. So the course no longer runs on a time limit. You can move at the pace your life allows. There's still a suggested rhythm and a cohort structure for those who want the momentum, but it's a guide, not a deadline. That one change resolved more of the "I'm falling behind" pain than any survey question ever could.
Second, measuring intent isn't the same as measuring outcome. Right now I capture whether a graduate plans to submit their proposal, but not yet what happened when they did. Closing that loop, checking back months later with the graduates who were positioned to submit, is the next piece I'm building. It's harder, and I want to do it honestly rather than quickly.
So this isn't a finished system. It's a better one than I had, shaped by people who were generous enough to tell me where I was wrong. And I'm still listening.
Frequently asked questions
How do you measure success in a grant writing course?
Through a connected system: a before-and-after confidence comparison for each student, honest context about their role and goals, whether they intend to submit the proposal they built, and a required grant calendar that measures strategic judgment. No single number tells the whole story, so we don't pretend one does.
Do grant writing "success rates" matter?
Not as a measure of a writer's ability. Grant decisions depend on funder priorities, relationships, geographic requirements, and organizational readiness. Growth in skill, confidence, and strategic judgment is a far better signal, which is why we measure improvement rather than absolute outcomes.
What should employers look for in a grant writing certificate?
Evidence-based curriculum, practical assignments, instructor-reviewed proposals, and skills tied to real-world grant writing: research, readiness assessment, budgeting, outcomes, and forecasting.
What is grant revenue forecasting?
It's a method professionals use to predict annual grant revenue by assigning a probability to each opportunity and weighting the request amounts accordingly. It measures judgment and strategic thinking, not luck, and it's now a hands-on part of the Certificate.
Now I want to hear from you
This system exists because people told me where my thinking fell short. I'd like to keep that going.
Prospective students: what evidence would give you confidence that a course prepares you for real grant writing work?
Alumni: what would you be willing to share about where you've gone since?
Organizations: what would help you trust a certificate when you're hiring?
Educators: what have you found genuinely worth measuring in your own programs?
I read everything that comes in, and I'm still listening.
Cheering you on,
Allison
