How to grade yourself honestly on a flashcard
Every review ends with a question only you can answer: did you actually know that? The scheduler believes whatever you tell it, and a deck full of generous grades quietly falls apart.
The card shows "the forest" and a blank. You think... bosque? Maybe busque? Something with a b. You flip it: bosque. Close enough, you tap Good, and the word sails away for 3 weeks.
Except you didn't know it. You recognized it after the fact, which is a different thing entirely, and now a word you half-know is scheduled like a word you own. Three weeks from now it will be gone, and it'll take extra reviews to drag it back. The whole transaction cost you one moment of honesty.
The scheduler eats what you feed it
A modern scheduler like FSRS is a prediction machine. It watches your grades, fits a memory model per card, and times the next review for the moment you're about to forget. Its entire view of your memory comes through one channel: the grades.
Feed it inflated grades and it builds an inflated model. Intervals stretch beyond what the memory can hold, words start failing at 3 weeks that should've been reviewed at 5 days, and the deck develops that demoralizing pattern where everything feels simultaneously "reviewed" and shaky.
The scheduler has one channel into your memory: the grades. Lie on the input and the output lies back.
Grade honestly and the machine is genuinely good at its job. The difference between those two decks is not effort. It's calibration.
It helps to notice what the grade is for. It isn't a score, and nobody's GPA is riding on it. It's a sensor reading: how faded was this memory when you caught it? The scheduler needs that reading the way a thermostat needs the thermometer, and a thermostat wired to a flattering thermometer doesn't produce a warmer honest house.
Your brain is a generous grader
The bad news from metacognition research: your default self-assessment runs hot, and in predictable ways.
Koriat and Bjork (2005) named the core problem illusions of competence. When you study with the answer in view, you judge how well you know it while looking at it, and everything feels knowable with the answer on the table. The judgment you need (could I produce this cold?) is precisely the one the flipped card no longer measures.
And the inflation has a cost you can measure. Dunlosky and Rawson (2012) had students learn definitions while judging their own accuracy. The overconfident ones ended retention tests with the worst scores, because material judged "known" gets retired from practice early. Their paper's blunt subtitle: overconfidence produces underachievement.
Add the fluency trap (fast-feeling recognition reads as knowledge, see the testing effect) and the pattern is clear: every bias points the same direction, toward over-grading. Nobody needs help being stricter with themselves here; they need a procedure.
You can get better at judging
Before the procedure, some genuinely good news: self-assessment is a skill with a known upgrade path.
Nelson and Dunlosky (1991) found that judgments of learning made immediately after studying an item are mediocre predictors of later recall, while the same judgments made after a delay are startlingly accurate. The immediate judgment reads the afterglow; the delayed one has to actually probe the memory, which is the honest test.
Your review session exploits this automatically. Every card arrives days after you last saw it, so the judgment you're making at the moment of recall is the accurate kind, provided you make it before the flip. The commit-first habit (say it, then look) is a delayed judgment of learning wearing work clothes.
Calibration also improves with feedback. Learners who grade strictly for a few weeks start noticing which internal signals actually predict success: the word arriving whole versus assembling itself letter by letter, confidence with a shape to it versus vague warmth. That noticing transfers, usefully, to real conversation, where knowing whether you actually know a word decides whether you start the sentence.
A rubric you can actually follow
Verbamor uses 4 grades. Here's the honest mapping, and the only hard rule is the first one:
The bright line: if the answer arrived after the flip, it's an Again. No exceptions for "I basically had it." Basically-had-it is the exact state the next review exists to fix, and it can only fix it if the scheduler knows.
One more habit makes the rubric self-enforcing: commit before you flip. Say the word out loud, or type it, before the answer appears. A spoken guess can't be quietly revised into a pass after the fact. This is half the reason Verbamor cards make you produce into a blank rather than flip-and-judge.
The judgment calls
Real reviews produce edge cases. My rulings, for what they're worth:
- Right word, wrong gender. La bosque? Hard, at best. The article is part of the word; you'll say it wrong at dinner exactly the way you said it wrong on the card.
- Right word, mangled pronunciation. If you'd be understood, Hard. If your tutor would squint, Again.
- Took 10 seconds. Still counts, that's what retrieval looks like near the edge. Hard or Good depending on how ugly the search felt.
- Got it from the image, not the sentence. Fine. The image is a legitimate route (that's dual coding doing its job). Good.
- Synonym instead. You said selva for forest? You know a word; you don't know this card. Again, and no shame in it.
You'll notice the rulings trend strict. That's the point of having rulings: to lean against a bias that never stops leaning the other way.
Failing a card is cheap. Faking a pass is expensive
The psychology underneath all of this is that Again feels like losing. It isn't. An Again is one extra review tomorrow, maybe 8 seconds of your life, and the scheduler quietly rebuilds the word on a schedule that matches reality.
A fake Good costs more: 3 weeks of silent decay, a failed retrieval later anyway, and a model of the word that's now wrong in both directions. Kornell's work on retrieval failure even shows the miss itself has value; a failed attempt followed by the answer still strengthens the memory more than a smooth flip ever did.
So the honest grade is also, conveniently, the selfish one. Tap Again like it's nothing, because it is. The learners whose decks hold up at month 12 aren't the ones who passed the most cards. They're the ones whose grades meant something.
And if you've been generous for months, don't rebuild the deck; just start grading straight today. The scheduler re-fits to your real performance within a few weeks of clean data, the way any model recovers once the sensor stops lying.
Sources
The scheduler reads your grades
- Ye, J., Su, J., & Cao, Y. (2022). A stochastic shortest path algorithm for optimizing spaced repetition scheduling. Proceedings of KDD '22.
Why we over-grade ourselves
- Koriat, A., & Bjork, R. A. (2005). Illusions of competence in monitoring one's knowledge during study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(2), 187–194.
- Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students' learning and retention. Learning and Instruction, 22(4), 271–280.
- Rhodes, M. G., & Castel, A. D. (2008). Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions. Journal of Experimental Psychology: General, 137(4), 615–625.
Calibration is a skill
- Nelson, T. O., & Dunlosky, J. (1991). When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect." Psychological Science, 2(4), 267–270.
Failed tries still help
- Kornell, N., Hays, M. J., & Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4), 989–998.
Every load-bearing claim Verbamor makes is traced to its paper on the research page.
Grades in, memory out.
Verbamor's scheduler learns your memory from every grade you give it, and repays honesty with intervals that actually hold.
Download the app