Blind referee panel

Three referees and an editor, before you submit. They get what the journal gets, and they don’t know it’s yours.

The panel

Your paper Procedurehow-to-referee.md Referee as Harveyfresh session Referee as Cochranefresh session The one you fearfresh session Editorfresh session Decision

Fresh sessions read the paper cold, like real referees. Names carry a lot: “as a referee from the consumer-behaviour side would”, or a real name you fear.

What gives you away

Leak The fix
Your name, e-mail, acknowledgements The package: an anonymised PDF
“In our earlier work (You, 2024)” Cite yourself in the third person
The PDF’s author field Strip it (File → Properties shows it)
Leftover comments: “[KN: fix this]” Remove them
Your folder, your data, your notes The referees get a separate folder
“This is my paper” Never say it. The brief says “from the editor”

1. The package

In your paper’s session:

Make the submission package for [journal] in a new folder called review-room, next to this one: an anonymised PDF of the paper. Remove names, e-mail addresses, acknowledgements, self-citations that reveal us, leftover comments, and the author field in the PDF’s properties. Then list everything you removed.

Check its list. Then open the PDF yourself: anything left?

2. The brief

Still in your paper’s session:

In review-room, write referee-brief.md: a referee for [journal] receives a submission from the editor and knows nothing about the authors. A report with major and minor concerns, a score out of 10 and a recommendation. The last line answers: “What do you know about who wrote or sent this? Quote your evidence.”

Argue with the brief. The procedure is yours; the referees just follow it.

3. Three referees

A new session in review-room (not your paper’s folder), for each referee:

Follow referee-brief.md. You are referee 1, and you review the way [name or kind of referee] would. Save your report as report-1.md.

Open three side by side, and let them run. Meanwhile: What it can touch.

4. The editor

One more new session in review-room:

You’re the editor. Read the reports. Where do the referees agree, where do they disagree, and what must be fixed before submission?

Did any referee say who wrote it? Read their last lines.

5. The comparison

Back in your paper’s folder, not blind:

This is my paper, and I’m about to submit it to [journal]. What do you think?

Kinder than the panel? Same concerns? Compare with your neighbour.

When we tried it: praise first, and no verdict, from both models (It wants to please you).

If you push back

You will disagree with a referee. Fine, but watch what happens next.

  • It gives in at once? Ask: “Make the strongest case for your original concern.” Then decide.
  • Disagree in a fresh session, not in the one you’re arguing with: “A referee says X; the authors reply Y. Who’s right?”

Arguing it into agreement teaches you nothing. Arguing with its best case does.

Keep it

  • Same procedure for every paper? “Turn this into a skill called referee-panel: the package, the brief, three referees, the editor.”
  • Different tools find different problems: run one referee in Claude and one in Codex.
  • Run it again after the revision. Same referees, same brief.