[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"content-en-blog\u002Fabstract-review-rubric":3},{"seo":4,"title":7,"description":8,"category":9,"publishedAt":10,"author":11,"sections":12,"cta":70,"related":73},{"title":5,"description":6},"Abstract Review Rubric: Scoring Criteria and Examples","A scoring rubric for conference abstract review: five criteria, a five-point scale with anchors, and guidance for reviewer comments and calibration.","Abstract review rubric: scoring criteria and examples","Reviewers who score without shared anchors produce numbers that cannot be compared. A short rubric, agreed before the call closes, makes scores usable and decisions explainable.","review","2026-03-10","Eventumbot",[13,16,25,29,32,36,44,52,61,64,67],{"heading":14,"body":15},"Why a rubric matters","Without a rubric, a 4 from one reviewer can mean what a 2 means from another. A rubric does not remove judgement; it makes it comparable and gives the chair something to point to when an author asks why an abstract was declined.",{"heading":17,"body":18,"items":19},"Five criteria that work for most meetings","Keep the list short. Each criterion should be answerable from an abstract of a few hundred words.",[20,21,22,23,24],"Fit with the scope: does the work belong in this meeting and this track?","Scientific soundness: are the question, method and conclusions consistent with each other?","Originality and significance: does it add something for the audience of this meeting?","Clarity: can a specialist in the field follow it without the full paper?","Suitability for the format: does it work as an oral talk, a poster, or only one of them?",{"heading":26,"body":27,"template":28},"Scale with anchors","Use five points and describe each one. Anchors matter more than the number of levels.","5  Excellent: clear contribution, sound method, would improve the programme.\n4  Good: solid work, minor weaknesses that do not affect the conclusions.\n3  Acceptable: relevant but incomplete or unclear in one respect.\n2  Weak: significant problems with method, evidence or clarity.\n1  Unsuitable: out of scope or does not report a result.",{"heading":30,"body":31},"Ask for a recommendation and a comment","Alongside the scores, ask for a recommendation (accept as oral, accept as poster, reject) and one short comment written for the author. Keep confidential remarks for the committee in a separate field so nothing leaks into the decision letter.",{"heading":33,"body":34,"template":35},"Worked example: scoring two abstracts","The example below shows how the rubric turns a reviewer’s impression into a score that another person can follow. Both abstracts are fictional. Note that the second one is scientifically interesting but is scored low on clarity, and the comment tells the author exactly what to fix.","Abstract A: “Forecasting river levels with a hybrid model”\nFit 5 · Soundness 4 · Originality 3 · Clarity 5 · Format 5   Total 22\u002F25\nComment for author: Clear and well structured. The comparison with the baseline is convincing; please state the size of the test data set.\nRecommendation: Accept as oral.\n\nAbstract B: “A new approach to groundwater problems”\nFit 4 · Soundness 3 · Originality 4 · Clarity 2 · Format 3   Total 16\u002F25\nComment for author: The idea is promising but the abstract does not say what data were used or what result was obtained. Please add a method and a main finding.\nRecommendation: Accept as poster, subject to revision.",{"heading":37,"body":38,"items":39},"Weighting and total scores","Adding five scores of equal weight is the simplest option and is usually enough. If your committee thinks that some criteria matter more, decide the weights before scoring and publish them to reviewers, rather than adjusting them after you have seen the results. Whatever you choose, remember that a total is a way to sort abstracts, not a decision.",[40,41,42,43],"Equal weights: easy to explain, and reviewers do not need to calculate anything.","Weighted: for instance, soundness counted twice, if the meeting is strongly methodological.","Threshold rules: for example, any abstract scoring 1 on fit or soundness is rejected regardless of the total.","Borderline band: agree in advance the range of totals that the committee will discuss, for example 14 to 17 out of 25.",{"heading":45,"body":46,"items":47},"Adapting the rubric to the format","The same five criteria do not fit every contribution type equally. Keep the structure and adjust the emphasis, so reviewers do not penalise a poster for not being a full talk.",[48,49,50,51],"Oral presentation: give more weight to clarity and originality, because the audience will hear it once.","Poster: accept work in progress if the question and method are sound, and ask how well it will work visually.","Symposium proposal: add a criterion on coherence of the speakers and the value of the session as a whole.","Late-breaking results: relax the requirement for a full method, but still ask what was measured.",{"heading":53,"body":54,"items":55},"Common reviewer biases and how to reduce them","Reviewers are experts, and experts are still human. A rubric reduces some biases but not all. Naming them in the reviewer instructions makes them easier to notice.",[56,57,58,59,60],"Halo effect: a well-written first sentence colours the rest. Ask reviewers to score criteria one at a time.","Prestige bias: a known institution or author raises scores. Use anonymised review where the field allows it.","Language bias: an abstract by a non-native speaker is scored down for style. Ask reviewers to judge the science and to mark language issues separately.","Severity and leniency: some reviewers score everything low and others high. Compare each reviewer’s average with the group.","Fatigue: scores drift downward on the twentieth abstract. Cap the number per reviewer and suggest breaks.",{"heading":62,"body":63},"When reviewers disagree","Disagreement is normal and often useful. Set a threshold, for example a gap of two points on the total or opposite recommendations, above which a third reviewer or the track lead reads the abstract and decides. Ask the third reader to write down the reason in one or two sentences, so the decision can be explained later. Avoid averaging as a way of ending the conversation: an average of a 5 and a 1 says nothing about the abstract, only about the reviewers. When the disagreement is about scope and not quality, resolve it at the committee level and record the rule for the next edition.",{"heading":65,"body":66},"Writing comments authors can use","A comment written for the author is the only part of the review that most authors will read. Ask reviewers to say what works, what does not and what to change, in that order, and to avoid personal remarks. A useful comment names the specific gap. “The abstract is unclear” gives the author nothing; “The abstract does not say how many samples were analysed” gives them something to do. If reviewers know that the comment will be sent to the author, they write differently, so state that clearly and keep confidential remarks for the committee in a separate field.",{"heading":68,"body":69},"Calibrate before you score","Before the review period, have every reviewer score the same three sample abstracts and compare. Discuss the largest differences for ten minutes. This is the cheapest way to reduce the spread between strict and generous reviewers, and it works better than a long instruction document.",{"label":71,"to":72},"Explore peer review","\u002Ffeatures\u002Fpeer-review",[74,76,78,81],{"label":75,"to":72},"Peer review",{"label":75,"to":77},"\u002Fglossary\u002Fpeer-review",{"label":79,"to":80},"How to manage peer review for academic conferences","\u002Fblog\u002Fpeer-review-workflow-academic-conferences",{"label":82,"to":83},"Managing conflicts of interest in conference peer review","\u002Fblog\u002Fconflicts-of-interest-conference-peer-review"]