Academic conference success metrics: what to measure

Decide what success means

A society meeting may aim for member attendance, a specialist symposium for scientific quality and a campus event for student participation. Pick three to five goals before the call opens, and choose metrics that show progress toward them.

Metrics by stage

Define each one in writing so that next year’s team counts it the same way.

• Submissions: number received, by track and by career stage; share of first-time submitters.
• Review: number of reviews per abstract, share completed on time, acceptance rate, time from deadline to decision.
• Registration: total registered, by category; conversion of accepted presenters to registered; share registered at the early-bird rate.
• Attendance: number present, session attendance where counted, poster session attendance.
• Satisfaction: average scores from the survey, response rate and the most frequent free-text themes.
• Communication: volume of attendee questions and share answered without staff.
• Finance: income and cost by category, and net result against budget.

Watch definitions

Acceptance rate, for example, changes meaning depending on whether withdrawn abstracts are counted. Attendance can be registrations, badge scans or seats filled. Write down the definition next to each number and use the same one each year.

Compare carefully

Compare editions only when the format is comparable: same duration, similar location type, same fee structure. Note the differences, such as a new track or a change of country, next to the numbers so that a reader can judge the trend.

A metrics summary you can copy

A one-page summary lets a committee see the meeting at a glance. The numbers below are invented and show the layout, with a comparison column for the previous edition and a short note to explain unusual values.

Metric This year Last year Note Abstracts submitted 412 365 New track added Acceptance rate 68% 71% Withdrawn abstracts excluded Reviews completed by deadline 91% 84% Reminder schedule introduced Days from deadline to decision 23 31 Accepted presenters registered by date 89% 82% Total participants 387 341 Meeting in a new city Survey response rate 34% 28% Overall satisfaction (1–5) 4.2 4.0 Net result vs budget +EUR 6,400 –EUR 2,100

Definitions and formulas

Write the formula next to each metric so anyone can reproduce the number. These are the ones we would fix first.

• Acceptance rate = accepted abstracts ÷ abstracts submitted, excluding withdrawn and duplicates. Example: 280 accepted of 412 submitted, less 8 withdrawn, is 280 ÷ 404 = 69%.
• Review timeliness = reviews submitted by the deadline ÷ reviews assigned.
• Time to decision = days between the submission deadline and the date decision letters were sent.
• Presenter conversion = accepted abstracts with a registered presenter ÷ accepted abstracts.
• Cost per participant = total costs ÷ participants who attended.
• Survey response rate = completed surveys ÷ participants invited.

Set a baseline and targets

A number means little without a comparison. In the first year, treat every metric as a baseline and write down the definitions. In later years, set modest targets that you can influence, for example reducing the time to decision from 31 to 25 days, and avoid targets that depend on things outside your control, such as the number of submissions in a year when a competing meeting is held. Review the targets after the meeting and ask what drove each change.

Qualitative evidence

Some of the most important results are not numbers. Collect a few comments from attendees, invited speakers and reviewers, notes from the committee’s debrief, and any collaborations or projects that began at the meeting. A short paragraph about what people say they gained often persuades a funder or a society board better than a table. Record the source and date of each comment, and ask permission before quoting anyone by name.

Financial measures

The financial picture should be simple enough for any committee member to read. Compare budget and actual for each income and cost category, and show the result. Break costs into fixed and per-head, so that you can see how much of the result came from attendance. Add cost per participant and income per participant, and note any one-off items. Check whether sponsorship, fees and grants behaved as planned, and record the lessons for next year’s budget.

Reach and diversity of participation

Many societies care about who attends and who is missing. Count participants by country, career stage and, where you legitimately collect it and people agree to share it, gender or other characteristics. Report these as aggregate numbers only, and be careful with small groups that could identify individuals. Use the numbers to ask questions, for example whether fee waivers reached the people they were intended for, and not to rank participants.

Communication measures

Attendee questions are a signal about how well information worked. Count the questions received by email, chat and the info desk, and group them by topic. A high number of questions about the same subject means the website or the programme was unclear. Track the share answered by self-service, such as a chatbot or a frequently asked questions page, and compare it with the previous edition to see whether information is getting easier to find.

A data collection plan

Metrics are easy to promise and hard to collect after the fact. Decide at the start where each number will come from: the submission and review system for abstracts and reviews, the registration system for participants and payments, the finance records for costs, the survey tool for satisfaction, and the helpdesk or chat log for questions. Assign each source to an owner and set a date when the data is exported, before the team disperses.

Avoid vanity metrics

Some numbers look impressive and tell you little: page views without goals, social media impressions, the number of people “interested”. They may have a place in a report, but they should not steer decisions. Prefer measures linked to what the meeting was for. If the aim was to build a community, look at repeat attendance and new collaborations; if the aim was scientific quality, look at review outcomes and post-meeting publications.

Use the numbers in the handover

Put a one-page summary of the metrics, the survey findings and three recommendations in the handover for the next chair. Numbers that are not connected to a decision will be forgotten; those that lead to a change are worth collecting.