How to Write Better Test Questions: A Practical Guide for Educators, Trainers, and Recruiters

Design for screen-first logic

• Use Google Forms or Quilgo-native tools from the start;
• Keep content layout clean and screen-optimised.
• Treat every question as a digital object.

“Writers spent more time formatting than composing questions. It felt like content creation was limited by layout constraints.”

Build auto-marking carefully

• Use auto-marking for:
  • numbers,
  • standardised answers,
  • controlled vocab.
• Always list all valid variations of correct answers.

“Entering all acceptable variants of an answer was a key pain point. One participant said they changed a question to match auto-marking capabilities.”

Simplify visual complexity

• Avoid complex formatting (e.g. tables, multi-column layouts);
• Use bold headings, spacing, and concise instructions;
• Keep visual load low, especially for mobile users.

“I knew what em wanted to do, but couldn't do it on the platform. That was the most frustrating part.” — Sc3

Standardise your question structure

• Use consistent command verbs (“select”, “enter”, “type”);
• Align visuals, numbering, and units of measure;
• Document how to format multi-part or compound questions.

“Even inserting units like 'kg' after the answer box was unclear to many writers. Formatting guidance is essential.”

Types of Questions and How to Write Them Well

Multiple Choice (MCQ)

Still, the most common format. A strong MCQ includes:

• A clear, concise stem
• 3 - 5 well-written alternatives
• One correct answer, and several plausible distractors

Best practices:

• Avoid “All of the above” or “None of the above” unless necessary.
• Keep all answer choices similar in length and tone.
• Use positive phrasing; negatives add unnecessary confusion.
• Cambridge found that MCQs with more than one correct-looking answer caused up to 45% more “review requests” during pilot tests.

Short-Answer

• Great for checking factual recall (names, formulas, definitions).
• Avoid asking for complete sentences.
• Provide automated grading whenever possible (e.g., with Quilgo)
• Phrase the question so there's one clear, correct answer.

Cambridge notes: “Short-answer questions reduce guesswork but require precise formulation. Minor formatting variations can lead to inconsistent grading.”

Descriptive / Essay

Use these when you want deep insight into critical thinking, judgment, or argumentation.

• Be clear about expectations (length, structure, content)
• Avoid vague prompts (“Discuss X”); instead, provide clear guidance for the response.

Cambridge found that essay questions were the most misaligned with digital platforms, mainly when screen space limited the ability to review long texts.

Always test and review

• Test the quiz end-to-end yourself.
• Check:
  • question display,
  • auto-scoring,
  • logical progression;
• Ask a colleague to review.

“Reviewers focused so much on the mechanics (e.g. auto-scoring) that sometimes they overlooked clarity of the actual question.”

Start with Context, Not Content

Before writing a single question, ask yourself:

• Who is taking the test?
• What do they already know?
• What decisions will be based on this test?

Design your assessment to reflect real-world situations. Research shows that authentic, skill-based assessments not only reduce cheating but also improve engagement. Use realistic scenarios. For recruitment or training, describe tasks they'd face on the job. For students, make questions relevant to their future careers.

Build an author onboarding kit.

• Provide templates and guides:
  • How to write practical digital questions;
  • Auto-marking setup;
  • Platform limits and workarounds.
• Offer peer mentoring or short onboarding sessions.

“Without training, writers avoided complex items and limited themselves to what they could guess how to do. Creativity suffered.”

Quilgo test creators can deliver higher-quality assessments by treating the platform as a native medium, not a secondary container. Standardised workflows, clarity-first design, and innovative author training are the path forward. This research shows us how.

Sources:

Cambridge Assessment, Writing and Reviewing Assessment Questions on Screen: Issues and Challenges, 2020.

Read full study →