Our latest update, the Export data feature, is a simple yet powerful addition that saves educators, recruiters, and trainers hours of manual work. With a single click, you can download all key test details—from student participation and scores to proctoring logs—in a structured, universal format.
No more switching between screens or manually compiling data. Now, with a single click, you can download everything you need in a universal format, ready for analysis, reporting, or sharing.
What's inside your export now?
Student Details & Test Statuses - See who took the test, who didn't, and when they started.
Proctoring Insights - Get a full breakdown of security events:
Tab switching - How many times a student left the test window.
Face presence - Did the camera detect them throughout the exam?
Suspicious patterns - Any unusual behavior flagged by the system.
Suspicious screenshots - Captured moments that need a second look.
Test configuration & settings - Understand how each exam was set up:
Time limits & deadlines - Start time, duration, and cut off times.
Tracking settings - Whether activity, camera, and screen monitoring were enabled.
Security rules - Forced tracking, auto-close on cheating, and score visibility settings.
Student performance & answer
- A complete record for grading and progress tracking:
Max points & scoring - Total possible points and the student's final score.
Submitted answers - Full answer logs for deeper analysis.
Trust score - Metric indicating test integrity.
The Export data feature is just one of the many ways Quilgo streamlines online testing, but convenience doesn't stop here. This update is part of a bigger mission: making Quilgo the most seamless and intuitive platform for secure online testing.
Here's how we do it:
Automated Proctoring - AI-powered fraud detection and face consistency checks.
Seamless LMS Integration - Works effortlessly with Moodle, Google Forms, and Google Classroom.
Flexible Pricing Model - Pay only for concurrent test-takers, ensuring cost-efficiency.
With every update, we're making online assessments smarter and more efficient. The new Export Data feature is one more step toward making Quilgo the easiest, fastest, and most powerful assessment tool available.
The hidden ways exam monitoring helps students perform better
Many assume that online proctoring is just about catching cheaters. In reality, it plays a crucial role in improving student performance. A well-structured, fair, distraction-free test environment allows students to stay focused, reduce anxiety, and develop better exam-taking habits. Let’s explore how proctoring tools, like those offered by Quilgo, contribute to student success.
Proctoring reduces test anxiety
Knowing that an exam is being reasonably monitored helps ease stress rather than increase it.
Why? When students trust that everyone follows the same rules, they don’t feel pressured to seek unfair advantages, which creates a more comfortable testing atmosphere.
Science-backed: A study published in The Journal of Ethics found that when students perceive exams as fair, they experience lower anxiety and greater motivation to perform well. (Source)
Better focus, fewer distractions
Online exams have endless distractions—switching tabs, checking messages, and background noise. Proctoring tools help students stay engaged.
Data from Quilgo: Students in monitored tests show higher completion rates and extended periods of uninterrupted focus.
Supporting research: A 2023 study found that external monitoring reduces multitasking during exams, leading to more accurate assessment results. (Source)
Why it works: Structured conditions mimic traditional test-taking environments, reinforcing deep concentration and time management habits.
More apparent test conditions, less stress
Proctoring isn’t just about security—it also provides structure to help students feel more prepared.
A distraction-free environment that helps them stay engaged
The result? Fewer surprises, more confidence, and a smoother test experience.
Ethical testing builds student confidence
A well-monitored test ensures that grades reflect a student’s effort and knowledge. Instead of worrying about others cutting corners, students can focus on doing their best.
Key benefits:
Fair conditions encourage honest effort
Students trust their grades are earned, not given
A greater sense of accomplishment and motivation
At Quilgo, we believe that monitoring should support students—not stress them out.
Proctoring that helps, not punishes
Quilgo's monitoring tools create a fair, structured, and distraction-free test-taking experience:
Timer - helps students manage their time effectively, reducing stress and last-minute rushes.
Screen & camera tracking - Encourages focus by gently discouraging distractions without disrupting the test.
Secure test links - Ensures only the right students access the exam, maintaining fairness and integrity.
Results directly from educators - Students receive their scores from instructors, ensuring full control over grading and feedback.
Want to see how Quilgo can improve your students' performance?
🚀 Try Quilgo today and experience online exams as they should be—structured, fair, and focused.
With remote testing becoming the norm, institutions and businesses need a secure, reliable, and scalable solution for online assessments. But with so many options available, how does Quilgo compare to other leading tools?
Below, we break down key competitors, highlighting their strengths, weaknesses, and what makes Quilgo stand out.
The online assessment industry is filled with robust, feature-rich solutions, and we acknowledge that many competitors provide high-quality tools for secure and efficient testing. The core functionalities across platforms have reached an impressive standard, from proctoring to analytics. However, when choosing the right tool, it's not just about features—it's about how these tools are structured, priced, and scaled to fit real-world needs.
Pricing models: how Quilgo stands out
Pricing models can vary significantly when choosing an online proctoring or assessment tool. Some platforms charge per test, others per student, and many require costly institution-wide licenses. Understanding these differences is crucial in selecting the most cost-effective and scalable solution.
Standard pricing models in the market
Most online proctoring and exam platforms follow one of these pricing structures:
Pay-per-exam - Charges for each test attempt, regardless of how many students take exams simultaneously.
Per-student subscription - A flat rate per student per month or year, often limiting the number of exams.
Institution-wide licensing - A high-cost, bulk contract for unlimited use within an organization.
Hidden or custom pricing - Some platforms require direct contact for a quote, often leading to unclear costs.
How Quilgo's unique pricing model works
Quilgo redefines exam pricing with its test-taker seats model, which charges based on the number of students taking tests simultaneously (concurrent test-takers).
No limits on total exams - You can conduct unlimited tests, and pricing is based only on how many students are testing concurrently.
Scales with your needs - Whether you have 10 students or 10,000, you only pay for the number of simultaneous test-takers, making it cost-effective for institutions with fluctuating testing schedules.
Transparent and predictable - No hidden fees, per-test charges, and unnecessary expenses for inactive students.
Why Quilgo's pricing model is a game-changer
Fair and scalable - You're never overpaying for inactive students or locked into per-test fees.
Perfect for fluctuating demand - If your institution runs exams in waves or has peak testing seasons, this model ensures you only pay for active test-takers.
No budget waste - Unlike per-test or per-student subscriptions, you won't pay for unused capacity.
Ready to experience the most cost-efficient proctoring model?
🚀 Try Quilgo today and maximize your testing budget.
Online exams are convenient, but are they truly secure? Our latest data from the Quilgo Moodle plugin reveals that over 50% of test-takers navigate away from their exams at least once—and many do so multiple times. Whether checking notes, searching online, or collaborating with others, these behaviours put test integrity at risk.
What the numbers reveal
Since launching our Moodle plugin in April 2024, we've monitored millions of test attempts. Here's what we've uncovered:
✅ 51.8% of test-takers leave the test page at least once ✅ 30% leave twice or more ✅ 21% leave three or more times✅ 15.7% of tests involve text selection (potential copy-pasting) ✅ 1 in 31 proctored tests detects multiple faces on the screen
Whether searching online, checking notes, or collaborating, these behaviours put test integrity at risk. Without monitoring tools, how much do you trust online exam results?
Quilgo for Moodle: the ultimate solution for secure exams
Our Moodle plugin brings enterprise-level security to online assessments with:
🔹 AI-Powered fraud detection - detect unusual behaviour like copy-pasting, multiple screens, and unauthorized help. 🔹 Live Proctoring with camera monitoring - ensure the right person is taking the test with real-time face detection. 🔹 Plug & Play, no API configuration needed - get started instantly without extra technical setup. 🔹 Runs directly in Moodle, no extra software required - no additional downloads for test-takers or administrators. 🔹 High-demand performance - designed for large-scale assessments, handling thousands of students without lag. 🔹 Available in 12 languages - make exams accessible to a global audience.
Why It Matters
Whether you're an educator, university administrator, or corporate L&D professional, your assessments should reflect actual knowledge—not just a well-timed browser switch.
Integrating seamlessly into Moodle, Quilgo empowers institutions to ensure fairness, accuracy, and efficiency in online testing.
🚀 Join leading educators and organizations already using Quilgo for secure, reliable, and fair online assessments.
More than a million tests conducted on Quilgo have uncovered some surprising trends in learning, evaluation, and fairness. Whether you are a teacher, recruiter, or trainer, the statistics are clear: more innovative tools result in sharper focus, fewer distractions, and higher scores. Are you curious about what is driving these improvements? Let’s break it down.
A Boost in Scores
Here's the exciting part: test scores are climbing across the board!
Average scores rose from 51.6% in 2023 to 60.12% in 2024 .
With camera monitoring, scores increased from 49.65% to 59.18%.
Screen monitoring saw an even more significant leap: 47.4% to 61.42%.
Combined proctoring boosted results from 48.05% to 61.34%.
What is driving these improvements? It's not just the development of better tools; it's also about the adoption of more effective behaviors. Participants are becoming increasingly aware of monitoring features, which encourages them to remain focused and accountable. At the same time, educators and recruiters are using insights from past results to enhance their preparation and promote greater engagement. This collaboration fosters a culture in which genuine effort leads to success, making assessments more meaningful and impactful.
Less Cheating, More Integrity
One of the biggest challenges in online assessments is ensuring test-takers stay honest. But Quilgo's proctoring features tackle this head-on. In 2023, 64.88% of participants left their test screens at least once. By 2024, this number dropped to 60.47%. Among proctored tests, the results are even more promising:
With camera monitoring, page-leaving decreased from 57.58% to 51.70%.
Screen monitoring reduced it from 57.32% to 52.33%.
With combined monitoring , it dropped from 56.72% to 51.74%.
Still, 60% of participants leave their screens, which is significant. Without Quilgo, online assessments could quickly lose their credibility. By identifying and addressing these behaviours, Quilgo ensures assessments reflect actual skills and knowledge — not shortcuts or dishonest tactics. While the numbers are improving, there's still work to do, and Quilgo is leading the charge toward genuinely objective online evaluations.
More Innovative Tools for Better Testing
Quilgo is more than just a tool — it's a partner for educators, recruiters, and trainers who prioritize fairness, efficiency, and insight. By offering advanced features such as proctoring, detailed analytics, and scalable solutions, the platform transforms the possibilities of online assessments.
We introduced our new plans early in 2024.
Instead of limiting tests per month, we now limit the number of respondents taking your tests simultaneously.
We call it "test-taker seats".
This article explains how test-taker seats work.
Suppose you must host an online test for 50 people simultaneously.
To do that, you need 50 test-taker seats.
During the test, all the seats will be occupied.
Once the test is over, those 50 seats become vacant, and you can host another test for up to 50 people.
You can do as many tests per month as you wish as long as the number of simultaneous people taking your tests is within the test-taker seat limit.
Now, let's imagine you have a colleague.
You invite your colleague to your team and now share the test-taker seat allowance.
Your colleague also needs to host a test for 50 people.
If you and your colleague host your tests at the same time, you will need 100 test-taker seats. However, if you coordinate to host your tests at different times, you will need 50 test-taker seats only.
We hope this article helps you to understand how the test-taker seat model works. If you are not sure how many seats you need, please contact us at [email protected], and we will help you.
A few months ago we announced our AI quiz generator release.
Today we are making a big step forward in helping you to create beautiful professional online assessments in literally seconds.
Imagine you have a piece of text or educational material that you need to conduct an online assessment on. How much time would you need to spend on constructing questions, thinking of options lists etc? Well, now you would need a few seconds to generate an online assessment from text, educational material or an article.
To use the feature click the "Create Quiz" button in your Quilgo Dashboard and choose "Generate from material". Paste a piece of text, click "Generate", tune according to your needs and you have an online test ready to be sent.
Make sure your online quizzes are relevant and unique so your assessment process becomes unbiased, starts generating top-quality results, and never takes hours from your time.
You asked us many times "Can I show one question at a time in my quizzes"? We can now proudly say "Yes, now you can". Our new "Focused" quiz mode not only renders a single question per page, but also allows navigating through the quiz seamlessly.
In online quizzes, it's better to show one question at a time rather than many questions together. This simple approach has several advantages that make learning easier and more effective. Let's explore why it's a good idea:
Pay Better Attention
When you see only one question, it's easier to focus and understand it. You won't get distracted or overwhelmed, which helps you give a better answer.
Less Stress
Having one question at a time lowers anxiety. You can take your time, think clearly, and answer without worrying about missing anything.
Remember More
By focusing on one question, you can remember the information better. It helps your brain make connections and keeps the knowledge in your mind longer.
No Guessing
When faced with multiple questions together, you might guess or pick randomly. But with one question at a time, you think more carefully and give honest answers.
Instant Feedback
Getting immediate feedback on each answer helps you learn faster. You know what you got right and where you need improvement.
Easy to Use
Online quizzes with one question at a time are user-friendly and enjoyable. You won't get confused, and they work well on phones and tablets too.
Summarizing, showing one question at a time in online quizzes is a smart choice. It helps you focus, remember better, and reduces stress. With immediate feedback and a friendly design, it makes learning more effective and enjoyable. So, next time you take an online quiz, remember the power of simplicity!
We have a huge Indonesian user community so Quilgo now supports Bahasa.
Having all the buttons, labels, captions, descriptions and instructions in your native language is crucial for your work. That's why Quilgo now officially supports Bahasa language.
Along with the option shuffling, which is a huge improvement to Quilgo Forms, we also now support quiz import.
Imagine you have a quiz in a document or a spreadsheet and you want to conduct an online version of it with Quilgo. Now, instead of clicking and typing each question manually, you can use our import feature that makes things like 100x faster.
We understand how important it can be to have all the buttons, captions and instructions in your native language. This is why Quilgo now officially supports Spanish language!
Here is how to switch to Spanish:
Find the switch on the top of every public page like Our Guide
Go to Your Dashboard, open the account settings and change the language
Your test takes will also be able to instantly change the language to Spanish!
It's that easy! We wish you the most productive day and looking forward to see you on board!
Recently we announced our upcoming AI quiz generator release
and... There it is! We created this feature because building online quizzes are... well... tough! Especially at the start when your head is so overcrowded with ideas. So, why not save lots of time and effort and generate a simple quiz based on your topic and have something basic for pixel-perfect tuning? Exactly.
While we are already very excited to provide this feature to you, this is just the start. We are already looking into other parts of our service where you can benefit from AI so you have the best online assessment conduction experience ever. So, stay tuned!
👩💻 Having a team? Assess their tech, safety, social or team working skills. 🔍 Hiring? Increase the quality of the candidates you interview. 👨🎓 Educating someone? Run homework, tests and exams on any subject. ✨ ...turn on your imagination!
Quilgo works great for businesses, recruiting, and education. You can build online quizzes with a timer, add media, enable question randomization, set a start time and a deadline, turn the automated camera and screen AI proctoring on, send a single link to your test takers, get and download reports.
💎 You don't need to request a demo, install anything, speak to sales etc. Join now and one moment later you have your own online assessment ready to use. Yep, just like this!
You asked for it so many times, here it goes! We are introducing the Submission Deadline
feature that opens doors to a great variety of use cases in terms of how you set your online assessments up. Below we show a few examples of how the feature can be used:
Use case
Start Time
Duration
Submission Deadline
Online exam
10:00
60 min
11:00
Daily training task
00:00
60 min
23:59
Remote interview
Start any time
60 min
16:00
The Submission Deadline is a "hard deadline" option, which means, it has priority over the duration. For example, if the deadline is 16:00, the duration of the online test is 1 hour, but the respondent starts the test at 15:40, then they would only have 20 minutes to take the test, not 1 hour. We hope you find this feature helpful!
Deadlines play a crucial role in online assessments, whether it's a quiz, an exam, or an assignment. Setting a deadline is a way to ensure that students complete the task on time and that the grading process is fair and consistent for all students. In this article, we will discuss how deadlines can be used effectively in online assessments.
Encourage timely completion: Deadlines help to encourage timely completion of assessments. They create a sense of urgency that motivates students to prioritize their work and complete the task on time. This is especially important in online assessments where students have more flexibility in their schedules and may be prone to procrastination.
Facilitate planning: Setting deadlines allows students to plan their work and allocate time accordingly. This helps them to avoid last-minute cramming and ensures that they have enough time to review their work and make any necessary corrections before submitting.
Promote fairness: Deadlines ensure that all students are evaluated on the same criteria, as they are given equal amounts of time to complete the assessment. This promotes fairness in grading and reduces the risk of bias or discrimination.
Provide structure: Deadlines provide structure and help students to manage their time effectively. This is especially important in online assessments, where students are often working independently and may need more guidance to stay on track.
Support assessment design: Deadlines can be used to support the design of assessments, ensuring that they are well-constructed and aligned with learning objectives. For example, setting a deadline for an essay may help to ensure that students focus on the most important points and avoid unnecessary details.
Prevent cheating: Deadlines can be used as a deterrent to cheating. If students are given an adequate amount of time to complete an assessment, they are less likely to seek unauthorized help or resources during the process.
Encourage time management skills: Deadlines provide an opportunity for students to practice and develop their time management skills. This is a valuable skill that will serve them well in their academic and professional careers.
Deadlines play an important role in online assessments. They help to encourage timely completion, facilitate planning, promote fairness, provide structure, support assessment design, prevent cheating, and encourage time management skills. By setting appropriate deadlines, instructors can ensure that online assessments are effective and meaningful tools for evaluating student learning.
Deadlines are not only important in online assessments for students but also for online interviews. Just like in assessments, deadlines help to provide structure and encourage timeliness in the interview process. Here are some ways in which deadlines can be used effectively in online interviews:
Encourage timeliness: Deadlines can be used to encourage candidates to be punctual and arrive on time for their online interview. This can help to avoid delays and ensure that the interview runs smoothly.
Provide structure: Deadlines can help to provide structure to the interview process. By setting a time limit for each interview, interviewers can ensure that they cover all necessary topics and questions within the allotted time.
Promote fairness: Deadlines can promote fairness by ensuring that all candidates are given equal amounts of time to showcase their skills and experience during the interview. This can help to reduce the risk of bias or discrimination.
Facilitate planning: Deadlines can help candidates to plan and prepare for their interview. By knowing when their interview will take place, candidates can make sure they are available and can adequately prepare for the interview.
Avoid scheduling conflicts: Deadlines can help to avoid scheduling conflicts that may arise during the interview process. By setting clear deadlines for the interview, candidates can plan their schedule accordingly and avoid conflicts with other appointments or commitments.
Respect candidates' time: Deadlines show respect for candidates' time and demonstrate that the interviewer values their time as well. This can help to create a positive impression of the organization and encourage candidates to view the organization as a professional and respectful employer.
Encourage time management skills: Deadlines can help to encourage time management skills in candidates. By providing clear deadlines for the interview, candidates are encouraged to manage their time effectively and arrive on time for the interview.
In conclusion, deadlines are an important component of online interviews. They help to encourage timeliness, provide structure, promote fairness, facilitate planning, avoid scheduling conflicts, show respect for candidates' time, and encourage time management skills. By using deadlines effectively in the interview process, organizations can ensure a smooth and efficient interviewing process that is respectful and fair to all candidates.
A few months ago we introduced our online assessment builder
and got a lot of positive feedback. However, before you utilize the builder you need to have your quiz ready in front of you. We solved this problem and we now allow generating an online assessment by typing a few words and start assessing online instantly!
This feature will be ready in May 2023 so please stay tuned!
Online quiz generation with AI is a modern tool that uses artificial intelligence (AI) to create quizzes and assessments. This digital tool has revolutionized the way educators create assessments, making it faster, more efficient, and more accurate. In this article, we will explore the benefits of online quiz generation with AI.
Save time and effort
Online quiz generation with AI saves time and effort for educators. Instead of spending hours creating a quiz manually, educators can simply input the questions and let the AI generate the quiz. This tool can generate multiple quizzes in a matter of minutes, allowing educators to focus on other aspects of their job.
Despite we started with online quiz creation with AI, we also are looking into other aspects for AI integration:
Provide personalized assessments
One of the significant benefits of online quiz generation with AI is the ability to create personalized assessments. AI can analyze the performance of respondents and create assessments that are tailored to their strengths and weaknesses. This personalized approach helps respondents better understand the material and identify areas where they need to improve.
Increase accuracy
Online quiz generation with AI increases the accuracy of assessments. The AI algorithm can analyze the questions and answers to ensure that they are relevant and free of errors. This reduces the likelihood of mistakes and ensures that the assessments accurately measure the respondents' knowledge and understanding of the material.
Provide instant feedback
Online quiz generation with AI provides instant feedback to respondents. The AI algorithm can grade the assessments immediately and provide feedback to the respondents, highlighting areas where they did well and areas where they need to improve. This feedback helps respondents identify their strengths and weaknesses and make improvements in their learning.
Allow for data-driven decision-making
Online quiz generation with AI allows educators to make data-driven decisions. The AI algorithm can analyze the data collected from the assessments and provide insights into the respondents' performance. This information can help educators identify areas where they need to improve their teaching methods and adjust their curriculum to better meet the needs of their students.
In conclusion, online quiz generation with AI provides many benefits for educators and respondents alike. It saves time and effort, provides personalized assessments, increases accuracy, provides instant feedback, and allows for data-driven decision-making. By utilizing this tool, educators can create high-quality assessments that accurately measure respondents' knowledge and understanding of the material, leading to better learning outcomes.
We are very excited to announce our brand new feature:
Question Randomizer!
Here is how it works.
You create a section with, let's say, 20 questions, each question worth 10 points. Turn the randomizer on and set it to 5. This means each respondent will get 5 random questions out of a total of 20 with 50 points max for the section.
To use this feature in Quilgo Forms, choose the desired section, click the puzzle piece icon as shown in the picture below and set the desired number.
Here are some benefits of question randomization in online assessments:
It ensures fairness. Without question randomization, respondents could potentially share assessment questions with each other, giving some respondents an unfair advantage over others. By randomizing the order and selection of questions, each respondent receives a unique set of questions, making it much more difficult for respondents to share answers.
It helps prevent cheating. When respondents know the order or content of questions in advance, they may have the opportunity to cheat by accessing answers before the assessment. Randomizing the questions ensures that respondents cannot predict the order or content of the assessment, making cheating much more difficult.
It ensures that the assessment is valid and reliable. Validity refers to the extent to which a test measures what it is supposed to measure. Reliability refers to the consistency of results over time. By randomizing the questions, we ensure that each respondent is tested on the same content and that the assessment is consistent over time.
It helps respondents to focus. When respondents know the order or content of questions in advance, they may be more likely to focus on certain topics or concepts, while neglecting others. By randomizing the questions, respondents are forced to pay equal attention to all topics, which helps to ensure a more comprehensive understanding of the subject.
Makes it easier to analyze results. When questions are randomized, it is easier to compare the performance of respondents. If each respondent receives the same set of questions in the same order, it becomes much more difficult to compare results accurately.
In conclusion, question randomization is an important aspect of online assessments. It ensures fairness, prevents cheating, ensures validity and reliability, helps respondents focus, and makes it easier to analyze results. By using question randomization, we can ensure that online assessments are a fair and reliable way to assess respondent knowledge and understanding.
You might have noticed we are actively working on various bits at Quilgo.
This time we introduce the Smart Screen Tracking feature - it attempts to capture screenshots once unusual activity is detected and reports them. You can refer to our Docs
to see how screen tracking works.
Here is how screen proctoring can help:
Preventing cheating
One of the primary benefits of online assessment proctoring is that it can prevent cheating by respondents. Proctoring software can monitor respondents' behavior during exams, including recording their screen and webcam, flagging suspicious activities such as opening new tabs or attempting to copy and paste answers. This way, educators can ensure that the respondents are following the rules and not using external sources to complete their exams.
Convenience
Online assessment proctoring is also convenient for respondents, as they can take the exam from anywhere, at any time, as long as they have an internet connection. This flexibility can help reduce stress and anxiety, as respondents can take the exam in a comfortable environment without the pressure of a physical testing center.
Cost-effective
Online assessment proctoring can also be cost-effective for educational institutions. Traditional in-person proctoring requires physical facilities and personnel to monitor the exams, which can be expensive. Online proctoring eliminates the need for physical facilities and personnel, reducing costs and allowing educators to allocate resources elsewhere.
Time-saving
Online assessment proctoring can also save time for educators. Traditional in-person proctoring requires scheduling and coordinating with respondents to take the exam at a specific time and place. With online proctoring, educators can simply provide the exam and let respondents take it on their own schedule. This allows educators to focus on other tasks, such as grading and providing feedback to respondents.
Improved accessibility
Finally, online assessment proctoring can improve accessibility for respondents with disabilities. Proctoring software can include accommodations such as screen readers and enlarged text, making exams more accessible for respondents with visual impairments. Online proctoring also eliminates physical barriers that may prevent respondents with mobility impairments from taking in-person exams.
In conclusion, online assessment proctoring provides many benefits for educational institutions and respondents alike. By preventing cheating, providing convenience, reducing costs and saving time, and improving accessibility, online proctoring can help ensure academic integrity and fairness in the evaluation process.
