Why doesn't Smart Revise use AI to mark Advance questions?
Smart Revise uses AI to mark longer answer questions that are set in a Task by the teacher, but it does not use the AI marking function for Advance mode. There are three main reasons for this.
Reliability
With Tasks, teachers have an opportunity to moderate the marking and consider the AI feedback before releasing it to students. Allowing Advance questions to be marked by AI would remove this human filter.
AI is still in its infancy and the way examiners expect candidates to answer questions is not necessarily something the large language model understands. Typical examples include:
- Some courses where "justify" does not mean considering both sides of an argument, it means giving reasons for one side of the argument.
- Some courses where "evaluate" does not mean considering factors that are outside the case study given but referring to the context provided.
- Some courses where "chained line of reasoning" following assessment objectives (AOs) outlined in the specification means that candidates must structure their answer in that way.
AI does not appreciate these nuances and sometimes tries to be helpful in explaining how an answer could be improved (even though it should only be justifying its mark awarded), and as a result could misdirect a student.
Pedagogy
The best preparation for examinations is to engage with the mark schemes yourself. You will be able to see typical answers that examiners would expect, together with how the mark schemes are structured. If you used AI to mark answers you would bypass what is probably the most important part of answering the question, that is evaluating the accuracy of your answer and understanding what additional knowledge or structure you could have applied. While AI can help with this it is not as good as a student.
Cost
We want Smart Revise to be as affordable as possible. Using AI for commercial applications is not free, there is a charge per "token" which you can think of as a syllable in a word. The longer the answer a student gives, and the more often they use Advance mode (which we want to encourage) the more tokens are used and the more it will cost to provide the service.
Related Articles
AI marking in Smart Revise
Our model Smart Revise AI marking uses an adapted large language model provided by OpenAI that is fine tuned to the Smart Revise context. Data protection No personal data is sent to OpenAI. We only send the question, meta data about the question to ...
How to mark a task
Once a task has been submitted by a student you will need to mark them if you have not enabled self or peer marking. Most questions can also be marked by AI, but not all. Navigating to a task To mark a task, log into your teacher account and navigate ...
Try Smart Revise for free as a student
Sign up Head over to smartrevise.online and create a free student account by clicking Sign up as a student. Join a class if your teacher has an account You can skip this step if you are trying Smart Revise for yourself and not joining a teacher's ...
Whitelisting Smart Revise
If you need to update your firewall to allow access to the Smart Revise website, please add the following domains. smartrevise.online *.smartrevise.online (currently the following subdomains in use are "www" and "cdn1" but this may vary over time.) ...
Do you have a letter we can provide parents in regards to purchasing Smart Revise?
Yes we do! It is supplied in Microsoft Word format, so feel free to edit it to meet your needs, but it should provide a starting point if you are looking to supply a letter to parents.