Blog · 21 November 2026
Pairwise comparison beats individual scoring An AI judge ranked 100 essays from the ELLIPSE dataset by comparing them in pairs. The ranking matched trained human raters on most pairs, and on nearly all where the raters saw a clear difference. Scoring each essay individually did much worse.
LLM-writtenBy Claude Opus 5.5
Method
The test set is 100 essays from ELLIPSE , a public corpus of essays by English language learners in grades 8 to 12, all written on the same prompt. Two trained raters scored each essay for English proficiency on a five-level rubric. The average of their scores is the ground truth.
An AI judge (Claude Haiku) ranked the essays in two ways, with the same rubric:
Pairwise. The judge reads two essays and picks the stronger one. 800 such verdicts are combined into one ranking.
Individual scoring. The judge reads each essay alone and gives it a whole-number score from 1 to 5, the rubric’s scale, and the essays are ranked by score.
Judging criteria
The judge used ELLIPSE’s own five-level proficiency rubric, with every pair judged in both orders.
View the prompt Judging criteria given to the AI
You are an experienced rater of English language proficiency in essays written by English language learners in grades 8 to 12. All essays answer the same prompt.
Judge which essay shows the higher overall English language proficiency, using the holistic scale below. Judge language proficiency, not the opinion taken or how persuasive it is.
5: Native-like facility in the use of language with syntactic variety, appropriate word choice and phrases; well-controlled text organization; precise use of grammar and conventions; rare language inaccuracies that do not impede communication.
4: Facility in the use of language with syntactic variety and range of words and phrases; controlled organization; accuracy in grammar and conventions; occasional language inaccuracies that rarely impede communication.
3: Facility limited to the use of common structures and generic vocabulary; organization generally controlled although connection sometimes absent or unsuccessful; errors in grammar and syntax and usage. Communication is impeded by language inaccuracies in some cases.
2: Inconsistent facility in sentence formation, word choice, and mechanics; organization partially developed but may be missing or unsuccessful. Communication impeded in many instances by language inaccuracies.
1: A limited range of familiar words or phrases loosely strung together; frequent errors in grammar (including syntax) and usage. Communication impeded in most cases by language inaccuracies.
Do not reward length for its own sake.
Each ranking is evaluated on the 3,758 essay pairs the human scores separate: the measure is the share of those pairs it puts in the same order as the humans. A random order scores 50%.
Results
The pairwise ranking put most pairs in the same order as the human raters. Its errors are concentrated in close calls: where the raters’ scores differed by 1.5 points or more, it agreed on 98% of pairs.
50% 60% 70% 80% 90% 100% Close call0.5 pt Clear1 pt Very clear1.5 pt Obvious2+ pt Pairwise, 0.5 points apart: 78% of pairs Pairwise, 1 point apart: 89% of pairs Pairwise, 1.5 points apart: 98% of pairs Pairwise, 2 points apart: 98% of pairs Pairwise Individual scoring, 0.5 points apart: 60% of pairs Individual scoring, 1 point apart: 69% of pairs Individual scoring, 1.5 points apart: 81% of pairs Individual scoring, 2 points apart: 88% of pairs Individual scoring
Share of essay pairs put in the same order as the human raters. The axis starts at 50%, the score of a random order.
Individual scoring by the same model ordered far fewer pairs correctly. It gave 78 of the 100 essays the same score, a 2, so most essays tied.
Human raters, average of two
1.5 2 2.5 3 3.5 4 4.5
AI, individual scores
1 2 3 4 5
Number of essays at each score.
Pairwise agreement with the raters was comparable to the raters’ agreement with each other. Where both raters separated two essays, they agreed on the order 93% of the time, but they gave the same score to 30% of pairs. The pairwise ranking orders every pair.
Length does not explain the result. A ranking by word count is barely better than chance.
A B Browse example judgments 8 essay pairs side by side, with the raters' scores and the judge's reasoning Agrees with the raters
Essay A Raters' pick AI's pick 4.0 raters' score out of 5
Going to school is the worst way to attend classes. Online or video conferencing would benefit students to attend classes. Although going to school helps. Taking a class at home, student don't have to worry about classmates bulling, being late cause there is no place to travel, and having no food to eat in school.
Waking up early every morning to school can be very stressful. Students have to take a shower, brush their teeth, some girls put on makeup, and then packing the school bag. Students often get lazy getting up from bed therefor missing the bus. So they have to stay home, maybe wait for a ride, or even walk to school. Most students don't get a good amount of sleep that makes their focus off in class, also the hunger get the best of them which makes it worst. Working online students may pick the time that best fit them and the student stay home. So he or she don't need to worry about looking good.
Attending online classes there will be no classmates which is a good thing. Having no classmates he or she can focus on work, because the student is not in the class with a lots of people that will makings noises or distract the student. Since your not in a classroom nobody can bully, tease, or judge the student. That makes some students go though depression in school by bullies. For example the way he or she dress, looks, smells, or did in the pasts. It will make students not attend school no more. Therefor online classes students will be working by their self which will give them more focus on school work.
What can you benefit attending class from school? Going to school he or she can commutative with other people to make friends. Students can ask teacher or friends for more help. Cause the student is going out parents are saving money by the electric bill will be lower. By he or she going to school they can do sports or programs after school to help choose their career, and not be coup up staying at home.
In conclusion attending online class can benefit the students. It the best way to get the education. By keeping the students safe from bullies, no distraction from classmates, always have food to full up the belly to focus, and taking online classes that can work on the students time.
vs 2.5 raters' score out of 5
In may opinion, i think students they can't benefit by attending classes at home.
Because it is going to be so mach difficult for they working at home stading or doing homework by them self and by taking a classes online or video conferencing is going to be mach difficult then taking a class with a real teacher and not on the computer.
Is a lot of distraction at home like children's, noises, and animals so that is going to make a distraction for them so at home it is not going to be a good place for them to study,
and student they can't concentrate when they are working so study at home is not going to be a place for student's, and some of the students they don't care about studding thats why they prefer to study at home were no one is going to tel them noting if he don't do homework or study for a test.
Students they can get boring, tired, or angry when they don't no how to do sameting and they don't get help from nobody to do homework or something that they don't no how to do and then they star getting deprecation or headech.
The best way the students can be benefit, is going to school, get help from teachers, learn more then study at home, they can do something different like do sports, playing music, or something that is going to make their future grad.
◆ AI judge
Text A shows more varied syntax, longer and more developed sentences, and a clearer organizational structure with paragraphs covering distinct points and a conclusion, though it has frequent errors (e.g., 'bulling', 'therefor', 'the student stay home'). Text B has more pervasive errors in spelling, word choice, and mechanics ('mach', 'studding', 'noting', 'deprecation', 'headech'), with very short, loosely connected sentences and communication impeded more often. A is therefore the stronger language performance, though both fall in the lower bands.
Same pick with the essays in the other order.
Agrees with the raters
3.0 raters' score out of 5
AS Technology grows people have more options to education. Knowledge is more accessible then ever before because of New Technology. Some think distance learning is not effective sent because what if you don't under stand and have several questions that need to ve answer right away? Some believe it is the fetcher of schools. If a one Student don't attend to class for personal reasons distance learning is the best solution. People are still arguing about this problem. Some schools offer distance learning as an option for students to attend classes from home by way of online or video conferencing from home. Distance learning option is effective because students work most of the day. If they miss School for personal reasons and safe Environment.
Many study showed Most high school students and college students work at least 3/4 days a week. Students are very tired though out the day. That means students are not doing there best at school. If schools are offer distance learning options from home they put better effort on the task they are given because they will get enough sleep and rest.
Every student have different things to deal with out side of school and some times those things can get in the way of school. If a student miss day of school for many reasons like Doctor Appointment, Vacation, Sickness and other many reasons. He or She can attend to class from other places online or video conference. It helps students to manege school and other personal things.
The final reason why distance learning is better is because it is safe. when students go to school they can be exposed a lots of bad things like drags, alcohol and others. Schools are not the safest environment for students. School Shooting,Physical Bulging are major problem and distance learning will solve those problems that are listed above. Some schools offer distance learning as an option for students to attend class from home by way of online or video conferring. That help students because most students work, if they miss school for personal reason or by accident and school is not safe environment. Every school should offer distance learning as an option for students.
vs Essay B Raters' pick AI's pick 4.5 raters' score out of 5
If you were able to take online classes wouldn't you take them. Some schools offer distance learning as an option for students to attend classes from home. Distance learning is a program that allows you to take classes by way of online instead of physically attending a class. Taking online classes has many benefits that contribute to your personal life and also your student life. Online classes allows you to work at your own pace, have more time for yourself, and be able to work without any distractions. I believe that distance learning is a great option for schools to offer students.
Physically attending a class can sometimes be stressful. Teachers only have a certain amount of time to teach you what they have plan for that day and they tend to rush you. But what some teachers don't understand is that everybody doesn't learn at the same speed. It takes some students longer to understand what they are teaching. If you take online classes you wouldn't have to worry about anyone rushing you, because you can work at your own pace.
When you attend a class you really don't have time to take care of yourself, especially if you have multiple classes in one day. When its time to leave school you probably have to go straight home because you have to write an essay or have other homework to do. Also if you play a sport that makes it harder, because you have to balance your life, school, and the sport that you play. With online classes it makes it so mush easier because you can get your work done early in the morning instead of waiting for school to start for you can go to class. Just think about the extra time that you could have.
Having classes with other people can be very distracting. In all your classes there's always going to be someone or something that is keeping you from focusing. At home you don't have to worry about anyone distracting you. With online classes you can do your work peacefully.
More schools should start offering distance learning to students. I believe that students would do better in school if they had online classes. Online classes gives them the chance to work alone and not be distracted by anything. Schools should allow students to choice if they want to take online classes. Everyone doesn't work at the same pace.
◆ AI judge
Text A has frequent grammar, spelling, and usage errors ('under stand', 've answer', 'fetcher of schools', 'there best', 'manege', 'Physical Bulging', 'Many study showed', 'can be exposed a lots'), and some sentences are fragmentary or confusing, which impedes communication. Text B is largely accurate and fluent, with more varied sentence structures and a clearer organization of reasons, though it has a few slips ('mush', 'choice', 'Everyone doesn't'). B's language inaccuracies are much less frequent and rarely impede meaning, so B shows higher English proficiency.
Same pick with the essays in the other order.
Agrees with the raters
Essay A Raters' pick AI's pick 4.0 raters' score out of 5
Do you get boerd being at home all the time? Well, imagine having to go home and take classes online. Some say, students benefit from being able to attend classes from home by way of online or video confrencing. On the otherhand, others suggest that students taking classes online can cause lot's of distraction, being anti-social, and giving an oppurtunity to cheat on a subject without getting true help, and support from a teacher in school.
We all like being on social media and communicating with our friends and family whenever we have the chance. But, texting your freinds and trying to do your work at the same time can be a huge distraction. However, if a student is giving an advantage to take classes online, it will cause a student to get off task and go on their phone without having the right discipline like a regualr school would have.
In a regular school, students would have the oppurtunity to communicate with their peers. For example, if a teacher assigned a project for the class and told them they are able to work in groups. This wouldn't only count as a grade but, being able to be social with your classmates and not being able to do the work independently. Which is a great idea so that it wouldn't cause a student to be ant-social.
Finally, giving a student the advantage to take classes online will give them the idea of going to a different website and finding the answers to the question. Ironically, that's what a student would do if they had the chance to. But,
would it be helpful to ask for guidence, from someone who can actually give you some ways to help make you understand the topic. Not being able to get that type of help can be stressful and cause you to cheat.
In conclusion, taking classes online isn't a bad idea if wanting to finish school faster. But, it can also cause you to get distracted , anti-social, and not having the ability to get proper help when struggling with a specific topic.
vs 3.0 raters' score out of 5
The benefit by taking classes online. The benefit are the students don't has to go school, the classes are more shorest and one disadvantage is the student has to work by it self. The online classes have many benefit but it do have some disadvantage.
First, The student don't have to go school. The stdudent rather more online classes then go to to schools. The student. The student who are all the time late to school they will not be late any more. The students can wake up late to take their classes. This is one of many benefits for taking online classes.
Second, The online classes are more shorest then the time the students have to be in the schools. Most of the students . prefer online classes because the wake up and take the class any where the student is. The classes at school are more longer then classes in online. This is why the student prefer online classes beause those classes are more chorest.
Third, The disadvantage by taking online classes . The student have to work alone by it self. The students have alot of work and nobody can help him. The student can't work with other students after classes. The teacher during te time the classes he can help the student when that tie finis the teacher finish helping the student. The studentsthey don't have time to meet other students. This are some disanvantage by gething online classes for thr students.
Finally, The student in favor of goin to school the want to get more online classes. These are some benefit why most of the student want to take online clases. There are some good benefit for taking online classes.
◆ AI judge
Text A has more syntactic variety, uses richer vocabulary and phrases (e.g., 'anti-social', 'distraction', 'ironically', 'well-controlled' argument structure with an introduction and conclusion), and shows fewer grammar and spelling errors that impede communication. Text B relies on very simple, repetitive sentences, has frequent grammatical errors ('The benefit are', 'don't has to'), many misspellings, and fragments that make meaning hard to follow. Under the criteria, A clearly reflects higher English proficiency, though both are at lower levels.
Same pick with the essays in the other order.
Agrees with the raters
Essay A Raters' pick AI's pick 4.0 raters' score out of 5
Have you ever wondered if doing class work from home benefits the students? Yes, students would be able to benefit from doing class work from home. I have some strong and good reasons on why it benefits them. These reasons have been said by many people in the past that have done it as they listed; they are more focused, more time with family, more sleep, and you can do it at any point of the day.
First, more students say they feel more focused at home then what they would've been in school. For example, they say that there is no distraction to keep them from completeing their work and turning it in. Especaily, when its something important that would help them graduate from their classes. In fact, they have better thoughts of what they are going to do for their class work. Even though, when they have important family that they don't get to see as offten they would be able to spend more time with them.
As a result, students that do their class work from home have had a greater portion of passing then being in school. Thus, students have been able to work better when they have gotten a full night or resting. In other words, students have proven to be more active and awake when they wake up at there own time. Lastly, students don't worry about having to rush through the material and turning it in on time.
In conclusion, do students really benfit attending school from home? Students do benefit more when they are attending school from home. More importantly, they can focus more on the work given, as well have more time with their family, they can get plenty of sleep to do be able to do their work, and they can do their work when they feel they are ready to complete it in the day.
vs 3.0 raters' score out of 5
I think that could be a good idea attend classes from home by way of online or video for the students that can not eat before go to school because they no have time get the bus, students want extra credits, and can take the time that they want in online classes.
Examples:
I don't eat breakfast before go to school, because I don't have time to do it or I will loss my bus. Because is normal see a student come to late for the bus, and when I talk with others students they always tell me that they are hungry, so this new way "class online" can benefit to us.
Some students want extra credit to get a better diploma so this be more easy for these students, or also can help for students that failed a class, because sometimes friends tell me retake this class or he can't graduate so this other fact why its a good idea this new way to teach to the students.
Students need to do something like go to hospital, get sick, or other thing can happen in their life, they will loss class and this can affect on their grades, so I think if we get online class this could not happen because every class is recording so when the student have the time to do the class online or watch the videos that they have to, they will keep their grades higher and dont worry about grades no more.
◆ AI judge
Text A shows more syntactic variety and a wider range of connectives and phrases (e.g., 'As a result,' 'In other words,' 'In fact'), with mostly controlled organization and a clear introduction and conclusion, though it has spelling and some grammar slips. Text B relies heavily on run-on sentences, frequent omitted auxiliaries and articles ('I don't eat breakfast before go to school', 'they no have time'), and weak organization, so its language inaccuracies impede communication more often. Text A is therefore the stronger English language proficiency sample.
Same pick with the essays in the other order.
Agrees with the raters
Essay A Raters' pick AI's pick 4.0 raters' score out of 5
Online courses are a great benefit for all students , a good and huge opportunity . Students in this way learn step by step ,creating an environment that can help them to go by their own path. Also, learning from the comfort of home brings more concentration, and better results to the student. An online course doesn't take to much time to achieve it .In other words, if you choose to receive your courses online, you don't have to leave your house to go to other place to learn, you choose the time for it and you can complete it early and ,you can count on have very high expectations about your results.
Summer courses, brief courses and, courses that lead to complete a class in college are some examples of online courses you can take. Some are free and some not but, all of them offer a good list of materials, they provide you those materials in order to make the course easy and understandable to the student. The materials that you can take benefit on are a lot. Video conferencing, online books,calculators,dictionaries,videos and,games are some of them .Even they offer the opportunity to start a chat with you course's peers if you want to share your ideas and questions with them or the teacher. So you cannot complaint about anything.
In conclusion ,online courses don't replace a school environment but, it helps the student to go faster during the school year . It helps them to reach another classes successfully . Students during that learning are the leaders of their time and how they are managing they way they learn every lesson of the course. Nothing is a bad idea if you decide to discover other ways to learn, feed more your knowledge, what you want and what you need, all in order to be a successful person.
vs 3.5 raters' score out of 5
Some studies had say that, some schools offer distance learning as an option for students that attend classes from home by way of online or video conferencing. Classes online or video conferencing are a way to learn for all type of students throughout their lives, even when they are college students. Online courses have helped a lot of students to graduate on time, and with the necessary education.
Students that attempt classes from home by way of online can benefit by learning as if they were at a regular school, however, other don't take advantage of it. Some parents believe that online courses do not help students to get the right education because students can get distracted very easily with what is happening in their surroundings. Other half of parents, believe that online courses are an amazing way for students; because they can finish their school courses at home while they can be able to help at home, or even while they have a job.
For example, many students that attempt to a regular school are more focused, and integrate to their education. Also, attempting to face to face classes is easier than learning a class online. You can learn so much quicker, ask all the questions you may have, and even work along with your classmates.
Another example, online courses are definitely not for every student, most students do not focused, and some get distracted very easily. Also, a lot of students do not benefit from an online class because they do not give all their effort to learn. They focused more on what is happening in their surroundings, and even they can fell sleep. Sometimes is really hard to focus when there are things going on surround us but it only takes a lilttle of effort.
Students that actually benefit from an online class is because they are interested on passing that class, and want to learn as more as possible; putting all the effort, focus, and heart on it.
As a conclusion, students that attemt to classes from home by a way of online or video coferencing can benefit from it and most can't. It takes a lot of effort and focus to learn from an online class, and that is a something most students do not have.
◆ AI judge
Text A has mostly clean grammar and a broader range of structures and vocabulary (e.g., 'well-controlled' ideas, 'benefit on', 'complete it early', 'count on have very high expectations'), with some errors like 'to much', 'complaint'. Text B has more frequent and impeding errors: 'Some studies had say', 'attempt classes', 'fell sleep', 'lilttle', 'coferencing', 'focused' for 'focus', and awkward phrasing like 'Other half of parents'. Text A has better syntactic control and fewer communication-impeding inaccuracies, so it shows higher overall English proficiency.
Same pick with the essays in the other order.
Agrees with the raters
Essay A Raters' pick AI's pick 3.5 raters' score out of 5
Technology is a big part of our everyday life. People uses technology to make their life more comfortable. Nowadays,many schools offer distance learning from home by online or video streaming. Although, students can save their time by attending online classes nevertheless,students might use their notes on the test without their teacher's consent and students can become unsocial because they will not get to meet new people or will not able to hangout with their friends.
To begin with,school is where we get to make our friends and can have experiences with new opportunities. If technology takes over then the students will not be attending classes and will not be experiencing what the other side of the world looks like. Students will often prefer the online classes because waking up in the morning is stressful for so many students. For example, many schools offer club and special activities for students so they can volunteer and work with their interest to build experiences. If students take online classes then they will rather take online classes than going to school. As a result students are losing their opportunities by not joining these organizations. This shows that online classes are harming students rather than doing goods.
Furthermore,online classes are not worth it for students. Students might cheat while during the worksheet or project just to pass the class therefore,the students do not get to learn properly. For instance,students can easily open their notes while taking the test or have their friends do it for them. Even if the teacher is video streaming student can still access to the Internet to look up the answers. This proves that student will suffer from lack of education experiences in the future.
Overall, online classes are harming students. They might saves student's time but mostly student will take advantages for not attending school and doing nothing. Sometimes students will just want to get the grade without doing the assignments. In conclusion, online classes should only be access to special students for certain amount of time. That way students can actually go to class and communicate with people and can also be involve with other school activities rather than being lazy and taking the class home.
vs 3.0 raters' score out of 5
I think students wouldn't benefit from being able to attend clases from home because for
Some students will be more hard to learn and it will be effect in communicacion skills.
students wouldn't benefit from being able to attend classes from home becuase for some students will be more hard to learn. They prefer face to face with a teacher. Not going to school it will effect students communication skills. It will not led students communication skill to growth up beacuse they will not have to many people around them.
Some students will be more hard to learn taking classes from home becuase it will not be a teacher to teach them when they have a questions. some students are more face contact to be able to learn more easily. If you go to school your friend in class can explain you something that you didn't understand but, taking classes at home you don't have nobody to ask for help.
Students can be even asking for help to others teachers. Their are some students that English is not their first language and for thrm it will be more hard taking clases from home.
Students attending classes from home it will be affect their communication skills becuase they will not be able to talk with different person. This can be affect as they are growthing up becuase they will be scared to talk to new persons or to know new people. communication skill is important for everything even at work place and attending to online or video conferencing clases students will not be training their skill.
some students will said that taking online or video coferencing it will be benefit because it can prevent bus accident or car and can save student life , but some stydents are more safety at school them a house. Taking clases from home will not benefit in anything. it just will be destroyed students life becuase they will not be learning how to used their communication skill.
◆ AI judge
Text A has more controlled organization with a clear introduction, body paragraphs, and conclusion, and its errors ("People uses," "will not able") are fewer and less disruptive. Text B has a fragmentary opening, a stray sentence fragment, and frequent spelling and grammar errors ("clases," "becuase," "thrm," "Their are"), with repetitive, loosely connected paragraphs that impede communication more often. Text A better fits the level-3 descriptor, while Text B fits closer to level 2.
Same pick with the essays in the other order.
Disagrees with the raters
3.0 raters' score out of 5
i thnk students will not benefit from attending classes at home because its not the same as studying with a teacher, at school. if i was in this position i know for sure that i wouldnt be paying attention and be distracted all day because i go out with friends and family. at the same time if i were to take the classes at home, it would benefit me by being home with family, be able to go to work early, and actually participate because it would allow me to be on my own, alone and i like to be alone. Another benefit of attending school at home is that you will not have to drive, get stuck in traffic, and will be able to save money. If i were to take classes at home my mom will be on me about school because she really wants me passing and not failing. One thing i wouldn't like, would be working on my own because at times i do like to work on my own but mostly, i would like doing partner work with a friend. A goood thing about classes at home would be that you would be on your own schedule not like at school, you can sleep in more then wake up and start some classes, or you can do classes at a later time.
vs 2.0 raters' score out of 5
Although some say students would not be benefit from being able to attend classes from home because the capacity of learning decrease, actually students would be benefit from being able to attend classes from home because the efficiency to proccess information increase and each student will demostrate the level of learning by their efforts.
Some say students would not be benefit from being able to attend classes from home because the capacity of learning decrease.
"President of teachers from the american confederation of learning"(article 1).
"Survey from teachers to parents in the United States"(article 2).
Students would be benefit from being able to attend classes from home because the efficiency to proccess information increase.
"The space from being at home make the concentration easier for students"(article 2).
"Enough time to complete classworks and asigments"(article 1).
Students would be benefit from being able to attend classes from home because each student will demostrate the level of learning by their efforts.
"The capacity to find information by their own"(article 1).
"Development to take responsabilities and knowledge to manage them"(article 2).
Although some say students would not be benefit from being attend classes from home because the capacity of learning decrease, actually students would be benefit from being able to attend classes from home because the efficiency to proccess information increase and each student will demostrate the level of learning by their efforts.
In conclusion, this type of learning from home, benefit students, and teachers in many ways. All schools should concider the offer for students to attend classes from home, by way of online or video conferencing.
◆ AI judge
Text B shows more controlled organization, with a clear thesis, structured evidence sections, and a conclusion, and it uses more varied phrasing ('Although some say...', 'In conclusion...'). Text A is informal, uses lowercase throughout, has frequent spelling and punctuation errors, and relies on simple, run-on sentence structures with generic vocabulary. Although B also has many spelling errors and repetitive grammatical mistakes ('be benefit', 'demostrate'), its overall facility with syntax, connectives, and text organization is stronger than A's, placing it nearer level 3 than A.
Same pick with the essays in the other order.
Disagrees with the raters
3.0 raters' score out of 5
There are different advantages and disadvantages from studying from home, most of the people thing that there are more disadvantages, so students won't benefit from being able to attend classes from home. Some of the reasons than affect the students are: the students won't pay the same attention studying on their home as studying in the school, it also would be easier for the students to cheat on the different activities without a teacher watching them, the network can get disconnected very easy, some of the students will study at the time they want without finishing what they are suppose to finish, and they won't live the same experience with their friends in the school.
Some students have some problems paying attention in the school, most of them getting distracted doing another thing that doesn't have to be with the class, they also need a teacher that keep they remindind to do their work or stop doing the other thing, so what do you think they would when they are in home with lots of different distractions or activities to do, they won't be able to pay the same attention, because they don't have the one person that tells them to be quite or be paying attention. Some times it's good to have someone that helps them remind to do what they are supposed to.
Although if the students can attend classes from home it would easier for them to cheat when they are on their home, lots of students cheat on most of their tests just to get a good grade and pass the class that they need to pass, in their homes they can reach every kind of information just by searching it, so what it's going to tell us that they won't do that, instead of studying hard to get the grades they need, it is necesary to have someone to supervise how they do the exams or works that need to be made by their own. If they keep cheating, they won't learn anything from the classes they are taking.
Also it can happen that you are on a important class or some test that you are taking, and the network can just turn down. It is risky to take classes in a computer, because you don't know when the network will work in a good way, or just don't work. It can make them lose some important lessons they need to take or make them fail a test because of the bad network, sometimes the screen can freeze in the half of an important thing, so it is important to don't trust to much in the electronic devices we have.
Most of the students don't like to studying, don't like to do homework, or just don't like to work. So if the students would be able to attend classes from home, lots of the students won't keep studying just because they don't want, they would be able to do whatever they want, because they don't have someone that helps them understanding and trying to get their work done. Most of the students don't do their work because they thing that won't be useful in their life, they need to understand that every topic in each class is important for the different things they are going to be through when they grow up.
It is also good for some students to come to the school to make some friends, and do other things they won't do on their home, it is a different experience to be with lots of people, to meet them, and talk about different interestings they have, some students like to come to school just to see their friends, that what make them happy. This helps you get a social life and be happier every day.
In conclusion, there are more disadvantages than advantages from being able to attend to classes in the computer from home, all of them to keep the student studying, and keep him doing his work in the way it is supposed to be, to improve his knowledge while he is in the school.
vs 4.0 raters' score out of 5
Being schooled at home is what other children would've wanted and where they can just wake up at any time and doesn't worrry about being late.
There are also other types of way to attend classes at your home. For example, taking it online and video conferencing with your teacher and others from that school. And it is much more easier in a regular school.
Firstly, taking classes at home is much more comfortable than taking classes at school. Therefore, you can relax, not be tense, and not being afraid to ask questions. It is much easier to handle than a regular school.
Secondly, you're much more focus there are no one to annoy you, making such noise, or hearing somebody else talking about other stuff whether it is important or not. It is much more quieter than any of the room you've been in and your head is on the right point.
Thirdly, you don't need to worry about troubles unless you're slacking no, i'm talking about bullies those brats who always pick on the weak. Their head is not the right pont where they por they're anger all to you.
And others would say that taking classes from home can take your mind off from your objective. Because they're distraction if you have sibling and when you just can't really focus when you play games all the time and watch tv.
In conclusion, studying at home instead taking classes from a real schools can alson be hard there's really no one that you can depend on except, you have a teacher on your house now, thats much more easier.
◆ AI judge
Text A has more developed syntactic variety, longer and more connected sentences, and a clearer organization with topic sentences and a conclusion, though it has frequent errors ("thing," "suppose to," "remindind"). Text B is shorter, has more fragmentary and garbled sentences ("where they can just wake up at any time and doesn't worrry", "no, i'm talking about bullies"), weaker connections, and more severe communication breakdowns. Text A's errors are frequent but its communication is largely intact, placing it above B on the scale.
Same pick with the essays in the other order.
Limitations
One sample of 100 essays, one prompt, one run.
ELLIPSE has been public since 2023, so the essays may be in the model’s training data.
Conclusion
Pairwise comparison was far more accurate than individual scoring, with the same model and the same rubric.
Fewer than half the errors. Pairwise put 14% of essay pairs in the wrong order, against 33% for individual scoring.
Near-perfect on clear differences. Where the raters’ scores differed by 1.5 points or more, pairwise agreed on 98% of pairs, against 83%.
As consistent as a second rater. Pairwise agreed with the raters about as well as they agreed with each other.
Individual scoring could not separate the essays. It gave 78 of the 100 essays the same score.
Full results
Pairs in the same order as the raters’ average. These are all 3,758 essay pairs the raters’ average separates. Pairs a ranking ties count as half right. Intervals are 90% bootstrap intervals over essays.
Ranking
Same order
Pairwise
86% (81 to 90)
Individual scoring
67% (63 to 72)
Word count
57% (50 to 64)
By how far apart the raters’ average put the two essays.
Score difference
Pairs
Pairwise
Individual scoring
Word count
0.5
1,773
78%
60%
56%
1
1,259
89%
69%
56%
1.5 or more
726
98%
83%
62%
Against a single rater, compared with the other rater. Ties make this comparison depend on how they are counted, so both ways are shown.
Ranking
Ties count as half (avg. of both raters)
Only pairs both separate
Share of pairs it separates
Rater 1 against rater 2
79% (73 to 83)
93%
70%
Pairwise
87% (82 to 91)
89%
100%
Individual scoring
69% (64 to 74)
93%
44%
Rank correlation (Spearman, ×100), the standard measure in essay-scoring research. Intervals are 90% bootstrap intervals.
Ranking
Against one rater (avg. of both)
Against the raters’ average
Top-quarter overlap
Rater 1 against rater 2
61 (50 to 70)
n/a
60%
Pairwise
68 (58 to 75)
75 (65 to 83)
68%
Individual scoring
51 (41 to 61)
55 (45 to 66)
52%
Word count
15 (0 to 30)
17 (0 to 34)
24%
Top-quarter overlap is the share of a ranking’s top 25 essays that are also in the humans’ top 25.
Differences in rank correlation (paired bootstrap, 90% intervals):
Pairwise minus rater against rater: +7 (−3 to +17).
Pairwise minus individual scoring, against the raters’ average: +20 (+9 to +31).
Length. Controlling for word count leaves the pairwise rank correlation at 75. The pairwise ranking correlates with length at 29, the humans’ at 17.
Method.
Sample: 100 essays drawn at random from the 192 in the test split on the prompt “Distance learning”.
Human scores: each rater gave a whole number from 1 to 5. The ground truth is their average, which runs from 1.5 to 4.5 with a mean of 3.15. The dataset has no human ranking. The human order comes from sorting by these scores, so many essays tie.
Rubric: ELLIPSE’s holistic level descriptions, verbatim, plus “judge language proficiency, not the opinion taken” and “do not reward length”.
Pairwise run: each essay met 8 opponents, and every pair was judged in both orders. The ranking is a Bradley-Terry fit of all 800 verdicts.
Individual scoring: one whole-number score per essay, from 1 to 5. Each human rater also gave whole numbers; the half points come from averaging two raters.
Judge checks.
The judge picked the essay it read first 64% of the time. Judging both orders cancels this out.
It gave the same verdict in both orders 61% of the time.
Split-half reliability was 0.71.
Caveats.
ELLIPSE excluded essays and raters its authors found unreliable, which raises the human benchmark.
Prior work. An EMNLP 2025 study found the same direction on another essay corpus: GPT-4o agreed more with human scores when comparing pairs than when scoring directly.