{"id":1136,"date":"2011-11-07T10:29:57","date_gmt":"2011-11-07T10:29:57","guid":{"rendered":"http:\/\/newsletter.alt.ac.uk\/?p=1136"},"modified":"2011-11-07T10:29:57","modified_gmt":"2011-11-07T10:29:57","slug":"the-elements-of-e-assessment","status":"publish","type":"post","link":"https:\/\/altc.alt.ac.uk\/blog\/2011\/11\/the-elements-of-e-assessment\/","title":{"rendered":"The elements of e-assessment"},"content":{"rendered":"

When people think of e-assessment, they often think of online testing, in other words, the point when a candidate takes an exam. But nowadays technology is being harnessed to support the whole journey that \u2018assessment\u2019 involves.<\/span><\/h2>\n

OCR \u2013 Oxford, Cambridge and RSA Examinations \u2013 is in the business of assessment. It is one of the UK\u2019s largest awarding bodies with its core remits being to develop fit for purpose qualifications and to assess candidates who take those qualifications. OCR is also part of Cambridge Assessment, the University of Cambridge\u2019s international exams group, which has a global reach in assessment.<\/p>\n

Every year, more than three million students gain OCR qualifications. As well as school exams such as GCSEs and A Levels, OCR offers vocational qualifications in areas relevant to large sections of the workforce, such as IT, business and administration, and health and social care. Success in achieving qualifications following appropriate assessment helps to ensure a person\u2019s progression on to the next stage in their education or career and can have a major influence on their future.<\/p>\n

In recent years OCR has introduced technology across the breadth of the assessment process: in exam administration, marking, testing, and results. For teachers and trainers delivering OCR qualifications, technology is also being developed in the form of digital games, access to e-resources and membership of e-communities to name but a few, as part of the support package that comes with qualifications from awarding bodies today.<\/p>\n

This article takes a look at some of the ways that OCR is using technology to enhance the whole journey of assessment across a wide range of subjects and learners. It also explains why OCR \u2013 and Cambridge Assessment \u2013 will always be cautious about an immediate transfer to universal e-testing.<\/p>\n

e-administration<\/h2>\n

From the first vital step of ensuring a candidate is entered to take a particular exam, to downloading those eagerly-awaited exam results, teachers and exams officers go online using OCR\u2019s secure portal for all exam-related information: Interchange<\/a>. With a separate login and website from OCR\u2019s main website, the introduction of Interchange over ten years ago has dramatically reduced the time-consuming paper-based administration involved in the exam process. Virtually all \u2018centres\u2019 \u2013 the name given by awarding bodies to institutions who can administer public exams \u2013 use Interchange throughout the year. Ensuring that the right candidate is entered for the right exam is a task that, even for schools, is an all year round activity, carried out by a dedicated member of staff. Opportunities to take exams away from the traditional summer season have increased in recent years as a result of the growth of modularisation and resits, as well as the development of new qualifications for which there are near-monthly exam windows. With vocational qualifications, the timetabling and frequency of exams varies to fit around the delivery of training courses. Interchange is a key technological tool in handling an ever-increasing volume of exam traffic.<\/p>\n

Trying to make the communication of exam data easier and more streamlined for centres is a constant driver of change. A major project, in which OCR is participating, is now underway to simplify the exchange of exam-related data, the process currently known as Electronic Data Interchange, between all Joint Council for Qualifications (JCQ) awarding bodies and their customers. The A2C Data Exchange project, due to launch in September 2013, will change the format and the way that data is exchanged, ensuring that both general and vocational qualifications can be supported. The new standard can potentially be used for transactions between centres and all awarding bodies, not just those belonging to JCQ.<\/p>\n

e-marking<\/h2>\n

Accurate and consistent marking is vital to the credibility of the exams system. More than 3000 examiners marked a total of over three million scripts onscreen for OCR in 2010\/2011. Developed in partnership with RM Education for OCR\u2019s parent group, Cambridge Assessment, \u2018scoris assessor\u2019 is a new tool which allows examiners to mark GCSEs and A Levels on screen. Traditionally, paper exam scripts are sent to examiners who mark the hard copy and return the scripts plus a record of their marks separately to OCR. With onscreen marking, examiners can download sets of exam papers, say up to 20, at a time, and mark them on their computer screens rather than having to wade through piles of paperwork. The papers they mark onscreen may have been paper-based or computer-based test responses originally. As well as managing marking and the return of marking more efficiently and quickly, with benefits to the environment, the new system enables stricter adherence to the marking of principal examiners, producing greater consistency in marking across large teams of examiners spread across the country. In summer 2011, OCR announced that the introduction of onscreen marking had also led to a beneficial side effect; a new method of picking up possible cheating in exams. Through statistical screening, small groups of exam papers where a pattern of marks are very similar can now be identified. The process starts with the assumption that when two or more candidates have been colluding or copying from each other, their marks will be similar. These marks are fed through an advanced pattern matching routine which flags up schools and colleges where marks are so similar that they warrant further investigation. Malpractice investigators can then call up the flagged papers and visually inspect them for signs of collusion or copying.<\/p>\n

Another technological tool introduced to support marking is OCR\u2019s digital repository. This is a new option for centres to submit candidates\u2019 work for moderation digitally, replacing the hassle of posting work. If centres chose this method of submitting work to be moderated, large quantities of work can be submitted at the same time due to a bulk upload facility. Moderation forms a significant part of the exam system nowadays and supports assessments other than a final end-of-course exam. Subjects which involve coursework done under controlled conditions, or assessment by the teachers of their own students\u2019 work, is moderated. This enables the awarding body to check, based on a sample of work, that a teacher or tutor is marking correctly according to a set mark scheme for all candidates. As well as providing a convenient system for schools and colleges, OCR\u2019s assessors can easily access the digital repository.<\/p>\n

e-results<\/h2>\n

The secure portal, Interchange, is the place for centres to download their exam results. Analysing exam results is a vital activity for teachers and trainers to help them evaluate their own activities and plan for the future. Active Results<\/a> is a sophisticated new tool to help them drill down their students\u2019 results in greater depth. It can provide micro analysis of the performance of an individual in different questions across one paper, or the performance of a whole class in specific questions, giving the teacher guidance on where to focus teaching in the future. It also enables teachers and heads of department to make more strategic comparisons by looking at the performance of a group within their school or college, or their whole institution against that of other institutions across the country, by filters such as size, funding, or specialism. Active Results was developed by working closely with teachers so that the technology delivers what they want.<\/p>\n

e-support<\/h2>\n

OCR has worked hard to improve the support package available to centres delivering its qualifications. As recently as this September, OCR joined forces with two major educational publishers, Oxford University Press and Hodder Education to offer free e-versions of A Level textbooks to all schools and colleges<\/a>. This offer was taken up with enthusiasm as over 140,000 eBooks were ordered in the first weeks of the launch. Schools and colleges are now able to load the Flash-based eBooks onto their virtual learning environments, thereby reducing the need for transporting conventional textbooks. They can still buy the paper-based versions but now at a 25% discount.<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

\"Sample<\/a>
Figure 1: Sample pages from e-versions of A Level textbooks, part of the free eBooks scheme launched by OCR in conjunction with Hodder and OUP in September 2011.<\/figcaption><\/figure>\n

OCR has also won awards for the development of online tools designed to provide fun ways to re-enforce subject knowledge. The World of Science<\/a>\u00a0complements OCR\u2019s GCSE Science qualifications by using a ‘Sims-like’ game to make users test their knowledge of topics such as the environment, ecology, and energy. On a more serious note, OCR created a new digital learning device in a joint project with the NSPCC on the subject of Safeguarding<\/a> to\u00a0test the specific topic knowledge of people working with children taking one of OCR\u2019s new care qualifications.<\/p>\n

Facilitating communication between teachers delivering OCR qualifications across the country is also an important aim and OCR has been one of the first major awarding bodies to create subject specific e-communities. Of the various e-communities, unsurprisingly the IT e-community is the largest with over 1500 members. It\u2019s a two way channel of information between OCR and a wide range of contacts, and is an opportunity for fellow IT teachers to share examples of good practice and support each other.<\/p>\n

e-testing<\/h2>\n

A large body of research is taking place in OCR and Cambridge Assessment on computer-based testing. OCR currently offers a choice of test formats, paper-based or on-screen, in eleven GCSE subjects. Electronic versions of tests for Key Skills in literacy, numeracy and ICT, Basic Skills in literacy and numeracy, plus awards in administration and health and social care are all available. Since the introduction of e-testing of Key and Basic Skills in 2005, over one million computer-based tests in these areas have been taken.<\/p>\n

Many people assume that e-testing is the holy grail of technological advance in assessment. Computer-based testing is widely used in professional certification in aviation, medicine, law and finance industries. But despite OCR\u2019s adoption of technology in e-administration and e-marking, and other areas of assessment, its primary focus is not to make all existing paper and pen tests electronic. The awarding body remains cautious about e-testing as there are issues of practicality and principle to be overcome. Many schools with large cohorts who need to sit exams at the same time for example do not yet have enough computers, or IT support staff, to make this possible. Exams need to be taken at the same time to be fair and avoid the temptations of malpractice. Another issue, OCR believes, is to make sure that computer-based tests measure subject knowledge, rather than IT skills. These issues need to be resolved before the normal adoption of computer-based testing.<\/p>\n

OCR is working hard to identify ways in which technology can be applied to benefit the assessment process. With the help of the considerable research expertise within Cambridge Assessment, it keeps abreast of the latest developments and arguments about all aspects of e-assessment. In an increasingly technologically sophisticated world \u2013 with a young generation of candidates to match \u2013 OCR is keen to continue the debate about how technology can genuinely best support and enhance educational assessment.<\/p>\n

<\/p>\n

Sophie White<\/p>\n

Partnerships, OCR<\/p>\n

Sophie.White@ocr.org.uk<\/a><\/p>\n

\n
\n

If you enjoyed reading this article we invite you to\u00a0join the Association for Learning Technology (ALT)<\/a>\u00a0as an individual member, and to encourage your own organisation to join ALT as an organisational or sponsoring member.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"This article identifies the different ways that technology is being applied by UK exam board OCR to benefit the whole process of assessment, from administration to exam results. \n\n \n","protected":false},"author":1,"featured_media":1138,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[7,10],"tags":[725,806,942],"class_list":["post-1136","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-case-studies","category-featured","tag-altc","tag-eassessment","tag-ocr"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2011\/11\/eassessment.jpg?fit=1247%2C789&ssl=1","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":4169,"url":"https:\/\/altc.alt.ac.uk\/blog\/2014\/09\/bringing-adaptive-learning-moocs-to-the-classroom\/","url_meta":{"origin":1136,"position":0},"title":"Bringing adaptive learning MOOCs to the classroom","author":"ALT","date":"1 September 2014","format":false,"excerpt":"OCR (a UK exam board and part of the University of Cambridge) have joined up with the micro-adaptive learning service provider CogBooks to take our school MOOC project, Cambridge GCSE Computing Online (www.cambridgegcsecomputing.org), to the next level for the 2014\/15 school year. Cambridge GCSE Computing Online has been running since\u2026","rel":"","context":"In "Project updates"","block_context":{"text":"Project updates","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/project-updates\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/08\/cogbooks.jpg?fit=472%2C358&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":134,"url":"https:\/\/altc.alt.ac.uk\/blog\/2014\/01\/job-e-learning-developer-loughborough-university\/","url_meta":{"origin":1136,"position":1},"title":"Job Opportunity – E-Learning developer vacancy at Loughborough University","author":"ALT","date":"7 January 2014","format":false,"excerpt":"We have a great opportunity at Loughborough for an experienced E-Learning professional, if you are between contracts or looking for a new challenge. As part of commercialising the\u00a0Co-Tutor software\u00a0(with \u00a3100K of HEIF funding), we are looking to bring in some extra help. You will be working on Co-Tutor and other\u2026","rel":"","context":"In "ALT East Midlands MG"","block_context":{"text":"ALT East Midlands MG","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/altemidlands\/"},"img":{"alt_text":"Co Tutor Screen shot","src":"https:\/\/eastmidslt.files.wordpress.com\/2014\/01\/cotutsshot.png?w=350&h=200&crop=1","width":350,"height":200,"srcset":"https:\/\/eastmidslt.files.wordpress.com\/2014\/01\/cotutsshot.png?w=350&h=200&crop=1 1x, https:\/\/eastmidslt.files.wordpress.com\/2014\/01\/cotutsshot.png?w=525&h=300&crop=1 1.5x"},"classes":[]},{"id":3058,"url":"https:\/\/altc.alt.ac.uk\/blog\/2014\/01\/three-days-at-bett2014\/","url_meta":{"origin":1136,"position":2},"title":"Three Days at #Bett2014","author":"ALT","date":"31 January 2014","format":false,"excerpt":"There is a curious juxtaposition this year - opposite BETT is an exhibition by companies selling fairground equipment and gaming machines to lure in young people and inside BETT.... Day One An illuminating day, Mr Gove rightly talked up the strengths in the UK education system and some of the\u2026","rel":"","context":"In "Conference reviews"","block_context":{"text":"Conference reviews","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/reviews\/conference-reviews\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/01\/photobett.jpg?fit=960%2C720&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/01\/photobett.jpg?fit=960%2C720&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/01\/photobett.jpg?fit=960%2C720&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/01\/photobett.jpg?fit=960%2C720&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":1128,"url":"https:\/\/altc.alt.ac.uk\/blog\/2011\/11\/in-this-edition-2\/","url_meta":{"origin":1136,"position":3},"title":"In this Edition – Issue 25, November 2011","author":"ALT","date":"7 November 2011","format":false,"excerpt":"Julie Voce provides a round up of the 18th international conference of the Association for Learning Technology, Conference: Thriving in a colder and more challenging climate,\u00a0 held at the University of Leeds, UK, 6-8 September 2011. In July 2011, Stanford University announced that three introductory one-term undergraduate courses would be\u2026","rel":"","context":"In "Edition"","block_context":{"text":"Edition","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/edition\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":13502,"url":"https:\/\/altc.alt.ac.uk\/blog\/2026\/01\/training-staff-to-use-digital-assessment-tools-webinar\/","url_meta":{"origin":1136,"position":4},"title":"Training staff to use Digital Assessment tools Webinar","author":"ALT","date":"7 January 2026","format":false,"excerpt":"Our first webinar of this Academic year \u201cTraining Staff to use Digital Assessments\u201d was completed in November, you can review the whole webinar on the\u00a0ALT youtube channel. Thank you to our presenters: Kimberly O\u2019Brien and Maddie Kinnair for sharing\u00a0Newcastle University\u2019s approach to Synchronous and Asynchronous Training using Inspera Assessment for\u2026","rel":"","context":"In "Digital Assessment SIG"","block_context":{"text":"Digital Assessment SIG","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/digital-assessment-sig\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2026\/01\/TEMPLATE-DO-NOT-EDIT-THIS-PAGE-23.png?fit=734%2C550&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2026\/01\/TEMPLATE-DO-NOT-EDIT-THIS-PAGE-23.png?fit=734%2C550&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2026\/01\/TEMPLATE-DO-NOT-EDIT-THIS-PAGE-23.png?fit=734%2C550&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2026\/01\/TEMPLATE-DO-NOT-EDIT-THIS-PAGE-23.png?fit=734%2C550&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":12749,"url":"https:\/\/altc.alt.ac.uk\/blog\/2024\/12\/digital-assessment-sig-our-first-blog\/","url_meta":{"origin":1136,"position":5},"title":"Digital Assessment SIG: our first blog!","author":"","date":"12 December 2024","format":false,"excerpt":"Hi there everyone, welcome to ALT Digital Assessment (SIG)\u2019s first blog post! Our group is dedicated to exploring and advancing digital assessment practices across various higher educational institutions in the UK. We formed our group in September 2024, driven by a shared interest in digital assessment. We come from a\u2026","rel":"","context":"In "Digital Assessment SIG"","block_context":{"text":"Digital Assessment SIG","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/digital-assessment-sig\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/12\/DASIG.png?fit=700%2C200&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/12\/DASIG.png?fit=700%2C200&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/12\/DASIG.png?fit=700%2C200&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/12\/DASIG.png?fit=700%2C200&ssl=1&resize=700%2C400 2x"},"classes":[]}],"jetpack_shortlink":"https:\/\/wp.me\/p6CxU9-ik","_links":{"self":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/1136","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/comments?post=1136"}],"version-history":[{"count":0,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/1136\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/media\/1138"}],"wp:attachment":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/media?parent=1136"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/categories?post=1136"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/tags?post=1136"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}