{"id":3520,"date":"2014-03-14T09:49:00","date_gmt":"2014-03-14T09:49:00","guid":{"rendered":"http:\/\/newsletter.alt.ac.uk\/?p=3520"},"modified":"2014-03-14T09:49:00","modified_gmt":"2014-03-14T09:49:00","slug":"developing-and-running-a-mooc-some-practical-considerations","status":"publish","type":"post","link":"https:\/\/altc.alt.ac.uk\/blog\/2014\/03\/developing-and-running-a-mooc-some-practical-considerations\/","title":{"rendered":"Developing and running a MOOC: some practical considerations"},"content":{"rendered":"<p><strong>Report from a Centre for Distance Education seminar, University of London, 13 Jan 2014<\/strong><\/p>\n<p>The University of London\u2019s (UoL) <a href=\"http:\/\/cdelondon.wordpress.com\/\">Centre for Distance Education (CDE)<\/a> provides thought-provoking lunchtime seminars on topics of interest to learning technology practitioners and staff who teach or administer online courses. A recent well-attended seminar on the practicalities of Massive Open Online Courses (MOOCs) included presentations on MOOCs in English Common Law (ECL) and Creative Programming (CP). These were developed and delivered by the University\u2019s International Programmes division using the well-known Coursera platform. Both were launched in June 2013 alongside two further MOOCs from UoL. They were bespoke courses that did not already exist as part of a degree programme, and it was clear that a lot of work was required to get them developed within short timescales.<\/p>\n<p><b>MOOC Participants<\/b><\/p>\n<p>The student demographic reflected the profile reported for other MOOCs, for example the majority of students already held at least a first degree. The ECL MOOC cited the highest qualifications of their students as: undergraduate degree (40%), postgraduate qualification (40%), PhD (9%). Students came primarily from the USA, Spain, India, Brazil and the UK. The majority were between 22 and 40 with the average ages being 31 (CP) and 35 (ECL).<\/p>\n<p><b>Completion Rates<\/b><\/p>\n<p>The completion rates of the two courses differed, with ECL managing a very respectable 18% completion rate.<\/p>\n<table border=\"1\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td valign=\"top\" width=\"131\"><b>Course\/No. students \u00a0\u00a0<\/b><\/td>\n<td valign=\"top\" width=\"71\"><b>Initially registered<\/b><\/td>\n<td valign=\"top\" width=\"56\"><b>Started week 1<\/b><\/td>\n<td valign=\"top\" width=\"51\"><b>In final week<\/b><\/td>\n<td valign=\"top\" width=\"73\"><b>Completed<\/b><\/td>\n<td valign=\"top\" width=\"84\"><b>Completion Rate<\/b><\/td>\n<\/tr>\n<tr>\n<td valign=\"top\" width=\"131\"><b>English Common Law (ECL)<\/b><\/td>\n<td valign=\"top\" width=\"71\">41,000<\/td>\n<td valign=\"top\" width=\"56\">14,000<\/td>\n<td valign=\"top\" width=\"51\">6,400<\/td>\n<td valign=\"top\" width=\"73\">2,500<\/td>\n<td valign=\"top\" width=\"84\">18%<\/td>\n<\/tr>\n<tr>\n<td valign=\"top\" width=\"131\"><b>Creative Programming (CP)\u00a0<\/b><\/td>\n<td valign=\"top\" width=\"71\">97,000<\/td>\n<td valign=\"top\" width=\"56\">38,000<\/td>\n<td valign=\"top\" width=\"51\">6,600<\/td>\n<td valign=\"top\" width=\"73\">2,231<\/td>\n<td valign=\"top\" width=\"84\">6%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><strong><a href=\"https:\/\/www.coursera.org\/course\/engcomlaw\">English Common Law: Structure and Principles<\/a><\/strong><\/p>\n<p><span style=\"line-height: 1.5em\"><a href=\"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/Pat-Lockley.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-3526\" alt=\"Pat Lockley presenting\" src=\"https:\/\/i0.wp.com\/newsletter.alt.ac.uk\/wp-content\/uploads\/2014\/03\/Pat-Lockley-300x225.jpg?resize=300%2C225\" width=\"300\" height=\"225\" srcset=\"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/Pat-Lockley.jpg?resize=300%2C225&amp;ssl=1 300w, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/Pat-Lockley.jpg?resize=707%2C530&amp;ssl=1 707w, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/Pat-Lockley.jpg?w=720&amp;ssl=1 720w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>Patricia McKellar and Pat Lockley, from the UoL Laws team presented the story of the ECL MOOC. The main drivers for development were the opportunity to experiment with alternative delivery models, freedom from a regulatory framework, curiosity to see who would sign up, and the opportunity to promote the Laws programmes and attract fee-paying students. There were also reputational risks to be considered if things went badly.<\/span><\/p>\n<p>The team noted that the Coursera system could be customised to some extent. They had made a significant number of changes to the default template, primarily to make the course more visually engaging. Two hours of video content were required per week. These were not necessarily in a \u2018lecture\u2019 format and some videos developed by the MOOC team included scripted scenes with actors. This was an effective way to give participants a feeling of having been present at an event.<\/p>\n<p>Coursera recommended that students should not be required to purchase a textbook to complete the course, although some students did later express a preference for a textbook. In order to make up for the absence of a course text, permission was sought from publishers to digitise book chapters as course readings. Obtaining permissions took time, and more lead in time would have been helpful to integrate the readings into the course more effectively.<\/p>\n<p>A series of discussion forums were provided, each focusing on different types of questions. The platform allowed posts to be rated and those with high ratings \u2018floated up\u2019 to the top so they were very likely to be seen. Students began posting in large numbers immediately the course started, demonstrating that they were highly engaged. The team had to put a lot of time into monitoring the forums but also had \u2018power users\u2019 mentoring other students. Some commercial posts appeared, as did some \u2018concerning\u2019 posts which had to be dealt with. A useful feature used to resolve some of these issues was the option to \u2018mute\u2019 a participant so that although they continue to post, others couldn\u2019t see the posts. In addition to the forums, a \u2018responding to feedback\u2019 page was added to the course. This provided an issues log and indicated changes the team had made, were planning to make, or might make in the future.<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/our_mooc_structure.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-3524\" alt=\"MOOC structure\" src=\"https:\/\/i0.wp.com\/newsletter.alt.ac.uk\/wp-content\/uploads\/2014\/03\/our_mooc_structure-300x225.jpg?resize=300%2C225\" width=\"300\" height=\"225\" srcset=\"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/our_mooc_structure.jpg?resize=300%2C225&amp;ssl=1 300w, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2014\/03\/our_mooc_structure.jpg?w=667&amp;ssl=1 667w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>One of the key takeaway points from the presentation was the value of distributed content on YouTube and other cloud-based services. These create a parallel course existence outside of the original Coursera site and timeframes which means that others can access the course materials, but not the assessment or interaction. A copy of the ECL MOOC materials are available at: <a href=\"http:\/\/lawsfolio.londoninternational.ac.uk\/eclmooc\/\">http:\/\/lawsfolio.londoninternational.ac.uk\/eclmooc<\/a>.<\/p>\n<p>Eighty students who participated in the MOOC have subsequently applied to the UoL Law programme. Time will tell as to how many of these actually start and go on to complete other courses.<\/p>\n<p><strong><a href=\"https:\/\/www.coursera.org\/course\/digitalmedia\">Creative Programming for Digital Media &amp; Mobile Apps<\/a><\/strong><\/p>\n<p>Matthew Yee-King from Goldsmiths, University of London presented the CP MOOC which was developed between September 2012 and June 2013. The nature of the subject matter required technical (as well as curriculum) preparation before the team could start recording video lectures. One of the challenges of teaching coding is the need to develop great examples of work that have a strong impact, and yet are not too difficult for the students to learn to create themselves. To address this, the team aimed to provide the students with powerful tools (e.g. a physics engine) which were nevertheless easy to use.<\/p>\n<p>As in the case of the ECL MOOC, the volume of video material needed was a somewhat daunting aspect of teaching in this mode. The video had to be recorded quite rapidly as the course launch approached. During the process a problem emerged. Scripts had specified over-the-shoulder shots of lecturers coding, but shooting in this way did not allow screen text to be sufficiently in focus to be read. Consequently, screen captures of coding had to be recorded and edited into videos later. A further complication was a new release of the platform used for coding just before the MOOC launched, which required additional videos to describe changes and workarounds.<\/p>\n<p>For assessment the team made use of some of the Coursera tools which support \u2018massive\u2019 cohort size, such as peer assessment and in-video and weekly quizzes. For the peer assessed tasks there were three phases: submit, peer evaluate and self evaluate, before results could be seen. Deadlines for individuals could not be adjusted, but for the final assessment the deadline was extended for everyone, as many students were running out of time, but keen to complete the course.<\/p>\n<p>The forum rating function made it possible to use discussion forums for voting on issues such as assessment extensions, and generally worked well for identifying priority questions and highlighting useful information. The team anticipated very busy forums in this course and two students were on duty to provide moderation during UK office hours.<\/p>\n<p>The team were impressed by the quality of the student work that was generated. Some participants went from no coding experience to releasing a game on the app store by the end of the course.<\/p>\n<p><b>Summary: expect the unexpected<\/b><\/p>\n<p>This informative seminar gave attendees an insight into the practical concerns of the teams who developed and ran the two MOOCs. Despite the fact that learning and teaching online is, for many, now quite a familiar set of practices, there was a strong sense that when you do a MOOC, you should expect the unexpected.<\/p>\n<p><strong>Further information<\/strong><\/p>\n<p><i>The <\/i><a href=\"http:\/\/cdelondon.wordpress.com\/2014\/01\/08\/cde-seminar-running-a-mooc\"><i>slides and videos from the event<\/i><\/a><i> have now been made available via the CDE website. In addition UoL have published a <\/i><a href=\"http:\/\/www.londoninternational.ac.uk\/sites\/default\/files\/documents\/mooc_report-2013.pdf\"><i>report on the four MOOCs<\/i><\/a><i> run in 2013.<\/i><\/p>\n<p class=\"info\">Leo Havemann<br \/>\nLearning Technologist, Birkbeck, University of London<br \/>\nl.havemann@bbk.ac.uk @leohavemann<br \/>\nJulie Voce<br \/>\ne-Learning Services Manager, Imperial College London<br \/>\nj.voce@imperial.ac.uk, @julievoce<\/p>\n<p class=\"note\">If you enjoyed reading this article we invite you to join the Association for Learning Technology (ALT) as an individual member, and to encourage your own organisation to join ALT as an organisational or sponsoring member.<\/p>\n<p>&nbsp;<\/p>\n<p><i>\u00a0<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"Report from a Centre for Distance Education seminar, University of London, 13 Jan 2014 The University of London\u2019s (UoL) Centre for Distance Education (CDE) provides thought-provoking lunchtime seminars on topics of interest to learning technology practitioners and staff who teach or administer online courses. A recent well-attended seminar on the practicalities of Massive Open Online [&hellip;]","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[68],"tags":[732,888,902,916,933,1028],"class_list":["post-3520","post","type-post","status-publish","format-standard","hentry","category-conference-reviews","tag-altmoocsig","tag-julie-voce","tag-leo-havemann","tag-m25-ltg","tag-mooc","tag-university-of-london"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":4896,"url":"https:\/\/altc.alt.ac.uk\/blog\/2015\/06\/education-online-en-masse-lessons-for-teaching-and-learning-through-moocs\/","url_meta":{"origin":3520,"position":0},"title":"Education online en-masse: lessons for teaching and learning through MOOCs","author":"ALT","date":"24 June 2015","format":false,"excerpt":"On 24 April 2015 forty educators from 19 institutions discussed key issues in MOOC design and implementation at a one-day workshop hosted and funded by the University of Reading, a leading member of the FutureLearn MOOC consortium. The workshop offered the opportunity to evaluate practical lessons from the design and\u2026","rel":"","context":"In &quot;Conference reviews&quot;","block_context":{"text":"Conference reviews","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/reviews\/conference-reviews\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2015\/06\/MOOC-panel.png?fit=742%2C465&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2015\/06\/MOOC-panel.png?fit=742%2C465&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2015\/06\/MOOC-panel.png?fit=742%2C465&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2015\/06\/MOOC-panel.png?fit=742%2C465&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":6937,"url":"https:\/\/altc.alt.ac.uk\/blog\/2018\/02\/quality-assurance-of-mooc-based-curricula-a-project-report-from-kiron\/","url_meta":{"origin":3520,"position":1},"title":"Quality Assurance of MOOC-based curricula: a project report from Kiron","author":"Gabi Witthaus","date":"19 February 2018","format":false,"excerpt":"Hannes Niedermeier shares an update on how Kiron Open Higher Education is developing a multi-layered quality assurance model for MOOCs, enabling refugees to obtain recognition for MOOC-based learning from German universities.","rel":"","context":"In &quot;Case studies&quot;","block_context":{"text":"Case studies","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/case-studies\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Kirons-network.png?fit=949%2C765&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Kirons-network.png?fit=949%2C765&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Kirons-network.png?fit=949%2C765&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Kirons-network.png?fit=949%2C765&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":4026,"url":"https:\/\/altc.alt.ac.uk\/blog\/2014\/06\/what-is-the-problem-for-which-moocs-are-the-solution\/","url_meta":{"origin":3520,"position":2},"title":"What is the problem for which MOOCs are the solution?","author":"ALT","date":"26 June 2014","format":false,"excerpt":"MOOCs \u2013 Massive Open Online Courses \u2013 have been grabbing headlines and conference time for a year or two now. It\u2019s the very large numbers that attract attention. But are MOOCs solving any real, global education problems? They are certainly not solving the problem of providing the 100,000,000 university places\u2026","rel":"","context":"In &quot;In my opinion&quot;","block_context":{"text":"In my opinion","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/in-my-opinion\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1961,"url":"https:\/\/altc.alt.ac.uk\/blog\/2012\/08\/mooc-pedagogy-the-challenges-of-developing-for-coursera\/","url_meta":{"origin":3520,"position":3},"title":"MOOC pedagogy: the challenges of developing for Coursera","author":"ALT","date":"8 August 2012","format":false,"excerpt":"In the summer of 2012 the team of teachers and researchers associated with the MSc in E-learning programme at the University of Edinburgh began developing a Massive Open Online Course (MOOC) for the Coursera platform.\u00a0 Launched only a year earlier, this for-profit company founded by Stanford professors Andrew Ng and\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/featured\/"},"img":{"alt_text":"Screenshot of Coursera page for E-learning and Digital Cultures course","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2012\/08\/coursera.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2012\/08\/coursera.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2012\/08\/coursera.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":4743,"url":"https:\/\/altc.alt.ac.uk\/blog\/2015\/05\/emma-providing-multilingual-access-to-european-moocs\/","url_meta":{"origin":3520,"position":4},"title":"EMMA &#8211; providing multilingual access to European MOOCs","author":"ALT","date":"12 May 2015","format":false,"excerpt":"The European Multiple MOOC Aggregator, EMMA for short, is a 30-month project showcasing the diversity of MOOCs (Massive Open Online Courses) in Europe and piloting an innovative approach to their use. There are 11 partners currently involved in EMMA and, as the project grows, the plan is to involve other\u2026","rel":"","context":"In &quot;Featured&quot;","block_context":{"text":"Featured","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/featured\/"},"img":{"alt_text":"Translate key - multiple languages available","src":"https:\/\/i0.wp.com\/newsletter.alt.ac.uk\/wp-content\/uploads\/2015\/04\/languages-300x201.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":6103,"url":"https:\/\/altc.alt.ac.uk\/blog\/2017\/01\/open-learning-as-lifelong-learning-conduit-for-education-in-south-korea\/","url_meta":{"origin":3520,"position":5},"title":"Open Learning as Lifelong Learning: Conduit for education in South Korea","author":"howardscott75","date":"13 January 2017","format":false,"excerpt":"\u00a0 South Korea is developing open learning on par with any nation in the world, fuelled essentially by virtually unlimited bandwidth and connectivity; considerable government spending and investment in education, a progressive step in increasing accessibility to education for all; and as a step towards offsetting the rapidly declining birthrate\u2026","rel":"","context":"In &quot;Case studies&quot;","block_context":{"text":"Case studies","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/case-studies\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2017\/01\/sub02_img15.gif?fit=870%2C634&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2017\/01\/sub02_img15.gif?fit=870%2C634&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2017\/01\/sub02_img15.gif?fit=870%2C634&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2017\/01\/sub02_img15.gif?fit=870%2C634&ssl=1&resize=700%2C400 2x"},"classes":[]}],"jetpack_shortlink":"https:\/\/wp.me\/p6CxU9-UM","_links":{"self":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/3520","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/comments?post=3520"}],"version-history":[{"count":0,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/3520\/revisions"}],"wp:attachment":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/media?parent=3520"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/categories?post=3520"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/tags?post=3520"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}