{"id":1656,"date":"2012-06-08T11:15:45","date_gmt":"2012-06-08T11:15:45","guid":{"rendered":"http:\/\/newsletter.alt.ac.uk\/?p=1656"},"modified":"2012-06-08T11:15:45","modified_gmt":"2012-06-08T11:15:45","slug":"is-education-research-a-form-of-alchemy","status":"publish","type":"post","link":"https:\/\/altc.alt.ac.uk\/blog\/2012\/06\/is-education-research-a-form-of-alchemy\/","title":{"rendered":"Is education research a form of alchemy?"},"content":{"rendered":"

Aaron Sloman<\/a> is Honorary Professor of Artificial Intelligence and Cognitive Science at the University of Birmingham. Here he reflects on what is known about learning, and on the difficulties that exist in understanding it. These reflections were prompted by watching remotely part of the panel presentations at the 23 May launch of the Ufi Charitable Trust<\/a>.<\/p>\n

Aaron had participated as an interviewee for the trust’s study Scaling up – achieving a breakthrough in adult learning with technology<\/a>.<\/p>\n

Aaron Sloman will be an invited speaker at ALT-C 2012<\/a>.<\/p>\n

Is education research a form of alchemy?<\/strong><\/p>\n

Alchemists did masses of data collection, seeking correlations. In the process they learnt a great many useful facts – but lacked deep explanations. Searching for correlations can produce results of limited significance when studying processes with an underlying basis of mechanisms with astronomical generative power. But this correlation-seeking approach characterises much educational research.<\/p>\n

Accelerated progress in chemistry came from developing a deep explanatory theory about the hidden<\/strong> structure of matter and the processes such structure could support (atoms, subatomic particles, valence, constraints on chemical reactions, etc.). Thus deep research requires (among other things) the ability to invent powerful explanatory mechanisms, often referring to unobservables.<\/p>\n

My experience of researchers in education, psychology, social science and similar fields is that the vast majority of the ones I have encountered have had no experience of building, testing, and debugging, deep explanatory models of any working system. So their education does not equip them for a scientific study of education, a process that depends crucially on the operations of the most sophisticated information processing engines on the planet, many important features of which are still unknown.<\/p>\n

Learning and teaching are a bit like life. As every gardener knows, almost every generalisation about life is false, because there are so many forms of life, showing enormous variation. There may not be quite so many forms of learning (and failure to learn) but the underlying information processing systems have great internal complexity and diversity (even within one individual, between infancy and grand-parenthood) and they can interact in very different ways with learning materials, the everyday environment, laboratory equipment, peers, teachers, books, computers, the internet, family, physical disability, etc.<\/p>\n

I suspect that as a result, most generalisations about learning (e.g. what works, and what doesn’t) are false, unless very heavily qualified. For example, if research shows that a particular method of teaching children to read works much better than all other known methods for 80% of the under-seven population, that does not tell us why, or what to do about the other 20%, or whether for some or all of the 80% there might be an even better way. A deep understanding of the computational mechanisms<\/strong> of both reading and learning to read might provide a basis for teaching methods that are more sensitive to the diversity of child minds, home environments, brain development, and potential. An implication is that we still need deep research into mechanisms of learning (of which our current knowledge is still limited — even in the most advanced AI\/robotics and neuroscience laboratories) and research into the diversity of processes that can occur when those mechanisms interact with a wide range of learning environments, tasks, external and internal motivations, and social contexts. This also needs to take account of the fact that the mechanisms themselves can be very different in different individuals, since each learner is a product of a complex developmental process with many genetic and other influences, not a mass-produced instance of a common human genome.<\/p>\n

We need a powerful generative theory to provide the context for data collection. (Compare research in chemistry.) Data collection without a powerful theory can occasionally produce gold, but mostly it’s like shooting in the dark, and any correlations found will have unknown scope. Moreover, they will tell you nothing about what might have been achieved by trying a different technique you haven’t thought of.<\/p>\n

When I was teaching (first at Sussex University, then at Birmingham), along with a bunch of high-powered and highly creative colleagues with diverse talents, we discovered that for a range of students, learning about programming, artificial intelligence (AI), cognitive science, logic, and linguistics, it was possible to develop interactive learning environments that allowed different students to drive the systems in different directions at different speeds with lots of readily available support (documentation, libraries, language extensions, suggested problems) for a wide range of learning trajectories.<\/p>\n

So, as in kindergarten, the students learnt different things, but many of them also learnt how to learn.<\/p>\n

They learnt at very different speeds — some with an initial long plateau before taking off, others flying from the start, and a small subset for whom the approach did not work at all, even with hours of individual tuition. I think some kinds of learning (not yet specified precisely enough) require short-term memory mechanisms that, for unknown reasons, are either lacking or seriously underdeveloped in a small subset of the population [i]<\/a>.<\/p>\n

Some of those students developed strategies for getting high marks in other courses on the basis of very shallow understanding. When we expanded to teaching a MSc conversion course, we found highly intelligent people whose brains had been seriously handicapped by learning bad things. For example some of the people who had become expert Fortran programmers found it harder than young children to learn logic programming.<\/p>\n

There’s still a huge amount to be done to:<\/p>\n

    \n
  1. transplant those techniques onto modern technology,<\/li>\n
  2. expand the content to fit a wider range of subjects,<\/li>\n
  3. educate teachers to understand enough about the mechanisms, and about the diversity of learners, to be able build the extensions required to support the kind of content they<\/strong> want to teach, and to<\/li>\n
  4. find and repair gaps and inadequacies in the theories and the mechanisms developed.<\/li>\n<\/ol>\n

    Our teaching\/learning environments were based on a partial theory about the processes of learning — partly inspired by progress and problems in AI. The theory presupposed that the process of learning is in some cases partly like the process of programming, including similar stages of implementing ideas, testing them, debugging them, and extending them, most of which learners do unconsciously. This is very different from a theory that learners develop networks of associations, for example [ii]<\/a>.<\/p>\n

    A much deeper theory is required. No doubt there are different approaches to teaching programming that can produce even better results, using the same cognitive mechanisms in learners: humans evolved learning capabilities that could be made to work in a huge variety of environments, as shown by toddlers learning to use things nowadays that none of their ancestors had ever encountered. (Of course, humans don’t all start the same.)<\/p>\n

    The teachers also need help acquiring a deep understanding of the diversity of information-processing systems found in different learners and how to accommodate that diversity in their teaching.<\/p>\n

    A major challenge is that this is all totally alien to a world with fixed syllabus structures, numerical marking schemes, and league tables.<\/p>\n

    What next?<\/strong><\/p>\n

    These are not the theories of a specialist researcher in education or educational technology. My own work over the last 50 years or so has been concerned with attempting to combine ideas and methods from research in philosophy (especially philosophy of mathematics), artificial intelligence, robotics, psychology, neuroscience, evolution, animal cognition, software engineering and computer science. Some ideas derived from that work are presented in a disorganised collection of materials still under development here http:\/\/www.cs.bham.ac.uk\/research\/projects\/cogaff\/misc\/AREADME.html<\/a>.<\/p>\n

    I think the theories sketched in Annette Karmiloff-Smith’s 1992 book \u201cBeyond Modularity: A Developmental Perspective on Cognitive Science\u201d will prove crucial for educational theory, though they require further development in order to be expressed computationally.<\/p>\n

    Progress has been slow because the products of millions of years of biological evolution interacting with very varied and very complex physical, biological, and social environments are too complex to be fully understood using current theories and research methods.<\/p>\n

    But the new wave of enthusiasm to teach our children to think computationally, starting in primary school with new powerful learning environments, may, over the next few decades, produce a new wave of scientists and teachers whose insight into multifarious processes of learning and teaching, will be deeper than anything we have at present, especially if they learn to do “thinky” programming, in the sense explained in http:\/\/tinyurl.com\/thinky-ex<\/a>.<\/p>\n

    It may turn out that human minds are too complex to be understood by human minds. But we should at least try.<\/p>\n

    <\/a>[i] Some research that can be interpreted in this light is: http:\/\/www.eis.mdx.ac.uk\/research\/PhDArea\/saeed\/<\/a><\/p>\n

    <\/a>[ii] Some of these ideas were presented long ago in Gerald J. Sussman, A computational model of skill acquisition, 1975, American Elsevier, San Francisco, CA, http:\/\/dspace.mit.edu\/handle\/1721.1\/6894<\/a><\/p>\n

    Aaron Sloman
    \nHonorary Professor of Artificial Intelligence and Cognitive Science
    \nUniversity of Birmingham<\/p>\n

    If you enjoyed reading this article we invite you to join the Association for Learning Technology (ALT)<\/a> as an individual member, and to encourage your own organisation to join ALT as an organisational or sponsoring member<\/p>\n","protected":false},"excerpt":{"rendered":"Aaron Sloman is Honorary Professor of Artificial Intelligence and Cognitive Science at the University of\nBirmingham. Here he reflects on what is known about learning, and on the difficulties that exist in understanding it. These reflections were prompted by watching remotely part of the panel presentations at the 23 May launch of the Ufi Charitable Trust.","protected":false},"author":1,"featured_media":1660,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[5],"tags":[725,727,814],"class_list":["post-1656","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-in-my-opinion","tag-altc","tag-altc2012","tag-educationresearch"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2012\/05\/aaron-sloman.jpg?fit=198%2C198&ssl=1","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":1601,"url":"https:\/\/altc.alt.ac.uk\/blog\/2012\/06\/in-this-edition-issue-27-may-2012\/","url_meta":{"origin":1656,"position":0},"title":"In this Edition – Issue 27, June 2012","author":"ALT","date":"8 June 2012","format":false,"excerpt":"Aaron Sloman, Honorary Professor of Artificial Intelligence and Cognitive Science at the University of Birmingham,\u00a0reflects on what is known about learning, and on the difficulties that exist in understanding it. These reflections were prompted by watching remotely part of the panel presentations at the 23 May launch of the Ufi\u2026","rel":"","context":"In "Edition"","block_context":{"text":"Edition","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/edition\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":6916,"url":"https:\/\/altc.alt.ac.uk\/blog\/2018\/02\/emerging-learning-technologies\/","url_meta":{"origin":1656,"position":1},"title":"Emerging Learning Technologies","author":"rowellc","date":"13 February 2018","format":false,"excerpt":"Along with DevLearn in Las Vegas, Learning Technologies in London shares the top spot for largest learning technology exhibition and conference in the world and I had the privilege of attending again this year. Learning Technologies is my favourite conference of the year (sorry ALT!), from the incredible industry-leading speakers\u2026","rel":"","context":"In "Conference reviews"","block_context":{"text":"Conference reviews","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/reviews\/conference-reviews\/"},"img":{"alt_text":"Photo of Don Taylor","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Don-Taylor.jpg?fit=1200%2C900&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Don-Taylor.jpg?fit=1200%2C900&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Don-Taylor.jpg?fit=1200%2C900&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Don-Taylor.jpg?fit=1200%2C900&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2018\/02\/Don-Taylor.jpg?fit=1200%2C900&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":8150,"url":"https:\/\/altc.alt.ac.uk\/blog\/2019\/08\/alt-conference-from-the-executive-education-point-of-view\/","url_meta":{"origin":1656,"position":2},"title":"ALT Conference from the Executive Education Point of View","author":"rchallen","date":"19 August 2019","format":false,"excerpt":"Executive Education comes in various shapes and forms, from one-day programs and workshops to multi-modular pathways, and from open programs available to anyone who meets the entrance requirements to tailored custom programs that use the joint forces of an Executive Education (EE) provider and the client\u2019s L&D department. The range\u2026","rel":"","context":"In "altc19"","block_context":{"text":"altc19","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/events\/alt-2019-conference-posts\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/08\/Headway-on-Unsplash.jpg?fit=1200%2C800&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/08\/Headway-on-Unsplash.jpg?fit=1200%2C800&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/08\/Headway-on-Unsplash.jpg?fit=1200%2C800&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/08\/Headway-on-Unsplash.jpg?fit=1200%2C800&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/08\/Headway-on-Unsplash.jpg?fit=1200%2C800&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":8274,"url":"https:\/\/altc.alt.ac.uk\/blog\/2019\/09\/maren-deepwell-in-conversation-with-mia-zamora\/","url_meta":{"origin":1656,"position":3},"title":"Maren Deepwell in conversation with\u2026 Mia Zamora","author":"","date":"24 September 2019","format":false,"excerpt":"This time I am joined by Mia Zamora (@MiaZamoraPhD), one of the Co-Chairs for next year's OER Conference and Associate Professor of English & Director of MA in Writing Studies, Kean University. Mia and I often only get to meet virtually in conference settings, so it's a particular pleasure for\u2026","rel":"","context":"In "In conversation with"","block_context":{"text":"In conversation with","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/in-conversation-with\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/09\/In-Conversation-with...-photos-10.jpg?fit=958%2C500&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/09\/In-Conversation-with...-photos-10.jpg?fit=958%2C500&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/09\/In-Conversation-with...-photos-10.jpg?fit=958%2C500&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2019\/09\/In-Conversation-with...-photos-10.jpg?fit=958%2C500&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":11950,"url":"https:\/\/altc.alt.ac.uk\/blog\/2024\/02\/oer24-guest-post-its-like-watching-someone-else-make-out-with-your-girlfriend-reflections-on-the-first-time-i-saw-another-lecturer-use-my-content\/","url_meta":{"origin":1656,"position":4},"title":"OER24 Guest Post: \u201cIt’s like watching someone else make out with your girlfriend.\u201d Reflections on the first time I saw another lecturer use \u201cMY!!\u201d content.","author":"ALT","date":"16 February 2024","format":false,"excerpt":"Aaron Sorkin was planning to watch episode one from series five of The West Wing, the famed and successful TV series he had created, but which he had left after producing series four. On hearing of Sorkin\u2019s plans, Larry David, who had co-created the Seinfeld Show and left the series\u2026","rel":"","context":"In "Events"","block_context":{"text":"Events","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/events\/"},"img":{"alt_text":"OER Blog cover Copy","src":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/02\/OER-Blog-cover-6.png?fit=700%2C216&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/02\/OER-Blog-cover-6.png?fit=700%2C216&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/02\/OER-Blog-cover-6.png?fit=700%2C216&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/altc.alt.ac.uk\/blog\/wp-content\/uploads\/sites\/1112\/2024\/02\/OER-Blog-cover-6.png?fit=700%2C216&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":4219,"url":"https:\/\/altc.alt.ac.uk\/blog\/2014\/09\/call-for-papers-learning-technology-innovation-in-higher-education-and-beyond\/","url_meta":{"origin":1656,"position":5},"title":"Call for Papers: Learning Technology innovation in Higher Education and beyond","author":"ALT","date":"18 September 2014","format":false,"excerpt":"The call for papers for a Special Issue of\u00a0Research in Learning Technology, the Journal of the Association for Learning Technology has been issued at\u00a0http:\/\/go.alt.ac.uk\/1r87Xlp. All accepted papers will be published as a Special Issue of\u00a0Research in Learning Technology, \u201cLearning Technology innovation in Higher Education and beyond: Sharing global perspectives on\u2026","rel":"","context":"In "ALT news"","block_context":{"text":"ALT news","link":"https:\/\/altc.alt.ac.uk\/blog\/category\/alt-news\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_shortlink":"https:\/\/wp.me\/p6CxU9-qI","_links":{"self":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/1656","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/comments?post=1656"}],"version-history":[{"count":0,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/posts\/1656\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/media\/1660"}],"wp:attachment":[{"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/media?parent=1656"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/categories?post=1656"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/altc.alt.ac.uk\/blog\/wp-json\/wp\/v2\/tags?post=1656"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}