A Multimodal Framework for Computer Mediated Learning: The Reshaping of Curriculum Knowledge and Learning



Multimodality is an emergent theory, and while there is a small (but significant) body
of work on multimodal theory that sets out to address the theoretical questions that it
raises many of the theoretical concepts and tools remain unsettled (e.g. Khess and van
Leeuwen, 1996; Kress and van Leeuwen, 2001; Finnegan, 2002). Despite this,
educational researchers have actively taken up multimodal theory across a wide range
of learning contexts. This includes, among others, pre-school learning (Lancaster,
2001; Pahl, 1999), bilingual language learners (Kenner, 2000), literacy (Moss 2001;
Street, 1998), English education (SEP, 2002), and science education (Kress et al.
2001; O’Halloran, 1998). Multimodality has generated much interest among
designers, academics and educational practitioners working in the area of new
technologies and technology-mediated learning. However, with a few notable
exceptions (e.g. Burn and Parker, 2001; Lemke, 2002; van Leeuwen, 1998) there has
been little multimodal research in the field of technology-mediated learning.

Background

The ideas and questions that inform this thesis emerged from watching the children of
friends and my own daughter, ‘play’ and ‘work’ on computers. I watched them ‘read’
books, ‘play’ music, write, draw, build and destroy cities, and kill armies. I listened to
the sound-effects of the software, watched the visual display of animated (revolving)
icons and characters, the use of colour on screen, the spatial construction of the
screen environment, and all the time I wondered what was going on. The children sat
at the computer, they looked intently at the screen, moved the mouse, clicked on
icons, pressed keys, and pointed at things on the screen. In these moments I wondered
whether the multimodal theory of meaning making that I could apply relatively
quickly and easily to my daughter’s other kinds of ‘work’ (her drawings and writing
on paper, the books we read together, the three-dimensional objects that she makes
from a variety of materials - beads, boxes, clay, cardboard) could be of any use in
understanding this ‘world’ on the computer screen.

18



More intriguing information

1. American trade policy towards Sub Saharan Africa –- a meta analysis of AGOA
2. Improving Business Cycle Forecasts’ Accuracy - What Can We Learn from Past Errors?
3. Strengthening civil society from the outside? Donor driven consultation and participation processes in Poverty Reduction Strategies (PRSP): the Bolivian case
4. The name is absent
5. Computational Experiments with the Fuzzy Love and Romance
6. Tissue Tracking Imaging for Identifying the Origin of Idiopathic Ventricular Arrhythmias: A New Role of Cardiac Ultrasound in Electrophysiology
7. WP 36 - Women's Preferences or Delineated Policies? The development or part-time work in the Netherlands, Germany and the United Kingdom
8. TINKERING WITH VALUATION ESTIMATES: IS THERE A FUTURE FOR WILLINGNESS TO ACCEPT MEASURES?
9. Co-ordinating European sectoral policies against the background of European Spatial Development
10. Skills, Partnerships and Tenancy in Sri Lankan Rice Farms
11. Imitation in location choice
12. Transgression et Contestation Dans Ie conte diderotien. Pierre Hartmann Strasbourg
13. Foreign direct investment in the Indian telecommunications sector
14. Surveying the welfare state: challenges, policy development and causes of resilience
15. The name is absent
16. Group cooperation, inclusion and disaffected pupils: some responses to informal learning in the music classroom
17. Natural hazard mitigation in Southern California
18. The name is absent
19. Implementation of the Ordinal Shapley Value for a three-agent economy
20. El impacto espacial de las economías de aglomeración y su efecto sobre la estructura urbana.El caso de la industria en Barcelona, 1986-1996