A Multimodal Framework for Computer Mediated Learning: The Reshaping of Curriculum Knowledge and Learning

The four modes of writing, image, ‘program mode’ (the multimodal representation of
the program code is discussed in the next section of the paper) and speech are not
given equal salience in the behaviour edit-state. The ‘size’ of the block of writing,
the image of the spring, and of the program code differs. The image and the written
text occupy the same amount of the screen, while the program code is approximately
half their size. The spoken mode is not visually indicated on the behaviour. The
composition of the edit-state of the behaviours allocates specific spaces to particular
modal realisations. Kress and van Leeuwen’s (1996) theory of compositional
information values (outlined in Chapters Two and Three of the thesis) can be usefully
applied to the edit state of the bounce behaviour shown in figure 5.6 b. The image is
positioned in the top left quarter of the composition, the writing is positioned in the
bottom left quarter, and the program code is positioned in the top right quarter as
shown in figure 5.7.

Figure 5.7: The modal division of the bounce behaviour edit-state.

As figure 5.7 shows, the top-left position of the image of the spring suggests that its
information value is ‘given and ideal’. In other words it is presented as something
that the user already knows, an agreed departure point for the message, and the
idealised essence of the concept of bounce. This demonstrates the potential of images

165

<<   162   163   164   165   166   167   168   >>

More intriguing information