YouTube: Semantic ambiguity, bricolage and sign making

This research rocks! At a workshop on ‘Technology enhanced learning in the context of technological, societal and cultural transformation‘, held in Garmisch Partenkirchen earlier this month, I was lucky enough to talk to Elisabetta Adami who was presenting an expellent paper on ‘Individualized participation in public forms of communication and learning: reshaping contexts in a changing world of cultural products.’

But it was her doctoral research which really got me interested.  Elisabetta’s dissertation, called Video interaction on YouTube: Contemporary Changes in Semiosis and Communication’, looks at interaction through video replies on YouTube. It is both serious research and fascinating to read.

The entire dissertation, written in English is available on the web and can also be downloaded. Here is an excerpt from the conclusion to the abstract:

“the analysis of the process of video-interaction focuses on (a) its distinctive features and structural characteristics, (b) its semiotic ‘affordances’ (Kress and van Leeuwen, 2001: 67), in terms of the material and social constraints and possibilities which the medium imposes over the semiosis, and (c) the diversified (and often conflicting) semiotic practices with which the affordances are actualized by the interactants.

Rather than following traditionally conceived cooperative or relevance principles and notions of coherence and cohesion, video-interaction works on a ‘loose’ form of individualized participation. While the structural characteristics determine the interactional possibilities, the interactants’ practices exploit the affordances of video-interaction in unexpected ways and often lead to changes in the structure itself (in the same way as the Saussurean parole, when made socially dominant, modifies the langue). Patterns of relatedness in the exchanges are driven by the sign-makers’ diversified interests. More specifically, sign-making relations in the exchanges are established through a system of differentiation-within-attuning, so that interactants bring their distinctive contribution while keeping the same (either formal or semantic) theme, set by the initial video. In this sense, video-interaction is analogous to collective forms of artistic improvisation (e.g., the genre of variation in music or the contemporary free-style). Video responses take up – and actualize – one or more prompts within the range of possibilities set by the initial video. This prompt-response relation generally disregards the interlocutor’s intended meaning, it often does not follow relevance principles, it presents (traditionally considered) marked textual organizations, and does not build coherent exchanges. Not only is (intertextual) implicitness widely practiced, but also formal attuning is sometimes more regarded than (semantic) coherence for the establishment of relatedness in the exchange.

Rather than on the interactants’ mutual understanding, video-interaction hinges on a playful and challenging engagement with the medium and with the other texts in the exchange, by exploiting maximally the representational possibilities of both.

Patterns of relatedness are established through an interest-driven selection, transformation, assemblage and recontextualization of (often formal, at times implicit or backgrounded) elements of the initial video or of other texts. This way, sign-making is often done by means of a copy-and-paste technique, which follows the interactants’ diversified interests, and disregards coherence or the signmaker’s intended meaning. Responses frequently and intentionally produce their texts through misunderstanding and exploit maximally the potential semantic ambiguity of the interlocutor’s text. Incoherent exchanges are successful and generally acknowledged and accepted by interactants. In this sense, videointeraction epitomizes the changes in representation and communication which are taking place in our contemporary semiotic landscape, whereby traditional systems of coherence are disregarded and (traditionally considered) incoherent or noncohesive exchanges are acceptable as the result of representations produced through the selection, copy and paste, recontextualization and forwarding of other texts.

These contemporary changes in representation and communication need analogous changes in the theories of communication, while their description requires adequate analytical models. Therefore the thesis concludes by hypothesizing the usefulness of the theoretical and analytical framework devised for the research to the description of contemporary forms of communication.”

Vygotsky, Activity Theory and the use of tools for formal and informal learning

In general I don’t like Christmas. Difficult travel, rampant consumerism, enforced jollity and all that kind of thing. But there is one thing I like about it and that is the peace away form day to day meetings to try and think and write a little. In this case I have an overdue short paper to deliver for the MatureIP project looking at teh work of Vygotsky and what we can learn from his work for knowledge maturing processes and for Personal Learning Environments.
Needless to say, I have not finished it yet and the more I read the more confused I seem to get.
The approach Vygotsky took to cognitive development is sociocultural, working on the assumption that ‘action is mediated and cannot be separated from the milieu in which it is carried out’ (Wertsch, 1991:18).Vygotsky considered that “higher mental functions are, by definition, culturally mediated.” Social processes give rise to individual processes and both are essentially mediated by artefacts.
Furthermore Vygotsky held that “environment cannot be regarded as a static entity and one which is peripheral in relation co development, but must be seen as changeable and dynamic.” The social cultural approach to learning has been extended through Activity Theory and I find that interesting in the context of comparing formal education and the use of tools compared to informal learning in social networks. Within an activity system tools or instruments – including technologies – are considered to be mediating elements.

actsystemschools.001

First lets look at formal education. Formal education systems are heavily rule bound, with rule determining both the contents and usually the process of learning. The divisions of labour are strongly defined, especially with regard to the roles of managers and teachers within teh system. the community is that of the institution, which once more is heavily prescriptive regarding tools and objects with outcomes frequently being seen as formal acquisition of qualifications. In this subject – or learner – situation the selection of the tools which mediate the learning. Indeed in this activity system the selection of tools is intended more to preserve the rules and the division of labour and to contain the outcomes, than it is to support learning per se.

actsystementerpises.001
Then lets compare that with the use of social software for learning in the workplace. Firstly the division of labour is very different and more likely to be influenced by work place divisions than that of teachers. In this respect if the object is knowledge acquisition the outcomes may well be bounded by work processes, for instance through the need to solve a problem or through the introduction of new technologies or innovation in the workplace. The division of labour still remains important to the activity, especially the object, in permitting or restraining the time and the access of the subject to the tools they need to undertake the activity. However it is important to note that Vykotsky saw learning as taking place in Zones of Proximal development and to be influenced by the interventions of a Significant Other Person. This could be  a teacher, a trainer, a peer. However this process is once more mediated by instruments or tools thus meaning that significant person or persons could be supporting learning through a forum or through a Personal Learning Network.
Once more the tools will mediate the activity of learning. But here the prescription may be less in that the community itself will influence the tools and may be a broader community of learners or a community of practice, recommending tools based on a collective experience. However, rules may still apply especially through the Terms and Conditions of Service and use of any particular social software service. In the context of the tools, Vygotsky considered that all artefacts are culturally, historically and institutionally situated. “In a sense, then, there is no way not to be socioculturally situated when carrying out an action. Conversely there is no tool that is adequate to all tasks, and there is no universally appropriate form of cultural mediation. Even language, the ‘tool of tools’ is no exception to this rule”. (Cole and Wertsch).
In terms of informal learning and work based learning, the tools are less likely to be culturally bound to the institution of the school. Thus more often we may see the appropriation of cultural tools or artefacts used in wider society and repurposed for learning, than the use of explicitly ‘educational software’. But over a period of time, as the practice of the use of such tools for learning becomes culturally embedded within society, it may start to influence the selection of tools and instruments for learning within institutions framed through the rules and division of labour of the education systems.
Sorry if all this is not too clear. But I would very much welcome any feedback :)

Digital Identities and Personal Learning Environments

These are the slides from my presentation from the excellent session on Digital Identities at the Online Educa Berlin conference held earlier this month.

Google Goggles – an important tool for mobile work based learning?

Is Google running short of imagination. Not when it comes to applications – there seems to be a new product announcement almost everyday. But Google Goggles – who thought that up? Its a terrible name. But in terms of developing a work based mobile learning platform it may represent a big step forward.

Goggles is a very simple application. You merely point your Android phone at an object – a building, an object, an artefact – and it produces search results based on the image (Google say they will be porting it to other platforms in the future).

If course Goggles has not been developed for learning. Google are interested in driving more search traffic to their site and have arguably paid little attention to education in the past (witness the little attention paid to developing Google scholar). But we have noted before the way in which social software applications (as well as mobile devices) are being appropriated for learning despite their original design purpose.

Work based learning poses particular opportunities and issues and for mobile learning.  Most elearning courses are based on formal programmes of study, on a curriculum, usually designed around a particular discipline. Even vocational programmes envisage steady progression through a corpus of ideas and knowledge, albeit with practice based phases. Work based learning is predicated on occupational practice. Practice is often inter disciplinary in terms of a knowledge base and progression is dependent on the nature of the work being carried out. In other words in work based learning the context of action is king. Up to now it has proved difficult to develop elearning base don widely differing contexts of practice based action.

Mobile devices have portability to be used in workplaces where access to computers may be problematic. Goggles can allow simple gesturing to allow access to a wealth of information about the particular practice being carried out. Of course this is not enough to support learning. Learning requires reflection. But it is not difficult to envisage a simple interface allowing reflection through audio, video or text input which could then be aggregated along with the original video which sparked the reflection and the results of the Google search. The addition of keywords could allow such reflections to be added to a Personal or Organisational Learning Environment. Geotagging could also allow an extension to enhanced reality applications thus allowing interaction with other learners also encountered similar learning situations.

The object or artefact opens a Zone of Proximal Development in Vygotsky’s terminology, with ‘the significant other’ supporting learning being mediated through technology.

Workplaces could become a rich learning environment with learning opportunities embedded in artefacts and in geographical spaces. And at the sameGoogle Giggles  time informal learning, that learning which takes place everyday in relation to context, can be brought together within a formal learning base.

None of this seems unrealistic to me. Who wants to build me some apps to try it?

Hearing the learners’ voice

One big thing was missing from last weeks Online-Educa Berlin conference was the voice of the learners. Not so strange I suppose in view of the cost of the conference. and not so strange when compared with other conferences on technology Enhanced Learning. Although we talk about leaners a lot, how often do we talk to them or, more importantly, listen.

Although many projects talk about user centred design, and research based design, I get the impression that there is more talk than action. Often technologists are happier with usability rubrics than they are sitting down with real learners.

Of course there is a problem of methodologies. How do we research what learners are doing with technologies. What research methods can help us and how can we interpret the results? Ethnographic studies are one obvious approach and one that many researchers I have talked to have advocated. However, ethnographic approaches, at least in the traditional form of the discipline, are extremely time consuming and require extended access to the subjects of study. Within the Mature project, we have used an approach dubbed Rapid Ethnography. What this really means, I think, is extended case studies.

The UK Jisc funded Learner Experiences of E-learning strand is extremely impressive in this regard. Initial project work helped us, they say, “to understand the complexity of learners’ lives and experiences.” The projects found

  • “Learners are living complex and time constrained lives. In these circumstances efficient and flexible access to learning materials, experts and communities are becoming increasingly important. Learners appreciate flexible access to course related resources.
  • Learners make frequent use of technology both at home and within their institution. They use the internet as the first port of call for information in their lives and expect to be able to locate and download relevant resources for their study.
  • Similarly, many learners are used to establishing and maintaining frequent technology mediated connections and expect frequent and responsive communications in relation to their study.
  • Personalisation and choice are core elements of technology use in learners’ lives that they expect to transfer to their study.
  • There is evidence of an ‘underworld’ of informal learning which is not expected or supported by the institution or its courses but may be enabled and sustained by use of technology.”

I am especially interested in the last of the bullet points and will return to it in a later post.

The methodology is also outlined on the project wiki pages. They found that

And best of all they have “produced a set of recipe cards for different types of data collection methods, particularly well suited to evaluations of learners’ experiences of e-learning:

This is an impressive piece of work. But I particularly like the use of the wiki, not only to provide access to the outcomes of the projects, but to share tools and methodologies with other researchers. If all projects were to follow such an approach we could collectively begin to address some of the methodological challenges for involving users in technology design.