Recognising competence and learning

As promised some further thoughts on the DISCUSS conference, held earlier this week in Munich.

One of the themes for discussion was the recognition of (prior) learning. The theme had emerged after looking at the main work of Europa projects, particularly in the field of lifelong learning. The idea and attraction of recognising learning from different contexts, and particularly form informal learning is hardly new. In the 1990s, in the UK, the National Council for Vocational Qualifications (as it was then called) devoted resources to developing systems for the Accreditation of Prior Learning. One of the ideas behind National Vocational Qualifications was teh decoupling of teaching and learning from learning outcomes, expressed in terms of competences and performance criteria. Therefore, it was thought, anyone should be able to have their competences recognised (through certification) regardless of whether or not they had followed a particular formal training programme. Despite the considerable investment, it was only at best a limited success. Developing observably robust processes for accrediting such learning was problematic, as was the time and cost in implementing such processes.

It is interesting to consider why there is once more an upsurge of interest in the recognition of prior learning. My feeling was in the UK, the initiative wax driven because of teh weak links between vocational education and training and the labour market.n In countries liek Germany, with a strong apprenticeship training system, there was seen as no need for such a procedure. Furthermore learning was linked to the work process, and competence seen as the internalised ability to perform in an occupation, rather than as an externalised series of criteria for qualification. However the recent waves of migration, initially from Eastern Europe and now of refugees, has resulted in large numbers of people who may be well qualified (in all senses of the word) but with no easily recognisable qualification for employment.

I am unconvinced that attempts to formally assess prior competence as a basis for the fast tracking of  awarding qualifications will work. I think we probably need to look much deeper at both ideas around effective practice and at what exactly we mean my recognition and will write more about this in future posts. But digging around in my computer today I came up with a paper I wrote together with Jenny Hughes around some of these issues. I am not sure the title helped attract a wide readership: The role and importance of informal competences in the process of acquisition and transfer of work skills. Validation of competencies – a review of reference models in the light of youth research: United Kingdom. Below is an extract.

“NVQs and the accreditation of informal learning

As Bjørnåvold (2000) says the system of NVQs is, in principle, open to any learning path and learning form and places a particular emphasis on experience-based learning at work, At least in theory, it does not matter how or where you have learned; what matters is what you have learned. The system is open to learning taking place outside formal education and training institutions, or to what Bjørnåvold terms non-formal learning. This learning has to be identified and judged, so it is no coincidence that questions of assessment and recognition have become crucial in the debate on the current status of the NVQ system and its future prospects.

While the NVQ system as such dates back to 1989, the actual introduction of “new” assessment methodologies can be dated to 1991. This was the year the National Council for Vocational Qualifications (NCVQ) and its Scottish equivalent, Scotvec, required that “accreditation of prior learning” should be available for all qualifications accredited by these bodies (NVQs and general national qualifications, GNVQs). The introduction of a specialised assessment approach to supplement the ordinary assessment and testing procedures used when following traditional and formal pathways, was motivated by the following factors:

1. to give formal recognition to the knowledge and skills which people already possess, as a route to new employment;
2. to increase the number of people with formal qualifications;
3. to reduce training time by avoiding repetition of what candidates already know.

The actual procedure applied can be divided into the following steps. The first step consists of providing general information about the APL process, normally by advisers who are not subject specialists, often supported by printed material or videos. The second and most crucial step includes the gathering and preparation of a portfolio. No fixed format for the portfolio has been established but all evidence must be related to the requirements of the target qualification. The portfolio should include statements of job tasks and responsibilities from past or present employers as well as examples (proofs) of relevant “products”. Results of tests or specifically-undertaken projects should also be included. Thirdly, the actual assessment of the candidate takes place. As it is stated:”The assessment process is substantially the same as that which is used for any candidate for an NVQ. The APL differs from the normal assessment process in that the candidate is providing evidence largely of past activity rather than of skills acquired during the current training course.”The result of the assessment can lead to full recognition, although only a minority of candidates have sufficient prior experience to achieve this, In most cases, the portfolio assessment leads to exemption from parts of a programme or course. The attention towards specialised APL methodologies has diminished somewhat in the UK during recent years. It is argued that there is a danger of isolating APL, and rather, it should be integrated into normal assessments as one of several sources of evidence.”The view that APL is different and separate has resulted in evidence of prior learning and achievement being used less widely than anticipated. Assessors have taken steps to avoid this source of evidence or at least become over-anxious about its inclusion in the overall evidence a candidate may have to offer.”We can thus observe a situation where responsible bodies have tried to strike a balance between evidence of prior and current learning as well as between informal and formal learning. This has not been a straightforward task as several findings suggest that APL is perceived as a “short cut”, less rigorously applied than traditional assessment approaches. The actual use of this kind of evidence, either through explicit APL procedures or in other, more integrated ways, is difficult to overview. Awarding bodies are not required to list alternative learning routes, including APL, on the certificate of a candidate. This makes it almost impossible to identify where prior or informal learning has been used as evidence.

As mentioned in the discussions of the Mediterranean and Nordic experiences, the question of assessment methodologies cannot be separated from the question of qualification standards. Whatever evidence is gathered, some sort of reference point must be established. This has become the most challenging part of the NVQ exercise in general and the assessment exercise in particular.We will approach this question indirectly by addressing some of the underlying assumptions of the NVQ system and its translation into practical measures. Currently the system relies heavily on the following basic assumptions: legitimacy is to be assured through the assumed match between the national vocational standards and competences gained at work. The involvement of industry in defining and setting up standards has been a crucial part of this struggle for acceptance, Validity is supposed to be assured through the linking and location of both training and assessment, to the workplace. The intention is to strengthen the authenticity of both processes, avoiding simulated training and assessment situations where validity is threatened. Reliability is assured through detailed specifications of each single qualification (and module). Together with extensive training of the assessors, this is supposed to secure the consistency of assessments and eventually lead to an acceptable level of reliability.

A number of observers have argued that these assumptions are difficult to defend. When it comes to legitimacy, it is true that employers are represented in the above-mentioned leading bodies and standards councils, but several weaknesses of both a practical and fundamental character have appeared. Firstly, there are limits to what a relatively small group of employer representatives can contribute, often on the basis of scarce resources and limited time. Secondly, the more powerful and more technically knowledgeable organisations usually represent large companies with good training records and wield the greatest influence. Smaller, less influential organisations obtain less relevant results. Thirdly, disagreements in committees, irrespective of who is represented, are more easily resolved by inclusion than exclusion, inflating the scope of the qualifications. Generally speaking, there is a conflict of interest built into the national standards between the commitment to describe competences valid on a universal level and the commitment to create as specific and precise standards as possible. As to the questions of validity and reliability, our discussion touches upon drawing up the boundaries of the domain to be assessed and tested. High quality assessments depend on the existence of clear competence domains; validity and reliability depend on clear-cut definitions, domain-boundaries, domain-content and ways whereby this content can be expressed.

As in the Finnish case, the UK approach immediately faced a problem in this area. While early efforts concentrated on narrow task-analysis, a gradual shift towards broader function-analysis had taken place This shift reflects the need to create national standards describing transferable competences. Observers have noted that the introduction of functions was paralleled by detailed descriptions of every element in each function, prescribing performance criteria and the range of conditions for successful performance. The length and complexity of NVQs, currently a much criticised factor, stems from this “dynamic”. As Wolf says, we seem to have entered a “never ending spiral of specifications”. Researchers at the University of Sussex have concluded on the challenges facing NVQ-based assessments: pursuing perfect reliability leads to meaningless assessment. Pursuing perfect validity leads towards assessments which cover everything relevant, but take too much time, and leave too little time for learning. This statement reflects the challenges faced by all countries introducing output or performance-based systems relying heavily on assessments.

“Measurement of competences” is first and foremost a question of establishing reference points and less a question of instruments and tools. This is clearly illustrated by the NVQ system where questions of standards clearly stand out as more important than the specific tools developed during the past decade. And as stated, specific approaches like, “accreditation of prior learning” (APL), and “accreditation of prior experiential learning” (APEL), have become less visible as the NVQ system has settled. This is an understandable and fully reasonable development since all assessment approaches in the NVQ system in principle have to face the challenge of experientially-based learning, i.e., learning outside the formal school context. The experiences from APL and APEL are thus being integrated into the NVQ system albeit to an extent that is difficult to judge. In a way, this is an example of the maturing of the system. The UK system, being one of the first to try to construct a performance-based system, linking various formal and non-formal learning paths, illustrates the dilemmas of assessing and recognising non-formal learning better than most other systems because there has been time to observe and study systematically the problems and possibilities. The future challenge facing the UK system can be summarised as follows: who should take part in the definition standards, how should competence domains be described and how should boundaries be set? When these questions are answered, high quality assessments can materialise.”

How can we make work in construction trendy?

For some reason the construction industry is not a sexy research area. Motor cars, yes, machine tools, yes, the computer industry, yes, yes, yes. But poor old construction, boring. Yet in economic terms, construction could be seen as the most important sector in Europe.

Our initial research under the Learning Layers project reveals some interesting contradictions. The construction industry is probably the biggest victim of the present recession. Even the neo liberal UK government is now taking actions to stimulate house building – through the partial nationalisation of mortgage debts. Probably an emphasis on infrastructure projects or on social housing would have had a bigger impact and would have avoided the risk of another house price bubble. But the fact they are doing anything at all shows the problem.

But whilst the recession has badly hit profitability and employment another concern has arisen in our interviews with construction companies. Managers are severely worried about the ability to recruit new trainees and particularly to recruit the better educated apprentices they see as critical to cope with the increasing use of technology in construction. Managers point to the major issue as being the image of the industry – just as in research they consider the industry not to be sufficiently sexy. They are less likely to discuss issues such as wages, opportunities for progression or just the sheer hard physical work involved in many construction trades. Having said that, reality may be very different from practice in other images which have a positive image. Work in the games industry can be hard, poorly paid and boring. And for every kid who makes a fortune out of a mobile app, thousands make no money at all.

Either way they are right in that there will almost certainly be demand for new skills to deal with technology – both in the uses of technology for construction but perhaps more important the changing materials being used in building today, not least due to ecologiocal and energy saving concerns and legislation. Whilst improving initial education training programmes is one response and attempting to improve the image of the industry, the big challenge may be to improve research and development and to develop more continuous training for existing employees. In this short extract form previous research, below, we provide an overview of the industry in Europe and Germany, together with issues in how training – or informal learning – might be improved.

The total turnover of the construction industry in 2010 (EU27) was 1186 billion Euros forming 9,7% of the GDP in 2010 (EU27). The construction industry is the biggest industrial employer in Europe with 13,9 million operatives making up 6,6% of the total employment in EU27. In addition it has a substantial influence on other industries represented by a multiplier effect. According to a study by the European Commission, 1 person working in the construction industry is responsible for 2 further persons working in other sectors. Therefore, it is estimated that 41,7 million workers in the EU depend, directly or indirectly, on the construction sector. Out of the 3,1 million enterprises 95% are SMEs with fewer than 20 and 93% with fewer than 10 operatives.   The level of investment in R&D in the European construction sector is low compared to other sectors. The construction sector only invests a small portion of its total production value in research, development, and innovation.

The developments of new processes and materials provide substantial challenges for the construction industry. The traditional educational and training methods are proving to be insufficient as the rapid emergence of new skill and quality requirements (for example those related to green building techniques) require much faster involvement and action on all three levels (individual, organisational and cluster) in order to react quickly to these changes and exploit opportunities. Without this the market potential is hampered by lack of innovation skills and training gaps (Dittrich, Deitmer 2003). The increased rate of technical change introduces greater uncertainty for firms, which, in turn, demands an increased capacity for problem solving skills (Toner 2011, 7). This situation is aggravated in some fast developing European Regions because skilled craftspeople are missing. Therefore there is increasing need for rapid re- and upskilling of the building workforce across the construction cluster.

The construction industry in Germany is one of the country’s most stable economic sectors. Providing jobs to more than 2,2 million people it holds a market share of 21% making the German construction sector the largest in the EU27 in terms of production value. In Germany the federal states, enterprises and the apprentices share the costs of the dual education system (practical training in schools and on-site training). The German compensation fund for construction industry SOKA-BAU reported a total of 270 million Euros of training allowances and job training costs in 2010 making it just a little more than 0,1% of the total production value. In fact, the building trade has one of the lowest participation rates for employees towards further training provision than any other sector (TNS INFRATEST 2008). This is because much of the formal training offering is only weakly connected with real work tasks. The cost pressure in building enterprises limits chances for time-consuming training measures far away from the workplace (Schulte, Spöttl, 2009). Any mobile support for learning and informing at the work place would be welcomed by companies as well as by building workers themselves. With enterprises paying for all the costs associated with the on-the-job training, SMEs need a cost effective solution to overcome the issues that occur with the rapid development in the technologies, processes and materials.

2012 PLE Conference papers now online

In these days of repositories and Open Online Resources publishing should be easy. But it is still not so simple. For one thing there is all the editing and checking = for another developing / begging or borrowing the technical infrastructure.

The PLE Conference organisers are committed to publishing all contributions to our annual conference online with a Creative Commons License. And thanks to hard work by Carlos, Luis and Sara, the proceedings of the 2012 conference, held in Aveiro, Portugal, are now online here.

Check it out – if you have any interest in Personal Learning Environments you will find much of interest.

Only 15 per cent of UK companies offer apprenticeship training

The UK Commission for Employment and Skills has published an interesting survey of Employer Perspectives Survey, the second in a series of biennial, large scale surveys of employers designed to provide a UK-wide picture of employer perspectives of, and experiences in, the recruitment and skills landscape. The draw attention to the following key findings:

  • There are perhaps unexpected signs of business confidence amongst private sector employers: almost half of establishments expect their business to grow in the coming year, and there is also greater confidence amongst younger businesses than older ones.
  • Employers typically use a range of channels when they are looking to recruit. They tend to make most use of private recruitment services which they do not have to pay for. Indeed, the single most common channel employers used to find candidates to fill vacant posts was ‘word of mouth’.
  • Candidates’ qualifications play a role in most employers’ recruitment processes and decisions, and a significant role for more than two in five. Academic qualifications continue to be better regarded than vocational qualifications.
  • Whilst the majority of employers train and plan their training there is a significant core of employers that do not.
  • Employers are more likely to provide training internally than to access the external workforce development market, although overall around half of employers do use external channels to deliver workforce development for their staff.
  • Employers most commonly look to commercial providers (private sector training firms or third sector providers) when they are looking outside of their own organisation to deliver training.
  • Overall take up of vocational qualifications remains at a steady level. However, there has been qualitative improvement in satisfaction with vocational qualifications amongst those employers that offer them.
  • Only a minority of all UK establishments offer apprenticeships (15 per cent). However, almost a quarter of those who don’t currently offer Apprenticeships expect to in the coming 2-3 years.
  • Employers are open to the recruitment of, or providing opportunities to, young people. Just over a quarter of all establishments, or 62% of those who had recruited, had recruited a young person in the previous 12 months. A quarter of all establishments had offered a placement to schools, college or university students.

A number of these findings appear significant. Employers still often rely on word of mouth – i.e. informal networks – when recruiting. And if qualifications play significant role for more than two in five decisions about who to recruit this means for three out of five they do not! The report also notes that

Academic qualifications continue to be better regarded than vocational qualifications and that when employers are looking to recruit new employees to key occupational roles, they usually anticipate that they will need to develop these new recruits’ skills, at least to some extent. UKCES report that employers are more likely to provide training internally (63 per cent did so) than to access the external workforce development market. Furthermore there is a wide sectoral variation in the provision of external training, ranging from 86 per cent in the Non-Market Services to 49 per cent in Trade, Accommodation and Transport sector.

Prospects for young people are problematic. “Amongst those active in the labour market in the last 12 months, the recruitment of young people was highest in the Trade, Accommodation and Transport sector at 71 per cent falling to between 55 and 59 per cent in all other sectors. This reflects the roles they are recruited to: 21 per cent of all employers recruiting young people reported that their most recent recruit was to a Sales and Customer Service role and 20 per cent to an Elementary occupation.”

Just 15 per cent of enterprises were offering apprenticeships. And of those that were: “Approaching a third of those who offer formal Apprenticeships (31 per cent) offer Apprenticeships that take 12 months or less to complete, and five per cent offer Apprenticeships with a duration of six months or less.”

All in all the report reveals some pretty big challenges ahead if the UK is going to develop an advanced education and training system, especially where employers are concerned.

 

Who owns the e-Portfolio?

Over the years I have had a fair bit of interest, in this diagramme, produced in a paper for the the e-Portfolio conference in Cambridge in 2005.

I has some discussion about it with Gemma Tur at the PLE2012 Conference in Aveiro. And now Gemma, who is writing her doctoral dissertation in ePortfolios, has written to me to remind me of our discussion. Gemma says:

I thought I could add that eportfolios built with web 2.0 tools may have another process which is based on networking. Cambridge (2009, 2010) argues about the construction of two selves, the networked self and the symphonic self. The first is about documenting learning quickly, in everyday life, taking brief notes with short and quick reflection, sharing and networking. The second is about presenting learning, reorganizing learning, linking learning evidence, with longer and more profound reflection… no networking in this final stage, as it is an inner process

As I am working with learning eportfolios, with web 2.0 tools, networking is a learning process for my students. Therefore, they are building their networked self.

So, if I argue networking is an eportofolio process of web 2.0 eportfolios, who owns the process? Looking at your article and your illustration, I thought it could be a process owned by both the learner and the external world. If networking is a process of sharing, visiting, linking, connecting, commenting, does it mean that it involves both the learner and the audience? this is what I thought before you told me that it is the learner’s process for sure.

So do you think that definitely I should argue that it is only owned by the learner? Then although it could need someone else to comment and connect, in fact, the act of networking is the student’s responsibility? is this the reason why you think that?, do you think I should argue it is owned by the learner?

These are interesting discussion impacting on wider areas than ePortfolios. In particular I think the issue of control is important to the emerging MOOC discussion.

Returning to Gemma’s questions – although I have not read the paper – I don’t think I agree with Cambridge’s idea of he networked self and the symphonic self – at least in this context. I think that networking becomes more important when presenting learning, reorganizing learning, linking learning evidence, and longer and more profound reflection. these processes are inherently social and therefore take place in a social environment.

However it is interesting that social networking was hardly on the radar as a learning process in 2005. And when I referred to the ‘external world’ I was thinking about external organisations – qualification and governmental bodies, trade unions and employers rather than broad social networks. Probably the diagramme needs completely redrawing to reflect the advent and importance of Personal Learning Networks.

However, despite the fact that personal social networks exist in the external world (the ‘audience’), I think the owner of the process is the learner. AZnd I would return again to Ilona Buchems study of the psychological ownership of Personal learning Environments. Ilona says:

One of most interesting outcomes of the study was the relation between control and ownership. The results show that while perceived control of intangible aspects of a learning environment (such as being able to determine the subject matter or access rights) has a much larger impact on the feeling of ownership of a learning environment than perceived control of tangible aspects (such as being able to choose the technology).

Personal Learning Networks are possibly the most important of the intangible aspects of a learning environment. The development of PLEs (which I would argue come out of the ePortfolio debate) and the connectivist MOOCs are shifting control from the educational institutions to the elearners and possibly more important from institutions to wider communities of practice and learning. Whilst up to now, institutions have been able to keep some elements of control (and monopoly through verifying, moderating, accrediting and certifying learning, that is now being challenged by a range of factors including open online courses, new organisations such as the Social Science Centre in Lincoln in the UK and Open Badges.

Such a trend will almost inevitably continue as technology affords ever wider access to resources and learning. The issue of power and control is however unlikely to go away but will appear in different forms in the future.