Predicting mid and long term skills needs in the UK

Labour Market Information (LMI)  is not perhaps the most popular subject to talk about. But with the advent of open and linked data, LMI  is increasingly being open up to wider audiences and has considerable potential for helping people choose and plan future careers and plan education programmes, as well as for use in research, exploring future skills needs and for social and economic planning.

This is a video version of a presentation by Graham Attwell at the Slovenian ZRSZ Analytical Office conference on “Short-term Skills Anticipations and Mismatch in the Labour Market. Graham Attwell examines ongoing work on mid and long term skills anticipation in the UK. He will bases on work being undertaken by the UK Commission for Employment and Skills and the European EmployID project looking, in the mid term, at future skills needs and in the longer term at the future of work. He explains the motivation for undertaking these studies and their potential uses. He also explains briefly the data sources and statistical background and barriers to the wok on skills projections, whilst emphasising that they are not the only possible futures and can best serve as a a benchmark for debate and reflection that can be used to inform policy development and other choices and decisions. He goes on to look at how open and linked data is opening up more academic research to wider user groups, and presents the work of the UKCES LMI for All project, which has developed an open API allowing the development of applications for different user groups concerned with future jobs and future skills. Finally he briefly discusses the policy implications of this work and the choices and influence of policymakers in influencing different futures.

 

LMI for All API released

I have written periodic updates on the work we have been doing for the UKCES on open data, developing an open API to provide access to Labour Market Information. Although the APi is specifically targeted towards careers guidance organisations and towards end users looking for data to help in careers choices, in the longer term it may be of interest to others involved in labour market analysis and planning and for those working in economic, education and social planning.

The project has had to overcome a number of barriers, especially around the issues of disclosure, confidentiality and statistical reliability. The first public release of the API is now available. The following text is based on an email sent to interested individuals and organisations. Get in touch if you would like more information or would like to develop applications based on the API.

The screenshot above is of one of the ten applications developed at a hack day organised by one of our partners in the project, Rewired State. You can see all ten on their website.

The first pilot release of LMI for All is now available and to send you some details about this. Although this is a pilot version, it is fully functional and it would be great if you could test it as a pilot and let us know what is working well and what needs to be improved.

The main LMI for All site is at http://www.lmiforall.org.uk/.  This contains information about LMI for All and how it can be used.

The APi web explorer for developers can be accessed at http://api.lmiforall.org.uk/.  The APi is currently open for you to test and explore the potential for  development. If you wish to deploy the APi in your web site or application please email us at graham10 [at] mac [dot] com and we will supply you with an APi key.

For technical details and details about the data go to our wiki at http://collab.lmiforall.org.uk/.  This includes all the documentation including details about what data LMI for All includes and how this can be used.  There is also a frequently asked questions section.

Ongoing feedback from your organisation is an important part of the ongoing development of this data tool because we want to ensure that future improvements to LMI for All are based on feedback from people who have used it. To enable us to integrate this feedback into the development process, if you use LMI for All we will want to contact you about every four to six months to ask how things are progressing with the data tool. Additionally, to help with the promotion and roll out of LMI for All towards the end of the development period (second half of 2014), we may ask you for your permission to showcase particular LMI applications that your organisation chooses to develop.

If you have any questions, or need any further help, please use the FAQ space initially. However, if you have any specific questions which cannot be answered here, please use the LMI for All email address lmiforall [at] ukces [dot] org [dot] uk.

 

LMI for All – coming soon

A quick and overdue update on the Labour Market Information for All project, which we are developing together with Raycom, the University of Warwick and Rewired State and  is sponsored by the UK Commission for Employment and Skills (UKCES).

LMI for All will provide an online data portal bringing together existing sources of labour market information (LMI) that can inform people’s decisions about their careers.  The database will contain robust LMI from national surveys and data sources providing a common and consistent baseline to use alongside less formal sources of intelligence. Due for release at the end of May 2013, access to the database will be through an open API. the results of queries can then be embedded by developers in their own web sites of apps. We will also provide a code library to assist developers.

The project builds on the commitment by the UK government to open data. despite this, it is not simple. As the Open Data White Paper (HM Government, 2012)highlights,  data gathered by the public sector is not always readily accessible. Quality of the data, intermittent publication and a lack of common standards are also barriers. A commitment is given to change the culture of organisations, to bring about change: ‘This must change and one of the barriers to change is cultural’ (p. 18).

We have talked to a considerable number of data providers including government bodies. It is striking that all have been cooperative and wishing to help us in providing access to data. However, the devil is in the detail.

Much of the data publicly collected, is done so on the condition that is is non disclosive e.e. that it is impossible to find out who submitted that data. And of course the lower the level of aggregation, the easier it is to identify where the data is coming from. And the more the data is linked, the more risk there s of chong qi cheng bao disclosure.

We have developed ways of getting round this using both statistical methods (e.g. estimation) and technical approaches (data aggregation). But it remains a lot of work preparing the data for uploading to our database. And I guess that level of work will discourage others from utilising the potential of open data. It may explain why, transport excluded, their remain limited applications built on the open data movement in the UK.

It may suggest that the model we are working on, of a publicly funded project providing access to data, and then providing tools to build applications on top of that data, could provide a model for providing access to public data.

In the meantime if you are interested in using our API and developing your own applications for careers guidance and support, please get in touch.

 

Has Open and Linked Data failed?

I am intrigued by this presentation. Whilst I appreciate what Chris Taggart, who has been invo0lved in the development of the opencorporates and openlylocal data sites (and who undoubtedly has more experience and knowledge than me of the use of Open and Linked Data) I would be less pessimistic. I see the use of open and linked data as in very early days.

Firstly, although I appreciate that politicians and bureaucrats do not always want to release data – I think there is still a groundswell in favour of making data available – at least in Europe. Witness yesterdays unveiling of the Italian Open data store (sorry, I can’t find the url at the moment). And although Google search results do not help promote open data sites (and I am not a great fan of Google at the moment after they wiped out my account ten days again), they have contributed very useful tools such as Refine, Fusion Tables and Public Data Explorer.

I still think that as Chris Taggart says in one of his first slides the biggest challenge is relevance. And here I wonder if one of the problems is that Open and Linked Data specialists are just that – specialist developers in their own field. Many of the applications released so far on the UK Data store, whilst admiral examples of the art of development – would seem to have little practical use.

Maybe it is only when the tools and knowledge of how to work with Open and Linked data are adopted by developers and others in wonder social and subject areas that the true benefits will begin to show. Open data applications may work best, not through dedicated apps or sites, but when incorporated in other web sites which provide them with context and relevance. Thus we have been working with the use of open and linked data for careers guidance (see our new web site, www.careerstalk.org which includes working demonstrations).

Bu even more important may be finding ways of combining Open and Linked data with other forms of (human) knowledge and intelligence. It is just this form of knowledge – for instance the experiences and informal knowledge of careers guidance professionals, which brings relevance and context to the data from official data sets. And that provides a new design challenge.