The challenges of open data: emerging technology to support learner journeys

It is the end of the holidays and time to return back to work. And of course with September starts the autumn conference season. This week I am at the ALT C Conference at Warwick University and then at the European Conference for Educational Research in Porto. More on The ECER conference later.

At Alt C we are organising a workshop on the UKCES open data project (abstract below). And we will also have an exhibition stand. So if you are coming to the conference make sure to drop by the stand – No 16 in the Arts Centre – free coffee and sweets! and say hello.

The challenges of open data: emerging technology to support learner journeys

People make important decisions about their participation in the labour market every year. This extends from pupils in schools, to students in Further and Higher education institutions and individuals at every stage of their career and learning journeys. Whether these individuals are in transition from education and/or training, in employment and wishing to up-skill, re-skill or change their career, or whether they are outside the labour market wishing to re-enter, high quality and impartial labour market information (LMI) is crucial to effective career decision-making. LMI is at the heart of UK Government reforms of careers service provision. Linking and opening up careers focused LMI to optimise access to, and use of, core national data sources is one approach to improving that provision as well as supporting the Open Data policy agenda (see HM Government, 2012). Careers focused LMI can be used to support people make better decisions about learning and work and improve the efficiency of labour markets by helping match supply with demand, and helping institutions in planning future course provision.

A major project, funded by the UK Commission for Employment and Skills, is underway led by a team of data experts at the Institute for Employment Research (University of Warwick) with developers and technologists from Pontydysgu and Raycom designing, developing and delivering a careers LMI webportal, known as LMI for All. The presentation will focus on the challenge of collaborating and collecting evidence at scale between institutions and the social and technological design and development of the database. The database is accessed through an open API, which will be explored during the presentation.

Through open competition developers, including students in FE, have been encouraged to develop their own applications based on the data. Early adopters and developers have developed targeted applications and websites that present LMI in a more engaging way, which are targeted at specific audiences with contrasting needs.The web portal is innovative, as it seeks to link and open up careers focused LMI with the intention of optimising access to, and use of, core national data sources that can be used to support individuals make better decisions about learning and work. It has already won an award from the Open Data Institute.

The presentation will highlight some of the big data and technological challenges the project has addressed. It will also look at how to organise collaboration between institutions and organisations in sharing data to provide new services in education and training.Targeted participants include developers and stakeholders from a range of educational and learning settings.

The session will be interactive with participants able to test out the API, provide feedback and view applications.

Hack your career

I don’t normally post press releases on this site. Too much corporate speak. But I make an exception in this case. Regular readers will know that for the last three years I have been playing with the possibility of using open data for people to make choices about their future jobs and careers – whether it be moving to a new area to seek work, changing careers or selecting a university or college course. For the past two years we have been working with Warwick University and Raycom on the UK Commission for Education and Skills sponsored LMI for All project. the project has developed a database and APi providing access to a range of Labour Market Information. The work has proved challenging in terms of negotiating access to different data sets, ensuring the data is non disclosive and cleaning the data and in developing the technical infrastructure to provide easy access but at the same time ensuring the security of the data.

The beta vesrion of the APi was released in June this year. Whilst we provide access to a web based data explorer we do not provide apps. Instead the idea os to  Over the autumn we have been upgrading the infrastructure and adding more datasets including the US O*Net data. Whilst we provide access to a web based data explorer we do not provide apps. Instead the idea to encourage third party developers, including careers web sites, to themselves develop web and mobile applications based on the API.  And yesterday UKCES, working together with together with Loudsource have launched a CareerHack competition for apps based on the API.

The press release says:

A NEW competition launched today is calling on developers from across the globe to create an app to help people hack into a new career and win a share of £20,000 in the process.

The CareerHack contest, run by the UK Commission for Employment and Skills (UKCES), is asking developers to find innovative and inspiring ways of using data made available through its LMI for All data site. This is a unique portal containing Labour Market Information (LMI) on employment, skills and future job market predictions, which for the first time makes the different sources of information compatible with each other and available in the same place.

The winner will be given £10,000 to spend as they wish, with £5,000 going to the runner-up.  A special £5,000 prize is available to college students aged 16-24, giving the opportunity for the tech-leaders of tomorrow to showcase their talents and skills.

Michael Davis, Chief Executive of UKCES said:

“We wanted to find a way to allow as many people as possible to benefit from our open data approach to careers and jobs intelligence. An open innovation contest for developers is the perfect solution and we’re delighted that there is a special category for young people studying in college. I’m looking forward to seeing the creativity of app developers from across the world.”

The LMI for All data portal brings together extensive careers intelligence providing a single point of access to the data needed to answer common career questions such as how many people currently work in a particular job, average salaries and the skills needed for certain careers or roles.

While LMI for All information is already being used in various ways by a number of websites, organisers hope the CareerHack contest will open the resource up to creative individuals from around the world – uncovering new and innovate ways to use data to help people map out their future career.

To help illustrate the ways in which the information can be used a Career Trax website has been created by the UKCES – highlighting just one of the ways the LMI for All data can be used.

All entries must be submitted with a brief YouTube video, showcasing how the app works and illustrating its potential. A panel of judges, including representatives from Google and Ubuntu, Further Education institutions and business leaders, will then pick the overall winner next February.

Both individuals and teams are eligible to enter.  You will need to be capable of developing a workable app using LMI for All data. For more information, please visit the contest website at http://careerhack.appchallenge.net

The closing date for entries is 5pm on Friday the 21st of February 2014.

LMI for All API released

I have written periodic updates on the work we have been doing for the UKCES on open data, developing an open API to provide access to Labour Market Information. Although the APi is specifically targeted towards careers guidance organisations and towards end users looking for data to help in careers choices, in the longer term it may be of interest to others involved in labour market analysis and planning and for those working in economic, education and social planning.

The project has had to overcome a number of barriers, especially around the issues of disclosure, confidentiality and statistical reliability. The first public release of the API is now available. The following text is based on an email sent to interested individuals and organisations. Get in touch if you would like more information or would like to develop applications based on the API.

The screenshot above is of one of the ten applications developed at a hack day organised by one of our partners in the project, Rewired State. You can see all ten on their website.

The first pilot release of LMI for All is now available and to send you some details about this. Although this is a pilot version, it is fully functional and it would be great if you could test it as a pilot and let us know what is working well and what needs to be improved.

The main LMI for All site is at http://www.lmiforall.org.uk/.  This contains information about LMI for All and how it can be used.

The APi web explorer for developers can be accessed at http://api.lmiforall.org.uk/.  The APi is currently open for you to test and explore the potential for  development. If you wish to deploy the APi in your web site or application please email us at graham10 [at] mac [dot] com and we will supply you with an APi key.

For technical details and details about the data go to our wiki at http://collab.lmiforall.org.uk/.  This includes all the documentation including details about what data LMI for All includes and how this can be used.  There is also a frequently asked questions section.

Ongoing feedback from your organisation is an important part of the ongoing development of this data tool because we want to ensure that future improvements to LMI for All are based on feedback from people who have used it. To enable us to integrate this feedback into the development process, if you use LMI for All we will want to contact you about every four to six months to ask how things are progressing with the data tool. Additionally, to help with the promotion and roll out of LMI for All towards the end of the development period (second half of 2014), we may ask you for your permission to showcase particular LMI applications that your organisation chooses to develop.

If you have any questions, or need any further help, please use the FAQ space initially. However, if you have any specific questions which cannot be answered here, please use the LMI for All email address lmiforall [at] ukces [dot] org [dot] uk.

 

LMI for All – coming soon

A quick and overdue update on the Labour Market Information for All project, which we are developing together with Raycom, the University of Warwick and Rewired State and  is sponsored by the UK Commission for Employment and Skills (UKCES).

LMI for All will provide an online data portal bringing together existing sources of labour market information (LMI) that can inform people’s decisions about their careers.  The database will contain robust LMI from national surveys and data sources providing a common and consistent baseline to use alongside less formal sources of intelligence. Due for release at the end of May 2013, access to the database will be through an open API. the results of queries can then be embedded by developers in their own web sites of apps. We will also provide a code library to assist developers.

The project builds on the commitment by the UK government to open data. despite this, it is not simple. As the Open Data White Paper (HM Government, 2012)highlights,  data gathered by the public sector is not always readily accessible. Quality of the data, intermittent publication and a lack of common standards are also barriers. A commitment is given to change the culture of organisations, to bring about change: ‘This must change and one of the barriers to change is cultural’ (p. 18).

We have talked to a considerable number of data providers including government bodies. It is striking that all have been cooperative and wishing to help us in providing access to data. However, the devil is in the detail.

Much of the data publicly collected, is done so on the condition that is is non disclosive e.e. that it is impossible to find out who submitted that data. And of course the lower the level of aggregation, the easier it is to identify where the data is coming from. And the more the data is linked, the more risk there s of chong qi cheng bao disclosure.

We have developed ways of getting round this using both statistical methods (e.g. estimation) and technical approaches (data aggregation). But it remains a lot of work preparing the data for uploading to our database. And I guess that level of work will discourage others from utilising the potential of open data. It may explain why, transport excluded, their remain limited applications built on the open data movement in the UK.

It may suggest that the model we are working on, of a publicly funded project providing access to data, and then providing tools to build applications on top of that data, could provide a model for providing access to public data.

In the meantime if you are interested in using our API and developing your own applications for careers guidance and support, please get in touch.

 

Using web 2.0 and social media in European projects

Graham Attwell, Pontydysgu, UK from Web2LLP on Vimeo.

There is growing interest in how to use social media in European research and development projects. The Web2LLP project aims to improve web strategies and maximise the social media presence of lifelong learning projects. Their web site explains theyBritain provide “personalised support and training (a week-long face-to-face course and free webinars), and shares best-practices and resources.”

One of those resources is a video gallery including interviews with project managers who have used social media in European Commision sponsored Lifelong Learning Programme projects.

And when Maria Perifanou asked me for an interview how could I refuse. I talked to Maria about how we used social media in the G8WAY project. The G8WAY project was based on the idea that the growing availability of web 2.0 allows for bridging the present gap between the structures developed to support students in mastering today’s educational transition and their formulation in an institutional perspective through learner centered and connective approaches, with a chance to more effectively manage educational transition.  “G8WAY  developed web 2.0 enhanced learning environments, to enable learners to reflect and develop their creativity potentials and transitional skills in the light of their own and others’ learning experience, made visible through a variety of media sets and PLE tools, each of them designed to meet the requirements of transition envisaged, and all of which are mapped into one single pedagogy framework.”