The challenges of open data: emerging technology to support learner journeys

As promised, a post on our stand and presentation at Alt-C on the LMIforAll Labour Market Data project, sponsored by UKCES. Working together with the Institute for Employment Research at Warwick University and Raycom, we have developed a database and APi providing access to a range of data about a wide variety of different occupations in the UK including data about:

  • Pay
  • Gender
  • Numbers employed
  • Future employment projections
  • Occupational profiles
  • Skills and competences
  • Job vacancies
  • University destinations

The API is self documenting and is available free of charge to both for profit and not for profit organisatio0ns and developers. Working with Loud Source we have run a competition for Apps built on the API and together with Rewired State we have organised a series of Hack Days and Mod Days. We are currently redesigning the website to provide better access to the data and to the different applications that have been built to date.

One strange thing that took people visiting our stand some time to understand was that we were not selling anything (I think ours and Jisc were the only non commercial stands).  The second thing was that we were not trying to ‘sell’ them a shiny out of teh box project. To get added value from our database and API requires some thought and development effort on the part of organisations wanting to use the data. We provide the tools, they provide the effort to use them. But when people got that concept they were enthusiastic. And most interestingly they were coming up with completely new ideas for where the data might be valuable. As you can see in our presentation above, we have largely focused on the use of LMIforAll for careers planning. University and Further Education researchers and developers saw big potential using the API as a planning too for future courses and curriculum. Others saw it as a valuable resource for measuring employability, a big agenda point for many UK institutions. It was also suggested to us that the labour market data could be mashed together with data derived from learning analytics, providing possibly a more learner centred approach to analytics than has previously been deployed.

If you are interested in any of these ideas have a play on the LMIforAll web site. And feel free to get in touch if you have any questions.

 

 

The challenges of open data: emerging technology to support learner journeys

It is the end of the holidays and time to return back to work. And of course with September starts the autumn conference season. This week I am at the ALT C Conference at Warwick University and then at the European Conference for Educational Research in Porto. More on The ECER conference later.

At Alt C we are organising a workshop on the UKCES open data project (abstract below). And we will also have an exhibition stand. So if you are coming to the conference make sure to drop by the stand – No 16 in the Arts Centre – free coffee and sweets! and say hello.

The challenges of open data: emerging technology to support learner journeys

People make important decisions about their participation in the labour market every year. This extends from pupils in schools, to students in Further and Higher education institutions and individuals at every stage of their career and learning journeys. Whether these individuals are in transition from education and/or training, in employment and wishing to up-skill, re-skill or change their career, or whether they are outside the labour market wishing to re-enter, high quality and impartial labour market information (LMI) is crucial to effective career decision-making. LMI is at the heart of UK Government reforms of careers service provision. Linking and opening up careers focused LMI to optimise access to, and use of, core national data sources is one approach to improving that provision as well as supporting the Open Data policy agenda (see HM Government, 2012). Careers focused LMI can be used to support people make better decisions about learning and work and improve the efficiency of labour markets by helping match supply with demand, and helping institutions in planning future course provision.

A major project, funded by the UK Commission for Employment and Skills, is underway led by a team of data experts at the Institute for Employment Research (University of Warwick) with developers and technologists from Pontydysgu and Raycom designing, developing and delivering a careers LMI webportal, known as LMI for All. The presentation will focus on the challenge of collaborating and collecting evidence at scale between institutions and the social and technological design and development of the database. The database is accessed through an open API, which will be explored during the presentation.

Through open competition developers, including students in FE, have been encouraged to develop their own applications based on the data. Early adopters and developers have developed targeted applications and websites that present LMI in a more engaging way, which are targeted at specific audiences with contrasting needs.The web portal is innovative, as it seeks to link and open up careers focused LMI with the intention of optimising access to, and use of, core national data sources that can be used to support individuals make better decisions about learning and work. It has already won an award from the Open Data Institute.

The presentation will highlight some of the big data and technological challenges the project has addressed. It will also look at how to organise collaboration between institutions and organisations in sharing data to provide new services in education and training.Targeted participants include developers and stakeholders from a range of educational and learning settings.

The session will be interactive with participants able to test out the API, provide feedback and view applications.

LMI for All API released

I have written periodic updates on the work we have been doing for the UKCES on open data, developing an open API to provide access to Labour Market Information. Although the APi is specifically targeted towards careers guidance organisations and towards end users looking for data to help in careers choices, in the longer term it may be of interest to others involved in labour market analysis and planning and for those working in economic, education and social planning.

The project has had to overcome a number of barriers, especially around the issues of disclosure, confidentiality and statistical reliability. The first public release of the API is now available. The following text is based on an email sent to interested individuals and organisations. Get in touch if you would like more information or would like to develop applications based on the API.

The screenshot above is of one of the ten applications developed at a hack day organised by one of our partners in the project, Rewired State. You can see all ten on their website.

The first pilot release of LMI for All is now available and to send you some details about this. Although this is a pilot version, it is fully functional and it would be great if you could test it as a pilot and let us know what is working well and what needs to be improved.

The main LMI for All site is at http://www.lmiforall.org.uk/.  This contains information about LMI for All and how it can be used.

The APi web explorer for developers can be accessed at http://api.lmiforall.org.uk/.  The APi is currently open for you to test and explore the potential for  development. If you wish to deploy the APi in your web site or application please email us at graham10 [at] mac [dot] com and we will supply you with an APi key.

For technical details and details about the data go to our wiki at http://collab.lmiforall.org.uk/.  This includes all the documentation including details about what data LMI for All includes and how this can be used.  There is also a frequently asked questions section.

Ongoing feedback from your organisation is an important part of the ongoing development of this data tool because we want to ensure that future improvements to LMI for All are based on feedback from people who have used it. To enable us to integrate this feedback into the development process, if you use LMI for All we will want to contact you about every four to six months to ask how things are progressing with the data tool. Additionally, to help with the promotion and roll out of LMI for All towards the end of the development period (second half of 2014), we may ask you for your permission to showcase particular LMI applications that your organisation chooses to develop.

If you have any questions, or need any further help, please use the FAQ space initially. However, if you have any specific questions which cannot be answered here, please use the LMI for All email address lmiforall [at] ukces [dot] org [dot] uk.

 

LMI for All – coming soon

A quick and overdue update on the Labour Market Information for All project, which we are developing together with Raycom, the University of Warwick and Rewired State and  is sponsored by the UK Commission for Employment and Skills (UKCES).

LMI for All will provide an online data portal bringing together existing sources of labour market information (LMI) that can inform people’s decisions about their careers.  The database will contain robust LMI from national surveys and data sources providing a common and consistent baseline to use alongside less formal sources of intelligence. Due for release at the end of May 2013, access to the database will be through an open API. the results of queries can then be embedded by developers in their own web sites of apps. We will also provide a code library to assist developers.

The project builds on the commitment by the UK government to open data. despite this, it is not simple. As the Open Data White Paper (HM Government, 2012)highlights,  data gathered by the public sector is not always readily accessible. Quality of the data, intermittent publication and a lack of common standards are also barriers. A commitment is given to change the culture of organisations, to bring about change: ‘This must change and one of the barriers to change is cultural’ (p. 18).

We have talked to a considerable number of data providers including government bodies. It is striking that all have been cooperative and wishing to help us in providing access to data. However, the devil is in the detail.

Much of the data publicly collected, is done so on the condition that is is non disclosive e.e. that it is impossible to find out who submitted that data. And of course the lower the level of aggregation, the easier it is to identify where the data is coming from. And the more the data is linked, the more risk there s of chong qi cheng bao disclosure.

We have developed ways of getting round this using both statistical methods (e.g. estimation) and technical approaches (data aggregation). But it remains a lot of work preparing the data for uploading to our database. And I guess that level of work will discourage others from utilising the potential of open data. It may explain why, transport excluded, their remain limited applications built on the open data movement in the UK.

It may suggest that the model we are working on, of a publicly funded project providing access to data, and then providing tools to build applications on top of that data, could provide a model for providing access to public data.

In the meantime if you are interested in using our API and developing your own applications for careers guidance and support, please get in touch.

 

Happy birthday icould

What a difference the Creative Commons License makes.

According to the icould web site:  “icould gives you the inside story of how careers work. The icould storytellers relate, in their own words, their real life career journeys. There are over a thousand easy to search,varied and unique career videos as well as hundreds of written articles. From telecoms engineers to police officers, from landscape gardeners to web designers, from engine drivers to zookeepers; they talk about what they do, what it’s like, how they came to be where are and their hopes for the future.”

The service has just celebrated its second birthday. A email from Director, Dave Arnold says:

Happy birthday to icould! We launched icould two years ago this week and although we are still in our infancy, we are growing well and becoming better known. We’ve doubled the visitor numbers to icould.com in the past year and also now have icould content streamed on key sites such as Guardian Careers, Career Wales, Skills Development Scotland, TES and the Frog schools learning platform, extending icould’s reach to millions of young people across the UK.

We’ve continued to add to our career videos and written content, with recent additions featuring advice on student finances and more practical tips for getting a first job. We’ve also created a new ‘Focus On’ area, designed to demystify certain sectors and types of work, exploring all the jobs and career possibilities within that theme.  These Focus On areas consist of around eight to ten new video stories, new written content, competitions and specific guidance on training opportunities and company information.

Focus On Music was the first new area on icould.com sponsored by BlackBerry.  Launched over the Summer, it looks at careers of people behind the stars in the music industry. Focus On Music profiles the unseen heroes behind a music star, for example Jesse J’s choreographer and music video director and Tinnie Tempah’s publicist and photographer. We wanted to show that you don’t have to be behind the microphone to have a successful career in the music industry and hopefully we give young people an insight into the breadth of careers within the industry. This area was launched in July and has attracted considerable media attention as well as several successful partnerships, one with the iconic NME which has resulted in an icould user being offered a work taster experience with the Editor. We have also created some new free teaching resources to complement this new initiative.

……..

We’ve recently launched the next area, a Focus On Finance sponsored by Standard Life, which looks at the range of careers and skills needed in the Financial sector, proving that you don’t have to be an expert with numbers to work in finance!  We have a number of other areas in the pipeline, including a Focus on Media, which will launch in the New Year.

We continue to listen and respond to your feedback and are currently undertaking further research on the usage of icould.com to inform future developments.  We really appreciate your input, so please keep your comments and suggestions coming in.”

Obviously icould is on a roll. But lets use the Wayback machine to take us back to spring, 2009. I don’ t know, but I suspect that at that time iCould was struggling to make much impact. And here is one of the major reasons why. The Terms and Conditions of use at that time stated:

“Use of the icould website

Unless otherwise stated, icould owns the intellectual property rights in the website and material on the website. All these intellectual property rights are reserved.

Unless otherwise stated, you are entitled to use the icould website for personal use in any way, providing you do not reproduce any of the information as your own and/or seek to profit from it. Personal use constitutes viewing the icould website online and printing pages and/or documents for review offline.

If you wish to reproduce any materials accessible on the icould website including information, graphics, images and other design elements in printed or electronic form, you must obtain written permission first. Please use the contact details at the bottom of this page if you need to obtain permission.

Linking to the icould website is permitted, although displaying our pages within a frame of another website is not as this constitutes reproducing our content as your own.”

Now let’s forward to the present day. Under Terms and Conditions we find the following statement:

“…..we give permission to use the contents of the Site on a creative commons licence which can be found at:

Attribution-Non-commercial-No Derivative Works 3.0 Unported

This licence gives you permission to broadcast icould.com pages over the school network or use them on a whiteboard in a classroom.  You can circulate articles, use the worksheets and so on. This applies in any education or training context.

In simple terms:

  • You can copy, distribute, transmit the work and display the material with the exclusion of full length versions[i] of stories.
  • You may create derivative works with the exclusion of full length versions of stories.

Under the following conditions:

  • Attribution: You must give icould credit and make clear the resources come from icould.com.
  • Non-commercial: You may not use this work for commercial purposes or make any charge for the work.
  • Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a licence identical to the Creative Commons licence.

This means you could, for instance, create electronic worksheets or create electronic careers posters or include them in an e-portfolio or personal learning environment.”

Not only that, but icould provides an API key to make it easy for developers to incorporate icould materials in their own sites.

There is a lesson here for developers and content providers and indeed for many education and learning projects. Few of us have the clout to make it on our own. But through allowing use of our materials and projects we can build impact on a vastly greater scale. And whilst going creative commons closes off some business models it opens up others.

Congratulations to icould for opening up their content. And happy birthday. Lets hope they continue building on the success they are presently enjoying.