Category Archives: Data

Open and Linked Data and Mediation

Posted on by
Reply

There has been an explosion of interest in Open Data and the potential for linking data to produce new social apps. Yet despite all this attentions, and the growing access to data in some countries such as the UK, the development of new apps has been less than impressive.

Rather than full apps, probably the main use has been the development of interactive visualizations allowing users to explore different data sets and quick visualisations of different data sets. The Guardian newspaper data blog has led the way in the UK and in particular has shown the value of open journalism such as in this discussion on how they got the colours of the maps right.

But the development of more advanced apps has been slower. Probably the biggest take off has been around transport allowing real time timetable tracking etc. But even here the problem of the social purpose and use of data apps is an issue. take this compelling app from the German newspaper Suddeutsche . Its hows graphic representations of train journeys in Germany, providing information on each train’s itinerary and the details of any delay. There is also an interactive timeline, allowing you to watch previous days’ travel play out. Its fun. But I can’t really see that it is much use! Or take this app – available in various forms – using crowd sourced data to find the nearest post box in the UK. Do we really need it? Why not just ask somebody / anybody?

In education there are a number of apps for finding schools etc. But there is little use of open and linked data for learning.

We have been working with a number of organisations to produce open and linked data apps for use in careers guidance. There are now three iterations of what we variously call a TEBO (Technologically Enhanced Boundary Object) or Careers dashboard.

The first was a quick demonstrator which we built to see how it might work. The second works through an API to the Careers Wales beta web site. And the third – more technically advanced – iteration is a database and API developed for UKCES which is not publicly available at present.

One of issues being raised in this work is mediation. In general government / agencies seem to regard data as just standing on its own. Within the TEBO concept we always stressed the need for social mediation and had ideas for a number of ways in which this might happen using social software e.g Question and Answer applications.

In fact mediation takes place at a series of levels – including the selection of data originally collected, and the way data is selected for use and display within an application. Different people will need different apps for interrogating the same data. For instance our Careers Dashboard may have potential interest and use for:

  • Young people thinking about career choices;
  •  Young people applying to further or higher education, seeking an apprenticeship or employment;
  • Adults who are newly unemployed;
  •  Long term unemployed adults;
  •  Adults considering re-entering education and training (e.g. women returners);
  • Adults thinking about a change in career direction (e.g. mid-career changers);
  • Parents and carers supporting young people wishing to enter further education, vocational training or employment
  • Career professionals – careers teachers, careers advisers and subject teachers; and
  • Various others (e.g. educational planners and policymakers, professionals preparing funding applications, researchers).

However, mediation seems to be commonly understood as intervention and then posed as a dichotomy between non intervention or intervention or to put it another way – let end users access to data or only let professionals access to data. This seems to me a misunderstanding of both the potentials and limitations of the data but of the potentially rich ways in which mediation happens and the ways in which technologically can be used in such processes.

It would be interesting to look at mediation within physical communities and through extended web and social media based communities. It would also be interesting to link mediation to the potential quality of careers interventions (i.e. after mediation takes place.)

More to follow…..

 

 

 

 

Using and visualising data

Posted on by
Reply
Lincoln ddj
View more PowerPoint from Tony Hirst

Although this presentation is entitled ‘Data Driven Journalism’, it provides a great introduction for anyone wanting to use data – and more particularly data visualisations for research and development. Tont Hirst’s blog, OUseful blog, is a brilliant source of ideas for those interested in this fast growing area of work.

Finding and visualising Labour Market Data

Posted on by
Reply


Following my last post on creating a database for the LMI for All project, I am now beginning to explore what you can find out from the database.

One of the main sources for labour market data in the UK is the quarterly Labour Force Survey. Data on employment is collected under two main categories, the Standard Industrial Classification (SIC) about the industries in which people work, and the Standard Occupational Classification (SOC) about their occupation. Using our database API we can query the two classification systems against each other to find out how many people in a particular occupation work in which industries. We did this query on Friday for Computer Programmers. This gave us a long spreadsheet which was not particularly easy to understand. I cleaned the data and uploaded it to the IBM ManyEyes site and used the bubble visualisation which gives the graphic above. OK it is not perfect. The industry titles are too long for the index box. And maybe it provide too much data (I will look at what we get using a 3 figure SIC classification, rather than the present 4 figure SIC).

However I think it show potential. And there is no reason why we could not provide longitudinal and comparative data with a  bit of work.

 

Has Open and Linked Data failed?

Posted on by
Reply
How The Open Data Community Died – A Warning From The Future

I am intrigued by this presentation. Whilst I appreciate what Chris Taggart, who has been invo0lved in the development of the opencorporates and openlylocal data sites (and who undoubtedly has more experience and knowledge than me of the use of Open and Linked Data) I would be less pessimistic. I see the use of open and linked data as in very early days.

Firstly, although I appreciate that politicians and bureaucrats do not always want to release data – I think there is still a groundswell in favour of making data available – at least in Europe. Witness yesterdays unveiling of the Italian Open data store (sorry, I can’t find the url at the moment). And although Google search results do not help promote open data sites (and I am not a great fan of Google at the moment after they wiped out my account ten days again), they have contributed very useful tools such as Refine, Fusion Tables and Public Data Explorer.

I still think that as Chris Taggart says in one of his first slides the biggest challenge is relevance. And here I wonder if one of the problems is that Open and Linked Data specialists are just that – specialist developers in their own field. Many of the applications released so far on the UK Data store, whilst admiral examples of the art of development – would seem to have little practical use.

Maybe it is only when the tools and knowledge of how to work with Open and Linked data are adopted by developers and others in wonder social and subject areas that the true benefits will begin to show. Open data applications may work best, not through dedicated apps or sites, but when incorporated in other web sites which provide them with context and relevance. Thus we have been working with the use of open and linked data for careers guidance (see our new web site, www.careerstalk.org which includes working demonstrations).

Bu even more important may be finding ways of combining Open and Linked data with other forms of (human) knowledge and intelligence. It is just this form of knowledge – for instance the experiences and informal knowledge of careers guidance professionals, which brings relevance and context to the data from official data sets. And that provides a new design challenge.

Designing Open and Linked data apps is not easy

Posted on by
Reply

Over the last two years there has been much excitement about the idea of Open and Linked Data. This is especially so in countries like the UK where there has been a pronounced policy commitment to opening the use of public data for commercial and non commercial use. The UK government open data store boasts links to over 5400 sets of data saying “This can then be used by people to build useful applications that help society, or investigate how effective policy changes have been over time.”

There is no doubt that this data is of immense value to researchers. But despite various hack days, the number of genuinely useful applications seem limited.

We have been working with the data for the last nine months attempting to use labour market data to assist careers professionals and young people in choosing careers pathways. As Leia says in a comment on a recent post on this site “so many of our learners arrive with a complete incorrect (or no) idea about what skills are in demand and what’s realistic to expect in terms of looking for work and training.” We are not saying that labour market data and skills demand alone should guide young peoples’ choices. But it is certainly an important factor especially with university education becoming so expensive.

Why are we finding it hard to do? Firstly as the similar Salami project run by the University of Nottingham noted in a recent report much of the official data is collected for economic purposes, not for social use. For instance, much of the labour market information is collected through the Standard Industrial Classification (SIC) which although useful for analysing economic trends, is of limited use for occupational guidance. Instead, we really need Standard Occupational Classification (SOC) data. It doesn’t help that despite the data store which provides links to different data sets, the raw and interpreted data is scattered across a number of different web sites. Most of them are in the course of updating their sites, probably in order to make the data more accessible. But at the same time his is breaking links. And although there are a growing number of on-line tools, these all have their own idiosyncratic interfaces and processes (and often seem just not to work).

I was never very interested in statistics until I got involved in this project. And now I am desperately trying to teach myself SPSS but it is not easy and once more is time consuming.

Even when we have obtained the data it has to be cleaned. much of the data also requires manipulation if it is to be visualised. Visualisation tools are becoming more powerful, but still are not always simple to handle.

Using Open and Linked Data is a design process. And some of the most important people who have to be involved in any design process are the end users. Once more this is time consuming. And of course it is necessary to show them what the possibilities are. each different group of users will have different needs. We have spent a long time thinking about what data we should show to young people and what might be relevant for careers advisers.

Finally we have to remember that data is just data – however well visualised. The use of data has to involve meaning making. meaning making is not a precise science. Different people will make different meanings from the same data. The real added value comes when we allow them to participate in collective sense making through sharing and negotiating meanings.

We have developed the idea of a Technology Enhanced Boundary Object which is able to bring together data and data vidsualisations with a  social software layer to explore meanings. We hope to pilot this in the autumn. And we will provide access to a working version of some of our tools in the next week.

So in conclusion – I remain very excited about the potential of Open and Linked Data. But to design apps which are useful takes a lot of work.