Case study. The Ada chatbot: personalised, AI-driven assistant for each student.

As part of the AI and vocational education and training project funded through the EU Erasmus plus project we are producing a series of case studies of the use of AI in VET in five European countries. Here is my first case study – the Ada chatbot developed at Bolton College.

About Bolton College

Bolton College is one of the leading vocational education and training providers in the North West of England, specialising in delivering training – locally, regionally and nationally – to school leavers, adults and employers. The college employs over 550 staff members who teach over 14,500 full and part time students across a range of centres around Bolton. The college’s Learning Technology Team has a proven reputation for the use of learning analytics, machine learning and adaptive learning to support students as they progress with their studies.

The Ada Chatbot

The Learning Technology Team has developed a digital assistant called Ada which went live in April 2017. Ada, which uses the IBM Watson AI engine, can respond to a wide range of student inquiries across multiple domains. The college’s Learning Technology Lead, Aftab Hussain, says “It transforms the way students get information and insights that support them with their studies.” He explains: “It can be hard to find information on the campus. We have an information overload. We have lots of data but it is hard to manage. We don’t have the tools to manage it – this includes teachers, managers and students.” Ada was first developed to overcome the complexity of accessing information and data.

Student questions

Ada is able to respond to student questions including:

  1. General inquiries from students about the college (for example: semester dates, library opening hours, exam office locations, campus activities, deadline for applying for university and more);
  2. Specific questions from students about their studies (for example: What lessons do I have today/this afternoon/tomorrow? Who are my teachers? What’s my attendance like? When is my next exam? When and where is my work placement? What qualifications do I have? What courses am I enrolled in? etc.)
  3. Subject specific inquiries from students. Bolton College is teaching Ada to respond to questions relating to GCSE Maths, GCSE English and the employability curriculum.

Personalised and contextualised learning

Aftab Hussein explains: “We are connecting all campus data sets. Ada can reply to questions contextually. She recognises who you are and is personalised according to who you are and where you are in the student life cycle. The home page uses Natural Language Processing and the Watson AI engine. It can reply to 25000 questions around issues such as mental health or library opening times etc. It also includes subject specific enquiries including around English, Mathematics and business and employability. All teachers have been invited to submit the top 20 queries they receive. Machine learning can recognise the questions. The technical process is easy.” However, he acknowledges that inputting data into the system can be time consuming and they are looking at ways of automatically reading course documentation and presentations.

All the technical development has been undertaken in house. As well as being accessible through the web, Ada, has both IOS and Android apps and can also be queried though smart speakers.

The system also links to the college Moodle installation and can provide access to assignments, college information services and curriculum materials. The system is increasingly being used in online tutorials providing both questions for participants and access to learning materials for instance videos including for health and social care.

It is personalised for individuals and contextualised according to what they are doing or want to find out. Aftab says: “We are looking at the transactional distance – the system provides immediate feedback reducing the transactional distance. “

Digital assessment

Work is also being undertaken in developing the use of the bot for assessment. This is initially being used for the evaluation of work experience, where students need to provide short examples of how they are meeting objectives – for example in collaboration or problem solving. Answers can uploaded, evaluated by the AI and feedback returned instantly.

Nudging

Since March 2019, the Ada service has provided nudges to students with timely and contextualised information, advice and guidance (IAG) to support their studies. The service nudges students about forthcoming exams, their work placement feedback and more. In the following example, a student receives feedback regarding his work placement from his career coach and employer.

The College is currently implementing ProMonitor, a service which will offer teachers and tutors with a scalable solution for managing and supporting the progress made by their students. Once ProMonitor is in place, Ada will be in a position to nudge students about forthcoming assignments and the grades awarded for those assignments. She will also offer students advice and guidance about staying on track with their studies. Likewise, Ada will nudge teachers and student support teams to inform them about student progress; allowing for timely support to be put in place for students across the College.

A personal lifelong learning companion

For Aftab Hussein the persona of the digital agent is important. “In the future”, he says, “every child will have a personal lifelong learning companion which will support teaching and learning.” He thinks they will probably come from the big platform suppliers. Children will have their digital assistant from age the age of 3 or 4 and will have a Personal Learner Number allowing data to be exchanged between different institutions,

 

 

 

Discussion: Learning and Training anywhere

The International Labour Organization (ILO) have launched a E-Discussion on Continuing online learning and skills development in times of the COVID-19 crisis. The discussion started on 27 March and runs to 9 April.

The ILO say “the virtual discussion provides an opportunity to explore the concept of “learning and training anywhere, anytime”, an idea central to the concept of lifelong learning. This, in turn, requires examination of a range of issues such as how technically prepared we are to support new ways of working in the face of disruptors like a pandemic, and how quickly we can organize digital education and training and mobilize teachers and trainers to maintain services to learners.”

You can join the discussion at the following addresses

 

Four domains of learning

four development domaninspng

I came upon this text today when I was seeking to extend on an article I was writing that included the idea of learning in four domains. It was produced, I think, for the EmployID MOOC on the Changing World of Work and was probably written by Alan Brown and Jenny Bimrose.Sadly, I was so tied up with producing my own materials for the MOOC and didn’t get to read all of the other peoples. But at a time when there is a growing need to question to division between humanities and technical subjects, I think this offers a good way forward.

Relational development – learning with and from interacting with other people

A major route for relational development is learning through interactions at work, learning with and from others (in multiple contexts) and learning as participation in communities of practice (and communities of interest) while working with others. Socialisation at work, peer learning and identity work all contribute to individuals’ relational development. Many processes of relational development occur alongside other activities but more complex relationships requiring the use of influencing skills, engaging people for particular purposes, supporting the learning of others and exercising supervision, management or (team) leadership responsibilities may benefit from support through explicit education, training or development activities.

Jack from the UK had switched career and now who worked as a carer. From the outset Jack learned much about his work from engaging with residents in the care home as well as learning from other staff. He had received letters from residents expressing their gratitude, which had boosted his confidence. His manager encouraged him to become a trainer in the care home, and although nervous and unsure he delivered the training and his self-efficacy increased.

Cognitive development – acquiring knowledge and thinking skills

A major work-related route for cognitive development involves learning through mastery of an appropriate knowledge base and any subsequent technical updating. This form of development makes use of learning by acquisition and highlights the importance of subject or disciplinary knowledge and/or craft and technical knowledge, and it will be concerned with developing particular cognitive abilities, such as critical thinking; evaluating; synthesising etc.

Bernard, a Czech automotive worker, participated in a short internal company technical training programme which positively surprised him in terms of practical outcomes and motivated him to actively work on his vocational development. ‘You had to know your stuff, the trainer was extremely competent, he knew his field very well, but sometimes I had difficulties to follow him. Anyway, it was really done by professionals who knew their stuff, and I appreciated it very much. I was very satisfied. I learned lots of things that were later very useful for my work […] It was very interesting to meet people from a completely different and a rather specialised area. I learned a lot of things and I was proud of it. I think this was the moment that made me change my attitude towards learning. I became much more curious.’

Practical development – learning by doing, by experience, by taking on challenges

For practical development the major developmental route is often learning on the job, particularly learning through challenging work. Learning a practice is also about relationships, identity and cognitive development but there is value in drawing attention to this idea, even if conceptually it is a different order to the other forms of development highlighted in this representation of learning as a process of identity development. Practical development can encompass the importance of critical inquiry, innovation, new ideas, changing ways of working and (critical) reflection on practice. It may be facilitated by learning through experience, project work and/or by use of particular approaches to practice, such as planning and preparation, implementation (including problem-solving) and evaluation. The ultimate goal may be vocational mastery, with progressive inculcation into particular ways of thinking and practising, including acceptance of appropriate standards, ethics and values, and the development of particular skill sets and capabilities associated with developing expertise.

Davide, an Italian carpenter, saw learning as a practice-based process driven by curiosity, a spirit of observation, and trial and error. A major role was played by his passion for the transformation of matter, which he perceived as an almost sacred event: ‘It really struck me to see that from a piece of wood one can create a piece of furniture’.

Emotional development – making sense of your own feelings and how others feel 

For emotional development, the major developmental routes are learning through engagement,  reflexiveness that leads to greater self-understanding, and the development of particular personal qualities. Much emotional development may occur outside work, but the search for meaning in work, developing particular mind-sets, and mindfulness may be components of an individual’s emotional development. Particular avenues of development could include understanding the perspectives of others, respect for the views of others, empathy, anticipating the impact of your own words and actions, and a general reflexiveness, which includes exploring feelings. Identity development at work may also be influenced by changing ideas individuals have about their own well-being and changing definitions of career success (Brown & Bimrose 2014).

Henrik from Denmark switched career, moving into caring and developed a new relationship with his work, which he found much more emotionally engaging. While studying for his skilled worker qualification, Henrik immersed himself in individual assignments of his own choice. In one assignment, he developed a ‘product’ to help improve a pupil’s ability to communicate, an ability which was being lost due to a rare disease. When Henrik talked about the assignment he was very engaged and showed insight into the syndrome. Because the assignment was closely related to his experience and practice, he saw meaning in undertaking it: ‘It was as though there was a circle I could complete on my own.’ He received a top grade for the assignment, and it is evident that positive learning experiences and the perception of entering into learning processes that are meaningful to his life and work situation are strong motivating factors in his engagement in further learning.

Does technology destroy jobs

Infoposter_V1The argument over whether technology creates or destroys jobs has been going on for as long as I can remember.

Only yesterday John Naughton, in an article entitled “We are ignoring the new machine age at our peril“, worried about the impact of self driving cars and other technology on the future of employment. Naughton argued that there are “radical discontinuities that nobody could have anticipated”, driven by “combinatorial” effects of different technology trends coming together. These, he siad, include: “the near-infinite computing power provided by Moore’s law; precise digital mapping; GPS; developments in laser and infrared sensor technology; and machine-learning algorithms plus the availability of massive data-sets on which to train them.”

He warned the outcome could be “that vast swaths of human activity – and employment – which were hitherto regarded as beyond the reach of “intelligent” machines may now be susceptible to automation.” he went on to quote a studyby  Dr Carl Benedikt Frey and Michael Osborne, two researchers at the Martin School in Oxford,T heir report, The Future of Employment: How Susceptible Are Jobs to Computerisation?,  estimates the probability of computerisation for 702 detailed occupations, based on US government classifications of those occupations.  About 47% of total US employment, they conclude, is at risk from technologies now operational in laboratories and in the field.

However a study entitled ‘Are ICT Displacing Workers? Evidence from Seven European Countries‘ by Smaranda Pantea, Federico Biagi and Anna Sabadash from the Institute of Prospective Technologies in Seville comes up with a different answer. Looking at micro data ins even European countries for companies in the manufacturing, ICT producing and service sector the study found “a non-significant relationship between employment growth and ICT intensity among ICT-using firms.: The authors say: “Since our estimates mainly capture the “substitution” effects of ICT on employment (i.e. those due to ICT substituting for some type of labour and to ICT increasing productivity and hence reducing demand for inputs, for constant values of output), our results indicate that these effects are statistically insignificant.”

Of course this study and the American study are not directly comparable. They looked at different things and used different methodologies. One conclusion might be that whilst technology is not being directly substituted for overall employment, it is changing the nature of jobs available. Some labour market studies (for instance based on the US O*Net surveys) have suggested that what is happening is a bifurcation of labour, with an increasing number of high qualified jobs and of low skilled (and consequently low paid) service sector jobs. And of course another impact may be on the ;content’ and different skills required in different jobs. For instance our work in the construction industry through the Learning layers project suggests increasing adoption of technology is leading to the need for new (and higher) skills levels within what was traditionally seen as a lower skills sector. This has considerable implications for vocational education and training. ather than training for presents skills demands VET systems need to be looking at future skills. And by providing those future orein3eteds kills this could provide a workforce and society with the abilities and motivation to shape our use of technology in society, rather than as John Naughton fears that “we’re bound to lose this race against the machine” and in the course “enrich the corporations that own it.”

Dysgu Ponty

The Pontydysgu website is always full of news about the big projects we are involved in, like FP7 Learning Layers or Taccle2.  This is pretty inevitable as they take up the majority of our time and budget.  However, there are lots of other, smaller Pontydysgu projects running in the background that we rarely post anything about.  This is a bit of an oversight because although we often use these projects as test beds for trying out new ideas or as vehicles for piloting specific bits of technology that we then roll together in a much bigger package, they are also successful in their own right.

All of them are running in Pontypridd, (known locally as “Ponty”) which is where the Wales half of Pontydysgu is based. Some are part funded through the LLL Partnerships programme; some are funded in-house. We thought we might write a series of posts on what these projects are all about….

First up is Dysgu Ponty, which translates to Learning Ponty.  We chose this name because apart from the play on Pontydysgu (meaning approximately Bridge to Learning), we wanted to convey the idea that the whole community of Ponty was learning and that the town called Ponty was a learning resource.

The project is based on a very simple concept – let’s cover the town with QR codes linked to a learning resource.   The codes are being printed on decals (for shop windows), enamel (for the exteriors of building) and on varnished wooden plaques for hanging around trees in the park.  Codes come in three colours – red for Welsh, green for the English translation and black for careers.

So far we have 200 and our target is at least another hundred.  The town has a population of 30,000 but this covers all of the outlying villages as well.  It also has a great sense of community, which means that the level of support has been brilliant. The whole community is involved – schools, the Town Council, shops, businesses, the local newspaper

The link from each QR code goes to a website page on which there is a question that relates to the location.  The level is approximately 8 -12 yrs olds. Following the title question is some simple information using a range of multi media.   The location of the codes will be on Google Maps and we are currently sorting them out into a ‘Maths trail’, ‘Language trail’, ‘History trail’ etc so that children can choose whether to follow a subject trail or focus on the codes in one part of the town.

The purpose of the project is really to provide a bridge between formal and informal learning and to improve home school links.

We are currently working of a way of  ‘rewarding’ children for completing a number of questions – not sure Mozilla badges quite fits.  Also thinking about how we can get kids to be able to upload pictures as well as comments. May rethink the platform.

Meanwhile here are some examples of the sorts of things we are talking about

Location:  on the bandstand in the park

  • Links to… Question:  Have you ever heard brass band music?
  • Additional ‘information’ – mp3 of Colliery Brass Band with one line of text explaining that most all the pits had their own band

Location: Outside Costa Coffee

  • Links to… Question: Do you know where coffee comes from?
  • Additional information: You Tube video of coffee being harvested and processed

Location: Outside travel agent underneath exchange rates

  • Links to… Question:  How much is it worth?
  • Additional info:  Text and image – If you had £37.50 to take on holiday, how many Euros would you get?  Which travel agent in town has the best exchange rate today?

Location:  On the river bank adjacent to the confluence

  • Links to…mQuestion:  What rivers are these and where is their source?
  • Additional info:  The place where two rivers merge is called a ‘confluence’.  Use Google Earth to trace the two rivers back as far as you can, find out their names and where the river enters the sea.

 Location:  On the war memorial

  • Links to… Question:  How many died?
  • Additional info: Look at the names on the Great War memorial and then the names on the Worls War 2 memorial.  In which war were the greatest number of people from Pontypridd killed? How many times more people?  Why do you think this was?

 Location: Market Street

  • Links to…Question:  What has changed?
  • Additional Info: Picture of the street taken 100 years ago from same spot. Text – List all the things that are different between Market Street in 1910 and the same street today.
You get the idea!
[We also have black codes for older students linked to careers information as part of the EU New Jobs project.  The codes take them to links asking "So you want to be a baker?" or "So you want to be a printer?" with videos explaining what the job involves, what qualifications or skills you need etc. Some are purpose made and some from You Tube or Vimeo.  More on this is another post.]
Next time – Learning about Art in Ponty