1 of 80

Digital Technology

Miles Berry | @mberry �31 January 2018

These slides: bit.ly/researchingtech

2 of 80

Anything can happen in the next 90 minutes...

Teachers as researchers

Ed Tech

Researching technology in education

Keep taking the tablets?

3 of 80

Teachers as researchers

4 of 80

Knowledge creating schools

The 'tinkering' teacher is an individualised embryo of institutional knowledge creation.

When such tinkering becomes more systematic, more collective and explicitly managed, it is transformed into knowledge creation…

Transfer is difficult to achieve for it involves far more than telling or simply providing information…

This is most easily achieved when a teacher tinkers with information derived from another's professional practice.

Hargreaves, 1999

5 of 80

Teaching as a design science

Teachers acting as design scientists would observe four basic precepts, to

  • keep improving their practice,
  • have a principled way of designing and testing improvements in practice,
  • build on the work of others,
  • represent and share their pedagogic practice, the outcomes they achieved, and how these related to the elements of their design.

6 of 80

Evidence informed education

I think there is a huge prize waiting to be claimed by teachers. By collecting better evidence about what works best, and establishing a culture where this evidence is used as a matter of routine, we can improve outcomes for children, and increase professional independence.

Goldacre, 2013

7 of 80

EEF DIY Toolkit

DIY evaluation is useful for three reasons:

  • It indicates whether or not an intervention is effective.
  • Evaluation saves teachers time.
  • Evaluation guides future action.

8 of 80

9 of 80

Evidence based teaching?

We can use evidence to improve what we do on a day-to-day basis. It is teachers who are taking the lead in this - who are putting evidence at the centre of their profession, their schools, their classrooms, their teaching. It is evidence that will liberate the teaching profession from the shackles that I believe they have laboured under for too long… We have challenged the orthodoxies that have undermined the teaching profession; and we are working to put evidence right at the heart of our education system to free teachers from having to kow-tow to such orthodoxies.

10 of 80

Big questions

Is teaching an art or a science?

Is it a craft or a technology?

Can we ask ‘what works?’ or can we only speak of ‘what works for me, in my school, with my pupils’? Or is there some middle way?

11 of 80

Is the truth out there?

Positivism

  • The world exists and is knowable
  • Discovering laws of society
  • Theory as explanation of behaviour�
  • Experimental validation of theory�
  • Abstraction of reality

Constructivism

  • People construe the world differently
  • Discovering how people interpret the world
  • Theory as sets of meanings to make sense of the world
  • Search for meaning, relationships, consequences
  • Represent, analyse, compare

Barr Greenfield, 1975

12 of 80

Qualitative research

Cohen, Manion and Morrison, 2011 p 219

13 of 80

14 of 80

Berry, 2006

15 of 80

Ed Tech

16 of 80

Gove, 2012

Play from 1’27” to 2’12”

17 of 80

Technology

The systematic application of scientific and other organized knowledge to practical tasks

Galbraith, 1967

18 of 80

The academy

19 of 80

Concerns with ed tech

The inventor of an art is not always the best judge of the utility of his own inventions to the users of them. For this discovery of yours will create forgetfulness in the learners' souls, because they will not use their memories; they will trust to the external written characters and not remember of themselves. They will be hearers of many things and will have learned nothing; they will appear to be omniscient and will generally know nothing; they will be tiresome company, having the show of wisdom without the reality.

20 of 80

The textbook

21 of 80

The slate

22 of 80

Engagement!

. . . prevents idleness, and procures that great desideratum of schools, quietness, by commanding attention . . . Some Studies require a degree of mental exertion, that may or may not be made, and yet the omission remain undetected; but this is so visible, that every boy’s attention to his lesson may be seen on his slate; and detection immediately follows idleness, or indifferent performance!

23 of 80

1:1

Instead of hanging the slates to nails on the wall, every boy has a slate numbered according to his number in the class, and fastened to a nail on the desk at which he sits. By this means all going in and out for slates is avoided. But, if slates are suspended to nails on the walls, the class must go from their seats to fetch them; and the same to replace them, when they have done work.

24 of 80

25 of 80

26 of 80

Kay, 1982 via Watters, 2015

27 of 80

28 of 80

The web

29 of 80

TIY

The Internet is one vast educational tool. It's ideal for autodidacts and lends itself perfectly to interactive learning via communities of interest... the Internet is a dream to anyone committed to securing or providing an education.

30 of 80

Tablets

31 of 80

Phones

32 of 80

Steve Jobs, 1980

From 9m8s to 10m24s

33 of 80

Raspberry Pi, BBC micro:bit

34 of 80

But why?

Answers on a google form please…

bit.ly/18edtech

35 of 80

To learn IT

  • In order to learn IT skills
  • As preparation for living in a society that is permeated with technology
  • As preparation for work (employment)
  • In order to support and stimulate the country's economic development
  • To reduce inequalities

36 of 80

As a learning tool

  • As a tool to achieve traditional teaching and learning goals across the curriculum
  • To extend and enrich learning across the curriculum
  • To motivate learners
  • As a catalyst for educational change
  • ICT’s impact on the nature of knowledge
  • To fundamentally change teaching and learning
  • To support metacognition
  • To provide access to the curriculum for those who would otherwise be excluded
  • To reduce inequalities

37 of 80

As a teaching tool

  • To increase productivity
  • To reduce cost
  • To make education more efficient
  • As a substitute for teachers
  • To reward learners

  • To impress stakeholders

Twining, P (2002)

38 of 80

Researching technology in education

39 of 80

40 of 80

On the up?

In the school year 2014/15 schools forecast their ICT expenditure will be higher in cash terms than at any other time on record. Investment in hardware replacement, peripherals, software and technical support will reach £14,220 per primary school and £65,570 in each secondary school.

BESA, 2013

41 of 80

Challenging provision

In many schools planning was not systematic and there was very little or no evaluation of the impact of previous ICT spending. There were very few examples of schools being fully aware of the consequences of the depreciation of their current ICT estate.

42 of 80

Teaching first?

In the last five years UK schools have spent more than £1 billion on digital technology. From interactive whiteboards to tablets, there is more digital technology in schools than ever before. But so far there has been little evidence of substantial success in improving educational outcomes.

Schools spent £487 million on ICT equipment and services in 2009-2010. But this investment has not yet resulted in radical improvements to learning experiences or attainment. No technology has an impact on learning on its own right; impact depends on how it is used.

43 of 80

The impact of ICT in schools

The literature contains a great deal of persuasive argument that ICT is valuable in improving learning, teaching, motivation and achievement It is not easy to determine causal relationships between a single initiative and any observed changes in behaviour or achievement.

44 of 80

Education and technology

Digital technology will not automatically support and enhance learning processes unless some thought is given to the ‘goodness of fit’ between the learning task and the learning technology. Many debates over technology and learning appear to be driven by wider beliefs of what constitutes ‘good’ or ‘desirable’ learning.

45 of 80

Digital Natives

What we may actually be seeing is a generation where learners at the computer behave as butterflies fluttering across the information on the screen, touching or not touching pieces of information (i.e., hyperlinks), quickly fluttering to a next piece of information, unconscious to its value and without a plan.

46 of 80

Limited impact

Despite the pervasiveness of information and communication technologies (ICT) in our daily lives, these technologies have not yet been as widely adopted in formal education. But where they are used in the classroom, their impact on student performance is mixed, at best. In fact, PISA results show no appreciable improvements in student achievement in reading, mathematics or science in the countries that had invested heavily in ICT for education.

47 of 80

So what does work?

48 of 80

49 of 80

50 of 80

PISA: Spiezia 2010

51 of 80

A disconnect?

Schools are first and foremost regulatory environments – not least in terms of their dependence upon compulsion of attendance and subsequent coercion of behaviour

The introduction of a ‘networking logic’ to the organisation of social relations is seen to support an open (re)configuration of society and a corresponding under-determination of organisational structures

52 of 80

And yet...

“School systems need to find more effective ways to integrate technology into teaching and learning to provide educators with learning environments that support 21st century pedagogies and provide children with the 21st century skills they need to succeed in tomorrow’s world. Technology is the only way to dramatically expand access to knowledge. To deliver on the promises technology holds, countries need to invest more effectively and ensure that teachers are at the forefront of designing and implementing this change”

53 of 80

Visible learning

The biggest effects on student learning occur when teachers become learners of their own teaching, and when students become their own teachers.

Hattie, 2008

54 of 80

55 of 80

How effective is digital technology?

Overall, studies consistently find that digital technology is associated with moderate learning gains (on average an additional four months). However, there is considerable variation in impact. Evidence suggests that technology should be used to supplement other teaching, rather than replace more traditional approaches. It is unlikely that particular technologies bring about changes in learning directly, but different technology has the potential to enable changes in teaching and learning interactions, such as by providing more effective feedback for example, or enabling more helpful representations to be used or simply by motivating students to practise more.

EEF, 2016

56 of 80

Things to think about...

  • Effective use of technology is driven by learning and teaching goals rather than a specific technology: technology is not an end in itself.
  • Are you clear about how you expect the introduction of technology to improve learning? New technology does not automatically lead to increased attainment.
  • Technology should support pupils to work harder, for longer or more efficiently to improve their learning.
  • Motivation to use technology does not always translate into more effective learning, particularly if the use of the technology and the learning outcomes are not closely aligned.
  • Teachers need support and time to learn to use new technology effectively. This involves more than just learning how to use the technology; it should include support to understand how it can be used for learning.

EEF, 2016

57 of 80

Overall trends

  • Collaboration works
  • Short, focussed interventions
  • Support for lower attaining, SEN and the disadvantaged
  • Supplement teaching, don’t replace it
  • Easier to support maths and science than English. Easier to support writing than reading or spelling
  • At least a day’s CPD for any intervention, focussed on pedagogy

Higgins et al, 2012

58 of 80

Visible learning

The use of computers is more effective when:

  • There is a diversity of teaching strategies.
  • There is teacher pre-training in the use of computers as a teaching and learning tool.
  • There are multiple opportunities for learning.
  • The student, not the teacher, is in control of the learning.
  • Peer learning is optimised.
  • Feedback is optimised.

Hattie, 2008

59 of 80

Eight strategies

Learning from experts

Learning from others

Learning through making

Learning through exploring

Learning through inquiry

Learning through practising

Learning from assessment

Learning in and across settings

60 of 80

Proof, promise and potential?

We have shown how different technologies can improve learning by augmenting and connecting proven learning activities

This potential will only be realised through innovative teaching practice

If we are to make progress we need to clarify the nature of the goal we want to satisfy through future innovation

61 of 80

Keep taking the tablets?

62 of 80

63 of 80

iPads and young children...

64 of 80

Smart classrooms, 2010

  • Not constrained to one curriculum area
  • Best suited to personal use
  • Enthusiasm, maturity, respect and creativity
  • Ownership of learning, both independently and in collaborative situations

Queensland Govt, 2010

65 of 80

iPads in Scotland

Supports the curriculum

Transformative tech

Personal ownership

Leads to changes in professionalism and pedagogy

Parental engagement

University of Hull, 2012

66 of 80

iPads in education

Rationales matter

Accessibility, ease of use, increased productivity, collaboration/cooperation, personalisation, seamless learning, access to content, real-time monitoring, assessment, CPD

Clark and Luckin, 2013

67 of 80

Tablets for schools

Results suggest that long-term use of the Tablet has a profound effect on pedagogy, and that pupils benefit from having access to content both at school and at home. Pupils appear to have greater engagement with learning, collaboration with peers increases, and teachers can monitor individual progress effectively

Clarke et al 2013

68 of 80

Before iPad was introduced ... about 35 percent of her students entered first grade reading above grade level. With iPad, 100 percent of her students have been reading above grade level for two years running.

In a randomized comparison study during the 2011–2012 school year, eight kindergarten classrooms used iPad for nine weeks, while eight kindergarten classrooms did not. Students using iPad outperformed the non-iPad students in every literacy measure they were tested on.

First year of iPad use at this Title 1 Pre-K through 5 school resulted in jump of nearly 13 percent to 72.1 percent in end-of-grade composite test scores that include reading, math, and science.

The number of students at “advanced” level math is 175 percent higher at four iPad one-to-one middle schools than similar schools without iPad. The number of students at “advanced” level of reading is 35 percent higher, based on state assessments

Apple, 2014

69 of 80

Hmm...

70 of 80

At home?

“So, your kids must love the iPad?” I asked Mr. Jobs, trying to change the subject. The company’s first tablet was just hitting the shelves. “They haven’t used it,” he told me. “We limit how much technology our kids use at home.”

71 of 80

Only boys use Android...

The school gave us all iPads, and all we ever use them for is Instagram and SnapChat and YouTube. Everyone's connected all the time. They must have thought it would help us with learning but it's completely backfired. They even tried to change us to a new wifi signal but we knew it would block off lots of content, so we all carried on using the old one.

Lucy, 12�Green, 2013

72 of 80

The LA iPad roll out

There is no body of evidence that iPads will increase math and reading scores on state standardized tests. There is no evidence that students using iPads (or laptops or desktop computers) will get decent paying jobs after graduation.

… No hard data on how often the devices were used, in what situations, and under what conditions. Nor mention of data on student outcomes.

Cuban, 2013

73 of 80

Rosendale Primary

Rosendale Primary, in south London, won a £253,000 grant for the research which will involve 1,400 pupils in 24 schools in London, Essex and Manchester.

Rosendale pupils use tablet computers to photograph their work and tag it with notes about how well they learned. Children at the school are encouraged to reflect on every piece of work or unit of learning. They are asked to think about which bits went well, what they struggled with and what they might need to do to improve when they next revisit the subject.

The research project aims to test whether the strategy actually improves pupils' attainment. It will be tested at 24 two-form-entry schools, one form will carry on as normal, the other will record and reflect on their learning using digital note-taking. Children will be tested at the start and finish of the project to measure their abilities and the results evaluated at Manchester University.

BBC, 1/11/13

74 of 80

So, how did that go?

Pupils who participated in ReflectED made an average of four months’ additional progress in maths compared to pupils who did not.

Pupils who participated in ReflectED made an average of two months’ less progress in reading compared to pupils who did not.

75 of 80

Ooh. Can I see the analysis?

76 of 80

1:1?

Study 2 uses a quasi-experimental design and draws on student achievement data from 352 kindergarteners to understand the effect of 1:1 iPads, versus shared iPads and no iPads, on literacy achievement for one year of learning. Results from Hierarchical Linear Models (HLM) suggest that shared iPads—where children primarily engaged with the device in pairs—significantly out-performed peers who used 1:1 iPads or no iPads on end-of-year literacy achievement, controlling for baseline test scores and student demographic characteristics.

77 of 80

Meta analysis

This study performed a meta-analysis and research synthesis of the effects of integrated mobile devices in teaching and learning, in which 110 experimental and quasiexperimental journal articles published during the period 1993-2013 were coded and analyzed. Overall, there was a moderate mean effect size of 0.523 for the application of mobile devices to education.

78 of 80

Yao-Ting Sung, Kuo-En Chang, Tzu-Chien Liu, 2015

79 of 80

Systematic review

While we hypothesise how tablets can viably support children in completing a variety of learning tasks (across a range of contexts and academic subjects), the fragmented nature of the current knowledge base, and the scarcity of rigorous studies, make it difficult to draw firm conclusions. The generalisability of evidence is limited and detailed explanations as to how, or why, using tablets within certain activities can improve learning remain elusive.

80 of 80

Questions?

@mberry

m.berry@roehampton.ac.uk

These slides: bit.ly/researchingtech