1 of 46

What do we mean by ‘research’ in a local authority context? �� Is “I’ll know it when I see it” good enough?

Professor Andrew Booth (Professor in Evidence Synthesis, University of Sheffield)

Dr Louise Hayes (Research Design Lead, NIHR RSS Specialist Centre for Public Health)

Laura Brown (Research Programme Manager, NIHR RSS Specialist Centre for Public Health)

Email: nihr.rss.publichealth@newcastle.ac.uk

2 of 46

Who we are:

Louise Hayes

Laura Brown

Andrew Booth

3 of 46

Objectives of the Workshop

  1. To help participants to navigate the ambiguous landscape of research

  • To provide some pointers and resources to help participants plan research and/or evaluation projects

4 of 46

Research Or Evaluation, Which?

5 of 46

Instructions

Take the provided resource cards representing different research and/or evaluation methods. Place each card in the column that best represents its typical use.

Sort each method into one of three columns:

  • "Research" for methods primarily used to conduct research,
  • "Both" for methods commonly used interchangeably in research and evaluation contexts, or
  • "Evaluation" for methods primarily used to undertake evaluation.

6 of 46

Conclusion from Exercise 1 - Card Sort

  1. We cannot distinguish Research from Evaluation solely on the basis of Methods used
  2. Many (but not all) Methods can be used for both Research and Evaluation

THEREFORE:

  1. Methods that can only be used for Research (and, conversely, those that can only be used for Evaluation) tell us something about the characteristics of each.

What do you think that is?

7 of 46

What Does “Research” Mean To You?

8 of 46

“Research” WordCloud

https://livecloud.online/join/RXHA

How to participate?

1 Go to LiveCloud.online

2 Enter RXHA in the code field

3 Enter your name

4 Click on join

9 of 46

Conclusion from Exercise 2 - Word Cloud

10 of 46

What Is Research?�

Typically Pre-Specified Methods and Analysis

Verifiable Results

Systematic

Value extends beyond its Original Context

Generation of New Knowledge

Explicit Aims and Objectives

Not simply Data Collection

Not simply Number Crunching

Structured

Ethical

Accountable

11 of 46

Introduction to definition of Research and Decision Tool

12 of 46

Definition of LA research context

  • Discussions around what ‘research and evidence’ mean within a local authority setting are not new
  • Increasing investment in, and emphasis on, local authorities being ‘research active’
  • Being ‘research active’ requires a shared understanding of what ‘research’ is

13 of 46

Why do we need a consensus definition of research?

Enables research capacity building and organisational development

Easier to talk about research with colleagues (internal and external)

Starting point (or aide to further development) for research governance and research ethics processes

14 of 46

Project origins

Two projects:

Definition of research in local authorities consensus exercise

Discussions around research and research activity in local authorities

Increasing focus on research governance and research ethics processes in local authorities

Developing research infrastructure for local authorities

15 of 46

What we did

Adapted Delphi method

  • Structured communication technique
  • Seeks input from panel of experts
  • ‘Narrows down’ to agreement

Advantages of Delphi method:

  • Can be conducted remotely
  • Cost effective
  • Relatively quick

16 of 46

What we did

  • Two ‘rounds’ of online questionnaires seeking opinions on potential definitions followed by final Steering Committee workshop

17 of 46

Recruitment summary

  • Panellists recruited via online survey between 31 July and 04 September 2024

  • 130 potentially valid panellists signed-up; 60 selected for final panel

18 of 46

Consensus definition

Local authority research supports decision making about practice, policies and interventions at a local, regional or national level

It helps us understand how people are impacted by the context in which they live, work and go about their daily lives.

Research uses structured, organised and reproducible methods to:

  • produce new information or knowledge, which may include testing an idea, theory or new intervention

  • provide a new interpretation of existing information. This may include routinely collected data being using for a new purpose, as well as publicly available data.

and / or

and / or

19 of 46

Guidance and decision tool

20 of 46

Thank you to:

Delphi panellists and everyone who signed up

Project Steering Committee

Specialist Centre for Public Health Newcastle and Southampton colleagues

21 of 46

Next Steps

Collecting feedback on the definition and guidance document

  • Are the definition and guidance helpful for communicating about research, supporting research processes/capacity building?

  • How and where are the definition and guidance being used?

We need your help in testing it out in your setting!

Email your comments and feedback to: nihr.rss.publichealth@newcastle.ac.uk

22 of 46

Worked examples of the decision tool

23 of 46

Decision tool- worked example 1

Proposed activity:

Repositioning food and drinks to increase the accessibility of healthy foods and decrease the accessibility of unhealthy foods within a local authority school setting.

24 of 46

Decision tool- worked example 1

Proposed activity:

Repositioning food and drinks to increase the accessibility of healthy foods and decrease the accessibility of unhealthy foods within a local authority school setting

The aim of the project is to determine whether creating a healthier eating environment in this way could be an effective strategy for promoting healthier eating behaviours which should be adopted across schools within the area.

25 of 46

Decision tool- worked example 1

Proposed activity:

Repositioning food and drinks to increase the accessibility of healthy foods and decrease the accessibility of unhealthy foods within a local authority school setting

The aim of the project is to determine whether creating a healthier eating environment in this way could be an effective strategy for promoting healthier eating behaviours which should be adopted across schools within the area.

Unidentifiable purchasing data from the two schools involved in the project were collected for set time-periods before, during and after the intervention.

26 of 46

Decision tool- worked example 1

Proposed activity:

Repositioning food and drinks to increase the accessibility of healthy foods and decrease the accessibility of unhealthy foods within a local authority school setting

The aim of the project is to determine whether creating a healthier eating environment in this way could be an effective strategy for promoting healthier eating behaviours which should be adopted across schools within the area.

Unidentifiable purchasing data from the two schools involved in the project were collected for set time-periods before, during and after the intervention.

The amounts of healthy and unhealthy food items purchased during the selected time periods were analysed using recognised statistical techniques.

27 of 46

Decision tool- worked example 1

‘within a local authority school setting

28 of 46

Decision tool- worked example 1

‘The aim of the project is to determine whether creating a healthier eating environment in this way could be an effective strategy for promoting healthier eating behaviours which should be adopted across schools within the area’

29 of 46

Decision tool- worked example 1

‘Unidentifiable purchasing data from the two schools involved in the project were collected for set time-periods before, during and after the intervention ’

30 of 46

Decision tool- worked example 1

The amounts of healthy and unhealthy food items purchased during the selected time periods were analysed using recognised statistical techniques.’

31 of 46

Decision tool- worked example 1

32 of 46

Decision tool- worked example 2

Proposed activity:

Review of open spaces provision within a local authority area.

33 of 46

Decision tool- worked example 2

Proposed activity:

Review of open spaces provision within a local authority area.

A survey on local needs and a review of existing information and consultation around open spaces will be conducted.

34 of 46

Decision tool- worked example 2

Proposed activity:

Review of open spaces provision within a local authority area.

A survey on local needs and a review of existing information and consultation around open spaces will be conducted.

An audit of local open space provision will be conducted.

35 of 46

Decision tool- worked example 2

Proposed activity:

Review of open spaces provision within a local authority area.

A survey on local needs and a review of existing information and consultation around open spaces will be conducted.

An audit of local open space provision will be conducted.

The project will provide the council with up-to-date information on green space location, coverage and provision.

36 of 46

Decision tool- worked example 2

‘review of open spaces provision within a local authority area

37 of 46

Decision tool- worked example 2

‘The project will provide the council with up-to-date information on green space location, coverage and provision’

38 of 46

Decision tool- worked example 2

‘The project will provide the council with up-to-date information on green space location, coverage and provision’

39 of 46

Decision tool- worked example 2

Will your proposed work provide a new interpretation of existing information?

(includes routinely collected data being used for a new purpose, as well as publicly available data)

‘The project will provide the council with up-to-date information on green space location, coverage and provision’

40 of 46

Decision tool- worked example 2

41 of 46

Groupwork

42 of 46

The Lakeside Project: A Local Authority Peer-Led Recovery Programme Evaluation (See Sheet)

Peer-led recovery programme developed by a local Drug and Alcohol Action Team. Devised in response to high substance misuse rates and service gaps.

Programme offered befriending, skills training, family support, signposting, employment advice, and user-led activities including cooking classes, fishing clubs, and music groups.

A local health partnership conducted an evaluation commissioned by the project's management committee. Evaluation employed mixed quantitative and qualitative methods, including standard assessment tools, routine monitoring data, and feedback from service users and volunteers.

Purpose of evaluation: to inform local decision-making and provide practical recommendations for service improvement. Evaluation prioritised stakeholder engagement and operational improvements.

Produced final report with service statistics, participant feedback, and recommendations for expansion across the local authority area.

43 of 46

How would you convert this Evaluation project into a fundable Research project?

44 of 46

e.g. Title: The Lakeside Project: A Local Authority Investigation into Peer-Led Recovery Approaches

………………

45 of 46

Collect a Crib Sheet on Your Way Out

Thank you!

46 of 46

You Have Been Watching!

Professor Andrew Booth (Professor in Evidence Synthesis, University of Sheffield)

Dr Louise Hayes, (Research Design Lead, NIHR RSS Specialist Centre for Public Health)

Laura Brown, (Research Programme Manager, NIHR RSS Specialist Centre for Public Health)

Email: nihr.rss.publichealth@newcastle.ac.uk