1 of 19

Learning Analytics in action:

ethics & privacy issues in the classroom

​

​

María Jesús Rodríguez-Triana,

Alejandra Martínez-Monés & Sara Villagrá-Sobrino

​

LASI'16 - Bilbao - 27/06/2016

2 of 19

Benefits vs Dangers

(BIG) DATA

​

LEARNING ANALYTICS

2

3 of 19

Stakeholders

3

4 of 19

Code of practice for LA

  • Stakeholders:
    • Institutions
  • Aspects:
    • Responsibility
    • Transparency & consent
    • Privacy
    • Validity
    • Access
    • Enabling positive interventions
    • Minimising adverse impacts
    • Stewardship of data

4

(Sclater & Bailey, 2015). Code of practice for learning analytics. Jisc. Retrieved from: http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

5 of 19

DELICATE checklist

  • Stakeholders:
    • Institutions, policy makers
  • Aspects:
    • Purpose
    • Transparency
    • Data ownership
    • User involvement
    • Consent
    • Anonymity
    • Privacy
    • External services

​

5

Drachsler, H. & Greller, W. (2016). Privacy and Analytics – it’s a DELICATE issue. A Checklist to establish trusted Learning Analytics. 6th Learning Analytics and Knowledge Conference 2016, April 25-29, 2016, Edinburgh, UK.

6 of 19

What about teachers?

Am I doing right?

What should I do?

Frameworks &

Guidelines

6

7 of 19

Small-scale teacher-led LA

  • Stakeholders:
    • Teachers
  • Aspects:
    • Consent
    • Transparency
    • Access
    • Responsibility
    • Privacy
    • Validity
    • Stewardship
    • Impact

7

Rodríguez-Triana, M.J., Martínez-Monés, A., & Villagrá-Sobrino (2016). Learning analytics in small-scale teacher-led innovations: Ethical and data privacy issues. Journal of Learning Analytics, 3(1), 43–65.

8 of 19

Approach: Aligning learning design & analytics

8

M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations,” British Journal of Educational Technology, vol. 46, no. 2, pp. 330–343, 2015.

9 of 19

Studies: higher and primary education scenarios

9

10 of 19

Lessons: Implications related to the LA approach

  • LA approaches, roles, responsibility (Griffiths, 2012):
    • Institutional approaches → efficiency in the wider functioning of the institution
    • Regulation approaches → enhanced regulation of the teaching and learning environment
    • Reflection approaches → help lecturers carry out their tasks more effectively

​

  • Privacy, action & impact:
    • Data available in the classroom for the teacher
    • Actions triggered by LA
    • Classroom orchestration impact

10

11 of 19

Lessons: Implications derived from the solutions

  • Design methodology:
    • Participatory design helped to overcome certain orchestration issues
    • "Ethics by design”

​

  • Stakeholders role:
    • The teacher is the one who:
      • defines the educational purposes of the analysis,
      • reflects on the available data sources,
      • contributes to improve the validity of the results),
      • is aware of the limitations of the results obtained.

11

12 of 19

Lessons: implications from the educational contexts

  • Specific ways of working
  • Legal aspects (minors and privacy)
  • Technological learning environment:
    • Cloud-based tools do not cover information needs required by LA
    • Legal and ethical problems: data ownership and virtual identity

12

13 of 19

Lessons: recommendations for teachers

13

Category

Recommendation

Consent

· If information is already being tracked, inform the students (or families) about it, otherwise, ask for formal consent/agreement before data can be collected and/or analyzed.

· Be explicit about what you might do with that information and, if possible, agree on these possibilities with the students.

· Provide students with the option to update their digital dossiers and provide extra data but triangulate it to verify they do not “game” the system.

· Data should be deleted when individuals no longer want it to be processed or when it is no longer of use for its original purpose, as is the case with any other student data.

· Reflect on the consequences that opting out of the analysis will have on the participants and inform them.

Transparency

· Be explicit about which data is collected, how it is interpreted, why, and how it will affect the learning process.

Access

· Reflect on whether the students should access the data held about them, the analysis of the data, the labels attached to them, and if so, in which format this information should be provided to them.

· Consider the possibility of letting students correct the data stored about them.

Responsibility

· You are in charge of interpreting and validating the analyses as well as deciding what to do based on the analytics.

14 of 19

Lessons: recommendations for teachers

14

Category

Recommendation

Privacy

· If some data must be anonymous, be sure it cannot be re-identified by contextual information available to the users.

· If you use data from external sources, (e.g., Web 2.0 tools) be sure you can identify the owner correctly, and that other ethical and privacy issues are not put at risk when using those sources.

Validity

· The evidence obtained may be incomplete. Try to involve students (and families) in order to increase its accuracy.

Stewardship

· Use the data needed for the analysis, nothing more.

· Be sure that you comply with the data protection laws applicable in your region or country.

· The data should be preserved, secured, and shared in the same way as any other student data.

Avoiding negative impact

· Consider that your analysis may produce unexpected results that prompt you to intervene with the student. Which kinds of obligations will influence your actions?

15 of 19

Conclusions

15

LA approach

Solutions

Ed. Context

16 of 19

Future work

16

Evaluation with teachers

usefulness, usability & feasibility

benefits & challenges

Analyses of stakeholder's responsibilities

students, researchers, developers

​

Ethics & privacy

17 of 19

Thank you

for your participation

17

María Jesús Rodríguez-Triana

maria.rodrigueztriana@epfl.ch

​

Alejandra Martínez-Monés

amartine@info.uva.es

Sara Villagrá-Sobrino

sarena@pdg.uva.es

18 of 19

References

[1] W. Greller and H. Drachsler, “Translating learning into numbers: A generic framework for learning analytics,” Educational Technology and Society, vol. 15, no. 3, pp. 42–57, 2012.

[2] D. Griffiths, H. Drachsler, M. Kickmeier-Rust, C. Steiner, T. Hoel, and W. Greller, “Is Privacy a Show-stopper for Learning Analytics? A Review of Current Issues and Solutions,” Learning Analytics Community Exchange (LACE, Tech. Rep. February, 2016. [Online]. Available: http://www.laceproject.eu/learning-analyticsreview/files/2016/04/LACE-review-6privacy-show-stopper.pdf

[3] S. Slade and P. Prinsloo, “Learning analytics ethical issues and dilemmas,” American Behavioral Scientist, vol. 57, no. 10, pp. 1510–1529, 2013.

[4] N. Sclater, “Code of practice for learning analytics. A literature review of the ethical and legal issues,” JISC, Tech. Rep., 2014.

[5] A. Pardo and G. Siemens, “Ethical and privacy principles for learning analytics,” British Journal of Educational Technology, vol. 45, no. 3, pp. 438–450, 2014.

[6] H. Drachsler and W. Greller, “Privacy and Learning Analytics – a DELICATE issue. A Checklist for Trusted Learning Analytics,” in 6th International Conference on Learning Analytics and Knowledge, Edinburgh, UK, 2016.

18

19 of 19

References

[7] D. Griffiths, “The implications of Analytics for teaching practice in Higher Education,” JISC CETIS Analytics Series, vol. 1, no. 10, pp. 1–23, 2013.

[8] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations,” British Journal of Educational Technology, vol. 46, no. 2, pp. 330–343, 2015.

[9] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Towards a script-aware monitoring process of computer-supported collaborative learning scenarios,” International Journal of Technology Enhanced Learning, vol. 5, no. 2, pp. 151–167, 2013.

[10] M. J. Rodríguez-Triana, A. Martínez-Monés, and S. Villagrá-Sobrino, “Learning analytics in small-scale teacher-led innovations: Ethical and data privacy issues,” Journal of Learning Analytics, vol. 3, no. 1, pp. 43–65, 2016.

[11] D. Kay, N. Korn, and C. Oppenheim, “Legal, risk and ethical aspects of analytics in higher education,” JISC CETIS Analytics Series, Tech. Rep. 6, 2012. [Online]. Available: http://publications.cetis.org.uk/wp-content/uploads/2012/11/Legal-Riskand-Ethical-Aspects-of-Analytics-in-Higher-Education-Vol1-No6.pdf

​

​

19