1 of 44

A SECURED PLATFORM FOR PHARMACEUTICAL AND

MEDICAL CONSULTING SERVICES

2 of 44

A SECURED PLATFORM FOR PHARMACEUTICAL AND MEDICAL CONSULTING SERVICES

CDAP | Final Presentation

Project ID : 2022-164

2022 / 10 / 11 1

3 of 44

Perera N.D.A.

Jayasinghe J.P.N.H.

Gangegedara T.K.

IT19146416

Software Engineering

IT19210070

Software Engineering

IT19210216

Software Engineering

Our Team

Mr. Thusithanjana Thilakarthna

LECTURER

FACULTY OF COMPUTING | COMPUTER SCIENCE & SOFTWARE ENGINEERING

2022 / 10 / 11 2

Mr. Didula Chamara

​

LECTURER

FACULTY OF COMPUTING | COMPUTER SCIENCE & SOFTWARE ENGINEERING

Samiraja D.S.M.M.C.A.B.

IT19153582

Information Technology

4 of 44

INTRODUCTION

2022 / 10 / 11 6

5 of 44

How to identify a particular drug name with its description

Elder people are not flexible with interfaces

Sometimes pharmacists couldn’t identify the prescription

Can’t trust about secure of the data

Research Problem

2022 / 10 / 11 10

6 of 44

System Overview

2022 / 10 / 11 12

7 of 44

Perera N.D.A

IT19146416

Software Engineering

2022 / 10 / 11 13

8 of 44

Block-chain based network to secure and store medical records

2022 / 10 / 11 14

IT19146416 | Perera N.D.A | 2022-164

9 of 44

Research Problem

Can a user trust to enter the patient details?

Can patients control their medical records?

2022 / 10 / 11 16

IT19146416 | Perera N.D.A | 2022-164

10 of 44

Proof of work

  • Blockchain.py
  • DbController.py

IT19146416 | Perera N.D.A | 2022-164

2022 / 10 / 11 22

11 of 44

  • Model.py
  • MongoDB

IT19146416 | Perera N.D.A | 2022-164

2022 / 10 / 11 23

12 of 44

IT19146416 | Perera N.D.A | 2022-164

2022 / 10 / 11 23

13 of 44

Current Progress

IT19146416 | Perera N.D.A | 2022-164

2022 / 10 / 11 25

    • Implement a blockchain network
    • Connect the blockchain system to the application
    • Created a backup plan
    • Create a proxy re-encryption schema
    • Test with real users

14 of 44

Summary of Objective Achievement

IT19146416 | Perera N.D.A | 2022-164

2022 / 10 / 11 25

To develop a blockchain-based network to secure and store medical records

A mechanism is created for pharmacists to store medical data

Implement a proxy re-encryption schema to secure the patient details

15 of 44

Jayasinghe J.P.N.H.

IT19210070

Software Engineering

2022 / 10 / 11 29

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

16 of 44

Use voice recognition to search medications and get relevant information

2022 / 10 / 11 30

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

17 of 44

Research Problem

Can elders or people with some reading difficulties use this application easily?

Do you know the usages of the medicine you use?

2022 / 10 / 11 33

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

18 of 44

Proof of work

  • After training the model, test accuracy was 97%

2022 / 10 / 11 40

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

19 of 44

  • After training the model, test accuracy was 97%

2022 / 10 / 11 40

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

20 of 44

2022 / 10 / 11 39

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

21 of 44

2022 / 10 / 11 40

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

22 of 44

2022 / 10 / 11 41

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

23 of 44

Current Progress

  • Created a dataset using voice clips(.wav) of medicine names

​

  • Trained the model after reprocessing the dataset and building a CNN model

​

  • Take prediction after detecting the voice and Identify the medicine

​

  • Get usage of medicine after input a medicine as input

​

  • Get feedback from real-time users

​

2022 / 10 / 11 43

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

24 of 44

Summary of Objective Achievement

Voice recognition feature to search the medicines and their details

22022 / 10 / 11 34

IT19210070 | Jayasinghe J.P.N.H. | 2022-164

A reliable mechanism is created for the doctors to store medical data and access the historical data

​

Use text-to-speech feature for listening to the description

25 of 44

Samiraja D.S.M.M.C.A.B.

IT19153582

Information Technology

2022 / 10 / 11 64

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

26 of 44

Design Flexible Interfaces For Both Elder & Younger People According To User Age Groups

2022 / 10 / 11 65

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

27 of 44

Research Problem

Elder people can’t clearly see the interfaces

Too many actions to do within a task

2022 / 10 / 11 67

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

28 of 44

Proof of work

2022 / 10 / 11 73

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

29 of 44

Proof of work

2022 / 10 / 11 73

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

30 of 44

Use the ML model and train the dataset..

2022 / 10 / 11 74

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

31 of 44

Current Progress

2022 / 10 / 11 76

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

32 of 44

Summary of Objective Achievement

To Make sure that the application is flexible for both elder and younger users

2022 / 10 / 11 68

IT19153582 | Samiraja D.S.M.M.C.A.B. | 2022-164

Make sure the application is understandable for everyone

Use different types of login

33 of 44

Gangegedara T.K.

IT19210216

Software Engineering

2022 / 10 / 11 47

IT19210216 | Gangegedara T.K. | 2022-164

34 of 44

Identify medicines and read prescriptions by detecting through a mobile camera

2022 / 10 / 11 48

IT19210216 | Gangegedara T.K. | 2022-164

35 of 44

Research Problem

Difficult to read handwritten prescriptions

Lack of knowledge about medicines

Cause too many diseases by getting wrong medicines

2022 / 10 / 11 50

IT19210216 | Gangegedara T.K. | 2022-164

36 of 44

2022 / 10 / 11 57

IT19210216 | Gangegedara T.K. | 2022-164

​

  • Create the CNN model , train the dataset and get the accuracy around 78%.

Proof of Work

37 of 44

2022 / 10 / 11 58

IT19210216 | Gangegedara T.K. | 2022-164

38 of 44

Current Progress

​

  • Dataset creation using medicine prescription images.
  • Train the CNN model and get the accuracy
  • Detect the printed and handwritten text & identify the medicine.
  • Display the medicine
  • Get the details of the medicine
  • Test the mobile application with real users

​

2022 / 10 / 11 60

IT19210216 | Gangegedara T.K. | 2022-164

39 of 44

Main Objective

Identify the handwritten prescription image which is prescribed by doctors

2022 / 10 / 11 51

IT19210216 | Gangegedara T.K. | 2022-164

Identify the medicine name of a medicine box

Get the relevant medicine details of identified medicine

40 of 44

Functional Requirements

    • System should identify the medicine correctly by image and voice recognition
    • Patient details should be secure in the application
    • Should get a suitable interface according to age groups

​

Non-Functional Requirements

    • Application interfaces should be user friendly
    • Should give accurate results
    • Application should work smoothly

41 of 44

Commercialization

2022 / 10 / 11 80

​

​

​

​

Free Version

Premium Version

​

  • Handwritten prescription identification

​

  • Medicine box identification

​

  • Get medicine details

​

  • Blockchain based secure

​

  • Voice recognition for medicine identification

​

  • Divide the age groups of users by face recognition

​

  • Flexible user interfaces for elders

​

  • Rs. 150/= for month

42 of 44

Future Plans

​

  • Get more accurate results by expanding the dataset
  • Launch the mobile app in play store
  • Introduce the application for the users
  • Dockerize the application

​

​

​

​

43 of 44

Any Questions?

2022 / 10 / 11 81

44 of 44

THANK YOU !

2022 / 10 / 11 82