INTRODUCTION TO �DATA SCIENCE
– FARDINA FATHMIUL ALAM
(fardina@umd.edu)
CMSC 320
LECTURE: 01
Lecture 1 Part 1
Today we will cover
Chapter 1: https://ffalam.github.io/CMSC320TextBook/chapter1/Chapter_1_0.html
Remember, slides are just the summary, you must have to follow the textbook.
PART 2: Course Logistics and What to Expect.
2
Let’s start by understanding what is data science?
3
4
Need availability of DATA!!!
DATA SCIENCE
Data science is all about using data to solve problems.
5
In simple terms: Using data to draw an inference or predict an outcome. Such information can help us to make better decisions.
WHAT IS DATA SCIENCE?
6
Data science is an interdisciplinary field focused on discovering patterns and describing relationships using data.
WHAT IS THIS COURSE ABOUT?
This semester we will learn to take raw data and turn it into insights about the world or predictions about the future.
7
8
AI: any technique that enables computers to mimic human intelligence, e.g., using decision trees, rules, logic, ML
ML: a subset of AI that uses statistical techniques that enable machines to use experience to improve at tasks
Deep Learning: a subset of ML that uses vast amounts of data and multilayer neural nets to enable a machine to train itself to perform tasks
Statistics: science of collecting and analyzing numerical data, either to describe properties of a dataset or to make inferences based on a subset of data
Data Science: an applied branch of statistics that uses computer science techniques to manage, analyze, visualize and discover patterns in data
V’s of Big Data
Additional:
9
EXAMPLE: ANALYZE PATIENT’S MEDICAL RECORD, PREDICT DISEASE OUTBREAK
10
Raw Data: Medical records, patient demographics, lab results.
Applies Techniques and Models: Analyze patient data to identify risk factors, predict disease progression, and recommend personalized treatments.
Insights and Predictions: Identifies patterns in patient data to
THE DATA LIFECYCLE
11
Data collection
Exploratory analysis
&
Data viz
Analysis, hypothesis testing, & ML
Insight & Policy Decision
Data processing
REMEMBER: DATA SCIENCE IS NOT A STRICTLY ONE-WAY LINEAR PROCESS; IT'S DYNAMIC, ITERATIVE, AND ADAPTIVE
12
Step ‘x’
Step ‘y’
If need to revisit previous steps due to new insights or challenges that arise during later stage. Example: Later realize you need to collect more data. This allows for constant refinement and improvement as new information emerges and insights evolve.
learning and building as we go
BEFORE THAT: DEFINE PROBLEM STATEMENT
What problem are you going to solve?
13
A problem well defined is a problem half-solved. — Charles Kettering
Example: “I want to increase the profit” - is it a well defined problem statement?
How much to increase the average profit/ revenue such as 20% or 30% ?
What is the average time frame to increase the revenue?
14
Data collection is a systematic approach to gather relevant information from a variety of sources.
2 types of data collections methods:
PRIMARY vs SECONDARY DATA COLLECTIONS
15
Situation: Some unique problem and no related research is done on the subject.
Solution: Collect new data → Primary data collection.
Situation: Some problem and the data is readily available or collected by someone else.
Solution: Use the data → Secondary data collection.
2. DATA PROCESSING
Clean or scrub data to ensure the data quality
16
3. EXPLORE DATA: FIGURE OUT WHAT YOU HAVE
You’ll be sitting on like a terrabyte of raw data
Do Exploratory Data Analysis (EDA) : Descriptive statistics and Visualizations
Extract useful insights from the data, understanding patterns, and setting the stage for effective model building and decision-making
4. BUILD A MODEL
Steps to the solution.
18
Example: build a machine learning model that predicts a student's test score based on their study hours.
5. INTERPRETATION
19
The last step is getting a bunch of non-technical people to understand what your magical model is doing and why it’s right and they should listen to you.
Translate these findings into actionable insights.
Career in Data Science
20
CAREER IN DATA SCIENCE
21
Career in Data Science
Required Skills
22
23
“The ability to take data—to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it—that’s going to be a hugely important skill in the next decades …”
Hal Varian
Chief Economist at Google
Next Topics
24