1 of 31

CSxxx Fundamentals of Information Retrieval

Lecture 1 Introduction to Information Retrieval

Krishnendu Ghosh

Department of Computer Science & Engineering

Indian Institute of Information Technology Dharwad

2 of 31

Information Retrieval (IR)

Information Retrieval (IR) is finding material (usually documents) of an unstructured nature (usually text) that satisfies an information need from within large collections (usually stored on computers).

​

These days we frequently think first of web search, but there are many other cases:

  1. E-mail search
  2. Searching your laptop
  3. Corporate knowledge bases
  4. Legal information retrieval

3 of 31

Text: Unstructured vs Structured (Mid-90s)

4 of 31

Text: Unstructured vs Structured (2000s)

5 of 31

Information Retrieval: Why?

6 of 31

Information Retrieval: Why?

​

7 of 31

Information Retrieval: Why not RDBMS?

​

8 of 31

Information Retrieval: Transform

​

9 of 31

Information Retrieval: Core Concepts

10 of 31

Information Retrieval: Core Concepts

11 of 31

Information Retrieval: Applications

12 of 31

IR Applications: Text Categorization

​

13 of 31

IR Applications: Text Categorization

​

14 of 31

IR Applications: Text Categorization

​

15 of 31

IR Applications: Document Clustering

16 of 31

IR Applications: Content Based Filtering

​

17 of 31

IR Applications: Collaborative Filtering

18 of 31

IR Applications: Information Extraction

19 of 31

IR Applications: Question Answering

​

20 of 31

IR Applications: Web Search

​

21 of 31

IR Applications: Federated Search

​

22 of 31

IR Applications: Expertise Search

​

23 of 31

IR Applications: Citation/Link Analysis

​

24 of 31

IR Applications: Citation/Link Analysis

​

​

​

25 of 31

IR Applications: Multimedia Retrieval

​

​

26 of 31

IR Applications: Information Visualization

​

​

27 of 31

Basic Assumptions of Information Retrieval

  • Collection: A set of documents
    • Assume it is a static collection for the moment

​

  • Goal: Retrieve documents with information that is relevant to the user’s information need and helps the user complete a task

28 of 31

Classic Search Model

Query

Search Engine

Query

Reformulation

Repository

Result

29 of 31

How Good are the Retrieval System?

  • Precision: Fraction of retrieved docs that are relevant to the user’s information need
  • Recall: Fraction of relevant docs in collection that are retrieved

​

​

More precise definitions and measurements to follow later

30 of 31

Quiz 1

31 of 31

Thank You