1 of 23

Data collection methodology�FFP

Martin van der Meij

SALW Control Expert SEESAC

2 of 23

What ?

A data collection methodology for law enforcement is the structured way police agencies gather, record, and manage information so it’s accurate, lawful, and useful for investigations, accountability, and policy decisions.

3 of 23

What is the Intelligence Cycle?

Systematic and cyclical process that converts raw data into meaningful and actionable intelligence.
Series of interconnected phases, each contributing to the final output
This intelligence, in turn, empowers decision-makers to understand complex situations, predict outcomes, and make well-informed choices.

Good intelligence is rarely produced solely from one-off tips from informants.

Rather, it emerges from a longer-term process on incrementally increasing knowledge. This process may be set in motion by a vague report about a specific individual suspected of committing crime, or by rumours about a criminal enterprise about which little is currently known.

In order to develop the available information into intelligence, a structured and systematic series of activities should be adopted. The Intelligence Cycle is the framework in which six stages are conducted resulting in the distribution of a finished intelligence product. The six stages are a flexible process and there are no firm boundaries separating them. The stages consist of: Direction / Planning, Collection, Evaluation, Collation, Analysis and Dissemination

After dissemination there is possible another tasking and the whole cycle starts again. There are criticism towards the Intelligence Cycle, stating that it does not fit for the practical processes of intelligence work. Despite this critique it can be argued that it serves a good model to conceptualise the intelligence process.*************What I want to highlight here is that analysis is part of Intelligence Process, not a separate function.

4 of 23

Collection

Collection is gathering of data

COLLECTION PLAN: A FORMALLY DEFINED APPROACH TO DESCRIBING THE INFORMATION NEEDED AND MEANS OF ACQUIRING IT

Three main types of sources of information:

Open Source Information (OSINT)
Close Source Information
Classified Source Information

Care must be taken at this early stage to avoid data overload which is always a problem for any agency but data ignored because the provider believed it not to be relevant can cause problems later on.

The three main types of sources of information are open, closed and classified.

Open source (OSINT) is information that is publicly available. One very notable subset of open source information is so called “grey literature”. It can consist of research, technical, economic reports, “white papers”, conference documentation, dissertations and theses, discussion papers, subject-related newsletters, etc. One of the main difficulties in working with this type of source is evaluation as information available in the public domain can frequently be biased, inaccurate or sensationalized.
Closed source is information collected for a specific purpose with limited access and availability to the general public. Closed source information is often found in the form of structured databases. In the context of criminal intelligence analysis, these databases will largely include personal data collected as part of ongoing targeting operations, or broader criminal records, vehicle registration data, weapons licensing, etc.
Classified is information collected by specifically tasked covert means including use of human and technical (image and signals intelligence) resources. Use of classified information can significantly enhance the quality of an analytical product, as it is usually highly accurate; however, it can also make an analytical product significantly less actionable due to restrictions on dissemination.

5 of 23

Why ?

Data collection is the foundation of intelligence led policing. It enables law enforcement agencies to:

Identify patterns and trends
Enhance investigations and provide critical leads
Support decision-making processes (on various levels from operational to strategic planning)
Improve community safety

6 of 23

Meaning

It’s the who, what, where, when, why and how of collecting data in policing—done in a consistent and legally compliant way.

7 of 23

Meaning

Question	What is already known	What is not yet known
What
When
Where
Why
Who
How

8 of 23

What is data?

Data - Information

Data is collected and then processed or organized to become information. For instance, individual firearm seizures (data) are compiled into a monthly seizures report (information).

Information - Intelligence

Information is further analyzed and interpreted to generate intelligence. For example, the monthly seizure report (information) is analyzed to identify trends and predict future patterns on criminal use of firearms or hotspots (intelligence).

9 of 23

Data Collection Challenges

Data overload

New technologies have the potential for more data to be collected (facial recognition, video-surveillance, AI), but could also create a data overload of data that cannot be assessed and turned into actionable intelligence

“The needle in the haystack”

10 of 23

Collection Failure

“Garbage in – garbage out”

The more inaccurate data is used for the production of intelligence, the less reliable the resulting product will be

11 of 23

Collection failure – 2 reasons

Data was inaccurate in the first place
Data was recorded or interpreted incorrectly during the collection process

12 of 23

Common Types of Law enforcement data/ FFP

Incident reports (crimes, calls for service)

Arrest/ Seizure data (who, where, charges)

Stop/search data (traffic stops, pedestrian stops)

Use-of-force data

Body-worn camera footage

Evidence and forensic data

Community complaints or tips/ Informants

Tracing Data

Criminal records/Prison Data

Weapons registry/ import/ export data

Data from OSINT

Financial data

Data through Special Investigative Measures

13 of 23

Core elements of a good methodology

Standardized procedures

Same forms, data format, definitions, and codes across officers and departments

Legal & ethical compliance

Respects privacy, civil rights, and due process
Follows laws like data protection and evidence rules

Clear data sources

Officer observations
Witness statements
Surveillance systems
Digital records)

Reliable collection tools

Verification & quality control

5x 5, 4 x4
Supervisor review
Audits and error checks

Secure storage & access

Encryption
Controlled access
Retention schedules

14 of 23

Why it matters

Improves investigative accuracy

Supports transparency and accountability

Helps identify crime patterns

Builds public trust

Protects agencies legally

15 of 23

Firearms related

16 of 23

What Counts as a Firearm-Related Incident�

Be clear and consistent.

Include:
Discharge of a firearm (intentional or accidental)
Firearm used to threaten or intimidate
Possession during a crime
Recovered or seized firearms linked to criminal activity

17 of 23

Key Data Elements One Should Capture�

Incident Information

Date, time, and precise location (GPS if available)

Type of offense

Call type vs. confirmed offense

Firearm Details

Type (handgun, rifle, shotgun)

Make, model, caliber (if known)

Serial number (if recovered)

Loaded/unloaded status

Condition (fired, jammed, damaged)

Use Context

Fired or brandished

Number of shots fired (estimated if necessary)

Direction of fire

Distance (approximate)

Persons Involved

Suspect(s)

Victim(s)

Witness(es)

Evidence

Shell casings

Magazines

Firearm recovery location

18 of 23

Components

FOCUS

TOOLS

( INDICATORS)

ANALYSIS AND PRIORITIZATION

RESULTS

DATA PROTECTION

19 of 23

Data collection plan

Identify Data Needs: Determine the specific data required for the incident, such as demographics, location, time, and outcomes.
Gather Data Sources
Develop Data Collection Methods: Choose appropriate methods for data collection, based on the incident's context. Can include intelligence collection activities
Analyze and Report Data: Use statistical software or data analysis tools to analyze the collected data and generate reports for decision-making.
Implement Recommendations: Based on the analysis, implement recommendations to improve incident management and reduce risks.

20 of 23

Data collection focus issues

In many cases there will be a strong and recognizable flavour of investigative effort attached to the intelligence collection plan, rather than one that suggests proactive forecasting
It is important that the analyst understands that the differences between strategic analysis and other forms of intelligence provoke the need for a much more widespread and comprehensive collection regime
For most strategic issues, the collection phase of the process has to be custom-designed to suit the specific case circumstances
The basic concepts and techniques of collection planning and implementation are universally acceptable throughout the intelligence community. However, strategic collection moves from the obvious and the predictable range of criminal activity data, to a wider catchment involving the status and changes in a variety of areas (social, cultural, economic as well as criminal)

21 of 23

Data collection focus issues

Enforcement organisations will almost never have readily available to them the broad range of data necessary to undertake strategic assessments, and the challenge for the analyst is to widen the collection plan beyond organizational boundaries, routines and custom.
For the strategic analyst to properly measure the changing trends and patterns, it will be necessary to access raw data. The reason for this is simple: to compile a comprehensive picture of any criminal or security phenomenon by the cut-and-paste method of combining other people’s analysis is not, and can never be, entirely free from the bias of other analysts.
When analysts gather and process data they do so for a specific reason and that reasoning will inevitable shape the intelligence answer so that it suits the purpose. This is both understandable and justifiable. But for an overview picture at HQ or national, even regional management level, the strategic analysis challenge is to assemble all the data gathered by subordinate units and other agencies and analyse it afresh to address the specific issue under assignement.

22 of 23

Data collection focus issues

Finally, the development of a collection plan will rely heavily on a strictly formatted approach to recording the myriad of detailed questions and the selection of appropriate sources. This planning process is time-consuming but necessary, to ensure that the collection plan is comprehensive and focused on meeting the aim of the terms of reference.

23 of 23

Group Exercise

As a group, develop and present a comprehensive data collection plan for the Firearms Focal Point. The plan must highlight opportunities (leveraging technology, partnerships etc) and challenges (privacy concerns, data silos, etc).

Brainstorm within the group and draft the plan focusing on:

Needs
Sources
Methods
Opportunities
Challenges

And take into consideration points addressed in this presentation

Present the outcomes per group