Skip to content

About

With the increasing volume of crime-related data, traditional data processing tools struggle to handle large datasets efficiently. This project leverages big data platforms like Apache Spark, PySpark to analyze New York Police Department (NYPD) historical complaint data.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

3 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

Crime Analysis Using Big Data Techniques

This project analyzes crime data using big data processing and machine learning techniques to uncover patterns and predict crime characteristics. It was developed as part of the Big Data course.

Key Features

  • Data preprocessing and feature engineering on crime datasets
  • Classification of crime categories and severity using Naive Bayes
  • Visualization of crime trends and patterns
  • Performance evaluation of prediction models

How to Run

  1. Clone this repository
  2. Install the required packages with pip install -r requirements.txt
  3. Open and run Data_603_Final_project.ipynb to explore the analysis

Files Included

  • Crime_Analysis.ipynb: Main Jupyter notebook
  • requirements.txt: Python dependencies
  • README.md: Project summary and usage instructions

About

With the increasing volume of crime-related data, traditional data processing tools struggle to handle large datasets efficiently. This project leverages big data platforms like Apache Spark, PySpark to analyze New York Police Department (NYPD) historical complaint data.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages