San Francisco Crime Incidents Analysis based on Spark

SF_analysis.ipynb

Used Spark to do some OLAP analysis on downtown San Francisco Crime Incidents including:

• The number of crimes for different category
• The number of crimes for different district
• The number of crimes each Sunday at Downtown SF
• Visualize the spatial distribution of crimes
• One day analysis on Crime in Downtown San Francisco

SF_Crime_03To18.ipynb

• Time Series forecast based on ARIMA time series model
• 15-year analysis on the variation of spatial distribution of incidents in Downtown SF
• Found the correlation between weather and crime incidents

KmeansMatplot_demo.ipynb

A K-Means Clustering Model demo