Merge crawler with data analysis and website codebase #6
Description
The crawler codebase is currently untouched since development was moved to the University of Southampton. The code and its outstanding issues should be separated from deprecated files and features, prepared for open source and merged with the GitHub repository.