Notebooks

Document Search Using Map Reduce
In this notebook, we implement a custom MapReduce framework in python, and use it to create a document search function.

Implementing Efficient Joins on Mobile App Data
In this notebook, we implement a few different join algorithms, and study their time and space complexity on real world datasets.

Big Data Workflow with Pandas and SQLite3
In this notebook, demonstrate a workflow using pandas and SQLite3 which scales well with large data.

Creating a Crime Database Using Postgres
In this notebook, we create a Postgres database containing boston crime data. We also explore how to use Postgres to create groups and revoke/restore permissions.

Finding Value in Used Car Listings on ebay
In this notebook, we analyze a dataset of used-car listings from the german ebay website ebay Kleinazeigan.

Building Fast Queries on a csv
In this notebook, we create a python Inventory() class based on a laptop store's inventory. Using time/space complexity analysis, we optimize lookups that store employees may use frequently.

Finding Heavy Traffic Indicators
In this notebook, we analyze a dataset containing hourly westbound traffic on I-94.

Exploring Star Wars Survey Results
In this notebook, we finally answer the question everyone has been asking since 1999: how much do Star Wars fans hate Jar Jar?

Anayzing NYC Test Score Data
In this notebook, we investigate standardized test performance among high schoolers across the boroughs of New York City.

Analyzing Employee Exit Surveys
In this notebook, we analyze two datasets containing exit surveys of employees from education related government agencies.

Answering Business Questions using SQL
In this notebook, we use SQLite3 along with the popular chinook database to demonstrate writing queries in SQL.

Chunk Processing in Pandas
In this notebook, we demonstrate how pandas can be used to optimize datasets which are too large to fit into memory.

Exploring CIA Factbook Database using SQL
In this notebook, we use SQLite3 to explore the CIA's world factbook database factbook.db.