IRS 990 e-File Data (part 1) — Set up AWS CLI credentials and grab index files
Tutorials for Sarbanes-Oxley Paper Data
Dan Neely (from University of Milwaukee-Wisconsin) and I just had the following article published at the Journal of Business Ethics: Saxton, G. D., & Neely, D. G. (2018). The Relationship Between Sarbanes–Oxley Policies and Donor Advisories in Nonprofit Organizations. Journal of Business Ethics. This page contains tutorials on how to download the IRS 990 e-file […]
Python PANDAS Code Bytes
This page contains brief (generally one-liner) blocks of code for working with Python and PANDAS for data analytics. I created it as a handy reference for PANDAS commands I tended to forget when I was learning. I hope it proves useful to you, too! I also have a page with longer data analytics tutorials. Table […]
Python Data Analytics Tutorials
The bulk of my research involves some degree of ‘Big Data’ — such as datasets with a million or more tweets. Getting these data prepped for analysis can involve massive amounts of data manipulation — anything from aggregating data to the daily or organizational level, to merging in additional variables, to generating data required for […]
Downloading Tweets, Take III – MongoDB
In this tutorial I walk you through how to use Python and MongoDB to download tweets from a list of Twitter users. This tutorial builds on several recents posts on how to use Python to download Twitter data. Specifically, in a previous post I showed you how to download tweets using Python and an SQLite […]
SQLite vs. MongoDB for Big Data
In my latest tutorial I walked readers through a Python script designed to download tweets by a set of Twitter users and insert them into an SQLite database. In this post I will provide my own thoughts on the pros and cons of using a relational database such as SQLite vs. a “noSQL” database such […]
Downloading Tweets – Take II
The goal of this post is to walk you through a Python script designed to download tweets by a set of Twitter users and insert them into an SQLite database. In a previous post I supplied a brief, temporary attempt at providing an overview of how to download tweets sent by a list of Twitter […]
Using Your Twitter API Key
Below is an embedded version of an iPython notebook I have made publicly available on nbviewer. To download a copy of the code, click on the icon with three horizontal lines at the top right of the notebook (just below this paragraph) and select “Download Notebook.” I hope you find it helpful. If so, please […]
Setting up Access to the Twitter API
The Twitter API (application programming interface) is your gateway to accessing Twitter data. The image above shows a screenshot of Twitter’s Search API, just one of the key parts of the API you might be interested in. To access any of them you’ll need to have a password. So, in this post I’m going to […]
Analyzing Big Data with Python PANDAS
This is a series of iPython notebooks for analyzing Big Data — specifically Twitter data — using Python’s powerful PANDAS (Python Data Analysis) library. Through these tutorials I’ll walk you through how to analyze your raw social media data using a typical social science approach. The target audience is those who are interested in covering […]