I wrote this to log all pixels from /r/place. At the time, I thought I could do some cool stuff with all the data, so I wrote this tiny scraper to get data from the WebSocket connection and log it to a sqlite3 database. However, I did not really expect the massive popularity of /r/place - in retrospect, sqlite didn't work out, and couldn't keep up with the load.
Even though the data was very incomplete, I was able to make some cool visualizations with it, like this heatmap on Tableau Public.
In addition, the export_png.js
script can generate PNGs from the /r/place canvas at any time it has scraped, so I made a timelapse of the data I had:
git clone https://github.com/wgoodall01/place.git
cd place
npm install
npm install -g pm2
pm2 start --name "place" index.js
It also works without pm2, but there are some fun metrics you would miss out on.
place
tablebitmap
tableRun ./export_csv.sh
, and assuming you have sqlite3 in your system path it will dump the whole place
table into a export-${timestamp}.csv