About

I made this as a personal project as a way to learn how to scrape in JavaScript and to learn D3.js. The categories of fish are defined by aquabid. Fish sales data is from aquabid.com and is updated each night at 12:30am

Notes

Currently the data being displayed for the closed auctions on aquabid, after selecting "view 1 previous day", includes sales that have been sold before their close date. This allows a single sale to remain as a data point for multiple days. This is fine for viewing trends, but not valid for any serious data analysis

As of January 2018, aquabid's robots.txt only prevents automated browsing on the "/cgi-bin/auction/vfb.cgi" pages. Presumably, this is to avoid automated bid making.

This page's github.

Raw data is available publicly from a Firebase with instructions on the scraper's github.