Daily Archives: February 13, 2021

Saving space in large git repositories

In mid-2017 I set up an automated scrape of a frequently-updated website. Every day my script would crawl the website, download its contents, and commit these to GitHub. This allowed me to back up not just the site contents but the complete history of changes. This scrape did its thing for nearly 4 years until […]

Posted in Uncategorized | Leave a comment