A console tool for scraping the official Stardew Valley Wiki and serializing it into a JSON object for Enchiridion Reader.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Claire 142eca5c15 Added readme 2 years ago
Scripts Added LINQPad script for merging infobox and navbox scripts 4 years ago
StardewScraper Added LINQPad script for merging infobox and navbox scripts 4 years ago
.gitignore Initial commit 4 years ago
LICENSE Added readme 2 years ago
README.md Added readme 2 years ago
StardewScraper.sln Initial commit 4 years ago

README.md

StardewScraper

This is .NET console program which uses the MediaWiki Action API to retrieve data from the official Stardew Valley wiki. The program works by retrieving JSON data objects via the API, and parsing those objects for relevant information in the infobox section of each page. Because the JSON returned from the MediaWiki API is very polluted, this program makes heavy use of regular expressions (regex) to extract the relevant information.

It also exports everything to a JSON text file for use elsewhere (like Enchiridion Reader, an ongoing project I have yet to release publicly).

Notes

I have not updated this script since 2020, and there have been several major game updates since then. It's possible (maybe even probable) that it will still successfully scrape data, but it may miss entirely new types of data.

If/when I get back into my other project, I'll be updating this script to work with the latest game data.