Interest in new mapper document?
Moderator: Moderators
-
- Posts: 5
- Joined: Sat Mar 20, 2021 6:49 am
Interest in new mapper document?
Not too sure if someone has done anything like this before or if there is any interest at all, but all the entries for the mappers for each NES carts I could find were the same text file. So, I took that and (I believe) accurately converted the raw text into csv, xlxs and json. If there's interest I would be happy to share (assuming that doesn't violate any terms).
Re: Interest in new mapper document?
You should really use our wiki instead of Firebug's and/or Disch's documents.
https://wiki.nesdev.com
https://wiki.nesdev.com
- Controllerhead
- Posts: 314
- Joined: Tue Nov 13, 2018 4:58 am
- Location: $4016
- Contact:
Re: Interest in new mapper document?
I'm working on something similar with the goal of a universal ASM6F template... and eventually more goals...
http://forums.nesdev.com/viewtopic.php? ... 92#p266362
I'd be interested to see what you came up with.
http://forums.nesdev.com/viewtopic.php? ... 92#p266362
I'd be interested to see what you came up with.
-
- Posts: 5
- Joined: Sat Mar 20, 2021 6:49 am
Re: Interest in new mapper document?
So that was my original plan, only I wasn't able to get a dump that i could manage nearly as easily (oddly) as the TXT file, which I have successfully converted to JSON and CSV for use in my powershell script. My concern would be with with accuracy of the datalidnariq wrote: ↑Sat Mar 20, 2021 12:28 pm You should really use our wiki instead of Firebug's and/or Disch's documents.
https://wiki.nesdev.com
Re: Interest in new mapper document?
Yes, there's a bunch of errors we've fixed in the multiple-decades-old mappers docs.
You can download a raw ("wikitext") version using the mediawiki API - mediawikiwiki: API:Get the contents of a page
You can download a raw ("wikitext") version using the mediawiki API - mediawikiwiki: API:Get the contents of a page
- Controllerhead
- Posts: 314
- Joined: Tue Nov 13, 2018 4:58 am
- Location: $4016
- Contact:
Re: Interest in new mapper document?
In that case, i've already "sanitized" a bunch of this data and have a work in progress JSON file. Here:lidnariq wrote: ↑Sat Mar 20, 2021 2:13 pm Yes, there's a bunch of errors we've fixed in the multiple-decades-old mappers docs.
You can download a raw ("wikitext") version using the mediawiki API - mediawikiwiki: API:Get the contents of a page
https://nesblast.com/NEStemplate/
https://nesblast.com/NEStemplate/mapper_data.json
Please note this work is incomplete. I don't like releasing incomplete things into the wild, but, it would be much easier than starting from scratch and (likely) repeating the same work that i have already done. Enjoy.
Last edited by Controllerhead on Sat Mar 20, 2021 3:25 pm, edited 1 time in total.
Re: Interest in new mapper document?
Occasionally I upload a dump of the wiki to my NESdev Wiki mirror.
-
- Posts: 5
- Joined: Sat Mar 20, 2021 6:49 am
Re: Interest in new mapper document?
Awesome, thanks all for the resources, these will work great
Re: Interest in new mapper document?
This is great stuff. I think anything that visually shows things is much better than only text.Controllerhead wrote: ↑Sat Mar 20, 2021 2:43 pm i've already "sanitized" a bunch of this data and have a work in progress JSON file. Here:
https://nesblast.com/NEStemplate/
https://nesblast.com/NEStemplate/mapper_data.json
Please note this work is incomplete. I don't like releasing incomplete things into the wild, but, it would be much easier than starting from scratch and (likely) repeating the same work that i have already done. Enjoy.
-
- Posts: 5
- Joined: Sat Mar 20, 2021 6:49 am
Re: Interest in new mapper document?
If there is any interest in my json or my Powershell script, see below. Note this can work with any json file assuming it has the correct headers. If there's any interest, I may expand to include other consoles. This was mainly a POC/test project for generating an intractable GUI interface in powershell. It's very much a work in progress.
https://github.com/jamjen831/dumpScriptAssist
https://github.com/jamjen831/dumpScriptAssist
- Controllerhead
- Posts: 314
- Joined: Tue Nov 13, 2018 4:58 am
- Location: $4016
- Contact:
Re: Interest in new mapper document?
Thanks =) I'm glad you enjoyed it!
It makes fighting with HTML Tables and sanitizing much of this data by hand all worth it. I did it mostly to get a birds eye view of the mapper situation myself: it's fun using the up/down arrow keys to cycle through them. I guess i'm glad i didn't let it die a lonely death on my hard drive like thousands of other things =p
It's really all of the hard work and research of the NESdev community here: I just dolled it up a bit.
Unfortunately, much of this data is still a mess, which is why i was reluctant to release it, but, i'm excited to see what eyebreakstuff can come up with as far as automatically parsing what is on the wiki. Writing web crawlers or powershell scripts isn't my specialty per-se, i honestly just threw Lidnariq's HTML tables in a JSON formatter and did the rest by hand: I hope my incomplete work-in-progress here can help.
The wiki is an absolutely wonderful resource, but, from a software perspective, sanitized data is powerful. If we can generate graphics, well, we can generate other things: The eventual plan here is to generate ASM6F templates for mappers: gathering valid hardware configurations as well as register locations to write mapper dependent macros to handle them. Perhaps emulator authors could benefit from a standardized mapper handling format as well.
...It would be great for say, an NES game engine, to support multiple mappers, wouldn't it? =)
-
- Posts: 5
- Joined: Sat Mar 20, 2021 6:49 am
Re: Interest in new mapper document?
So I love the idea of scraping the wiki, but is I cannot for the life of me find any page(s) that contain this info
Re: Interest in new mapper document?
What is "this" info?
Re: Interest in new mapper document?
And why would one want to scrap the best NES development wiki on the internet?
Re: Interest in new mapper document?
Because english spelling is terrible. (Scraping is the participle of "scrape". "scrapping" would be the participle of "scrap")