chat-🎮 Claude's Game Knowledge Taxonomy.md

USER

We want to programmatically probe the game-specific knowledge of different instruction-trained LLMs. We want a large and diverse question collection. Large is easy to measure, but diversity is more tricky. To get diversity, we can check for the distribution of questions across some common vocabulary of categories. Depth categories (from Bloom’s Taxonomy):

• Knowledge (recall)

• Comprehension (understand)

• Application (solve a new problem)

• Analysis (identify relationships)

• Synthesis (build something new)

• Evaluation (make judgements given criteria)

Content categories:

• Lore

• Controls

• Item / Character / Location

• Strategies

I like how the depth categories are systematic being based on BT, but I feel like my content scheme is mis-named, incompleted, and unsystematic.

ASSISTANT

You're right that your content categories could benefit from a more systematic approach. Let's refine them to create a more comprehensive and well-structured taxonomy for game-specific knowledge.

Revised Content Categories for Game Knowledge

Game Mechanics

• Rules and systems
• Controls and interface
• Game physics/simulation properties
• Progression systems (leveling, skill trees, etc.)

Game Content

• Characters (playable and non-playable)
• Items and equipment
• Locations and environments
• Quests and missions

Game Context

• Narrative and lore
• World-building and setting
• Timeline and history
• Factions and relationships

Meta-Game Knowledge

• Strategies and tactics
• Optimization and efficiency
• Community conventions
• Updates and patches history
• Developer intentions/design philosophy

This revised structure offers several advantages:

1. It's more systematic, with clear category boundaries
2. It's comprehensive, covering most aspects of game knowledge
3. It's hierarchical, allowing for subcategories within main categories
4. It separates in-game knowledge from meta-knowledge
5. It works across different game genres

When combined with your Bloom's Taxonomy depth categories, you'll have a robust two-dimensional framework for classifying questions and ensuring diversity in your collection.

USER

nice, for each category and subcategory of Claude’s Taxonomy here, give a question (but not answer) for Earthbound, Super Metroid, and Pokemon Red

ASSISTANT

Questions by Claude's Game Knowledge Taxonomy

Game Mechanics

Rules and systems

• Earthbound: How does the rolling HP meter function during battles?
• Super Metroid: What happens when Samus' energy drops to zero while in the water areas of Maridia?
• Pokémon Red: How is a Pokémon's catch rate calculated when using different types of Poké Balls?

Controls and interface

• Earthbound: What button combination allows you to check the map while exploring?
• Super Metroid: How do you perform the "shinespark" technique after storing a speed boost?
• Pokémon Red: How do you access the PC storage system from within a Pokémon Center?

Game physics/simulation properties

• Earthbound: What determines whether an enemy gets a surprise attack on your party?
• Super Metroid: How does the game calculate damage when Samus uses the Screw Attack against different enemy types?
• Pokémon Red: What factors determine which Pokémon moves first in a battle turn?

Progression systems

• Earthbound: How does the game determine when a character learns a new PSI ability?
• Super Metroid: What criteria must be met to unlock the various suit upgrades throughout the game?
• Pokémon Red: What are the experience point thresholds for leveling up Pokémon in the "Fast" growth category?

Game Content

Characters

• Earthbound: What is the relationship between Pokey and Picky Minch?
• Super Metroid: Who is the baby Metroid that Samus encounters, and why is it significant?
• Pokémon Red: How does Professor Oak relate to your rival character?

Items and equipment

• Earthbound: What effect does the Casey Bat have compared to other weapons?
• Super Metroid: What is the difference between Super Missiles and regular Missiles?
• Pokémon Red: What are the effects of using a Rare Candy on a Pokémon?

Locations and environments

• Earthbound: What makes Moonside different from other areas in the game?
• Super Metroid: How does the environment in Norfair affect Samus without the proper suit upgrade?
• Pokémon Red: What unique properties does the Safari Zone have compared to other areas?

Quests and missions

• Earthbound: What must you do to gain entry to the Tenda Village?
• Super Metroid: What sequence of events must occur to escape Zebes in the final countdown?
• Pokémon Red: What are the requirements to encounter Mewtwo in Cerulean Cave?

Game Context

Narrative and lore

• Earthbound: What is the significance of the "Your Sanctuary" locations in the game's story?
• Super Metroid: What is the history between Samus Aran and Ridley?
• Pokémon Red: What is the backstory of how Mewtwo was created?

World-building and setting

• Earthbound: How does Eagleland relate to real-world America?
• Super Metroid: What is the ecological relationship between the Metroids and the planet Zebes?
• Pokémon Red: How do Pokémon fit into the ecosystem and society of the Kanto region?

Timeline and history

• Earthbound: What events from EarthBound Beginnings (Mother) are referenced in EarthBound?
• Super Metroid: Where does Super Metroid fit chronologically in relation to the original Metroid and Metroid II?
• Pokémon Red: What historical conflict is mentioned involving Pokémon that occurred before the events of the game?

Factions and relationships

• Earthbound: What is the Happy Happy Religious Group and what are their objectives?
• Super Metroid: What is the relationship between the Space Pirates and the Chozo?
• Pokémon Red: What is Team Rocket's organizational structure and ultimate goal?

Meta-Game Knowledge

Strategies and tactics

• Earthbound: What strategy can players use to defeat Giygas in the final battle?
• Super Metroid: What is the optimal route for a 100% item collection speedrun?
• Pokémon Red: What team composition is most effective against the Elite Four?

Optimization and efficiency

• Earthbound: What is the most efficient way to grind for experience points?
• Super Metroid: How can players optimize their movement to perform a wall jump consistently?
• Pokémon Red: What is the most efficient method to raise a Pokémon's Special stat?

Community conventions

• Earthbound: What nickname has the community given to the "Sanctuary Boss" in Lumine Hall?
• Super Metroid: What terminology do speedrunners use for the technique of bypassing the Ice Beam requirement?
• Pokémon Red: What is the community-named "MissingNo" glitch and how is it performed?

Updates and patches history

• Earthbound: What differences exist between the Japanese Mother 2 release and the American EarthBound version?
• Super Metroid: What bugs were fixed in the PAL version of Super Metroid compared to the NTSC release?
• Pokémon Red: What changes were made in Pokémon Red version 1.1 compared to the initial release?

Developer intentions/design philosophy

• Earthbound: What real-world experiences did Shigesato Itoi draw upon when creating the game's themes?
• Super Metroid: How did the developers intend players to discover the secret techniques like wall jumping?
• Pokémon Red: What was Game Freak's design philosophy behind limiting players to carrying only six Pokémon?