Blog

Learn About Our Meetup

4500+ Members

[R] Using Fractal Neural Networks to Play SimCity 1 and Conway’s Game of Life at Variable Scales

Workshop paper at AIIDE 2019 Experimental AI in Games

http://www.exag.org/papers/EXAG_2019_paper_21.pdf

Abstract:

We introduce gym-city, a Reinforcement Learning environment that uses SimCity 1’s game engine to simulate an urban environment, wherein agents might seek to optimize one or a combination of any number of city-wide metrics, on gameboards of various sizes. We focus on population, and analyze our agents’ ability to generalize to larger map-sizes than those seen during training. The environment is interactive, allowing a human player to build alongside agents during training and inference, potentially influencing the course of their learning, or manually probing and evaluating their performance. To test our agents’ ability to capture distance-agnostic relationships between elements of the gameboard, we design a minigame within the environment which is, by design, unsolvable at large enough scales given strictly local strategies. Given the game engine’s extensive use of Cellular Automata, we also train our agents to “play” Conway’s Game of Life – again optimizing for population – and examine their behaviour at multiple scales. To make our models compatible with variable-scale gameplay, we use Neural Networks with recursive weights and structure – fractals to be truncated at different depths, dependent upon the size of the gameboard.

Associated project:

https://github.com/smearle/gym-city

submitted by /u/hardmaru
[link] [comments]

Next Meetup

 

Days
:
Hours
:
Minutes
:
Seconds

 

Plug yourself into AI and don't miss a beat

 


Toronto AI is a social and collaborative hub to unite AI innovators of Toronto and surrounding areas. We explore AI technologies in digital art and music, healthcare, marketing, fintech, vr, robotics and more. Toronto AI was founded by Dave MacDonald and Patrick O'Mara.