Learn About Our Meetup

4500+ Members

[P] Ball & beam gym – control theory lab simulations as Open AI gym environments

While trying out reinforcement learning I built some custom ball & beam environments since I was already familiar with it from control theory labs. I built it as a first order system where the angle of the beam is under full control (did not want to spend time simulating a motor). So it can be baselined by using a simple PID controller.

There are currently environments for three objectives:

  • Balancing – just keeping the ball on beam
  • Setpoint – keeping the ball as close as possible to a setpoint
  • Throw – throwing the ball as far as possible to the right

The environments have two different state spaces. The agent can either use key-variables (position, velocity, angle) or the images from the visualization as state space.

Hope someone else wants to try it! 🙂

submitted by /u/lilsmacky
[link] [comments]

Next Meetup




Plug yourself into AI and don't miss a beat