Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[P] pytorch-fuzzdom: Write browser tests without DOM specifics

The goal of the project is to let developers write automated browser (ie selenium) tests that have no specific DOM knowledge of the target application. The idea is to reduce the need to rewrite these tests when the underlining DOM implementation changes. To accomplish this an RL agent trained on the Miniwob++ dataset to map user specified actions to a series of DOM events. The agent is exposed through a familiar `ActionChains` interface that ques up actions to be performed in a browser.

One notable difference from prior approaches is the utilization of the DOM as graph data. This uses pytorch-geometric to represent both the state space and the available action space. This allows the agent to work with a variable number of nodes and actions.

Github: https://github.com/zbyte64/pytorch-fuzzdom
Current status: The model after a day of training should converge on ~10 of the 16 tasks. I am about to have less free time to work on this so I am making it public now.

submitted by /u/zbyte64
[link] [comments]