[P] pytorch-fuzzdom: Write browser tests without DOM specifics
The goal of the project is to let developers write automated browser (ie selenium) tests that have no specific DOM knowledge of the target application. The idea is to reduce the need to rewrite these tests when the underlining DOM implementation changes. To accomplish this an RL agent trained on the Miniwob++ dataset to map user specified actions to a series of DOM events. The agent is exposed through a familiar `ActionChains` interface that ques up actions to be performed in a browser.
One notable difference from prior approaches is the utilization of the DOM as graph data. This uses pytorch-geometric to represent both the state space and the available action space. This allows the agent to work with a variable number of nodes and actions.
Github: https://github.com/zbyte64/pytorch-fuzzdom
Current status: The model after a day of training should converge on ~10 of the 16 tasks. I am about to have less free time to work on this so I am making it public now.
submitted by /u/zbyte64
[link] [comments]