AWbot connects to your web site and make URL requests like any other visitors.
AWBot is not a web indexing robot but a web client tool that emulate some visitors browsing on your web site to test its stability after a development change, to test its reliability and/or response to heavy load.
You choose which pages you want to test in a test/config file (parameters in URLs or forms can be easily supplied).
Then you can launch AWbot as often as you want to test your site, get benchmarks information or make some load benchmarking (AWBot can be launched with several simultaneous process).
AWBot is GPL.