Comparing tools for acceptance testing of web apps


TextTest/WebUseCase

Exactor/ WebCommand

Fit/HtmlFixture

Selenium

Watir

Canoo

Test Language Type

Domain Language

Tool-defined

Tool-defined

Tool-defined (“Selenese”)

Programming Language (Ruby)

Tool-defined (in XML)

Test Persistence Format

plain text usecase script plain text logs

plain text script

script embedded in table

script embedded in table

Ruby script

XML file

HTTP mechanism

HtmlUnit

JWebUnit

HtmlUnit

Javascript engine with real browser

Drives Internet Explorer via DOM

HtmlUnit

Can record tests using the “browser”

Yes

No

No

No

No

No

Assertion mechanism

Comparison of logged data, both by “browser” and (maybe) server

hand-assertion of page contents

hand-assertion of page contents

hand-assertion of page contents

hand-assertion of page contents

hand-assertion of page contents

Code changes required to get started

domain names in 'title' attribute of HTML controls

None

None

None

None

None

Test Refactoring Support

Domain language composite files (cannot pass arguments)

Domain language composite files (can pass arguments)

None

None

Programming language : free refactoring

None

Integration with other tools

Parallel testing on grid (SGE or LSF) Bug-reporting (Bugzilla)

Continous integration (CruiseControl)

None

None

None

None