In software testing, test automation (which includes automated test execution) is one or more of the following tasks:

• Using purpose-built software tools to control and set up test preconditions
• Executing tests
• Comparing actual outcomes to predicted or expected outcomes

Test automation is expected to help run many test cases consistently and repeatedly on different versions of the SUT and environments.

Before we can build our test automation framework, let's first know about its objectives, advantages, and disadvantages first.

Objective of test automation:

• Improving test efficiency
• Providing wider function coverage
• Reducing the total test cost
• Performing tests that manual testers cannot
• Shortening the test execution period
• Increasing the test frequency/reducing the time required for test cycles

Advantages of test automation:

• More tests can be run per build
• The possibility of creating tests that cannot be done manually (real-time, remote, parallel tests)
• Tests run faster
• Tests are less subject to operator error
• More effective and efficient use of testing resources
• Quicker feedback regarding software quality
• Improved system reliability (e.g., repeatability, consistency)
• Improved consistency of tests

Disadvantages of test automation:

• Additional costs are involved
• Initial investment to setup TAS
• Requires additional technologies to build TAS
• Tester team needs to have development and automation skill
• On-going TAS maintenance requirement
• Can distract from testing objective since testers focus on automating tests cases
• Tests can become more complex due to the test automation script
• Additional errors may be introduced by automation

Keywords

TAS : Test Automation Solution
SUT : System Under Test

When we consider investing in Test Automation, one thing we have to keep in mind is that test automation has its limitations and these are the limitations of test automation.

Limitations of test automation:

• Not all manual tests can be automated
• The automation can only check machine-interpretable results
• The automation can only check actual results that can be verified by an automated test oracle
• Not a replacement for exploratory testing

If you are interested in implementing test automation project, let's get started with me by building a test automation framework from scratch with Pytest, and Python selenium with my upcoming blog. Build A Test Automation Framework with me from Scratch, with Pytest, Python Selenium, Page Object Model, and HTML Reports. Knowing what to do and what not to do in a test automation project.

Reference: The above theories were quoted from the International Software Testing Qualifications Board Advanced Level Syllabus: Test Automation Engineer version 2016