What is ATS?
The Axway Automated Testing System (ATS) is an internally developed testing framework widely used for the testing needs of most of the Axway products.
For those already aware of ATS features, you may go directly to the table of contents or check the release notes
Key features
- Easy to write and maintain automated tests. Understandable by both QA and developers
- Appropriate for variety types of functional and performance testing
- Separate components, or complete products, or products grouped as a bigger product can be tested
- Tests work on all platforms with (virtually) no change
- Support of distributed environments – it all works locally and remotely
- Comprehensive statistics about the system resource usage of the tested applications
- Consolidated reporting allowing easy test result analyzes
- Ability to freely mix ATS code with your own code
- Ability to plug in your own code, so it feels like it is part of ATS. For example you can use your own file transfer protocol or database
What kind of testing it is good at?
If we follow the naming conventions at https://en.wikipedia.org/wiki/Software_testing we can say that ATS falls in the following categories:
Testing levels
- Integration testing
- Component interface testing
- System testing
Obviously Unit testing is not a strong point and it should never be
Testing types
- Installation testing
- Smoke and sanity testing
- Regression testing
- Functional testing
- Performance testing(Load and Endurance)
Testing processes
- Agile or Extreme development model
- Waterfall development model
- Top-down and bottom-up
What can you do with ATS?
Unfortunately we cannot give both a short and detailed enough answer to this question, but still :
- Testing a software application involves interacting with that application and the environment it is living in. Some examples of such interactions are the following:
- File transfer over most popular protocols. You can also plug in support for your own protocol
- All kinds of actions on a file system
- Interactions with databases
- HTTP and REST operations. Good support for JSON and XML data
- Running external processes and analyzing the produced result
- Manipulating and sending complex mails
- Interacting with application through a standard UI(HTML, Mobile, Swing)
- Run your own test steps on a remote host as part of the whole test scenario
- Run your own test steps according to some load pattern to achieve the wanted load on the tested application. Monitor its performance meanwhile
ATS runs on Java
Java is good because:
- Java is very powerful. We can satisfy almost all ATS requirements using Java
- Java is cross-platform. That is why our test code almost always runs on any supported OS without changes
- There is plenty of third party free/open source products available which can be used to fight some though tasks. By reusing all this, ATS power can be used for fighting other tough tasks
But Java is bad because:
- Some QA people are concerned about Java because "Writing Java code can be difficult".
Well, we can show you difficult to understand and maintain code no matter the programming language.
We answer to this concern by being very careful when it comes to defining the public API of the framework. We always negotiate this process with our customers (the QA people) in order to give them the most user friendly API possible.
The result is test code which is usually very linear and it looks more like script rather than Java developers code.
Our goal is each test line to represents a single user step of the same test if it was performed manually.
A quick example
You can have a look at this short ATS video presentation
The test code itself is available here
A ready-to-use test project
For the impatient, we have create a VM image with a ready-to-use test project. Here is more info.
User Guide
Now as you strive to know more about ATS, you can dive into ATS examples and useful information
Retrieving the ATS artifacts
Here you can see the options
Building the ATS framework yourself
Here you can see the few short steps
Release notes
Here they are