Performance testing is a particularly common question in our experience with our clients and prospects. We have encountered situations where understanding what constituted good performance was not clear at the beginning of a test effort.
Benchmarking web services usually involved simulating lots of users and sending lots of messages to simulate a heavy production situation. Often we’re called upon to simulate production environments using our gateway, so we often become central to discussions around performance. Equally important is a desire to understand what statistics are available to measure, and what the relationship between them can be.
Key Performance Testing Metrics
We have identified key metrics that are used in various organizations as the most important statistics that are reported on. The reasons to choose one or the other vary but follow a short list of themes. Some organizations characterize one metric or another as being the key performance indication.