Rigorous Testing

by admin on December 17, 2009

I recently implemented a software release with a significant bug in it. Does this mean my testing approach is flawed?

This weekend I implemented a minor enhancement to the Metrici Advisor service. The enhancement added some new features to assessment forms. I had followed our testing procedure thoroughly, the new version passed all the tests, and I put it live.

I was emailed on Saturday morning by one of our more active users. The assessment form, when accessed from one part of the system, did not work at all.

This particular way of accessing the form is not heavily used, and it fails so gracefully that it is not obviously an error. I do not suppose anybody else had really noticed. The bug itself was trivial to fix – I had missed out a single line on a configuration file. But that is not the point. I still managed to put in a version with a significant bug, and my testing did not catch it.

I was concerned by this. Does this bug suggests that we should change our testing approach?

Related Posts

Leave a Comment

*