Are Your Defects Too Small to Log?
All testers have encountered this situation. At some point in the testing cycle, you notice a minor issue. Misaligned text, a button that’s not quite the right size, color is not pretty or any number of other bugs that don’t really affect functionality or may not even be client facing. Now you have to decide if you stop your functional or other test to spend the time to write up this trivial bug.
Some testers operate by the credo of logging every single bug, no matter how trivial. Others ignore all trivial bugs altogether. I believe there’s a happy medium, and most testers do operate within a balance between logging all trivial bugs and logging none, if they’re allowed to.
First, let’s be clear that neither way is more right or wrong than the other. But here are some things to consider when deciding whether or not to have your testers – or if you, if you’re the tester – to log every single bug, no matter how trivial. They might also help you prioritize the ones you do decide to log.
- Will it affect the user experience?
- Will a user even notice it?
- If I was a user would this minor issue bother me?
Once you’ve answered those questions, then consider the following. How much time will be spent logging the bug, prioritizing it, fixing it, and testing the fix? Is it worth that cost? Time is money, after all.
Some managers and developers can view testers as too focused on minor details if most of their time is spent logging trivial bugs. Much like people question police officers for focusing on minor, victimless crimes when much more significant ones need to be stopped, testers need to put things into perspective and focus on larger issues first.
I’m of the mindset that trivial bugs do need to be logged, but only after the major bugs have been found and fixed. While testing new functionality back in the days, I focused on the big issues. I made quick notations of trivial things to come back to later, but focus my time on the big things. Not wanting to slow down the testing and release process, I was waiting to log trivial bugs until the testing is nearly done and the product is close to a release. Time to market is the key. Making your product UI pretty instead of concentrating on functional or usability parts as a first priority is not ideal.
You don’t want to ignore the trivial bugs altogether. Doing so could result in an application with a bunch of minor issues that can start to add up and make your product seem unprofessional and sloppy. However, the time should only be spent on them after the big ones have been found and fixed. Help shorten testing cycles and keep them smoother by prioritizing which bugs you add and when. Thoughts?
About the Author
The author, Ruslan Desyatnikov, is the CEO & Founder of QA Mentor. He created QA Mentor to fill the gap he has witnessed in QA service providers during his near 20 years in QA. With Ruslan’s guidance, unique services and methodologies were developed at QA Mentor to aid clients in their QA difficulties while still offering a high ROI. Ruslan offers monthly seminars aimed at imparting his extensive testing knowledge that can be applied to start-ups as well as large companies. To learn more about QA Mentor and testing services please visit www.qamentor.com or contact Ruslan directly by sending email to rdesyatnikov@qamentor.com
Vice President - Digital Transformation Leader, specializing in mobile Apps, web Apps, IoT and AWS Cloud
10yYes, I expect every defect should be logged before my customer report them. But all depends on the stage of the product. If product is not launched then every defect is important with right PRIORITY and Categorization. If the product is very old and in production for many years then regression is very critical. It should not break the running functionality on wide variety of supported platforms (either mobile or browsers on different OS). Here QA Manager and Product Manager role become very important to set the target release of all identified defects based on business value.
Top Voice Badge QA professional helping software development teams to build quality , user friendly products | Occasional Blogger writing on different topics | Social Volunteer aiming to make world a better place to live
10yNice article giving great insights on the factors to be considered before logging such bugs. I completely agree on the above. As a tester we should not go for numbers instead we should go with business and end user sense to log a bug. Off-course every little things should be noticed and logged but this should be done once major's are identified and should be fixed accordingly.
MIS and network support at SANS
10yI usually log all kind of defects and especially small one
CEO | Inventor of HIST & Investigative Testing Methodology | QA Expert & Coach | CEO/CTO Advisor for Fortune 500 Companies | Author | Speaker | Investor | Forbes Technology Council | 450+ Clients |100+ Industry Awards
10yKobi, I agree with you on one hand that smaller cosmetic defects are easier to fix but again question is "Is it worth it?". 2 months ago we tested a web site for one of real estate agency after their rebuild their website where majority of testing was browser compatibility testing. One of the requirements was to test and certify IE7 browser. I raised a question how many users based on Google analytics accessing your older version of the web site from IE 7 browser and they said 2%. I stated that IE7 is no longer supported by Microsoft and you should not waste money for testing cycle in IE7 as 2% is so minimal to worry about and you can put annotation on your website which browsers should be used for best viewing. They still wanted us to test and certify in IE7 which we did by identifying 2 cosmetic issues with links overlapping and drop-down list cutting off on the side. After that, they decided to fix those 2 issues. They fixed it in 1 day and we successfully re-tested them. But when I asked my guys to re-test in IE11 version just to make sure nothing is broken we noticed that links which were fixed in IE7 were shifted to the left which looked very odd. They fixed now issue in IE11 but when we retested in IE7 the older issue reappeared again :) So they finally agreed to leave those defects identified n IE7 along and not bother anymore. So my point is although testers should be acting like a vacuum machine and report all issues regardless of severity if I will wear my Product owner hat I will make determination based on ROI and customer impact.