Running a web office I see a lot of sites, quality assurance is part of every minute of my day. Everything I see goes through the same quality checks otherwise we don’t launch it. Tools and people will come and go, quality on the other hand is the one thing in a web office that is a constant. It’s the one think you should put all your focus on improving. If a project is delayed a week or two no one will mind six months from now, but if you sacrificed quality in the rush to launch six months from now the effects will still be noticed. Often you only have 10 seconds to impress your users.
I go through a few quality and consistency checks almost every day. Typically it’s the student assistants who are the worst offenders but even seasoned web workers make mistakes. It’s good to keep everybody on their toes and make sure the whole team (even if it’s just two of you) are aware when someone makes a mistake. It’s an opportunity for everyone to learn, not a platform to criticize.
Below are some testing patterns I use on a daily basis based depending on the stage of the project.
Navigation / User Experience
First and foremost I click every link possible. The LinkChecker plugin for Firefox is a must have but be careful, I’m not just looking for 404′s, it’s blank or incorrect content that I look for.
If the site is a redesign I make sure in the navigation there is also references to all the old URL’s for each new menu item. We do this as part of the navigation process so when the site is ready to launch we can create the redirect list quickly and painlessly.
For every one of our projects we create a list of user goals. These are the primary actions an ideal user should take for us to call them “successful”. This could be as broad as clicking to view the program list or as detailed as getting them to sign up for an open house. Regardless, for each user goal I create a step by step list of the pages and screens they would see to get to that goal. This way we can see them compared to each other and determine where we can optimize.
I love the five second test, I think it’s a great way to get immediate feedback from someone who has no vested interest in the site. It gives an objective view from an outsider with no repercussion of their thoughts and feelings, it’s as honest as you can get. Before showing mockups to a department or client I like to run a few of these, just to see how outsiders react and often it gives us data to back up our own opinions.
I then bring up the mockup and the actual coded site side by side and check to see if any details are missing. I’m not looking for pixel perfection but at the very least looking for the same colors, relative spacing and feel.
I typically have every different type of browser I can get my hands on open all the time. I <3 Spoon.net. From doing so much front end development I get use to the browser quirks, know how to spot them and know how to get around them. As IE 6 is fading it doesn’t mean you don’t still have to support it, it just means you support it in a different way. Make sure there are no peek a boo bugs or double margins. Developers should know better.
If there is an address or location making sure the HTML is correctly formatted with microformats. Although it might not be immediately apparent why they should be there, in the not so distant future they will be connecting information all over.
Making sure Google Analytics is set up and installed on every page prior to launch. If this is an existing site, make sure the same analytics id is installed on the new site. You want to have all the historical data you can get your hands on. In addition make sure all you filters and user goals are setup beforehand. You don’t want to loose those first time visitors when your new site gets announced.
Using the Webmaster Toolbar for Firefox the first thing I do is turn off CSS. Looking at the pure hierarchy of the page to make sure it makes sense. H2′s are nested under H1′s and skip to navigation and content links are in place and working.
Lastly I take a look at the whole user experience. What happens if someone hits a 404? Are they presented with a pretty page with navigation intact and a friendly error?
Using that redirect list I make sure to type in a few random old URI’s to make sure they forward to the right pages on the new site.
I also make sure any promotion areas, news or event lists have enough content in them to last for the next few weeks. This way as the department is fixing odds and ends they notice after launch they don’t have to worry about the small items that move over time. It’s won’t be cool two weeks in to see the site with blank areas where news or promotions should be.
Every one of our departments want a new site and they want it up as soon as possible. This is totally understandable but there is no need to sacrifice quality for speed. As Karlyn posted earlier this week, “Ultimately it’s what you deliver that matters.” Keep your quality standards high, so what if the department heads get a little annoyed, your users will thank you.
Photo by mollyjolly