The Big Picture
How do You Define the Categories?
We have three categories of companies in the competition. Small is for companies under $100million in annual revenues. Medium is for companies from $100m to $999Million. Large companies are for those $1Billion and larger.
How Does the Judging Process Work?
Each entry is reviewed by a panel of five independent judges, using a scoring system that measures 25 different performance criteria. The sites with the highest scores in their category (Large Company Division, seven to eight awards; Small Company Division, one to two awards, depending on how many enter in each category) become the “Years Ten Best Web Support Sites.”
We’re a Tiny Division of a Big Company. What’s Our Category?
We only allow for total corporate revenues, so if you are owned by a larger company, that revenue is what counts. We do verify all small and medium entrants. How do we know if your parent company is slipping you some money on the side? We have to keep the competition equal.
How Many Companies Enter the Competition?
We’ve had winners from outside the U.S. in the past (including Canada, the U.K., Israel, Austria and Finland), and wed love to see more. Naturally, our judges may have a hard time evaluating your site if the text is in an obscure dialect of Klingon. But if even some of your site is in English, we can probably give it a fair review.
Do We Have to be ASP Members to Participate?
What About Overseas Entries?
Weve had winners from outside the U.S. in the past (including Canada, the U.K., Israel, Austria and Finland), and wed love to see more. Naturally, our judges may have a hard time evaluating your site if the text is in an obscure dialect of Klingon. But if even some of your site is in English, we can probably give it a fair review.
When is the Deadline?
In 2017, the deadline will be Friday, March 17. We can also accept late entries (with a late fee) during the following week. And, if we still have judges available, we may be able to process entries as much as two weeks after the deadline. But if youre going to be that late, check with us first. (By the way—the deadline is based on when WE receive the entry.)
Why do We Have to Write an Entry Essay?
The essay helps the judges understand why youve made specific design and implementation decisions about your site. This is a chance for you to explain your customers, the practical problems you faced, and your company priorities. Note that the information you provide in your essay represents 20% of the total points the judges can award for your site.
What’s the Purpose of the Challenges Part of the Essay?
This section explains how well you used your resources—people, money, technology—and your problem-solving insights. Many companies lose points on this section, by the way, by submitting public relations happy talk (“we strive to make our customers even more delirious with joy”). If you overhauled the site to fix lousy navigation or a defective search engine, say so.
What’s the Purpose of the Three Key Features Part of the Essay?
This section helps the judges identify features or areas of the site that they should look at most closely. Its a good idea to use this section to explain why you feel these features are exceptional, and perhaps to supply metrics and other background information for context.
How Long Can the Essay be?
Our judges used to complain that essays were sometimes too long to read. So were now imposing a strict limit of twelve pages (including a cover page) for the entire essay. Screen shots and charts should be placed with the text, and count as part of the twelve-page total. If you cant describe your biggest challenge and three key features in this space, youre probably trying to cram too much into what should be a simple document.
Can We Write About Something Other than Challenges and Key Features?
No. These components act as a very open-ended template. The judges refer to the essay to determine the scores they assign for the final five issues in the scoring system, so we need some standardization.
How do We Submit an Entry?
Please pay for your entry online Submit Your Site. Once you have paid, you will get the entry form emailed to you. Please submit your entry form and essay to Christi. Entry essays must be submitted as a single electronic file, PDF and Word. The entry form page should be a separate file, also in PDF format. You can find more information about this by checking the Entry Form.
What if We Send You a Hard Copy Entry?
We will lay it gently in the recycling bin and ask you to resubmit your entry as requested. We are not mailing hard copies to judges.
How do We Pay the Entry Fee?
Please pay for your entry on our website at Submit Your Site.
Our Site is Password-Protected. What do We do?
Well ask you to provide a generic password that we can pass on to the judges for the duration of the competition. (A generic password is easiest for us to administer, because judges are assigned randomly.) We also strongly encourage you to TEST the password you submit with your entry—surprisingly often, were given passwords that dont work, and this makes our judges cranky.
Judging and Scoring
How do We Find Out About the Scoring System?
Just download a copy of the Scoring Criteria document we give all of our judges. Our scoring system is completely open and transparent—you can see exactly what we look at and how many possible points we assign. (To the best of our knowledge, no other Web competition offers this much disclosure, by the way.)
Some of the Scoring Criteria don’t Apply to Our Site. Will We be at a Disadvantage?
No. In fact, weve never seen a site that excelled in all 25 of our performance metrics, or that even offered all of the features we measure.
Bear in mind also that our scoring system measures the quality of feature implementation, not just the checklist presence of a feature. A site that does an excellent job of implementing a shorter list of features will generally out-perform a site that does a poor job of implementing many features.
How Can a Small Company with Limited Resources Compete Against the Big Guys?
That’s why we have a Small, Medium and Large Company categories. The entries in each category compete only against each other to level the playing field.
Who are the Judges?
We recruit our judges primarily from the membership of the ASP—support managers, analysts, Web designers, consultants, and other support professionals. We try to find a broad mix of talents and expertise so that our evaluations will reflect many points of view. The majority of our judges have already helped with at least one previous “Best Sites” competition, so theyre pretty familiar with the scoring system and the challenges of Web support delivery.
Can Someone be a Judge if Their Company Also Enters the Competition?
Yes. We dont give judges their own sites to evaluate, of course. We also wont assign a judge to evaluate sites developed by direct competitors, clients, or former employers.
Will Your Judges Sign Non-Disclosure Agreements?
If thats a concern, let us know in advance and well select judges for your entry who will agree to swallow a cyanide capsule rather than disclose your secrets. (Please note that the entry materials you provide should not include confidential material, since we publish selections from the winning submissions after the awards are presented.)
How Long does the Judging Take?
If our judges all turn in their scores on time, well announce the winners by the end of May. The individual site evaluations will take two or three weeks to produce, and the “Years Ten Best Sites” book should be ready mid-July.
If you would like to receive notification by e-mail when this years edition of the book becomes available, join our ASP NEWS List.
Can We Find Out Where We Ranked?
No. We discourage the notion that Web support can be measured on a simple linear scale. We identify a group of ten companies that embody overall excellence and we show individual participants how they compare against category averages. Beyond that, we never disclose or publish individual rankings.
If We don’t Win, What Will We Get?
A lot. First, well show you how the judges scored your site in each of our 25 performance areas, and then compare these scores against category benchmarks to show your relative strengths and weaknesses. Well also show you the text comments that the judges made about your site. And youll get a complimentary copy of “The Years Ten Best Web Support Sites,” a book-length review of the years winners (a $300 value).
How Long Can I Display the Awards Logo?
Theres no limit (and no licensing fee, incidentally).
How much Visibility will the Winners Get?
For most winners, the most valuable publicity comes from posting our “award winner” logo on their support site, where it will be seen by customers and partners who visit the site. We also provide trophies that help remind your own support people about what a great job theyre doing. And we blitz the world with press releases, which occasionally produce stories about individual winners. At least one large PC manufacturer in Austin, Texas, now brags about “award-winning support” in their TV commercials, which suggests that winning this award can have serious marketing value.