. | Section | Category | Comments | 0 (major deficiencies) | 1 (minor deficiencies) | 2 (no deficiciencies) | 3 (exceptional) |
. | Survey building | Question types | This refers to the different kinds of questions that are available (e.g. "select one", "select multiple", "free response", etc.) | Missing core question types (e.g. no "select one") | Includes basic question types (select one, select multiple, free response). | …plus advanced question types such as grids, visual analog scales, etc. | …plus ability to include multimedia (images, video, etc.) in questions, ability for respondent to upload files |
. | Validation | Ability to create validation rules for user input | No validation | Basic validation (number vs. text) | Advanced validation (ability to distinguish between an integer, currency, and a phone number for example); email validation | ...plus full customizability of validation with regular expressions or similar | |
. | Ease of use | Generally how easy is it to create a survey through the software's website? | Very difficult to perform basic survey building tasks (e.g. inserting new question). Requires viewing help documents to use basic functions. | Inefficient question building (e.g. unnecessary extra clicks to add questions, unnecessary animation). | User can build survey quickly and without instruction. No unnecessary clicking or confusing user interface elements. | Survey building is very quick (e.g. can be done completely from the keyboard without the mouse) | |
. | Survey logic | i.e. skip patterns, skip logic, display logic, etc. | No survey logic | Basic survey logic (e.g. only possible to skip between pages) | Able to skip both individual questions and entire pages; can chain skip logic (e.g. if Q1=yes and Q2=no). Can display data from prior questions in question descriptions. | …plus ability to use external data in survey logic (e.g. prior data about respondents) | |
. | |||||||
. | Email distribution | Importing respondent information | Importing email addresses and other respondent information (name, occupation, etc.) from an external data source | No ability to import | Can import limited data (e.g. only name and email) | Can import arbitrary data for each respondent in addition to name and email | …can display imported information in survey questions. |
. | Distribution via email | Sending survey links via email | No ability to distribut survey via email | Emails custom links but no personalization | Personalized email (e.g. "Dear John,") with custom link | …plus ability to send HTML email, customize templates | |
. | Followup via email | No ability to send target followups | Targeted followups but no personalization | Personalized, targeted followup email | …plus ability to send HTML email, customize templates | ||
. | Tracking | No ability to track clicks | n/a | Tracks clicks on cusotmized links (you know who opened link) | …plus email delivery and/or open tracking | ||
. | |||||||
. | Responding | Themes | Refers to look/feel of survey as displayed to respondents | No ability to change themes | Themes are limited or poorly designed | Multiple, well-designed themes with the ability to customize through the admin interface | …plus ability to include arbitrary HTML/CSS/JavaScript |
. | Domain name | The domain name used for responses should be sensible and not look weird to respondents. Research.net is good; superfunfreesurvey.info is bad. | Domain has a non-standard TLD (e.g. .info vs. .com/.net), or is generally unprofessional | Domain name is ok but not great (e.g. uses name of company; survey companies have weird names) | High quality domain name (e.g. research.net, or company's domain name isn't weird) | Ability to use custom domain name or choose from multiple high quality domains | |
. | White label | Ability to remove all logos/branding of the survey software | No white label option | Ability to remove some but not all branding, or requires manual customization of themes | Ability to remove the majority of branding (e.g. can remove logo but not small footer text) | Fully white label (no branding whatsoever) | |
. | Survey completion page | It is good to have control of what happens after the respondant finishes the survey. This is usually a "thank you for responding" page with some degree of customization. | n/a | Generic "survey completed" screen without the ability to customize | Survey completed screen with customized text | …plus ability to redirect to any URL | |
. | Mobile support | Does not have mobile-specific formatting | Mobile-specific formatting but some bugs that make completing the survey difficult | Mobile-specific formatting | Fully responsive layout (works on phones, tablets, small laptop screens, etc.) | ||
. | |||||||
. | Analysis/exporting | Viewing data online | This is not critical because we can always export the data, but it is nice to be able to see summary metrics (e.g. # responses) and to see the distributions for responses to each question. | No ability to see survey data online (e.g. must export) | Limited ability to see response rate and survey data online | Can see response rate and distributions of responses for each question. | …plus advanced data analsysis features, good visualizations, or anything else that makes looking at data online better/easier. |
. | Exporting | No ability to export | Can export but can't export to CSV | Export to CSV | …plus export directly to one or more statistics packages. | ||
. | |||||||
. | General | Documentation | Online help/documentation for creating surveys, managing admin accounts, etc. | None | Some online documentation; limited or not searchable | Searchable online documentation | ...plus contextual integration with the admin interface (if you have a question about a feature, there's a link next to it with help) |
. | Support | No way to talk to a human | Support is additional cost | Free email/web-based support | ...plus free phone support | ||
. | API | Way for programmers to interface with the survey software | No API | Limited API (e.g. can only create responses but cannot create new questions) | Full API (majority of features through web interface can be accessed through API) | ...plus RESTful/JSON interface (not XML or less friendly interface) | |
. | SSL | aka bank-level encryption, prevents data from being intercepted between your computer and their servers | No SSL or certificate error | Some SSL (e.g. only for responses but not for creating survey) | n/a | SSL used throughout |