PDi Survey Effectiveness Index ©

Meeting the Measurement Challenge
Making sure your survey investments are not going to waste

• 1.0 to 1.49 would average to a rating of 1 (Strongly Disagree)
• 1.50 to 2.49 would average to a rating of 2 (Disagree)
• 2.50 to 3.49 would average to a rating of 3 (Neutral)
• 3.50 to 4.49 would average to a rating of 4 (Agree)
• 4.50 to 5.0 favorable would average to a rating of 5 (Strongly Agree)

• Ratings 2.49 and below mean most respondents were disagreeing with positively worded PDi Survey Index© statements. This is a failure score, usually linked with a fatally flawed survey effort and requires major and immediate changes. This score means that an area(s) of survey effectiveness is failing.
• Ratings between 2.50 and 2.99 mean most respondents were neutral, and could not agree with positively worded PDi Survey Effectiveness Index© statements. This is a low score, and indicates an area in need of immediate improvement. This score means trouble, and serious change initiatives are necessary to salvage the survey effort.
  
• Ratings between 3.00 and 3.49 mean a small majority of respondents agreed with positively worded PDi Survey Effectiveness Index statements. This is a mediocre score, and indicates opportunities for improvement. Although somewhat adequate, this level of survey performance is not effective and merits change.
  
• Ratings between 3.50 and 3.99 mean most respondents agreed with positively worded PDi Survey Effectiveness Index statements. This is a positive score, usually indicating good performance. Enough respondents remain neutral or negative, however, to hold the mean score below 4.0 and to leave room for key refinements.
  
• Ratings above 4.00 mean most respondents agreed or strongly agreed with a positively worded statement. These are excellent to world class scores. Ongoing evaluation is recommended.

Category Scores

While the overall PDi Survey Effectiveness Index© rating is 3.44, each index category is somewhat different. The different types of categories in the PDi Survey Effectiveness Index© include:

1. Needs Analysis – Does the survey focus on important issues and real needs?
2. Sampling Strategy – Does the survey accurately capture the opinions of those it claims to represent, and provide verification of that fact?
3. Survey Design & Administration (Question Quality) – Is the survey reliable and valid (face, content and construct validity)? Has the survey been clearly explained and efficiently administered?
4. Survey Design & Administration (Survey Credibility) - Does the survey meet all research and statistical standards?
5. Survey Analysis & Feedback – Have survey results captured important information, and has that information been effectively communicated and shared?
6. Action Planning – Will action planning follow through on the survey findings and result in meaningful change?
7. Survey Synchronization (Customers) – Do different internal groups coordinate their survey efforts to improve?
8. Survey Synchronization (Internal Partners) - Can the results of different types of metrics be linked together for a comprehensive view of the organization?
9. Overall Survey Satisfaction – All things considered, is the survey effort worth the time and effort?
10. Respondent Trust- Do respondents trust that their individual responses will be kept confidential?

Mean ratings range from a low of 3.15 in Overall Satisfaction to a high of 3.72 in Needs Analysis. These category means are illustrated in boxplots, where the highlighted box represents the 25th to 75th percentile range, with the mean bar in the middle. These figures are based on the pretest results. Updated scores are available from PDi.