capability
Do Selection, Assessment And Performance Evaluation Well
Every serious book on the subject, in one place — the model, the playbook, and a way to measure yourself.
The Bicycle method · plain language
How this guide was built
There's no single author here, and that's the point. We read every serious book on this subject cover to cover, pulled out the working model buried in each one, and combined them into one — keeping what the experts agree on, and being honest about where they disagree. Then we checked the claims against the research and built the tools and self-checks you'll find below. So you get the real, whole answer on the subject, and can see the book behind every point.
Convergence/divergence measured across the reconciled model.
The shoulders it stands on
Not one author — many. Each source, in brief. (The same bio & abstract appear on that book's profile.)
263074003-Competency-Dictionary
This book This document equips managers in the State System of Higher Education to run a rigorous, behavior-and-results-based performance appraisal and development process. Built on Hay/McBer competency research, it defines nineteen management competencies—each with a graduated scale of observable behaviors calibrated to four levels of organizational contribution—alongside step-by-step instructions for setting SMART goals, conducting mid-cycle reviews, and rating both results and competencies. It translates System strategy into accountable, measurable individual objectives, establishes a common set of behavioral expectations aligned with System values, and provides a shared yet locally flexible framework for attracting, developing, retaining, and rewarding high-quality managers.
A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
Ian Taylor M.BThis book Written for busy HR and recruitment practitioners who suspect interviews alone can't reliably identify the best candidates, this practical guide demystifies assessment centres and equips readers to introduce them with minimal fuss. Grounded in occupational psychology research yet stripped of jargon, it explains why work samples and behaviour-based methods out-predict interviews and personality tests, provides a ready-to-use competence framework, and walks through every step from selling the concept to skeptical line managers, to training assessors, to interpreting psychometrics, to running dozens of tried-and-tested activities (role plays, in trays, analytical exercises, and group tasks). The book's central insight—that behaviour is observable, controllable, and predictive while values, motives, and personality are not—reframes selection as a science of watching what people actually do, giving readers the confidence and tools to make fairer, more defensible, more cost-effective hiring and development decisions.
Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
Robert EdenboroughThis book In a world where poor hiring decisions cost organisations hundreds of percent of a salary and performance is often managed through gut feel and informal ritual, Robert Edenborough's 'Assessment Methods in Recruitment, Selection and Performance' delivers a unified, evidence-based framework for understanding people at work. Drawing on over 40 years of applied experience—from selecting barmen to astronauts—Edenborough walks managers and HR professionals through the history, science, and practice of psychometrics, assessment centres, and structured interviews, showing how these three disciplines form a joined-up system for predicting and managing human performance. The book demystifies statistical concepts like validity, reliability, norms, and correlation, explains the legal and ethical landscape from data protection to equal opportunities, and provides practical guidance on competency modelling, exercise design, assessor training, 360-degree feedback, coaching, and the use of technology. It culminates in cutting-edge applications including team assessment for major organisational change and HR due diligence in mergers and acquisitions—making it essential reading for anyone who wants their people decisions to be as rigorous as their financial ones.
Competency Mapping and Assessment Manual - User Guide
This book Written by seasoned HR consultant Indranil Gupta, this user guide demystifies the full lifecycle of competency-based talent management—from understanding what a competency is (tracing its Latin and French etymology, McClelland's iceberg model, and Bloom's taxonomy) through building a competency dictionary, constructing behavioral and technical frameworks, running rigorous Assessment and Development Centers, conducting Behavioral Event Interviews, and linking all of these tools to recruitment, performance management, learning and development, succession planning, and reward systems. Packed with real-world examples, BARS scales, the Johari Window, ethical guidelines for assessors, and sample AC designs, the book equips HR practitioners to independently build objective, data-driven systems that replace gut-feel decisions with evidence-based evaluations of both visible skills and deeply hidden motivational drivers.
HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
Harvard Business ReviewThis book Traditional annual performance reviews are increasingly under fire: they consume enormous time, generate stress, and rarely improve results in today's fast-paced, knowledge-driven organizations. This collected HBR guide reframes performance management as an ongoing, flexible discipline in which managers set clear-but-adaptive goals, provide frequent feedback grounded in facts rather than assumptions, coach employees through questions rather than answers, develop people via stretch assignments and tailored learning, motivate through recognition and intrinsic rewards, and lead teams by building explicit goals, roles, and rules of conduct. Drawing on decades of HBR research and expert practitioners, it equips managers to boost engagement, retain top talent, turn around underperformers, and produce better outcomes—while treating the 'people side' of work with the same rigor as the tasks themselves.
HBRs 10 Must Reads on Performance Management
Harvard Business ReviewThis book Traditional annual performance reviews are widely despised, time-consuming, and increasingly out of step with modern work, yet they persist. This collection of ten essential HBR articles diagnoses why legacy appraisal systems fail—their fixation on ratings, financial rewards, and past behavior—and lays out a practical blueprint for reinvention. Drawing on companies from Deloitte and GE to Wells Fargo, Alaska Airlines, IBM, and Telstra, the book shows how to replace once-a-year ratings with frequent check-ins, avoid the traps of surrogation and bias, use people analytics ethically, design metrics that foster rather than kill collaboration, retain top talent through job sculpting, break the boss-driven set-up-to-fail syndrome, and create the conditions for employees to thrive. It equips managers and leaders to build performance systems that improve current results while developing the workforce their organizations need for the future.
Hiring Success The Art and Science of Staffing Assessment and Employee Selection
Steven HuntThis book Staffing assessments—personality measures, ability tests, background checks, structured interviews, and work simulations—are used to evaluate millions of job candidates each year, yet few people understand how they actually work or why they outperform intuition-based hiring. Written by industrial-organizational psychologist Steven Hunt, Hiring Success bridges the gap between dense scientific research and oversimplified vendor white papers, offering a thorough but accessible explanation of assessment science. The book shows that human behavior is remarkably consistent over time, which is why well-designed assessments can predict future job performance months or years in advance far more accurately than unstructured interviews or resume reviews. It walks readers through what assessments measure (what candidates have done, can do, and want to do), how to evaluate their validity and business value, how to answer common criticisms, and how to integrate assessments into hiring processes for both entry-level and professional jobs. The result is a practical toolkit for anyone who wants to hire better employees while treating candidates fairly.
How to Measure Employee Performance (The performance management series)
Jack ZigonThis book Clear expectations are one of the most reliable levers for improving employee performance, yet most organizations struggle to define what 'a good job' looks like for jobs in R&D, marketing, HR, and customer service. Jack Zigon's How to Measure Employee Performance distills 23 years of consulting into a practical, seven-step process: review organizational goals, identify a position's customers and their needs, list the results (not activities) the job produces, weight those results by importance, create general and specific measures, set numeric ranges and descriptive goals, and design a lightweight tracking system for feedback. Backed by 40 real-world example performance plans across dozens of job families, the guide turns vague duties into verifiable, observable measures—giving employees the feedback they need to self-correct and giving managers a fair, focused basis for evaluation and reward.
Job analysis a guide to assessing work activities
Gael, SidneyThis book Job Analysis: A Guide to Assessing Work Activities is a comprehensive, hands-on manual for anyone who needs to understand and document exactly what tasks are performed in specific jobs and how workers perform them. Drawing on decades of U.S. Air Force research and AT&T's development of the Work Performance Survey System (WPSS), Sidney Gael walks the reader through the entire lifecycle of a job analysis project: planning and managing the effort, deriving accurate task statements, writing well-structured questionnaires, interviewing incumbents and supervisors, distributing and collecting surveys, computerizing and analyzing the data, and interpreting the results to support training, selection, job design, and job evaluation. Assuming no prior experience, the book provides concrete guidelines, examples, and even a complete computer user manual, plus a shortcut version for small organizations. It is the rare 'how-to' text in a field where procedural guidance is scarce, enabling readers to produce objective, accurate, and complete information about a job or set of jobs with minimal reliance on consultants.
Managing Staff Selection and Assessment (Managing Work and Organizations Series)
Paul IlesThis book Most textbooks treat staff selection as a technical problem of measuring the right traits accurately; Paul Iles' book breaks decisively from that view by presenting selection and assessment as a strategically vital, socially constructed, and politically charged activity. Weaving together four disciplinary paradigms—American strategic management, differential psychology's psychometrics, European social psychology's social process model, and Foucauldian critical discourse theory—Iles shows how assessment can drive organizational and cultural change, how it is shaped by national and cultural context, how it profoundly affects candidates' self-perceptions and careers, and how it operates as a technology of organizational power. Grounded in real case studies (building societies, IT firms, banks, a Finnish paper multinational) and international comparative research, the book culminates in a rich analysis of managerial competence, revealing both the promise and the limits of competency frameworks. It is essential for anyone who wants to manage assessment thoughtfully rather than merely administer tests.
Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
This book This handbook is the definitive reference for anyone who wants to understand the full landscape of personnel assessment and selection. Edited by Neal Schmitt and written by leading industrial-organizational psychologists, it traces the field from its origins around 1900 through modern web-based, global, and team-based selection challenges. It systematically covers the individual-difference constructs that predict performance (cognitive ability, personality, interests, physical ability, self-evaluations), the methods used to measure them (interviews, biodata, simulations, self-reports, individual assessment), the multidimensional criteria that define job performance (task, contextual, counterproductive, turnover, adaptability, safety), and the societal and organizational constraints (legal, cultural, strategic, diversity, applicant reactions) that shape what selection systems can and should do. Combining rigorous validation theory (validity generalization, meta-analysis, job analysis) with practical guidance on implementing and sustaining selection programs, it equips researchers and practitioners to build defensible, valid, and context-sensitive selection systems.
Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
Gary CokinsThis book Gary Cokins contends that most organizations are data rich but information poor, drowning in transactional data yet unable to translate strategy into results because their improvement programs—balanced scorecards, activity-based costing, six sigma, lean, CRM—operate as disconnected silos. 'Performance Management' reframes these familiar methodologies as interlocking gears of one overarching discipline that gives managers and employee teams the visibility, fact-based data, and analytic intelligence to align daily work with executive strategy, make better trade-off decisions, and ultimately convert customer value into shareholder wealth. Drawing on decades of consulting in cost management and industrial engineering, Cokins offers a practitioner's synthesis—strategy maps for focus, scorecards for communication and feedback, ABM for reliable cost and profit truth, and data warehousing/analytics as enablers—showing that technology is no longer the impediment; the thinking is. The book equips readers to escalate managing from an apprenticeship-based craft into a formal, systems-thinking discipline.
Management: Tasks, Responsibilities, Practices
Peter F. DruckerThis book Gary Cokins argues that most organizations are 'over-managed but under-led,' able to formulate strategy but failing to execute it. In this conversational, example-rich compilation, he demolishes the narrow view that performance management equals scorecards plus budgeting and instead presents it as an umbrella framework integrating strategy maps, balanced scorecards, activity-based costing, customer value management, rolling forecasts, enterprise risk management, human capital analytics, and predictive analytics—all mounted on a common business-intelligence platform. The payoff is an organization that can anticipate, react, and respond faster and smarter, aligning employee behavior with strategy, understanding which customers and products truly earn money, and converting potential value into realized shareholder wealth. Whether you are a newcomer or a seasoned practitioner, the book shows not just what and why, but how—including how to overcome the human resistance to change that dooms most implementations.
Management: Tasks, Responsibilities, Practices
Peter F. DruckerThis book Performance Management translates the rigorous science of Applied Behavior Analysis into a hands-on 'how-to' technology for managers, supervisors, and students who want to bring out the best in people while generating the highest value for their organizations. Drawing on more than four decades of field experience across thousands of workplaces and over thirty countries, Aubrey Daniels and Jon Bailey show that all organizational results are the product of human behavior, and that behavior is controlled far more by its consequences than by the antecedents (goals, memos, training, threats) most managers rely on. The book walks readers step-by-step through pinpointing behaviors and results, measuring and graphing performance, analyzing the ABCs and PIC/NIC patterns that explain why people do what they do, and above all delivering positive reinforcement effectively and on the right schedule. It debunks common management myths—that punishment works, that money alone motivates, that competition and forced-ranking appraisals improve performance—and demonstrates through data-driven case studies how frequent, contingent, positive consequences produce dramatic, sustainable gains in productivity, quality, safety, and morale.
GUIDELINES - Testing and Assessment
This book Michael Armstrong's Performance Management distills decades of research and practice into a clear, actionable framework for turning the discredited annual appraisal ritual into a living, continuous process of dialogue, agreement, measurement, feedback, and development. Drawing on surveys from the CIPD, IRS, e-reward and Lawler & McDermott plus rich case studies (Halifax BOS, Pfizer, Raytheon, Standard Chartered, the Scottish Parliament), the book shows how to set integrated objectives, agree role profiles and performance measures, review and assess performance fairly, improve individual, team and organizational results, link (or deliberately decouple) performance from pay, use 360-degree feedback, and embed performance management through the committed involvement of top managers, line managers, employees and HR. It is both strategic and eminently practical, offering checklists, forms, guiding principles and evaluation methods for anyone introducing or improving a performance management system.
Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
This book Personnel Selection: Adding Value Through People distills a century of research on how employers pick staff, showing that employees vary enormously in value and that good selection therefore pays for itself many times over. Mark Cook systematically evaluates every major selection method — interviews, mental ability tests, personality questionnaires, biodata, assessment centres, references, work samples, emotional intelligence and more — against six criteria: reliability, validity, fairness, acceptability, cost and practicality. Drawing on meta-analysis and validity generalization, the book cuts through folklore (graphology, unstructured interviews, faith in plausible salespeople) to reveal what genuinely predicts performance and why, while candidly addressing the legal minefield of adverse impact and the diversity-validity dilemma. For HR professionals, psychologists and managers, it is both a rigorous scientific reference and a practical guide to building selection systems that are accurate, defensible and value-adding.
Personnel Selection and Assessment
Heinz Schuler James L. Farr Mike SmithThis book For decades personnel selection research optimized only the organization's cost-benefit calculus, treating job candidates as objects to be measured rather than as people whose perceptions, reactions, and welfare matter. This volume, assembled from an international conference of distinguished applied psychologists, systematically restores the individual side of the selection ledger. It introduces the organizing concept of 'social validity'—the degree to which selection situations offer information, participation, transparency, and feedback—and marshals empirical and theoretical chapters spanning recruitment, interviews, assessment centers, job analysis, motivational distortion, performance appraisal, feedback, fairness, team-based criteria, computer-assisted assessment, and complex problem solving. Read it to understand why technically valid procedures still fail, how applicant reactions shape utility, and how organizations can build human resource systems that are simultaneously competitive and humane.
Personnel Selection in Organizations
Neil Schmitt, Walter C. BormanThis book Personnel Selection in Organizations gathers sixteen original chapters by leading scholars to move the science and practice of employee selection beyond dust-bowl empiricism toward a coherent, theory-driven model. It reconceives job analysis and content validity as construct-linkage problems, offers an explicit theory of individual job performance, expands the criterion domain to include contextual (citizenship, prosocial) performance, scrutinizes predictor constructs (interviews, personality, biodata, assessment centers, computerized tests), and treats validity as a unitary process of building inferential linkages between predictor and performance constructs. It also confronts the human and organizational context—fairness and legal pressures, applicant reactions and gaming, the economic utility of selection, selection OUT (firings, layoffs, retirement), small-sample settings, changing demographics, and staffing as competitive strategy. Together the chapters argue that better selection requires understanding WHY procedures work, not merely THAT they work.
Selection-Assessment-Methods
This book Organizations spend fortunes recruiting talent yet often select employees using haphazard, informal methods that fail to predict who will actually perform well. This concise, evidence-based guide by leading selection expert Elaine Pulakos dispels common myths about employment testing and demystifies the technical, legal, and measurement issues that scare HR professionals away from formal assessments. It surveys the full menu of proven assessment tools—cognitive ability tests, personality tests, structured interviews, work samples, assessment centers, situational judgment tests, biodata, integrity tests, and physical tests—and shows how each stacks up on four critical criteria: validity, adverse impact, cost, and applicant reactions. Grounded in job analysis and meta-analytic research, the book gives readers a practical roadmap for choosing the right combination of assessments for any job while balancing predictive power against legal risk and workforce diversity, delivering millions in productivity gains and cost savings.
Standardized Survey Interviewing - Minimizing Interviewer Error
This book Standardized Survey Interviewing distills decades of methodological research into a clear, actionable framework for treating survey interviewing as rigorous scientific measurement rather than art. Fowler and Mangione document precisely how interviewers—through the way they read questions, probe answers, record responses, relate to respondents, and set performance standards—can inflate standard errors, reduce reliability, and bias estimates. Drawing on a large-scale experiment testing interviewer training and supervision plus a rich body of prior research (notably Cannell's work), the authors show which levers actually matter: writing questions that can be asked and answered consistently, training respondents in their role, communicating high accuracy standards, selecting and training interviewers, and—critically—supervising the question-and-answer process via tape recording and monitoring. The book is essential for anyone who collects quantitative data from people, offering cost-effective, empirically justified strategies to produce more valid and precise survey estimates.
Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
Bernard MarrThis book Bernard Marr argues that most organizations fail at performance management because they fall into three traps: an incomplete, one-sided view of strategy; measuring what is easy rather than what matters; and using measures to control people like machines. Strategic Performance Management offers an integrated alternative that unites market-based and resource-based strategic analysis into a 'value creation map' and 'value narrative,' then guides readers to design relevant performance indicators (not just measures), and to embed them in an 'enabled learning environment' where indicators inform learning, dialogue, and better strategic decisions. Rich with real-world case studies (DHL, Novo Nordisk, Fujitsu, Shell, TT Club, the UK Home Office) and templates for identifying value drivers, designing indicators, assessing risk, and evaluating mergers, the book shows how to move from management-by-numbers to management-by-insights and make strategy everyone's everyday job.
Structured_Interviewing_Raising
This book For decades, the employment interview has been condemned by researchers as unreliable, invalid, subjective, and legally vulnerable. This study demonstrates that structuring the interview through six concrete steps—job-analysis-based questions, identical questions for every candidate, anchored rating scales, a trained interview panel, consistent administration, and rigorous attention to fairness and documentation—transforms the interview into a psychometrically sound selection device. In a field study of 149 entry-level production hires, the structured interview achieved high interrater reliability (r = .88), strong predictive validity (corrected r = .56), demonstrated fairness for minorities and women, and produced substantial economic utility. The technique's validity rivals or exceeds paper-and-pencil cognitive aptitude tests and far exceeds the traditional interview (mean r = .14), while offering managers an involving, defensible, and credible role in hiring. This is essential reading for anyone who selects employees and wants to keep the interview they love while giving it the rigor of a test.
The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
Kasey Harboe Guentert, Mollie BerkeThis book Written by two industrial-organizational psychologists with nearly 40 combined years of consulting and in-house experience, The Hiring Handbook demystifies the science of talent selection and packages it into an accessible, self-service guide for HR leaders, hiring managers, entrepreneurs, and small business owners. It argues that a well-structured, human-led interview—grounded in a rigorous job analysis—remains the single best predictor of job performance, even in the age of AI. The book walks readers through a simple 'order of operations': first understanding the job (job analysis and job profiles), then designing structured, job-relevant questions and assessment methods, and finally evaluating candidates objectively against pre-defined criteria using clear rating scales. Along the way it tackles bias, cognitive errors, cheating, legal and privacy considerations across the US, Europe, India, and China, and the responsible use of generative AI. The result is a rigorous yet friendly resource that turns hiring from a costly, gut-driven guessing game into a fair, consistent, and defensible competitive advantage.
The Performance Appraisal Tool Kit
This book Performance reviews are universally dreaded, dismissed as a bureaucratic paper chase used only to justify a 3 percent raise. This book argues that the problem isn't the review itself but the outdated, generic, one-size-fits-all form and the flawed assumptions behind it. Falcone and Tan reframe performance appraisal as a living, breathing, customizable process—a strategic scorecard for an organization's most critical asset, its human capital. Through six essential steps, they show you how to set a strategic vision, design a template matched to your company's stage of growth, craft content descriptors that raise expectations, gain employee buy-in, roll up scores into an enterprise dashboard, and reinvent the program year after year. Along the way they demystify compensation mechanics (compa-ratios, salary matrices, pay-for-performance), teach calibration to fight grade inflation, and tie individual scores through 9-box succession models all the way up to CEO-level strategy. The result is a 'consultant in a box' that turns a tired annual ritual into a competitive advantage and a career-making leadership tool.
Understanding performance appraisal social, organizational, and goal-based perspectives
Murphy, Kevin R., 1952-, Cleveland etc.This book Murphy and Cleveland overturn decades of measurement-focused performance appraisal research by arguing that raters are not passive measurement instruments but active agents pursuing goals within a rich organizational context. Using a four-component model (rating context, performance judgment, performance rating, and evaluation), they show why apparent 'errors' like leniency and halo are often sensible, adaptive responses to organizational pressures rather than cognitive failures. Drawing on social, organizational, and cognitive psychology, they explain how context shapes rater goals, how judgments differ from recorded ratings, and how appraisal systems should be designed around the compatible goals of key constituencies rather than an abstract ideal of accuracy. The book offers a goal-oriented framework for designing, implementing, and evaluating appraisal systems and 53 concrete directions for research and practice, making it essential for anyone who wants to understand why appraisal so often fails and how to make it useful.
Who The A Method for Hiring
Geoff Smart Randy StreetThis book Who argues that the most important decisions managers make are not 'what' decisions but 'who' decisions—who they put in place to run sales, build products, and lead. Drawing on ghSMART's work on over 12,000 hiring decisions, interviews with more than 80 billionaires and CEOs, and the largest-ever statistical study pairing CEO assessments with financial performance, Geoff Smart and Randy Street expose the failure of intuitive 'voodoo hiring' methods and replace them with the A Method for Hiring. The book walks readers through building a Scorecard that defines the mission, outcomes, and competencies of a role; systematically Sourcing candidates through referrals; Selecting them through four structured interviews (screening, Who, focused, and reference); and Selling the right person on joining using the five F's (fit, family, freedom, fortune, fun). Practical, story-rich, and research-backed, it shows any manager how to raise their hiring success rate to 90 percent and, in doing so, make more money, enjoy more time, and build a winning team.
Author bios & book abstracts are single-source (keyed by library id) — authored once, rendered here and on each book profile.
Movement I
Orient
Do Selection, Assessment And Performance Evaluation Well, by design — validity as a learnable capability, not a knack.
Why do selection, assessment and performance evaluation well matters, and where mastering it takes you.
- — The one-line promise and the story behind it
- — Why we read the whole shelf, not one book
Do Selection, Assessment and Performance Evaluation Well
The need-to-know
The degree to which an assessment measures the intended construct and accurately predicts future job performance or other criteria.
The story · before you read a word of advice
The hero
You are building a real capability: Do Selection, Assessment And Performance Evaluation Well.
The problem — felt outside, and in
- Outside · Validity / Predictive Accuracy erodes when it is left to instinct instead of method.
- Inside · You were taught the moves piecemeal, never the whole model.
The plan
- 1Master job & role analysis / requirement definition.
- 2Master competency / criterion framework quality.
- 3Master assessment / activity method design & choice.
If nothing changes
You stay dependent on instinct, and it fails you when the stakes are highest.
Success
Validity / Predictive Accuracy becomes something you produce by design, not by luck.
Why the Bicycle
We read the whole shelf
Not one author's opinion. We read every serious book on this, pulled out the working model inside each, and reconciled them into one — so you get the field, not a hot take.
Ideas you can test
We turn each idea into something you can measure, then check it against the research — so what you're told is verifiable, not just plausible.
Every claim shows its source
You can always see which book a point came from and how strong the evidence is behind it. No hand-waving.
Set the record straight
What the field gets wrong
The misconceptions the books in this field converge on correcting.
Experienced managers can accurately size up candidates through unstructured interviews and gut instinct.
Unstructured interviews and intuition are weak, bias-prone predictors; structured interviews grounded in job analysis with standardized questions and anchored scoring achieve validity comparable to ability tests and are far more accurate.
Performance is simply the measurable results (outputs) an employee achieves.
Performance is both results AND behaviours/competencies (a 'mixed model'); both must be assessed.
A once-a-year formal appraisal with ratings is a sufficient, fair, and objective way to manage performance.
Performance management is a continuous, forward-looking, developmental process; frequent feedback and coaching throughout the year matter far more than a single annual rating event, and ratings often reveal more about the rater than the ratee.
Cognitive/mental ability tests are unfair, biased rationing devices with little real link to work; above a threshold most people perform equally.
General mental ability is the strongest single predictor of job performance across almost all jobs, with a continuous linear ability-performance relationship; its genuine issue is adverse impact, not validity.
Personality questionnaires are useless in selection because candidates can simply fake their answers.
Well-designed personality measures (especially conscientiousness) predict performance modestly; most applicants don't radically fake, and faking has smaller effects on validity than assumed—though the bigger limit is modest validity for job proficiency.
Fairness and validity are technical, psychometric properties of a test, and a valid selection process automatically benefits everyone equally.
Fairness and acceptability are social, value-laden constructs shaped by process, transparency, and stakeholders; the most valid predictors often produce adverse subgroup impact, forcing efficiency-equity tradeoffs and value judgments.
When an employee underperforms, it is essentially the employee's fault.
Bosses often unwittingly co-create poor performance through the set-up-to-fail syndrome, low expectations, excessive control, unclear goals, or bad processes.
Academic qualifications, aptitude/knowledge tests, and years of experience are reliable predictors of job success.
These surface-level inputs are weak predictors; hidden traits (motives, self-image) and properly chosen psychometric measures predict superior performance far better, and experience is an input, not a behavioural output.
If an assessment looks job-relevant and has a plausible name, it must predict performance.
Face validity means nothing; validity is a justified inference from scores to job behaviour that must be established with actual criterion/content data and theory (all validation is essentially construct validation).
Validity is a fixed property of a test, established locally by a single criterion correlation, and is method-specific.
Validity generalizes across settings for many predictors (much variation is statistical artifact), and methods like interviews or simulations can measure many constructs—validity depends on constructs, not the method label.
Assessment is a neutral, objective measurement that predicts performance without affecting the person, and selection is a one-way organizational choice.
Assessment is a two-way, negotiated social and political process that shapes candidates' identities and careers; equality, diversity, and the applicant's own perspective must be built into every stage.
An Assessment Centre is a physical location or a simple pass/fail test consisting of 'stupid games,' and is only useful for recruitment.
An assessment centre is a multi-technique, multi-assessor behavioural methodology that fairly assesses job-relevant behaviours and integrates across the whole employee lifecycle for both selection and development.
Some jobs simply can't be measured, and you should measure the activities employees perform.
Any job can be measured through observable, verifiable outputs; measure the value-added results left behind, not activity, since activity without results is not what the organization pays for.
If you can't measure something quantitatively it doesn't count, so measure everything.
Many meaningful contributions (behaviours, intangibles) must be assessed qualitatively; over-quantification and measuring everything easy while ignoring what matters creates burden and dysfunctional gaming.
Antecedents (goals, training, threats, motivational speeches) plus punishment and high stretch goals are the most effective ways to drive performance.
Consequences maintain behaviour, not antecedents; positive reinforcement builds performance while punishment and forced-distribution/internal competition create fear, resentment, and mediocrity.
A manager's job is to motivate their staff, and positive encouragement always motivates best.
Motivation is internal; the leader's job is to create an environment where people motivate themselves, and experts specifically seek constructive negative feedback to improve.
Job analysis can be skipped or done loosely, and written job documents describe what workers actually do.
Systematic job analysis is essential and must flow into questions and evaluation; documents describe expected—not actual—activities and must be verified through interviews and observation.
Performance appraisal is fundamentally a measurement problem, and better scales, training, or accuracy will fix it.
Appraisal is primarily a goal-directed social and communication process; rater 'errors' reflect unwillingness (adaptive responses to organizational pressure), and usefulness to stakeholders matters more than context-free accuracy.
The immediate supervisor is the natural and sufficient sole source of appraisal.
No single source has access to all relevant information; multiple sources are often needed for accurate and useful appraisal.
Appraisal data automatically provide the accurate information needed for internal selection and development decisions.
Appraisal data are widely inaccurate, incomplete, and inadequate; psychometric assessment often supplies information unavailable from any other internal source.
Adding more tests and procedures always yields more information about a candidate.
Redundant or poorly chosen tests generate noise, not signal; a test's value depends on its overlap with the competency domain, not on quantity.
Assessment centres are too costly and time-consuming to justify.
Utility analysis shows the value gap between good and poor performers plus the hidden costs of mis-hires far outweigh the modest extra resources of a well-run centre.
Graphology is a valid personality assessment technique comparable to psychometrics.
Graphology has no scientific validation and non-graphologists predict as well as graphologists.
Integrity tests are useless because candidates misrepresent themselves.
Meta-analytic evidence shows integrity tests validly predict job performance and counterproductive behaviours.
Using selection tests creates legal problems rather than solving them.
Informal methods carry the same adverse-impact legal burden; well-validated formal assessments are the best legal defence and best practice.
Assessments are barriers designed to screen people out and are unfair, and applicants will fake their way through self-reports.
Assessments provide the most objective, consistent way to give candidates opportunities based on true potential, and well-designed tools retain substantial predictive value despite faking.
Every manager should aim for the highest behavioural level on every competency, and goals should be built around the person.
The aim is a role-appropriate behavioural profile, and goals must be set to the needs and requirements of the position, not the person.
Performance goals should be perfect targets (zero errors, 100%) and everything should be labeled high priority.
Use ranges (reserving perfection only where no error is tolerable) and percentage weights totalling 100 to force real prioritisation and differentiate performers.
Movement II
Map
The reconciled model behind the topic — and what mastery looks like as you climb.
How the pieces fit together — the model, and what good looks like at each altitude.
- — 36 constructs and how they connect
- — The keystone: validity
- — Foundations → Practitioner → Advanced
▸ Foundations & Requirements3
▸ Assessment Methods3
▸ Measurement & Tracking3
▸ Development & Feedback2
▸ Rewards & Team Setup2
The constructs
How they connect (44)
- Job & Role Analysis / Requirement Definition → enables → Competency / Criterion Framework Quality
- Job & Role Analysis / Requirement Definition → enables → Assessment / Activity Method Design & Choice
- Job & Role Analysis / Requirement Definition → produces → Validity / Predictive Accuracy
- Competency / Criterion Framework Quality → produces → Observable Behaviour / Construct Coverage
- Assessment / Activity Method Design & Choice → produces → Validity / Predictive Accuracy
- Structure & Standardization of Procedure → produces → Reliability / Inter-Rater Consistency
- Structure & Standardization of Procedure → enables → Validity / Predictive Accuracy
- Assessor/Rater Training & Calibration → produces → Reliability / Inter-Rater Consistency
- Assessor/Rater Training & Calibration → moderates → Rater Bias & Evaluation Error
- Rater Bias & Evaluation Error → moderates → Reliability / Inter-Rater Consistency
- Reliability / Inter-Rater Consistency → enables → Validity / Predictive Accuracy
- Validity / Predictive Accuracy → produces → Rating / Selection Decision Quality
- Rating / Selection Decision Quality → predicts → Individual / Job Performance
- Validity / Predictive Accuracy → enables → Fairness, Adverse Impact & Legal Defensibility
- Goal Setting & Objective Alignment → produces → Goal Clarity & Shared Expectations
- Goal Setting & Objective Alignment → enables → Motivation & Engagement
- Feedback & Coaching → produces → Self-Awareness & Skill Growth
- Feedback & Coaching → enables → Motivation & Engagement
- Feedback & Coaching → enables → Accountable & Productive Work Behaviour
- Development Planning & Capability Building → produces → Self-Awareness & Skill Growth
- Reward, Recognition & Compensation Linkage → enables → Motivation & Engagement
- Motivation & Engagement → produces → Accountable & Productive Work Behaviour
- Accountable & Productive Work Behaviour → produces → Individual / Job Performance
- Strategic Alignment & Shared Understanding → enables → Accountable & Productive Work Behaviour
- Measurement / Scorecard System → enables → Strategic Alignment & Shared Understanding
- Enabling Data, Analytics & Technology → enables → Rating / Selection Decision Quality
- Candidate/Applicant Reactions & Perceived Fairness → moderates → Rating / Selection Decision Quality
- Candidate/Applicant Reactions & Perceived Fairness → enables → Organizational Utility & Financial Value
- Applicant Faking / Truthful Disclosure → moderates → Validity / Predictive Accuracy
- Candidate Attributes / KSAOs → predicts → Individual / Job Performance
- Person-Role / Culture Fit → predicts → Individual / Job Performance
- Individual / Job Performance → produces → Organizational Utility & Financial Value
- Individual / Job Performance → produces → Sustainable Organizational Performance
- Motivation & Engagement → produces → Retention & Talent Growth
- Fairness, Adverse Impact & Legal Defensibility → enables → Organizational Utility & Financial Value
- Organizational & Environmental Context → moderates → Validity / Predictive Accuracy
- Organizational & Environmental Context → moderates → Individual / Job Performance
- Organizational & Environmental Context → moderates → Rating / Selection Decision Quality
- Leadership Support, Manager Capability & Buy-In → moderates → Performance Management Process Design
- Leadership Support, Manager Capability & Buy-In → enables → Strategic Alignment & Shared Understanding
- Leadership Support, Manager Capability & Buy-In → moderates → Feedback & Coaching
- Performance Management Process Design → enables → Goal Clarity & Shared Expectations
- Rater Bias & Evaluation Error → moderates → Rating / Selection Decision Quality
- Observable Behaviour / Construct Coverage → produces → Validity / Predictive Accuracy
The model, read as a role
The Validity Operator
Do Selection, Assessment And Performance Evaluation Well
What you own
- ▪Job & Role Analysis / Requirement Definition. Systematic, ideally future-oriented identification of a role's critical tasks and the KSAOs, competencies, and outcomes required, forming the foundation for criteria, predictors, and scorecards.
- ▪Competency / Criterion Framework Quality. The degree to which the model of what is being assessed consists of specific, observable, job-relevant, culturally appropriate behavioral indicators, competencies, or performance factors.
- ▪Assessment / Activity Method Design & Choice. Decisions about which assessment methods (interviews, work samples, tests, assessment centres) to use and how they are constructed, standardized, and grounded in job analysis.
- ▪Structure & Standardization of Procedure. The extent to which content, administration, questioning, scoring, and combination of information are standardized across candidates/respondents to minimize discretionary variation and bias.
- ▪Assessor/Rater Training & Calibration. Provision of tailored, practice-heavy training and rater alignment developing observation, recording, coding, neutral feedback, and calibration skills to reduce idiosyncratic error.
- ▪Goal Setting & Objective Alignment. Setting clear, measurable, achievable goals cascaded from and aligned with organizational strategy, giving a clear line of sight for individuals and teams.
How success is measured
- ✓Validity / Predictive Accuracy. The degree to which an assessment measures the intended construct and accurately predicts future job performance or other criteria.
- ✓Reliability / Inter-Rater Consistency. The consistency and agreement with which different raters or occasions yield the same rating from the same evidence.
- ✓Rating / Selection Decision Quality. The accuracy of the recorded rating or selection decision in matching individuals to roles and correctly identifying future high performers, reflecting private judgment.
- ✓Individual / Job Performance. The quality, timeliness, and value-added impact of an employee's work outcomes and behaviours relative to goals and expectations.
What it takes
- ▪Rater Bias & Evaluation Error. Systematic distortion in assessment from cognitive/social biases, stereotypes, cultural-fit judgments, idiosyncratic rater tendencies, and gut-level judgment.
- ▪Observable Behaviour / Construct Coverage. The degree to which assessment elicits and records what candidates actually say and do (behavioural evidence) across the relevant construct domain rather than inferred states.
- ▪Strategic Alignment & Shared Understanding. The extent to which individual/team behaviour, priorities, and effort are congruent with strategy and employees understand how their work contributes to strategic objectives.
- ▪Goal Clarity & Shared Expectations. Employees' shared understanding of what results, behaviours, and standards are expected and what meets versus exceeds performance.
- ▪Motivation & Engagement. Employees' internal drive, commitment, and psychological investment in work, energized by recognition, autonomy, challenge, meaning, and reinforcement.
The reconciled model, rendered as a job description — a scanning device that makes the guide's ideas read as a role you could hold. A deterministic transform of the factor model; nothing added.
What good looks like · the climb from zero to great
The path from starting out to expert
Mastery isn't one leap — it's four stages, and the honest part is the move between them: what actually separates the next level, and what it takes to get there. Find where you are, then read what's above you.
Starting out
Define what you are actually measuringnew to it — knows the words, not yet the work
What it looks like- Writes down the role's critical tasks and required KSAOs before opening a req or drafting an appraisal form
- Lists observable, job-relevant behaviours rather than vague traits like 'good attitude'
- Sets basic individual goals and states expected results, even if not yet cascaded from strategy
- Records what candidates actually said and did instead of relying only on gut impressions
Moving from knowing what to measure to administering it consistently and comparably across people, so ratings reflect the candidate rather than the rater
- Which assessment methods (interviews, work samples, tests, assessment centres) fit which constructs
- How standardization of content, administration, and scoring reduces error variance
- Common rater biases (halo, similarity, leniency, cultural-fit) and how faking distorts self-report
- Constructing behaviourally anchored scoring guides tied to the job analysis
- Running calibration sessions that align raters on the same evidence
- Conducting evidence-based feedback conversations from recorded behaviour
- Attentive observation and accurate real-time behavioural recording
- Consistency and discipline in following a fixed protocol
- A structured interview/scoring template and note-capture tools
- Willingness to constrain personal discretion in favour of procedure
Foundational
Build the structured, standardized proceduredoes the basics reliably, by the book
What it looks like- Chooses assessment methods grounded in the job analysis and constructs them consistently
- Uses standardized questions, administration, and scoring across all candidates
- Trains and calibrates raters so different assessors reach similar ratings from the same evidence
- Runs regular feedback conversations backed by recorded behavioural evidence
Consistent ratings become evidentially accurate ones — proving the process predicts performance and is demonstrably fair and legally defensible, not merely repeatable
- Validity types (content, criterion, construct) and how to accumulate evidence for each
- Adverse impact analysis, the four-fifths rule, and legal defensibility standards
- Psychometric properties, norm groups, and ethical test-use limits
- Linking predictor scores to criterion outcomes and interpreting the relationship
- Building weighted scorecards that distinguish meets from exceeds
- Translating assessment results into development plans, reward differentiation, and fit decisions
- Quantitative reasoning about prediction, error, and group differences
- Judgment to weigh competing evidence into a defensible decision
- Access to performance criterion data and psychometrically sound instruments
- Ethical commitment to fairness over expedient shortcuts
Proficient
Make it valid, fair, and decision-readygood — adapts to context, gets consistent results
What it looks like- Demonstrates that assessments predict actual job performance and defends validity evidence
- Uses psychometric tools and norms ethically and within their validity limits
- Monitors adverse impact and produces decisions that withstand legal and fairness scrutiny
- Produces accurate rating/selection decisions and links performance to development, reward, and retention
Optimizing an individual assessment becomes engineering a whole system aligned to strategy that delivers demonstrable organizational value and sustainable performance across context
- How scorecards cascade from strategy and how surrogation corrupts metrics
- Utility analysis, retention economics, and the business case for people systems
- How context (culture, legal regime, labour market, remote work, life-cycle) shapes design choices
- Securing senior-leader and line-manager buy-in and driving change management
- Deploying people analytics and predictive intelligence ethically
- Running single/double-loop learning to question assumptions and redesign the system
- Systems thinking that reconciles trade-offs across selection, PM, reward, and culture
- Strategic foresight about future capability and workforce needs
- Organizational mandate and cross-functional stakeholder relationships
- Analytics and HR-systems infrastructure with governance for ethical data use
Expert
Align the whole system to strategy and valuegreat — sets the standard, reconciles the hard trade-offs
What it looks like- Cascades scorecards and effort to strategy and secures visible leader and line-manager buy-in
- Uses analytics and double-loop learning to validate assumptions and avoid gaming or metric surrogation
- Adapts assessment/PM design to organizational context, life-cycle, labour market, and team composition
- Demonstrates net financial utility and sustainable high-performance culture with strong retention
Movement III
Master
The load-bearing sections — worked in the order you grow into them — plus the playbook and where the field disagrees.
How to actually do it — section by section, with the playbook.
- — 36 sections in journey order
- — Frameworks, checklists, and worked cases
Starting out
Define what you are actually measuringmoderate · 6 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Selection-Assessment-Methods
- Structured_Interviewing_Raising
- Job analysis a guide to assessing work activities
- Management: Tasks, Responsibilities, Practices
This section shows you how to elicit and record what candidates actually do and say across the full construct domain, rather than scoring inferred traits or impressions. It links behavioral evidence to defensible ratings.
Observable Behaviour / Construct Coverage
Assessment goes wrong the moment a rater writes down a conclusion instead of an observation. "Confident" is a conclusion. "Made eye contact, spoke without hedging, and answered the hard question directly" is what was actually seen and heard. The discipline of observable behaviour is the discipline of recording the second kind and letting the first kind be an inference you can trace back to something real.
The reason this matters is that inferred states are unfalsifiable and portable. If you record "seemed anxious," no one can check it, and you can attach it to whichever candidate you already doubted. If you record what the candidate said and did, the evidence sits on the table for anyone to weigh. Capturing behaviour rather than impression is what makes a rating auditable rather than merely asserted.
Coverage is the other half. It is not enough to capture behaviour accurately if you only capture behaviour from a narrow slice of the job. The competency framework defines the domain that matters, and good assessment elicits behaviour across that whole domain, not just the parts easiest to observe. A rich record of one competency and silence on four others is a confident answer to the wrong question.
When both hold, the evidence base actually supports the prediction you want to make. Validity depends on it, because you can only predict performance from a faithful, complete record of what the person did. Thin or inferred evidence produces a rating that sounds substantiated and rests on almost nothing.
Why it matters. When assessments capture inferences instead of behavior, ratings become untraceable opinions that neither predict performance nor withstand challenge.
Myth
Assessors can accurately infer underlying qualities like resilience or integrity from overall impression during an assessment.
Reality
Inferred states are projections; only observed behavior is evidence, and coverage matters as much as capture — a few vivid behaviors sampling only part of the domain produce a confident but incomplete picture.
The retrieved papers address construct validity, discriminant validity, and observational versus survey measures in general organizational contexts, but none directly substantiate the specific assessment principle of eliciting and recording observable candidate behaviour across a construct domain rather than inferred states.
How to
- Design exercises that require candidates to demonstrate behavior, not describe intentions.
- Require assessors to log specific quotes and actions as the basis for every score.
- Check that your evidence spans the whole competency domain, not just the behaviors easiest to observe.
Watch out for
- Rating a competency the exercise never actually gave the candidate a chance to display.
- Accepting self-reported hypotheticals ('I would...') as evidence of demonstrated behavior.
- Effective Assessor Behaviors in Group Decision MakingChecklist — 7 checkpoints
- Score behavior you observed, not traits you inferred.
- Ensure exercises sample the full construct domain, not just convenient behaviors.
- Anchor every rating to a specific recorded action or statement.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Selection-Assessment-Methods; Structured_Interviewing_Raising; Job analysis a guide to assessing work activities; Management: Tasks, Responsibilities, Practices
strong · 5 sources
- 263074003-Competency-Dictionary
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- How to Measure Employee Performance (The performance management series)
- GUIDELINES - Testing and Assessment
- HBRs 10 Must Reads on Performance Management
This section covers how to set clear, measurable goals that cascade from strategy and give each person a visible line of sight to organizational priorities. It connects goal quality to both clarity and motivation.
Goal Setting & Objective Alignment
A goal earns its keep by being checkable. "Improve customer service" commits no one to anything, because no two people would agree on when it had been met. "Resolve support tickets within four hours" tells a person exactly what to do on Monday morning and exactly how they will know whether they did it. Clear, measurable, achievable goals convert intention into direction, and direction is the thing a person can actually act on.
The harder work is alignment. A goal that is clear but disconnected from the organization's strategy simply produces well-measured effort pointed the wrong way. Cascading goals from strategy downward gives each person a line of sight: they can see how their target connects to the team's, and the team's to the organization's. That line of sight is what turns a list of individual objectives into coordinated work rather than parallel busyness.
Two things follow when goals are set well. First, expectations become shared rather than assumed, so the manager and the person are working from the same picture of what success looks like, which removes most of the surprise from later evaluation. Second, motivation follows, because people engage more with work whose purpose and endpoint they can see than with tasks handed down without a destination.
The recognition worth holding onto is that a goal is a promise about how someone will be judged. Set it vaguely and you have promised a fair evaluation you cannot deliver. Set it clearly and aligned, and you have given the person both a target to aim at and a standard they helped define.
Why it matters. Goals disconnected from strategy or vaguely worded cause people to optimize the wrong things confidently, and effort applied precisely to the wrong target is worse than no effort.
Myth
More goals with higher stretch targets drive more performance, so ambitious quotas across many areas are best.
Reality
A proliferation of stretch goals fragments attention and often drives gaming and short-term distortion; a few well-chosen, genuinely aligned goals with clear measures outperform many aggressive ones.
Goal-setting theory and PM literature support that specific, challenging, aligned goals cascaded from organizational strategy improve individual and team performance and provide a clear line of sight.
How to
- Cascade each individual goal explicitly from a specific organizational objective so the line of sight is visible.
- Make each goal measurable with a defined success threshold, not a directional aspiration.
- Limit the number of goals so attention concentrates on what matters most.
Watch out for
- Setting goals that are measurable but trivial because they were easy to quantify.
- Cascading targets mechanically downward without checking they remain achievable at the individual level.
- The Balanced Scorecard FrameworkFramework — A strategic planning and management framework used to align business activities to the vision and strategy of the organization, improve internal and external communications, and monitor organizational performance against strategic goals.
- Goal-Setting TemplateTemplate — To document an employee's primary goals, measures of achievement, and the detailed plan for accomplishing them, ensuring clarity and alignment between manager and employee.
- Collaborative Goal Setting and PlanningProcess — To collaboratively define an employee's goals for the next period and create a practical, documented plan for achieving them, ensuring alignment and shared ownership.
- Performance Management ImplementationProcess — To systematically change behavior to produce desired organizational results.
- Performance Rating CalibrationProcess — To ensure managers across a department or division apply performance standards and ratings consistently, avoiding grade inflation or bias.
- Tie every goal to a named strategic objective so people see the connection.
- Fewer, well-measured goals beat many stretch targets that fragment focus.
- Define the success threshold explicitly — direction is not a goal.
Grounded in: 263074003-Competency-Dictionary; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; How to Measure Employee Performance (The performance management series); GUIDELINES - Testing and Assessment; HBRs 10 Must Reads on Performance Management
moderate · 4 sources
- How to Measure Employee Performance (The performance management series)
- GUIDELINES - Testing and Assessment
- Competency Mapping and Assessment Manual - User Guide
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
This section helps you establish a shared understanding of expected results, behaviours, and the standards that distinguish meeting from exceeding.
Goal Clarity & Shared Expectations
The most common failure in performance is not poor effort but effort aimed at the wrong target, because the target was never made explicit. An employee can work hard for months on what they believe matters, then sit in a review and discover their manager was measuring something else entirely. That is a clarity failure, and it belongs to the process, not the person.
Goal clarity means the employee shares an understanding with their manager of three things: what results are expected, what behaviors are expected in producing them, and what standard separates adequate from exceptional. The third is the one most often skipped. People are frequently told what to do and rarely told what "good" looks like versus "great," which leaves them to guess where the bar sits and then to feel blindsided when the guess is wrong.
This clarity is a product of goal setting done well. When objectives are named and aligned deliberately at the start of a cycle, the expectations become concrete rather than assumed. A performance management process that is designed for this — that builds in the conversation where standards get stated and confirmed — makes shared understanding the default instead of a lucky accident.
The test is simple and worth applying: ask an employee and their manager separately what success in the role looks like this period. When the two answers match, expectations are shared. When they diverge, everything downstream — feedback, evaluation, reward — is already compromised, and no amount of end-of-year rigor will repair a target that was never agreed on.
Why it matters. Ambiguous expectations make every performance judgment feel arbitrary and every rating contestable after the fact.
Myth
Managers believe that setting a goal is the same as establishing a shared expectation.
Reality
A goal states the target; clarity requires agreeing on what the standard looks like in practice—what 'meets' versus 'exceeds' concretely means—which almost never survives being assumed rather than discussed.
Goal-setting and clarity literature supports that clear, shared goals improve performance and role understanding, but the retrieved snippets do not directly address the specific construct of shared standards distinguishing 'meets' versus 'exceeds' expectations.
How to
- Define the observable behaviours and results that constitute meeting versus exceeding the standard.
- Confirm shared understanding by having the employee restate expectations in their own terms.
- Revisit expectations when the work or context shifts so standards don't silently drift.
Watch out for
- Standards that live in the manager's head and only become explicit at rating time.
- Confusing quantity of goals with clarity of any single one.
- Good Performance Plan ChecklistChecklist — 8 checkpoints
- Performance Plan for a Process Development EngineerCase study — An example demonstrating how the book's methodology can be applied to a complex, white-collar technical role where performance is not easily quantified.
- Performance Plan WorksheetTemplate — To provide a standardized format for employees and managers to draft and finalize a complete performance plan.
- Performance Matrix TemplateTemplate — To create a single, weighted index to measure and track the total performance of a person or group across multiple accountabilities.
- Troubleshooting ToolTemplate — To diagnose why a performance improvement initiative is not working as expected.
- Clarity requires defining 'exceeds' concretely, not just naming the target.
- Have employees restate expectations to expose hidden gaps in understanding.
- Undocumented standards become weapons at appraisal time.
Grounded in: How to Measure Employee Performance (The performance management series); GUIDELINES - Testing and Assessment; Competency Mapping and Assessment Manual - User Guide; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
strong · 10 sources
- Job analysis a guide to assessing work activities
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection in Organizations
- Selection-Assessment-Methods
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Structured_Interviewing_Raising
- Who The A Method for Hiring
- How to Measure Employee Performance (The performance management series)
This section shows you how to define what a role actually requires before you build any interview guide, test, or scorecard. You get a method for deriving criteria from tasks and future demands rather than from the last person who held the job.
Job & Role Analysis / Requirement Definition
Before you can measure a person against a role, you have to know what the role actually demands, and that knowledge is rarely sitting ready in a job description. A job description tells you what someone is called. Analysis tells you what someone must do, in what conditions, to what standard. The distinction matters because everything downstream inherits the accuracy of this first step: the criteria you score against, the methods you choose, the predictions you make about who will succeed. Get the requirement wrong and you build a precise instrument pointed at the wrong target.
The discipline is to move from tasks to requirements without skipping the middle. First the critical tasks — not every activity, but the ones that separate adequate performance from failure. Then the knowledge, skills, abilities, and other characteristics those tasks actually require. A task like "resolve escalated complaints" implies composure under pressure, judgment about when to concede, and command of policy. Naming those requirements explicitly is the work; leaving them implied is how bias slips in, because unstated requirements get filled by whoever the assessor pictures as a natural fit.
The part practitioners most often neglect is time. A role is not static, and the person you hire will spend years in the version of the job that is coming, not the one you documented. Future-oriented analysis asks what the role will demand as the work changes, and builds the requirement around that. It is harder, because you are describing something that does not yet fully exist, and it is more honest, because you are hiring for a future you can partly see.
When the analysis is done well, the later choices stop feeling arbitrary. The framework has something to be faithful to. The methods have a reason to exist. And when someone challenges a selection decision, you can point to the task the requirement came from, rather than to a preference you cannot defend.
Why it matters. Every downstream instrument inherits the errors of a sloppy requirement definition — you cannot validly measure competencies you never correctly specified.
Myth
Practitioners treat the existing job description as a finished role analysis and simply lift its bullet points into selection criteria.
Reality
Job descriptions are administrative artifacts written for HR and legal purposes, not empirical accounts of what drives performance; a real analysis interrogates high performers, critical incidents, and where the role is heading in two years.
The retrieved snippets address job demands-resources theory, relative weight analysis, GMA validity, and a retail competency framework, but none directly substantiate the practice of systematic, future-oriented job/role analysis identifying critical tasks and KSAOs as a foundation for criteria and predictors.
How to
- Interview current high and average performers and collect critical incidents that distinguish them, not just task lists.
- Separate KSAOs that must exist at entry from those that can be developed on the job, and weight criteria by their contribution to outcomes.
- Project the role forward: ask what the job will demand after foreseeable strategy, technology, or market shifts and add those requirements explicitly.
Watch out for
- Anchoring the profile to the incumbent's idiosyncratic strengths, which encodes cloning rather than requirements.
- Producing a wish-list of twenty competencies that no single hire could ever embody, which makes prioritization impossible downstream.
- Life-Cycle Model of Strategic AssessmentProcess — To ensure that key managerial positions are filled by individuals whose skills and competencies match the specific strategic requirements of the business.
- Job Analysis for Content-Valid Test DevelopmentProcess — To create a selection instrument that is a representative sample of critical job tasks and required knowledge, skills, and abilities (KSAs), thereby providing evidence of content validity.
- Job AnalysisProcess — To systematically identify the activities, responsibilities, knowledge, skills, and abilities (KSAs) required for successful performance in a role.
- Derive selection criteria from evidence about what differentiates performance, not from the job description.
- Build the analysis around future role demands, not just the current state of the work.
- Rank requirements by their weight in driving outcomes so later scorecards can allocate attention proportionally.
Grounded in: Job analysis a guide to assessing work activities; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Personnel Selection in Organizations; Selection-Assessment-Methods; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Structured_Interviewing_Raising; Who The A Method for Hiring; How to Measure Employee Performance (The performance management series)
strong · 8 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Structured_Interviewing_Raising
- The Performance Appraisal Tool Kit
- How to Measure Employee Performance (The performance management series)
- 263074003-Competency-Dictionary
This section helps you judge whether your competency model is built from observable behaviors or from abstractions that no two assessors will read the same way. It gives criteria for indicators that are specific, job-relevant, and culturally usable.
Competency / Criterion Framework Quality
A competency framework earns its keep by being specific enough to disagree about. "Strong leadership" is not a competency; it is a compliment. Two assessors can both endorse it while picturing entirely different people, and neither will ever discover the gap. The quality of a framework lives in whether it names behavior you could actually watch someone perform — describes the person present in the room, delegates a decision, adapts a plan when the data shifts — rather than a trait you can only infer and admire.
The test is observability. Every indicator should point to something a person does, in language concrete enough that a reasonable observer could mark whether it happened. This is what makes a framework fair as much as accurate: when indicators are behavioral, candidates are compared on the same visible ground, and when they are abstract, they are compared on the assessor's private theory of what the abstraction means.
Job relevance is the other constraint, and it flows directly from the analysis that preceded it. A competency belongs in the framework because the role requires it, not because it sounds impressive or because it appears on someone else's list. Borrowed models drift toward generic virtue — collaboration, integrity, drive — that describe good people everywhere and distinguish no one for this particular job. Cultural fit of the indicators matters too; a behavior that signals confidence in one setting reads as arrogance in another, and a framework blind to that will systematically misjudge.
A good framework is also disciplined about coverage. It should map the parts of the role that matter and resist the urge to measure everything measurable. When the indicators are specific, observable, relevant, and appropriate to the setting, the people using them start to converge — which is the quiet signal that the model describes the work rather than the modeler.
Why it matters. A vague framework guarantees that assessors substitute their private definitions, so the entire assessment measures rater personality rather than the candidate.
Myth
A competency labeled 'Leadership' or 'Strategic Thinking' with a one-line definition is a usable assessment construct.
Reality
Single-word competencies are containers, not measures; two assessors watching the same behavior will code it differently unless the model spells out concrete, observable behavioral anchors at defined levels.
The retrieved papers address criterion reliability, validity generalization, and performance dimensions but none evaluate the quality of competency/criterion frameworks in terms of specific, observable, job-relevant, or culturally appropriate behavioral indicators.
How to
- Rewrite each competency as observable behavioral indicators phrased as what the person does or says, not as traits they possess.
- Test each indicator against real candidate behavior to confirm assessors can locate it in evidence without inference.
- Check every indicator for cultural and contextual appropriateness so behaviors are not penalized purely for expression style.
Watch out for
- Importing a generic off-the-shelf competency library that was never grounded in your own job analysis.
- Defining competencies so finely that they overlap and double-count the same behavior across dimensions.
- State System Competency FrameworkFramework — A behavioral framework that defines performance through a dictionary of 19 competencies, each with scaled indicators of proficiency.
- The Sample Competence FrameworkFramework — A framework of 13 competencies with specific positive and negative behavioral indicators tailored for assessment centre activities.
- Hudson's 5 + 1 Competency ModelFramework — A flexible framework for structuring an organization's competencies.
- Competency-Based Human Resource ManagementFramework — A framework that uses a defined set of competencies (underlying characteristics that drive superior performance) as the common language for integrating all HR activities.
- Structured Interviewing FrameworkFramework — A systematic method for conducting interviews where all candidates for a role are asked the same predetermined, job-relevant questions and evaluated against a consistent, objective rating scale.
- BP's Cross-Cultural Competency ModelCase study — Global oil company BP undergoing major changes in the late 1980s, including internationalization and a push for a more entrepreneurial culture.
- Participant Review TestTemplate — To assess a participant's understanding of core concepts after a competency mapping training program.
- Designing and Running an Assessment CentreProcess — To objectively measure job-related competencies and improve the predictive validity of selection and development decisions.
- ORCE Process for AssessorsProcess — To ensure objective and systematic evaluation of participant behavior by separating observation from evaluation.
- Developing a Structured Psychometric Interview (SPI)Process — To create a valid and reliable interview that can empirically distinguish between superior and average performers for a specific role.
- Strategy Map and Scorecard ImplementationProcess — To translate the organization's high-level vision and strategy into a coherent set of actionable objectives and measurable performance indicators that align employee behavior and guide decision-making.
- Performance Indicator DesignProcess — To create a comprehensive and unambiguous definition for each performance indicator to ensure consistent data collection, interpretation, and use for learning.
- Replace trait labels with observable behavioral indicators that two assessors could agree on.
- Anchor each competency to leveled behaviors so 'more' and 'less' are defined, not guessed.
- Audit indicators for cultural bias before deployment, not after adverse-impact data appears.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Structured_Interviewing_Raising; The Performance Appraisal Tool Kit; How to Measure Employee Performance (The performance management series); 263074003-Competency-Dictionary
Foundational
Build the structured, standardized procedurestrong · 7 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Structured_Interviewing_Raising
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Competency Mapping and Assessment Manual - User Guide
- Job analysis a guide to assessing work activities
This section clarifies what inter-rater consistency actually measures and how to know whether your assessment produces the same result from the same evidence. It positions reliability as the precondition for validity.
Reliability / Inter-Rater Consistency
Two assessors watch the same candidate handle the same exercise. One scores it a 4, the other a 2. Nothing about the candidate has changed between those two numbers; what has changed is the person holding the pen. Reliability names the gap between them, and closing that gap is the first honest test any assessment must pass. A rating that swings with the rater tells you about the rater, not the person being rated.
The uncomfortable part is that reliability comes before everything you actually care about. An assessment cannot predict job performance if it cannot first agree with itself. If the same evidence yields different scores depending on who is watching or when, there is no stable signal underneath to be accurate about. Consistency is the floor; accuracy is the building. You do not get the building without the floor.
Two forces build that floor. Structure and standardization strip out the room for improvisation, so raters respond to the same prompts, the same scale, the same defined behaviours. Training and calibration then align the humans, teaching them to read a given piece of evidence the same way and to catch themselves when they drift. Working against both is ordinary rater bias, the idiosyncratic tendencies and gut impressions that pull each observer toward their own private baseline.
High agreement does not prove you are measuring the right thing. Several raters can converge confidently on a score that predicts nothing at all. Reliability earns you a signal worth examining; it does not certify that the signal matters. Treat it as the price of admission, not the verdict.
Why it matters. An unreliable assessment cannot be valid — if the score depends on who happened to rate, it cannot be measuring anything stable about the candidate.
Myth
High reliability means the assessment is good, so strong inter-rater agreement is proof the process works.
Reality
Reliability is necessary but not sufficient; assessors can agree perfectly while all sharing the same irrelevant bias, producing consistent measurement of the wrong thing.
Multiple papers define and empirically document inter-rater reliability as the degree of agreement/consistency across different raters evaluating the same evidence.
How to
- Measure agreement with an appropriate statistic on shared evidence, not just percentage of matching final decisions.
- Diagnose disagreement to its source — ambiguous anchors, weak training, or genuine construct difficulty — and fix that source.
- Treat reliability as a floor to clear before claiming validity, not as the endpoint.
Watch out for
- Chasing agreement by forcing consensus, which manufactures reliability while hiding real rating problems.
- Assuming reliability generalizes across exercises when it was only established for one.
- WPSS Follow-Up ProcedureFramework — A structured method that uses the output of a WPSS survey (a list of significant tasks) as the input for a subsequent data collection effort to link job activities to other factors like required skills, abilities, or job design characteristics.
- The Six-Step Structured Interview FrameworkFramework — A systematic framework for creating and implementing a psychometrically sound and legally defensible employment interview.
- Checklist for Legally Defensible AppraisalsChecklist — 8 checkpoints
- Highly Structured Employment Interviewing TechniqueProcess — To increase the reliability, validity, fairness, and legal defensibility of the employment interview, making it a psychometrically sound selection tool.
- Reliability enables validity but never substitutes for it.
- Consistent agreement can still be consistently biased — check what raters agree on.
- Measure agreement on evidence-to-rating, not just on final decisions.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Structured_Interviewing_Raising; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Competency Mapping and Assessment Manual - User Guide; Job analysis a guide to assessing work activities
moderate · 5 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- HBRs 10 Must Reads on Performance Management
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Standardized Survey Interviewing - Minimizing Interviewer Error
- Understanding performance appraisal social, organizational, and goal-based perspectives
This section names the specific distortions that creep into human judgment — halo, similarity, stereotype, cultural-fit reasoning, gut feel — and how to constrain them. It treats bias as a manageable system property, not a moral failing.
Rater Bias & Evaluation Error
The judgment feels like insight. A candidate walks in, and within a minute the assessor has a read: sharp, or not; one of us, or not. That instant impression then quietly steers everything that follows, as the rater notices the evidence that confirms it and discounts the evidence that does not. This is rater bias at work, and its danger is precisely that it does not feel like bias. It feels like being perceptive.
The distortion comes in several flavors. There is the stereotype that assigns traits by group rather than by evidence. There is the cultural-fit judgment, which often just means the candidate reminds the rater of themselves. There are idiosyncratic tendencies, the rater who scores everyone high or everyone low, and the gut-level verdict that arrives before the exercise is even complete. Each one is systematic, meaning it does not average out across a career; it leans the same way every time.
Bias corrodes two things at once. It undermines reliability, because a rating shaped by private impression will not match another rater's reading of the same behaviour. And it degrades decision quality directly, since a distorted score becomes a distorted hire or a distorted appraisal. The error does not stay contained in the rating; it travels into the outcome.
Training and calibration are the counterweight, not a cure. They make raters aware of the specific ways their judgment slips and give them a common standard to return to. Awareness narrows the drift; it does not delete the instinct. The practical stance is to assume the gut is speaking and to require that the evidence, scored against defined behaviours, be allowed to speak louder.
Why it matters. Unmanaged rater bias systematically disadvantages qualified candidates and inflates the wrong ones, degrading both fairness and predictive quality at once.
Myth
Bias is something biased individuals have, so screening out prejudiced raters or reminding people to be objective solves it.
Reality
These distortions are structural features of normal cognition operating under ambiguity; awareness alone barely moves them, which is why structure and calibration — not good intentions — are the effective levers.
Retrieved papers confirm that human-performed evaluations are prone to bias and that cultural differences affect how performance is perceived, but they do not comprehensively establish the full range of cognitive/social biases, stereotypes, and idiosyncratic rater tendencies claimed.
How to
- Force evaluation to specific recorded behaviors, removing the ambiguity that gut judgment fills with bias.
- Watch for 'culture fit' language, which frequently launders similarity bias into a legitimate-sounding criterion.
- Use multiple independent raters and reconcile against anchors so no single person's tendency dominates.
Watch out for
- Believing an unconscious-bias training session immunizes raters — the effect on decisions is weak and short-lived.
- Letting first-impression or early-strong-answer halo color scoring of every later dimension.
- The Four-Component Model for Understanding Performance AppraisalFramework — A holistic framework that approaches PA as a social process occurring within a context, breaking it down into four key components for analysis and improvement.
- Deloitte's Performance Snapshot QuestionsTemplate — To capture a team leader's assessment of a team member's performance and potential by asking about their own future intentions, thereby reducing idiosyncratic rater bias.
- Cognitive Process of Performance JudgmentProcess — To understand how a rater transforms observations of behavior into a subjective, evaluative judgment.
- Bias is reduced by structure and calibration, not by exhortation to be fair.
- 'Culture fit' is often similarity bias in disguise — demand behavioral justification.
- Independent multi-rater scoring dilutes any single rater's systematic tendency.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; HBRs 10 Must Reads on Performance Management; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Standardized Survey Interviewing - Minimizing Interviewer Error; Understanding performance appraisal social, organizational, and goal-based perspectives
strong · 8 sources
- 263074003-Competency-Dictionary
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- GUIDELINES - Testing and Assessment
- Personnel Selection and Assessment
- Competency Mapping and Assessment Manual - User Guide
- Management: Tasks, Responsibilities, Practices
- How to Measure Employee Performance (The performance management series)
This section addresses how to deliver timely, evidence-based feedback and on-the-job coaching that people can actually use to improve. It distinguishes feedback that changes behavior from feedback that just gets delivered.
Feedback & Coaching
Feedback decays. The gap between an event and the comment about it determines how much a person can actually do with the comment. Point out a specific behavior the same day it happens, tied to something the person saw and remembers, and it lands as information they can use. Wait for the quarterly review to raise the same behavior and it arrives as a verdict, stripped of the context that made it correctable. Timeliness is not a nicety of delivery; it is what makes feedback usable at all.
The quality of feedback rests on evidence rather than impression. "You seemed disengaged" invites a defense. "In the client call you interrupted twice before the requirements were on the table" gives the person a scene to replay and a lever to move. Evidence-based feedback is specific about the observed action and quiet about the inferred character behind it, and that restraint is what keeps the conversation about the work.
Coaching differs from feedback in that it happens while the work is still in motion. Feedback describes what already occurred; coaching shapes what happens next, on the job, in the actual conditions where the skill has to hold. A person who receives both regularly starts to see their own performance more clearly, which is the point. The feedback builds self-awareness and skill; over time it also feeds motivation and steadier, more accountable work.
All of this runs through the manager, and the manager is the variable. A person's willingness to hear evidence, to coach in the moment rather than store up grievances for a form, to make the regularity a habit rather than an event, decides whether any of it reaches the employee. Good intentions about feedback are common. The capability and buy-in to deliver it well, week after week, are what separate the systems that improve people from the ones that only rate them.
Why it matters. Feedback done badly damages trust and performance more than no feedback at all, while done well it is the primary engine of skill growth and engagement.
Myth
The annual review is the main feedback vehicle, and honest, direct delivery is what makes feedback effective.
Reality
Timeliness and specificity matter far more than the review cycle or bluntness; feedback given months late about a vague pattern cannot be acted on, however honest, and manager capability strongly shapes whether it lands at all.
Multiple studies confirm that regular, constructive feedback and on-the-job coaching improve employee performance, motivation, and learning outcomes.
How to
- Give feedback close to the behavior, referencing the specific observed action, not accumulated impressions.
- Separate evaluative feedback from developmental coaching so people can hear the growth conversation without defending a rating.
- Equip managers to deliver it — the same feedback lands differently depending on the manager's skill.
Watch out for
- Saving feedback for the review, by which point it is too stale and too aggregated to change behavior.
- Confusing directness with usefulness — harsh, unspecific feedback triggers defense and no learning.
- How to Select an A PlayerChecklist — 6 checkpoints
- The U.S. Employment Service's Use of the GATBCase study — A nationwide public employment testing program in the US during the 1980s, aiming to improve referral quality using the General Aptitude Test Battery (GATB).
- DHL Greece's Value Creation MapCase study — DHL Greece, a market leader, wanted to establish a more sophisticated performance management system to maintain its market share against new competitors.
- Task-Oriented Rating (TOR) FormTemplate — To create a performance evaluation tool based on the specific, important tasks of a job, allowing for more objective and detailed feedback.
- Interviewer Monitoring FormTemplate — To provide a standardized template for supervisors to evaluate interviewer performance during an interview, ensuring all key behaviors are assessed consistently.
- Developing a Struggling Employee (The Three Cs)Process — To diagnose the root cause of poor performance and create a structured plan for improvement, or to determine if the employee needs to be managed out of the organization.
- Interviewer Supervision via MonitoringProcess — To gather information on actual interviewer performance, ensure adherence to standardized procedures, and provide feedback to maintain or improve data quality.
- The Three-Step Assessment ProcessProcess — To create a fair, accurate, and legally defensible hiring process that reduces bias and improves the quality of hires.
- Feedback's value decays with delay — deliver it close to the behavior.
- Specific observed behavior, not general impression, is what makes feedback actionable.
- Manager capability moderates whether feedback helps or harms; invest in it.
Grounded in: 263074003-Competency-Dictionary; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; GUIDELINES - Testing and Assessment; Personnel Selection and Assessment; Competency Mapping and Assessment Manual - User Guide; Management: Tasks, Responsibilities, Practices; How to Measure Employee Performance (The performance management series)
moderate · 6 sources
- GUIDELINES - Testing and Assessment
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- The Performance Appraisal Tool Kit
- Understanding performance appraisal social, organizational, and goal-based perspectives
- HBRs 10 Must Reads on Performance Management
This section gives you the architecture for performance management as a continuous plan-act-monitor-review dialogue rather than a once-a-year form-filling ritual.
Performance Management Process Design
The annual appraisal fails at the one thing it was built to do. Performance happens continuously, in the flow of decisions and work across a year, and a single conversation scheduled twelve months out cannot correct, direct, or reinforce any of it in time to matter. By the time the form is filled in, the moments where a manager could have shaped the work have long passed. The design problem is not the quality of the appraisal but the interval.
A better design treats performance management as a cycle rather than an event: plan, act, monitor, review, and back to plan, running continuously and flexibly rather than on a fixed bureaucratic calendar. The center of gravity shifts from the form to the dialogue. What holds the cycle together is the ongoing conversation between a person and their manager about what is expected, how the work is going, and what needs to change, and the paperwork exists to support that conversation rather than replace it.
A continuous cycle is also where expectations get set and reset. When the process is a live dialogue, goals stay clear and shared because they can be revisited when conditions change, rather than fossilizing in a document written last January. The design produces alignment as a byproduct of its rhythm.
None of this survives contact with managers who do not believe in it. A process built for continuous dialogue still requires managers willing and able to have the conversations, and where that capability or buy-in is missing, even the best-designed cycle collapses back into a form filled in once a year under duress. The design sets the ceiling; the manager determines whether you reach it.
Why it matters. A process designed around compliance produces defensive box-ticking; one designed around dialogue produces the ongoing course-correction that actually changes performance.
Myth
Managers assume that abolishing the annual appraisal is itself the reform.
Reality
Removing the annual event without installing a disciplined rhythm of check-ins leaves a vacuum where feedback quietly disappears; continuous PM is more demanding of managers, not less.
Retrieved papers support rethinking bureaucratic annual appraisals and emphasize fairness and continuous performance management elements, but none directly validate the specific plan-act-monitor-review continuous dialogue-based design integrated with HR systems.
How to
- Design short, scheduled check-in cadences and give managers a light structure for each so 'continuous' doesn't collapse into 'never'.
- Integrate the cycle with existing HR data (goals, development, reward) so it isn't a parallel bureaucracy.
- Build in a mid-cycle recalibration point so goals can flex when circumstances change.
Watch out for
- Layering a new continuous system on top of the old annual one, doubling the burden and satisfying no one.
- Assuming managers know how to hold a developmental dialogue; without capability building the cadence is empty.
- The Ongoing Performance Management CycleFramework — A continuous, flexible approach to managing performance that replaces or supplements the traditional annual review.
- Risk-Based Performance Management FrameworkFramework — A four-step framework (depicted in Exhibit 4.3) that integrates risk management with strategy formulation and execution to maximize stakeholder value.
- Enabled Learning Environment FrameworkFramework — A cultural and procedural framework for shifting from a top-down, control-oriented management style to one that fosters inquiry, dialogue, and continuous learning at all levels.
- The Golden Cycle of Performance ManagementFramework — A three-step framework illustrating that performance management is a continuous process, not a singular annual event.
- Ethical Considerations in Competency Based AssessmentsChecklist — 10 checkpoints
- Deloitte's Reinvention of Performance ManagementCase study — Deloitte, a global professional services firm, found its traditional annual review process consumed nearly 2 million hours a year and produced biased, backward-looking data.
- ICL's Integrated Assessment StrategyCase study — A major UK electronics and communications company in the 1980s seeking to strategically manage its human resources.
- Raytheon Inc.Case study — A US-based defense and aerospace supplier implementing a company-wide 'Performance Development' process.
- Standard Chartered BankCase study — A global banking business aiming to accelerate a high-performing organization.
- Management Performance Appraisal and Development ProcessProcess — To set goals, select competencies, review progress, assess final performance against both results and behaviors, and create a development plan.
- Model Appraisal ProcessProcess — To formally review past performance, set future objectives, and identify development needs in a structured manner.
- Reinvented Performance Management Cycle (Deloitte Model)Process — To fuel future performance by providing frequent, forward-looking coaching while collecting reliable data for compensation and promotion decisions.
- The Performance Management CycleProcess — To systematically improve organizational performance by developing the performance of individuals and teams in a continuous, self-renewing cycle.
- Introducing and Developing Performance ManagementProcess — To successfully design, launch, and embed an effective performance management process that fits the organization's culture and business needs.
- The Six Essential Steps to Reinventing Performance ManagementProcess — To guide leaders through a structured process of designing and implementing a new, strategic performance management system.
- Designing a Goal-Oriented Appraisal SystemProcess — To design a PA system by analyzing stakeholder goals first, rather than starting with a generic 'best practice' template.
- Continuous PM demands more manager discipline than the annual model it replaces.
- The cycle must plug into reward, goals, and development or it becomes ceremonial.
- A defined check-in rhythm is what prevents 'ongoing' from meaning 'ad hoc'.
Grounded in: GUIDELINES - Testing and Assessment; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; The Performance Appraisal Tool Kit; Understanding performance appraisal social, organizational, and goal-based perspectives; HBRs 10 Must Reads on Performance Management
emerging · 3 sources
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Who The A Method for Hiring
- Personnel Selection in Organizations
This section addresses how candidates and references distort self-reported information and how that distortion erodes your predictions.
Applicant Faking / Truthful Disclosure
Self-report is the softest ground in selection. When you ask a candidate about their weaknesses, or a reference about a past hire's failings, you are asking people to volunteer information that works against the outcome they want. Candidates want the offer; references often want to protect a former colleague or avoid an awkward conversation. The disclosure that results sits somewhere between honest and polished, and the distance between those two is where prediction goes wrong.
Faking does not usually announce itself as a lie. It shows up as omission, as the reframed weakness that turns out to be a strength, as the transition described without its real cause. Each small distortion loosens the connection between what the assessment records and what the person will actually do on the job. That connection is the whole point of assessing anyone, so anything that erodes it deserves attention rather than trust.
The useful move is to lean less on claims and more on evidence that is harder to shape — behavior the candidate has to demonstrate, accounts that can be cross-checked, questions that ask what happened rather than what the person believes about themselves. You will not eliminate distortion. You can design around it, so that the parts of your process most vulnerable to a polished answer carry the least weight in the final call.
Why it matters. Systematic faking inflates the wrong candidates to the top of your rankings, quietly destroying the predictive accuracy the assessment was chosen for.
Myth
Recruiters believe faking randomly adds noise that cancels out across candidates.
Reality
Faking is not random—it systematically advantages the most impression-managing candidates and reorders your rankings, which is far more damaging than uniform noise that would leave rank order intact.
How to
- Prefer behaviourally anchored, evidence-based questions over easily-gamed self-ratings.
- Use verifiable references and structured probing rather than open-ended endorsements.
- Include warning statements or forced-choice formats that reduce the payoff to distortion.
Watch out for
- Relying on transparent self-report personality items where the desirable answer is obvious.
- Treating a polished, confident self-presentation as evidence of the underlying trait.
- Newcomer Orientation Based on Medical Patient PreparationProcess — To help newcomers cope with the stress of organizational entry, thereby improving both performance and retention, by moving beyond simple information provision.
- Faking distorts rank order, not just adds cancellable noise.
- Verifiable evidence beats self-report wherever the socially desirable answer is obvious.
- Forced-choice and behavioural formats reduce the return on distortion.
Grounded in: Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Who The A Method for Hiring; Personnel Selection in Organizations
moderate · 5 sources
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Competency Mapping and Assessment Manual - User Guide
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- 263074003-Competency-Dictionary
This section covers the enduring individual differences—cognitive ability, personality, experience, motives—that your assessments are actually trying to measure.
Candidate Attributes / KSAOs
What you are actually measuring in any assessment is a set of enduring characteristics the person brings with them: cognitive ability, personality, accumulated experience, motives, interests. These are the individual differences that persist across situations, and they are the reason one candidate performs and another struggles once the novelty of a new role wears off.
The attributes matter because they predict performance, but the prediction is only as good as the match between the attribute and the demands of the work. Cognitive ability tells you something about how quickly someone learns a complex task; it tells you little about whether they will persist through tedium, which is a question of motive and interest. Experience signals exposure, not competence. Each attribute carries a specific kind of predictive weight, and treating them as interchangeable — hiring for one when the job rewards another — is how a well-run process still produces a poor fit.
The discipline is to know which attributes the role actually depends on before you decide how to measure them. An assessment that captures the wrong characteristics with great precision is worse than a rough read on the right ones. The work starts with the job, not the toolkit: name the attributes that drive performance in this particular role, then choose methods that surface those and not the ones that are merely easy to test for.
Why it matters. Choosing which attributes to assess determines what your entire selection process can and cannot predict about future performance.
Myth
Hiring managers over-weight job experience as the best predictor of future performance.
Reality
Years of experience is a weak predictor once someone is past a threshold; general cognitive ability and relevant personality facets typically predict performance more reliably across roles than tenure does.
The retrieved snippets touch on personality, cognitive ability, and KSAOs in selection contexts but none define or substantiate the claim that assessments measure enduring individual-difference candidate attributes.
How to
- Identify which KSAOs actually predict success in this specific role before selecting instruments.
- Measure each target attribute with a method validated for it, not a single generic interview.
- Weight attributes by their demonstrated relationship to performance, not by intuitive appeal.
Watch out for
- Assuming experience is a proxy for capability rather than testing capability directly.
- Assessing attributes that are easy to observe rather than those that predict performance.
- Rodger's Seven-Point PlanFramework — A classic framework for structuring a selection interview to ensure comprehensive coverage of a candidate's background and attributes.
- Incremental Assessment Improvement FrameworkFramework — A tiered approach to systematically improve hiring accuracy and efficiency by progressively implementing more sophisticated assessment methods.
- A Story of Staffing Success: Maggie Anderson's TrainerCase study — A training director (Maggie) needs to hire a software trainer with a unique blend of skills and uses a systematic, assessment-driven process.
- Job Analysis for SelectionProcess — To identify the critical tasks employees must perform and the knowledge, skills, and abilities (KSAs) they must possess to perform the job effectively, which then informs the content of the assessments.
- Cognitive ability and relevant personality facets usually out-predict raw experience.
- Define which attributes predict success in this role before choosing tools.
- Match each attribute to a method validated to measure it.
Grounded in: Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Competency Mapping and Assessment Manual - User Guide; Managing Staff Selection and Assessment (Managing Work and Organizations Series); 263074003-Competency-Dictionary
strong · 10 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Competency Mapping and Assessment Manual - User Guide
- Selection-Assessment-Methods
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection in Organizations
- Who The A Method for Hiring
- Job analysis a guide to assessing work activities
- Standardized Survey Interviewing - Minimizing Interviewer Error
This section guides your choice among interviews, work samples, tests, and assessment centres, and how to construct each so it actually samples the required competencies. You get the logic of matching method to construct.
Assessment / Activity Method Design & Choice
The choice of method is a bet about what the future job will reveal, and different methods reveal different things. A structured interview surfaces how someone reasons aloud and explains past choices. A work sample shows what they actually produce when handed the task. A cognitive test predicts how quickly they will pick up what they do not yet know. An assessment centre stages several of these at once. None is universally best; each is best for something, and the design question is whether the method exposes the behavior your analysis said the role demands.
The error to avoid is choosing methods for their familiarity or their polish rather than their fit. An elaborate assessment centre built around competencies nobody derived from the actual work is expensive theater. The grounding runs backward from the job: the analysis names the requirements, the requirements determine what you need to observe, and the method is simply the most economical way to observe it under conditions candidates share.
Construction matters as much as selection. A work sample only predicts if it samples work that resembles the job; an interview only informs if its questions target defined competencies rather than rapport. This is where design quietly becomes standardization — the same tasks, the same conditions, the same basis for scoring — because a method applied differently to each candidate produces impressions, not evidence.
More methods are not automatically better. Each one added should cover something the others miss, not repeat what you already know at greater cost. When the mix is chosen deliberately, the whole procedure predicts performance better than any single piece, which is the only justification for the effort it takes to run it well.
Why it matters. Choosing a method that cannot capture the target competency wastes candidate time and produces confident-looking data that predicts nothing.
Myth
The interview is the default instrument and other methods are optional add-ons for senior or specialized roles.
Reality
Unstructured interviews are among the weakest predictors available, while work samples and structured simulations often outperform them; the right method is dictated by which competency you are measuring, not by convenience or tradition.
The retrieved snippets touch on selection methods and validity peripherally but do not substantiate claims about how assessment methods are chosen, constructed, standardized, and grounded in job analysis.
How to
- Map each required competency to the method that best elicits it — behavior-under-load to simulations, procedural skill to work samples, reasoning to validated tests.
- Build every exercise from the job analysis so its content is a recognizable sample of real work.
- Combine methods to triangulate high-stakes competencies rather than relying on a single instrument.
Watch out for
- Adding an assessment centre exercise because it looks rigorous, without a competency it uniquely measures.
- Fielding a test or simulation whose difficulty or content has not been piloted against the actual candidate population.
- Assessment Method Evaluation CriteriaTemplate — To provide a framework for making rational choices among available assessment methods by comparing them on four key criteria.
- Select methods by which competency they can validly elicit, not by convention.
- Work samples and structured exercises generally out-predict unstructured conversation.
- Every exercise should be traceable to a specific requirement in the job analysis.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Competency Mapping and Assessment Manual - User Guide; Selection-Assessment-Methods; Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection in Organizations; Who The A Method for Hiring; Job analysis a guide to assessing work activities; Standardized Survey Interviewing - Minimizing Interviewer Error
strong · 7 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Structured_Interviewing_Raising
- Personnel Selection in Organizations
- Standardized Survey Interviewing - Minimizing Interviewer Error
- Who The A Method for Hiring
This section shows you how to hold content, administration, questioning, and scoring constant across candidates so differences in scores reflect candidates, not process drift. It covers the mechanics of standardization end to end.
Structure & Standardization of Procedure
Standardization is the deliberate removal of discretion from the places where discretion does no good. Left to their own devices, two assessors will ask different questions, follow different tangents, weigh different answers, and combine their impressions by feel. Each may believe they are being thorough. What they are actually doing is measuring different things and calling the results comparable. Structure closes that gap by fixing what should not vary: the content candidates face, the way it is administered, the questions asked, the scale used to score, and the rule for combining the pieces into a decision.
The combination step is the one most people underrate. Even careful assessors who ask identical questions will, at the end, blend their observations into an overall judgment using whatever mental arithmetic feels right in the moment. A standardized rule for aggregating scores — deciding in advance how the parts add up — protects the decision from the last-minute pull of a single vivid impression. The mechanical part is not cold; it is the safeguard against the warm bias that a charismatic answer or a shared background quietly introduces.
Standardization is what makes reliability possible: when the procedure is the same across people, the differences you observe are more likely to come from the candidates than from the process. And reliability is the precondition for validity, because a measure that shifts with who administers it cannot predict anything stable.
The usual objection is that structure feels rigid, that it strips out the judgment experience has earned. The honest reply is that structure does not remove judgment; it relocates it to where it belongs — into designing the questions, defining the scale, setting the rule — and out of the improvised moment where it does the most damage.
Why it matters. Without standardization, you compare candidates on effectively different assessments, and the variation you observe is procedural noise masquerading as signal.
Myth
Standardization means a rigid script that strips the assessment of nuance and rapport, so seasoned interviewers should be free to adapt.
Reality
Structure constrains how you ask and score, not whether you can probe; it is precisely the freedom to improvise that lets bias and inconsistency enter, which is why structured procedures show markedly higher validity.
The retrieved snippets address survey item design, measurement invariance, and fairness perceptions, but none directly examine standardization of procedure across candidates as a means of reducing discretionary variation and bias in structured assessment.
How to
- Fix the questions, exercises, and order in advance, and permit only pre-defined follow-up probes.
- Score each candidate against behavioral anchors immediately after their evidence, before moving on or comparing to others.
- Combine information mechanically using a pre-agreed rule rather than holistic gut synthesis at the end.
Watch out for
- Allowing 'just this once' deviations that quietly restore discretionary comparison.
- Standardizing the questions but leaving scoring holistic, which reintroduces the variance you tried to remove.
- Structured Interview Development and Administration ChecklistChecklist — 10 checkpoints
- Standardized InterviewingProcess — To ensure that every respondent is exposed to the same measurement experience, so that differences in answers reflect true differences between respondents, not differences in the interview process.
- Standardize questioning AND scoring AND how information is combined — partial structure leaks validity.
- Mechanical combination of ratings beats holistic clinical judgment for prediction.
- Pre-define permitted probes so structure and depth coexist.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Structured_Interviewing_Raising; Personnel Selection in Organizations; Standardized Survey Interviewing - Minimizing Interviewer Error; Who The A Method for Hiring
strong · 7 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Structured_Interviewing_Raising
- Standardized Survey Interviewing - Minimizing Interviewer Error
- The Performance Appraisal Tool Kit
This section describes how to train assessors to observe, record, and code behavior consistently, and how to calibrate them against shared standards. It emphasizes practice over lecture.
Assessor/Rater Training & Calibration
A scoring form does not score anyone. A person does, and that person arrives with a lifetime of habits about what to notice, what to overlook, and what a good answer sounds like. Training exists because those habits, left unexamined, become the real instrument — and it is an instrument that varies from rater to rater and from morning to afternoon. The point of preparing assessors is to replace private impression with a shared discipline of observing, recording, and coding what actually occurred.
The order of those verbs matters. The skill is to observe behavior first, write down what was said and done before interpreting it, and only then map the record onto the competency and its score. Assessors who evaluate while they watch tend to decide early and then collect evidence for the decision they already made. Training that is heavy on practice — real exercises, real recording, real coding, compared afterward against how others coded the same performance — builds the habit of holding judgment until the evidence is on the page.
Calibration is the second half, and it is ongoing rather than a one-time credential. Even well-trained raters drift apart on where the lines fall between one score and the next. Bringing them together to rate the same material and reconcile the differences pulls their standards back into alignment, so that a four means the same thing regardless of who wrote it.
This is what separates trained assessment from confident guessing. Training and calibration do not make raters identical, and they do not eliminate bias entirely. They shrink the idiosyncratic error each rater would otherwise contribute, which is the difference between a score that reflects the candidate and one that reflects the person holding the pen.
Why it matters. Untrained assessors introduce idiosyncratic error that no framework or structure can fully correct, capping the reliability of the entire system.
Myth
A briefing on the competency model plus experience in the role is sufficient preparation to assess accurately.
Reality
Domain expertise does not confer observation and coding skill; without practice-based calibration, experienced assessors diverge systematically because each has internalized a different bar.
Some retrieved papers discuss rater training and interrater reliability of performance ratings, but the evidence on whether error-training reduces idiosyncratic error is mixed and the specific components claimed (observation, recording, coding, calibration) are not directly substantiated.
How to
- Train assessors to record what candidates actually say and do before evaluating, separating observation from judgment.
- Run calibration sessions where assessors independently score the same recorded evidence and reconcile discrepancies against anchors.
- Refresh calibration periodically, since raters drift back to personal standards over time.
Watch out for
- Treating training as a one-time onboarding event rather than an ongoing calibration discipline.
- Letting a dominant senior assessor set the informal bar during reconciliation, replacing calibration with deference.
- Practice coding real evidence, don't just explain the framework.
- Calibrate assessors against shared cases and re-calibrate on a schedule.
- Enforce observe-then-evaluate so raters capture behavior before forming judgments.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Structured_Interviewing_Raising; Standardized Survey Interviewing - Minimizing Interviewer Error; The Performance Appraisal Tool Kit
Proficient
Make it valid, fair, and decision-readystrong · 13 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection in Organizations
- Selection-Assessment-Methods
- Structured_Interviewing_Raising
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Job analysis a guide to assessing work activities
- Who The A Method for Hiring
- Standardized Survey Interviewing - Minimizing Interviewer Error
This section defines what it takes for an assessment to measure the intended construct and predict later performance, and how the upstream constructs converge to produce it. It is the outcome the whole system exists to serve.
Validity / Predictive Accuracy
A selection method can be smooth, well-run, defensible, and still measure the wrong thing. Validity is the question of whether the assessment actually captures the capability you named and whether the scores tell you anything true about how someone will perform once hired. Everything else in the process is machinery in service of that one question, and it is the question most often skipped.
Validity is built long before a candidate arrives. It starts with job and role analysis, because you cannot measure a construct you have not defined, and it continues through the design of the exercises and activities that are supposed to surface that construct. Choose the wrong method for the requirement and no amount of rigor recovers it. A precise instrument aimed at the wrong target produces precise error.
Reliability and standardization feed validity but do not guarantee it. A consistent, well-structured procedure gives you a stable measurement, and a stable measurement is a precondition for an accurate one. Consistency without a real connection to the criterion is repeatable measurement of the irrelevant. The two work together: structure makes the reading trustworthy, and analysis of the actual job makes it meaningful.
When validity holds, the payoff is direct: the quality of the decisions that come out the other end. Ratings mean something, selections hold up, and the people you predicted would do well tend to. When validity is weak, the decision inherits that weakness no matter how confident it felt in the room. The score looks authoritative and predicts nothing, which is the most expensive kind of measurement there is.
Why it matters. Low validity means your selection and evaluation decisions are barely better than chance, imposing enormous hidden costs in mis-hires and mis-promotions.
Myth
An assessment that feels rigorous and looks job-related to candidates and managers is therefore valid.
Reality
Face validity and actual predictive validity are unrelated; polished, credible-seeming instruments routinely fail to predict performance, and validity can only be established empirically against criterion data.
Meta-analytic evidence confirms that assessments like general mental ability and emotional intelligence measures demonstrate predictive/operational validity for job performance criteria, consistent with the claim's definition of validity.
How to
- Define the criterion — what job success actually looks like — before evaluating any predictor against it.
- Trace validity back to its sources: job analysis relevance, method choice, standardization, and reliability, and shore up the weakest.
- Collect follow-up performance data on hires to test whether scores actually predicted outcomes.
Watch out for
- Trusting a predictor because it correlates with another predictor rather than with real performance.
- Assuming validity established elsewhere transfers to your role and population without local checking.
- Seven Criteria for Good ScenariosChecklist — 7 checkpoints
- Validation of a Structured Interview for Entry-Level Production EmployeesCase study — Hiring for entry-level labor-pool jobs in a large pulp and paper mill in the rural Southeast.
- Job Competency Mapping ProcessProcess — To identify key competencies for a role and create a validated model that can be used across HR functions like recruitment, training, and performance appraisal.
- Face validity is not predictive validity — measure predictions against real outcomes.
- Validity is built upstream from analysis, method, structure, and reliability; it cannot be added at the end.
- Define the performance criterion first, or you have nothing to validate against.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Personnel Selection in Organizations; Selection-Assessment-Methods; Structured_Interviewing_Raising; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Job analysis a guide to assessing work activities; Who The A Method for Hiring; Standardized Survey Interviewing - Minimizing Interviewer Error
moderate · 4 sources
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- GUIDELINES - Testing and Assessment
- Competency Mapping and Assessment Manual - User Guide
- HBRs 10 Must Reads on Performance Management
This section covers building development plans and providing real growth opportunities — stretch assignments, training, mentoring — that build the capabilities the role needs now and next. It focuses on turning identified gaps into experiences.
Development Planning & Capability Building
A development plan is a claim about the future, and most of them are wrong in a predictable direction: they list the courses a person can attend rather than the capabilities the person needs to build. The two are not the same. Training is one route to a capability, and often the weakest one. Stretch assignments and mentoring carry more, because they place a person in the actual conditions where the capability either forms or does not.
Start from the capability, not the catalog. Name what the person needs to be able to do, at the standard the role now demands and the standard a future role will demand, and then choose the growth opportunity that fits that gap. A stretch assignment works because it puts real stakes on skill that is still forming. Mentoring works because it gives a person access to judgment they have not yet developed themselves. A training course works when the gap is genuinely one of knowledge and not of practice.
The honest test of a development plan is whether it produces visible growth in skill and a sharper sense of one's own strengths and limits. A plan that generates activity without that growth has confused motion with progress. Development planning is only as good as the change it produces in what a person can actually do.
Why it matters. Without deliberate capability building, assessment merely labels people's current gaps while the organization's future skill needs go unmet.
Myth
Development means sending people to training courses, so a full course catalog constitutes a development strategy.
Reality
Most durable capability grows from challenging on-the-job experience and mentoring, not classroom training; a plan built only on courses builds knowledge people rarely convert into demonstrated skill.
The retrieved snippets touch on career development and training in general terms but do not substantiate the specific claim that creating development plans and providing stretch assignments, training, and mentoring builds current and future capabilities.
How to
- Anchor each development plan to specific capability gaps identified in assessment, not to generic offerings.
- Prioritize stretch assignments and real work exposure over courses as the primary growth mechanism.
- Pair experiences with mentoring or coaching so people extract learning rather than just surviving the challenge.
Watch out for
- Producing a plan of courses that never touches the actual gap the assessment surfaced.
- Assigning stretch experiences without support, so people fail visibly instead of growing.
- Career Lattice ModelFramework — A career development framework that views career paths as a flexible 'lattice' with multidirectional movements (upward, lateral, diagonal), rather than a rigid, one-way 'career ladder'.
- Individual Development Plan (IDP) TemplateTemplate — To outline an employee's long-term development goals and the specific tactics, tasks, resources, and timeline needed to achieve them.
- Build plans from assessed gaps, not from available course catalogs.
- Challenging assignments build more durable capability than training alone.
- Pair stretch experience with coaching so the challenge produces learning.
Grounded in: HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; GUIDELINES - Testing and Assessment; Competency Mapping and Assessment Manual - User Guide; HBRs 10 Must Reads on Performance Management
moderate · 5 sources
- 263074003-Competency-Dictionary
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- GUIDELINES - Testing and Assessment
- The Performance Appraisal Tool Kit
- Management: Tasks, Responsibilities, Practices
This section shows you how to connect performance to pay, recognition, and reinforcement so that differentiation actually motivates rather than demoralizes.
Reward, Recognition & Compensation Linkage
The signal a reward sends is often louder than its size. When high and low performers receive the same increase, the organization has said, precisely and in the currency people trust most, that performance does not matter. No amount of stated commitment to excellence survives that contradiction. Differentiation is the mechanism by which reward becomes information rather than an entitlement.
Money is not the only reinforcer, and treating it as such wastes the ones that cost less and often carry further. Recognition, specific and public, reinforces the behavior you want to see repeated, and it does so close to the moment the behavior occurs, when reinforcement holds. Contingent and merit pay work on a slower cycle and speak to a different need. The two are not substitutes; a system that leans entirely on either one leaves motivation on the table.
The link that matters runs from performance to reward, and it has to be legible to the person receiving it. A reward that arrives without a clear connection to what the person did teaches nothing about what to do next. When the connection is visible, reward feeds motivation and engagement directly, because the person can see that their effort registered and that superior work was treated as superior. Reward that fails to differentiate does not merely miss an opportunity; it actively erodes the motivation of the people you most want to keep.
Why it matters. Get the linkage wrong and your top performers quietly disengage while your average performers game the metrics that trigger payouts.
Myth
Practitioners believe that bigger financial incentives always produce proportionally stronger motivation.
Reality
Money is a hygiene factor with a saturation point; beyond fairness thresholds, non-financial recognition and the perceived legitimacy of who gets rewarded drive far more discretionary effort than the size of the check.
Evidence confirms that linking pay to performance can motivate performance and satisfaction, but multiple studies caution that tangible/contingent rewards can undermine intrinsic motivation, making the effect conditional.
How to
- Separate the merit conversation from the development conversation so feedback isn't heard purely as a negotiation over pay.
- Make the criteria for differentiated reward explicit and defensible before ratings are set, not after.
- Pair every material reward with timely, specific recognition that names the behaviour being reinforced.
Watch out for
- Forced-distribution pay curves that shrink the reward gap until 'exceptional' and 'solid' feel identical to recipients.
- Recognition that becomes routine or universal, which strips it of its signalling value.
- Perceived fairness of allocation predicts motivation more than absolute reward magnitude.
- Recognition works because it is specific and scarce, not because it is frequent.
- Decide differentiation criteria up front so rewards read as principled, not political.
Grounded in: 263074003-Competency-Dictionary; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; GUIDELINES - Testing and Assessment; The Performance Appraisal Tool Kit; Management: Tasks, Responsibilities, Practices
moderate · 4 sources
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
- HBRs 10 Must Reads on Performance Management
- Management: Tasks, Responsibilities, Practices
This section covers how to build a cascaded, weighted scorecard that communicates strategy and delivers both leading and lagging feedback.
Measurement / Scorecard System
A scorecard is a communication device before it is a measurement device. What an organization chooses to count, and how heavily it weights each thing, tells everyone below the strategy far more clearly than any strategy document. Cascade the metrics well and a person three levels down can see how their work connects to what the enterprise is trying to achieve. Cascade them badly and you have broadcast confusion with the authority of numbers.
Weighting is where the strategy actually lives. A metric with heavy weight declares a priority; a metric with light weight declares a nice-to-have. When the weights contradict the stated strategy, people follow the weights, because the weights are attached to consequences and the strategy statement is not. Getting the weights right is the harder and more consequential half of the work.
The most useful systems balance lagging measures against leading ones. Lagging metrics tell you what already happened, which is necessary and insufficient; leading metrics point at what is forming, and give a person the chance to act before the result is fixed. A scorecard weighted entirely toward lagging outcomes reports history. One that also carries reliable leading indicators lets people steer.
Reliability underwrites all of it. A metric people do not trust, or that measures something other than what it claims to measure, corrodes the whole system, because a single suspect number gives everyone permission to discount the rest. When the measures are cascaded, weighted, forward-looking, and trusted, they do the thing a scorecard is for: they align the people who use them around a shared understanding of what the work is supposed to produce.
Why it matters. Metrics are how strategy gets translated into daily behaviour, so a badly weighted scorecard silently reorganizes the whole organization around the wrong things.
Myth
Teams believe that measuring more things gives them a more complete picture of performance.
Reality
Every metric competes for attention, and a scorecard crowded with lagging indicators tells you what already happened rather than steering what comes next; discipline in selecting a few leading measures beats comprehensiveness.
Some retrieved papers support that performance measurement systems communicate strategy and cascade aligned goals with feedback, but none specifically validate the cascaded, weighted KPI/scorecard design or its leading/lagging future-focused structure.
How to
- Cascade metrics from strategic objectives downward so each KPI has a visible line back to strategy.
- Assign explicit weights and include at least one leading indicator per objective, not only outcome lagging measures.
- Test each metric for reliability and gameability before you deploy it.
Watch out for
- Choosing metrics because they are easy to collect rather than because they signal strategy.
- Scorecards that reward hitting the number while eroding the outcome the number was meant to represent.
- Deloitte's Performance Management ReinventionCase study — Deloitte found its traditional performance management system was not driving employee engagement or high performance.
- The Ineffective Presenter (Deepa)Case study — An employee (Deepa) delivers a rocky new-employee orientation presentation.
- A few weighted leading indicators outperform a long list of lagging ones.
- Every metric must trace back to a strategic objective or it dilutes focus.
- Test for gameability before deployment, not after behaviour distorts.
Grounded in: Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers; HBRs 10 Must Reads on Performance Management; Management: Tasks, Responsibilities, Practices
strong · 8 sources
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- Management: Tasks, Responsibilities, Practices
- GUIDELINES - Testing and Assessment
- The Performance Appraisal Tool Kit
- Management: Tasks, Responsibilities, Practices
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
This section addresses the internal drive and psychological investment that turns capability into discretionary effort, and how goals, feedback, and reward feed it.
Motivation & Engagement
Engagement is not a mood management sets; it is a response to conditions management creates. People bring internal drive to work when the work offers something worth investing in — a challenge that stretches them, autonomy in how they meet it, meaning in why it matters, and recognition when they deliver. Strip those away and even capable people go quiet, doing the minimum that keeps them out of trouble.
Several levers feed this. Goal setting that gives someone a real objective, rather than a vague assignment, supplies the challenge and the sense that their effort is directed at something. Feedback and coaching sustain investment by showing people their progress and treating their growth as something worth a manager's attention. Reward, recognition, and compensation reinforce the behavior you want repeated — not only through pay, but through the plain act of noticing good work and saying so.
What makes motivation worth the effort is what it produces. Engaged people behave more accountably and more productively, because the drive is theirs rather than borrowed from supervision. And they stay. Engagement is one of the stronger currents feeding retention and the growth of talent, because people rarely leave work they are genuinely invested in for reasons other than the work itself.
The practical implication is uncomfortable for anyone hoping for a shortcut: you cannot demand engagement or announce it into being. You build the conditions and let the drive follow. When it does, it compounds; when the conditions decay, no incentive scheme buys the investment back.
Why it matters. Motivation is the multiplier on every skill and system you build; without it, well-designed processes produce compliance rather than commitment.
Myth
Practitioners treat motivation as something you install through incentives and recognition programs.
Reality
Sustainable engagement is intrinsic—rooted in autonomy, mastery, and meaning—and extrinsic levers mostly protect it from erosion; you cannot bolt on motivation that the work itself withholds.
Peer-reviewed evidence links employee motivation and engagement to recognition, autonomy, meaning, and challenge as energizing drivers of psychological investment in work.
How to
- Design roles with meaningful autonomy over how work gets done, not just what.
- Connect individual effort to a visible outcome or beneficiary so the work carries meaning.
- Use feedback to signal progress toward mastery, which is a stronger motivator than praise alone.
Watch out for
- Relying on extrinsic incentives that can crowd out the intrinsic motivation already present.
- Confusing high activity or long hours with genuine psychological investment.
- Four Mechanisms for Creating a Thriving WorkforceFramework — A framework identifying four essential conditions managers must create to foster a workforce that is both energized (vitality) and growing (learning).
- Job Characteristic ChecklistChecklist — 4 checkpoints
- Extrinsic rewards protect motivation more than they create it.
- Autonomy, mastery, and meaning are the durable sources of engagement.
- Feedback that shows progress toward mastery beats generic praise.
Grounded in: HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; Management: Tasks, Responsibilities, Practices; GUIDELINES - Testing and Assessment; The Performance Appraisal Tool Kit; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide
moderate · 4 sources
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection in Organizations
This section covers how feedback and development translate into genuine self-awareness of strengths and blind spots plus real capability gain.
Self-Awareness & Skill Growth
Development has two distinct outputs that get lumped together and shouldn't be. One is knowing more about yourself — a clearer picture of your strengths, your weaknesses, and the effect your behavior actually has on others, which is often the last thing a person sees accurately about themselves. The other is being able to do more — new capabilities and job knowledge that expand what you can competently take on. Growth in the first without the second is insight with no outlet; growth in the second without the first is skill applied blindly.
Self-awareness comes largely from feedback and coaching, because most people cannot see their own behavioral impact from the inside. A colleague's reaction, a manager's observation, a pattern named out loud — these supply the external mirror that self-reflection alone cannot. The value is not in the compliment or the criticism but in the correction of a private picture that had drifted from reality.
Skill and knowledge come from development planning and deliberate capability building — the structured decision to close a specific gap rather than hoping exposure will eventually do it. This is where awareness earns its keep: knowing a weakness gives the development plan a target, and a target is what separates real growth from generic training that everyone attends and no one changes because of.
The recognition worth holding onto is that these two reinforce each other in a loop. Feedback reveals what to work on; capability building addresses it; the new capability changes the person's behavioral impact, which generates new feedback. A person who has both is not merely more skilled. They are more accurate about themselves, which is the harder and more durable gain.
Why it matters. Development without self-awareness produces training that never changes behaviour, because people can't fix a gap they don't believe they have.
Myth
People assume that receiving feedback automatically increases self-awareness.
Reality
Feedback only builds self-awareness when the recipient accepts it as valid; without psychological safety and a trusted source, feedback triggers defensiveness that entrenches the blind spot it was meant to reveal.
The retrieved snippets touch on self-awareness definitions and feedback effects in isolation but do not substantiate the specific claim that employee self-awareness and skill/knowledge growth arise from feedback and development.
How to
- Pair feedback with a specific behavioural example so it is concrete rather than characterological.
- Separate the moment of receiving feedback from the moment of judgment about it to reduce defensiveness.
- Convert accepted insight into a specific practice commitment so awareness becomes skill.
Watch out for
- Feedback framed as identity ('you are disorganized') rather than behaviour, which provokes defence.
- Assuming acknowledgment of feedback equals acceptance of it.
- Assessment of Merged Management TeamCase study — Following a merger between a complacent, reputable firm and an innovative but less commercially-focused one, the combined management team of a division was assessed.
- Conducting a Constructive Feedback DiscussionProcess — To elicit positive change in an employee's future performance or behavior through a productive, two-way dialogue.
- Feedback changes behaviour only once the recipient accepts it as valid.
- Behaviour-specific feedback lands where trait-based feedback rebounds.
- Self-awareness must convert into a practice commitment to become growth.
Grounded in: HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Personnel Selection in Organizations
strong · 10 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Selection-Assessment-Methods
- Personnel Selection and Assessment
- Personnel Selection in Organizations
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Understanding performance appraisal social, organizational, and goal-based perspectives
This section explains how applicants judge your selection process for fairness, relevance, and respect—and why those judgments matter beyond the hire.
Candidate/Applicant Reactions & Perceived Fairness
A candidate forms a verdict on your company long before you form one on them. Every step of a selection process sends a signal about how the organization treats people, and applicants read those signals closely: whether the questions relate to the work, whether the process explains itself, whether they were treated with respect, whether the whole thing seemed acceptable. These appraisals are both cognitive and emotional, and they accumulate.
The reactions matter for reasons beyond courtesy. When applicants perceive a procedure as fair and relevant, they engage with it more honestly and completely, which sharpens the quality of the decision you make from it. A method the candidate sees as arbitrary or invasive degrades its own signal — people withdraw, hedge, or disengage, and the assessment measures less of what you intended. So perceived fairness quietly shapes how well your selection decision actually works.
There is a second channel, slower but real. Candidates talk, decline offers, and carry impressions into markets where you will recruit again. A process that reads as transparent and respectful protects the value the organization gets from selection over time; one that reads as opaque or demeaning erodes it, offer by offer, referral by referral.
The practical recognition is that fairness is not a compliance layer laid on top of a valid method. Relevance — the visible tie between what you ask and what the job requires — is often the same thing candidates experience as fair. Build the process to measure the right things in a way the candidate can see, and the fairness tends to follow rather than needing to be manufactured.
Why it matters. Candidate reactions shape whether your best prospects accept offers, whether rejects reapply or litigate, and whether your employer brand survives the process.
Myth
Employers assume that a valid, statistically sound selection method is automatically perceived as fair.
Reality
Predictive validity and perceived fairness are distinct; a highly valid method that feels opaque or irrelevant to the job can produce worse candidate acceptance and reputation than a less valid but transparent, face-valid one.
Applicant reactions are defined as attitudes, affect, and cognitions about the hiring process, encompassing procedural justice/fairness perceptions of selection methods.
How to
- Use assessments with obvious job relevance and explain that relevance to candidates.
- Give candidates timely, respectful communication at every stage, including rejection.
- Offer transparency about how decisions are made and, where feasible, feedback on results.
Watch out for
- Deploying a black-box assessment that maximizes validity while alienating candidates.
- Treating rejected candidates carelessly—they talk publicly and may be future customers or reapplicants.
- Positive Applicant Reaction ChecklistChecklist — 4 checkpoints
- Face validity and transparency drive acceptance independent of statistical validity.
- Every candidate's experience becomes part of your public employer brand.
- Respectful rejection protects your future applicant pool.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Selection-Assessment-Methods; Personnel Selection and Assessment; Personnel Selection in Organizations; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Understanding performance appraisal social, organizational, and goal-based perspectives
moderate · 4 sources
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Who The A Method for Hiring
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
This section addresses the congruence between a candidate's values, skills, and will and the demands, culture, and rewards of the role and organization.
Person-Role / Culture Fit
Fit is the congruence between what a person needs and what a role offers, measured on both sides. On one side sit the individual's needs, values, skills, and will; on the other, the demands of the job, the culture that surrounds it, and the rewards it delivers. A strong candidate placed against a role that frustrates their values or fails to reward what motivates them will underperform — not from incapacity, but from misalignment.
Skill is the part organizations assess most confidently and the part that predicts fit least completely. A person can be fully capable of the work and still be poorly matched, because the culture rewards behavior they find hollow, or the role demands a pace or a style that runs against their grain. Will and values do quieter work, and they show up over months rather than in an interview, which is why they are so often underweighted in the decision.
Because fit predicts performance, the assessment has to look at both halves honestly. That means describing the role and its culture with the same candor you apply to evaluating the candidate — the actual demands, the real rewards, the way work gets done. A fit judgment built on a flattering picture of the job is a guess dressed as an analysis. The stronger read comes from matching a truthful account of the person to a truthful account of the place.
Why it matters. Strong fit predicts retention and discretionary effort, but the wrong conception of fit quietly filters out difference and homogenizes your workforce.
Myth
Practitioners equate culture fit with hiring people who resemble the current team.
Reality
Genuine fit is congruence between what the person needs and what the role and organization supply—not demographic or stylistic similarity; conflating the two produces homogeneity mistaken for cohesion and screens out valuable difference.
The literature substantiates person-job and person-organization fit as the congruence between an individual's values, skills, and abilities and the demands, culture, and rewards of the job or organization.
How to
- Define fit in terms of values and role demands, not personality similarity to incumbents.
- Assess both what the candidate can offer and what they need to thrive—fit is bidirectional.
- Distinguish culture fit from culture add so difference is treated as an asset.
Watch out for
- Using 'fit' as an unexamined justification for gut-level similarity bias.
- Optimizing fit to the current culture even when the strategy requires changing that culture.
- Performance Management Development FrameworkFramework — A conceptual model illustrating the key elements to consider when designing and implementing a performance management system.
- Strategic Staffing ModelsFramework — A set of three conceptual models that describe the relationship between an organization's staffing practices and its competitive strategy.
- Preparation Checklist for an Individual's Performance ReviewChecklist — 9 checkpoints
- Fit is need-supply congruence, not resemblance to the existing team.
- Assess what the role offers the person as well as what the person offers the role.
- 'Culture add' guards against homogenizing your workforce under the banner of fit.
Grounded in: Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Who The A Method for Hiring; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
strong · 9 sources
- 263074003-Competency-Dictionary
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Understanding performance appraisal social, organizational, and goal-based perspectives
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Management: Tasks, Responsibilities, Practices
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
This section is about the accuracy of the judgment you record—whether the person you rated high actually performs high—separate from whether the process felt fair.
Rating / Selection Decision Quality
A good decision and a good outcome are not the same thing. You can hire the right person for the wrong reasons and hire the wrong person after doing everything correctly. Rating and selection decision quality lives in the first half of that sentence: it asks whether the recorded judgment actually corresponds to how well this person will match the role and rise to be a high performer, independent of the luck that follows.
The quality of the decision is downstream of one thing above all: whether your assessment measures what it claims to measure and predicts what you need predicted. A well-validated method feeds a defensible rating; a method chosen by habit or comfort feeds a rating that merely feels right. The difference rarely announces itself in the moment. Two evaluators can record the same confident number, and only one of them is tracking the future.
Good tools and clean data sharpen the judgment rather than replace it. They organize the evidence, flag the inconsistencies, and force the private impression into a form that can be checked. But the rating remains a judgment, and judgment is porous. What a candidate feels about the process, whether it struck them as fair, whether the setting itself distorted their behavior, all press on the number that gets written down.
The honest test is not whether a decision produced a hire you like today. It is whether the same method, applied to the next hundred people, would keep sorting them correctly. That is the recognition worth holding: a rating is a prediction, and predictions are graded by accuracy, not by how sure you were when you made them.
Why it matters. A decision that looks defensible but doesn't predict performance quietly staffs your organization with the wrong people at scale.
Myth
A structured, well-documented process automatically produces an accurate decision.
Reality
Structure improves consistency, but a rating can be consistently wrong; accuracy comes from predictors that actually relate to performance and from restraining the evaluator's private impressions from overriding the evidence.
Retrieved papers document the modest reliability and rater disagreement that constrain rating/selection decision quality, but none directly validate a construct measuring the accuracy of recorded selection decisions in identifying future high performers.
How to
- Anchor every rating to job-relevant evidence collected before the overall judgment is formed, not reconstructed after.
- Separate the evidence-gathering step from the summary decision so first impressions don't contaminate later data.
- Track hit rates: revisit past decisions against subsequent performance to calibrate your judgment.
Watch out for
- Letting a single vivid signal (a polished interview, one bad quarter) dominate a multi-factor decision.
- Assuming inter-rater agreement means accuracy—raters can share the same bias.
- Consistency and accuracy are different properties; you can have one without the other.
- The private judgment matters most, so protect the moment of decision from anchoring and halo effects.
- You only learn if your decisions are good by auditing them against later performance.
Grounded in: 263074003-Competency-Dictionary; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Understanding performance appraisal social, organizational, and goal-based perspectives; Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Management: Tasks, Responsibilities, Practices; Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
strong · 13 sources
- 263074003-Competency-Dictionary
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- How to Measure Employee Performance (The performance management series)
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection in Organizations
- Selection-Assessment-Methods
- GUIDELINES - Testing and Assessment
- The Performance Appraisal Tool Kit
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Who The A Method for Hiring
This section defines what you are ultimately trying to predict and improve, and how to measure it without collapsing into proxies.
Individual / Job Performance
Performance is not effort, and it is not likability. It is the quality, the timeliness, and the value added by what a person actually produces, measured against what the role was supposed to deliver. An employee can be busy, agreeable, and present, and still fall short of that standard. The measure is the work and its impact, held next to the goals and expectations that were set for it.
Most of what predicts this outcome is decided before the person starts. The knowledge, skills, abilities, and other attributes they bring set a ceiling. How well the person fits the role and the culture around it determines how much of that ceiling gets reached. A capable person in a badly matched seat underperforms a modestly capable person in a well-matched one, which is why fit predicts results rather than merely correlating with comfort.
Once someone is in the seat, performance is sustained by accountable, productive behavior day to day. The attributes explain what a person can do; the behavior explains what they reliably do when no one is watching the clock. Both feed the same result.
All of this matters because individual performance is where organizational value is manufactured. The financial benefit an organization realizes from its people is not a separate lever you pull; it is the accumulation of individual work outcomes, one role at a time. Get the person-to-role match right, keep the behavior productive, and the value follows. Get it wrong, and no downstream system recovers what was lost at the source.
Why it matters. Everything upstream—selection, ratings, coaching—is only worth its cost if it moves the quality, timeliness, and value of actual work.
Myth
Performance is a single number that ranks people cleanly from best to worst.
Reality
Performance is multidimensional and often role-specific; the same person can be a top producer and a poor collaborator, and forcing it onto one axis destroys the information you need to act.
Peer-reviewed work confirms that job performance is a multidimensional construct encompassing task, contextual, and overall performance dimensions reflecting work outcomes relative to goals and expectations.
How to
- Specify what 'good' looks like for this role in terms of outcomes and behaviours before the period starts.
- Weight dimensions by what the role actually requires rather than defaulting to what is easy to count.
- Distinguish results the person controlled from results driven by market, tools, or teammates.
Watch out for
- Measuring only what the current system already captures, which systematically undervalues collaborative and preventive work.
- Attributing team or contextual outcomes to individuals and vice versa.
- The 7-Step Performance Plan Creation FrameworkFramework — A systematic, cascading framework for translating high-level organizational strategy into specific, measurable, and trackable individual employee performance goals.
- ASCII Control Codes for Team ProficiencyFramework — A framework for assessing a candidate's fit within a team by evaluating five key interpersonal proficiencies.
- Campbell's Theory of Performance DeterminantsFramework — A model positing that individual differences on any component of job performance are a direct function of three, and only three, major determinants.
- Adverse Impact Reduction Strategy CheckChecklist — 6 checkpoints
- Performance Plan for an Administrative SecretaryCase study — An example for a support role, demonstrating how to measure contributions that are often seen as qualitative or task-based.
- Supermarket Checkout Personnel PerformanceCase study — A study by Sackett, Zedeck, and Fogli (1988) examined the performance of supermarket checkout personnel.
- Robert Owen's Character CubesCase study — Early 1800s cotton mills in New Lanark, Scotland, managed by industrialist Robert Owen.
- Organizational Measures WorksheetTemplate — To document the relevant high-level goals that the individual's performance plan must align with.
- Performance Matrix (Visual Assessment Tool)Template — To provide a visual, non-mechanistic assessment of an individual's overall contribution by plotting them on a two-dimensional grid, facilitating a balanced discussion about performance.
- Employee Self-Evaluation FormTemplate — To gather employee input on their accomplishments, development needs, and future goals prior to the manager writing the formal performance review.
- Model Performance Appraisal Template (Structure)Template — To provide a comprehensive, ready-to-use template for assessing employee performance that can be adapted by any organization.
- Mixed Standard Scale (MSS) Example TemplateTemplate — To construct a rating scale that reduces halo and leniency biases by mixing behavioral items from different performance dimensions and quality levels.
- Creating Employee Performance PlansProcess — To create clear, verifiable, and motivating performance goals that align individual work with organizational priorities.
- Define performance dimensions per role before measuring, or you will measure the measurable rather than the important.
- Separate signal the person controlled from noise they didn't.
- A single performance score hides the diagnostic detail you need to coach or select.
Grounded in: 263074003-Competency-Dictionary; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; How to Measure Employee Performance (The performance management series); Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Personnel Selection in Organizations; Selection-Assessment-Methods; GUIDELINES - Testing and Assessment; The Performance Appraisal Tool Kit; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Who The A Method for Hiring
strong · 8 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Selection-Assessment-Methods
- Structured_Interviewing_Raising
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Personnel Selection and Assessment
This section covers avoiding discriminatory adverse impact and building selection and appraisal that hold up under scrutiny.
Fairness, Adverse Impact & Legal Defensibility
A selection or appraisal method can be legally defensible for the same reason it is accurate: it measures what actually matters for the job. This is the point most easily missed. Fairness is not a separate compliance layer bolted onto a valid process to keep lawyers calm. It grows out of validity. When a method predicts performance because it genuinely captures job-relevant ability, it tends to sort people on grounds a court will recognize as legitimate, and it tends not to disadvantage groups for reasons unrelated to the work.
Adverse impact is the failure mode to watch. A process can look neutral on its face and still produce systematically unequal outcomes across groups. The question is never only whether outcomes differ, but whether the difference traces to something the job requires or to something the method smuggled in by accident. A valid, job-related method gives you an answer you can stand behind; an unvalidated one leaves you defending a pattern you cannot explain.
The practical consequence is that defensibility and utility point the same direction. A process that avoids discriminatory impact and can withstand challenge is also the process that protects the financial value of the whole system, because litigation, remediation, and reputational damage all subtract from that value. Fairness done properly is not a tax on effectiveness. It is a condition of it, and the same discipline that earns one earns the other.
Why it matters. An indefensible process exposes you to legal liability, reputational damage, and the moral cost of systematically excluding qualified people.
Myth
If the process is validated and job-related, adverse impact is legally safe and no further action is needed.
Reality
Validity is a defense, not immunity; if a valid predictor produces adverse impact and a less-discriminatory alternative of comparable validity exists, you are still exposed and still obligated to consider it.
The retrieved papers touch on applicant fairness perceptions and fairness concepts but do not address adverse impact, equitable group outcomes, or legal defensibility of selection/appraisal.
How to
- Run adverse-impact analysis on every selection stage, not just the final decision, since compounding at each gate is where disparities hide.
- Document the job-relatedness and business necessity of each predictor at the time you adopt it.
- Actively search for less-discriminatory alternatives of equal validity and record why you chose or rejected them.
Watch out for
- Treating validity and fairness as the same thing—a predictor can be valid and still produce unjustifiable disparate impact.
- Auditing only the hire/no-hire step while resume screens and assessments quietly filter groups out earlier.
- The Paddington Guards Case (UK)Case study — A UK legal challenge in the 1990s where British Rail used cognitive tests for promoting guards to train drivers.
- Adverse impact accumulates across stages, so analyze each gate separately.
- Validity is a legal defense, not an exemption from seeking less-discriminatory alternatives.
- Contemporaneous documentation of job-relatedness is what actually survives a challenge.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Selection-Assessment-Methods; Structured_Interviewing_Raising; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Personnel Selection and Assessment
emerging · 2 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
This section covers using ability tests, personality inventories, and norm groups ethically and with validity awareness rather than as impressive-looking props.
Appropriate Psychometric & Norm Use
Ability tests and personality inventories carry an unearned authority. A number in a report reads as objective, and that appearance of precision is exactly what makes them dangerous in untrained hands. A score is only evidence of competence when the instrument was built to measure something relevant, validated for the purpose you are using it for, and interpreted against a norm group that actually resembles the people you are assessing. Strip any of those away and you are left with a number that looks like measurement and functions like guesswork.
The norm group is where most quiet damage happens. A percentile means nothing on its own; it means something only relative to the population it was calibrated against. Compare a candidate to the wrong reference group and you can manufacture a strength or a deficit that does not exist. The score did not lie. The comparison did.
Proper use also has an ethical spine, not just a technical one. The people who administer and interpret these instruments need genuine training, because the failure modes—over-reading a small difference, treating a personality profile as a verdict, applying a test outside the range it was validated for—are invisible to anyone who has not been taught to see them.
Used with that discipline, psychometrics add real evidence to a decision that would otherwise lean too hard on impression. Used casually, they add false confidence, which is worse than no evidence at all because it resists challenge. The test is not the authority. The validity behind it is, and validity is always conditional on how you use it.
Why it matters. Misused psychometrics create a false veneer of objectivity that makes bad decisions harder to challenge and easier to defend legally—until they aren't.
Myth
A published, well-known test is inherently objective and can be interpreted by anyone who buys it.
Reality
A test's validity is specific to the role, population, and norm group applied; interpreting scores without proper training or against the wrong norms produces confident, precise, and wrong conclusions.
How to
- Confirm the test is validated for your role and population before using it, not just that it is reputable.
- Match candidates to the appropriate norm group and disclose its limits.
- Restrict interpretation to properly qualified users and use scores as one input among several.
Watch out for
- Treating a numeric score as more objective than a structured interview simply because it is a number.
- Applying a norm group that doesn't represent your applicant population.
- Entry-Level Staffing Assessment ProcessProcess — To efficiently and consistently screen large numbers of applicants to identify those with the highest potential for success and retention.
- Professional Staffing Assessment ProcessProcess — To conduct a thorough, multi-stage evaluation to identify the best candidate from a pool of qualified individuals, while also recruiting top talent.
- Performance Fair Referral using Test ScoresProcess — To balance the organizational goal of maximizing workforce productivity with the societal goal of ensuring fair opportunity for minority group members who score lower on average on the test than they perform on the job.
- Validity is conditional on role, population, and norm group—not a fixed property of the instrument.
- Numerical precision is not accuracy; untrained interpretation manufactures false certainty.
- Psychometric scores are one evidence stream, never a standalone verdict.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
Expert
Align the whole system to strategy and valuemoderate · 5 sources
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Management: Tasks, Responsibilities, Practices
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- HBRs 10 Must Reads on Performance Management
- Job analysis a guide to assessing work activities
This section explains the data, analytics, and technology backbone that makes assessment and selection decisions defensible and repeatable.
Enabling Data, Analytics & Technology
Assessment produces numbers, and numbers accumulate. Scores from structured interviews, ratings across a panel, results from ability tests, records of who was hired and who succeeded — each decision leaves a trail. The question is whether that trail becomes usable knowledge or dies in a spreadsheet nobody opens again. Data management is the unglamorous prerequisite: consistent formats, records tied to specific criteria, results stored where they can be compared rather than scattered across inboxes and personal files.
Analytic intelligence turns those stored records into something that improves the next decision. When you can look back and see which assessment signals actually predicted who performed, you learn where your process is working and where it is only pretending to. Predictive analytics formalizes that instinct: it uses past patterns to estimate future performance, which is exactly what every selection decision is trying to do, usually by intuition alone.
The technology serves the judgment; it does not replace it. A system that scores candidates faster still needs criteria that mean something, and a model trained on past hiring can quietly inherit past bias. Ethical people analytics is the discipline of watching for that — knowing what the data is allowed to be used for, whose interests it serves, and where a correlation should not become a decision on its own.
What this infrastructure ultimately affects is the quality of the rating or selection decision at the end of the line. Better data does not guarantee a better choice, but its absence guarantees you will keep repeating the same errors without ever seeing them. The organizations that improve are the ones that treat each decision as evidence for the next.
Why it matters. Good analytics infrastructure turns intuition into evidence, while poor or ungoverned data quietly encodes yesterday's bias into tomorrow's automated decisions.
Myth
Organizations assume that acquiring a people-analytics platform will surface better decisions on its own.
Reality
Analytics amplify the quality of the underlying data and the questions asked; predictive models trained on biased historical outcomes reproduce and scale that bias with a veneer of objectivity.
The retrieved papers discuss big data analytics capabilities, AI in talent management, and big data adoption broadly, but none specifically substantiate the claim about ethical people analytics and technology infrastructure supporting assessment and decision-making as a defined construct.
How to
- Audit data quality and provenance before building any predictive model on it.
- Establish ethical guardrails and consent norms for people analytics up front, not as an afterthought.
- Keep a human decision-maker accountable for outputs so the model informs rather than replaces judgment.
Watch out for
- Treating model outputs as neutral facts when they encode the biases of the training data.
- Deploying predictive tools without an explainability standard managers can defend to candidates and regulators.
- Ten Aspects of a Successful Strategic Performance Improvement MeetingChecklist — 10 checkpoints
- Strategic Performance Improvement MeetingProcess — To use performance data for collaborative, forward-looking strategic decision-making and learning, rather than backward-looking judgment.
- Analytics scale the quality of your data and questions, including their flaws.
- Ethical guardrails must precede deployment, not follow a scandal.
- A model should inform an accountable human decision, never make it unattended.
Grounded in: Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Management: Tasks, Responsibilities, Practices; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; HBRs 10 Must Reads on Performance Management; Job analysis a guide to assessing work activities
moderate · 5 sources
- 263074003-Competency-Dictionary
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Management: Tasks, Responsibilities, Practices
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
This section shows how to make individual and team effort congruent with strategy and how to ensure people understand their contribution to it.
Strategic Alignment & Shared Understanding
Alignment is easy to assert and hard to observe. A leadership team can agree on a strategy in a room and still watch the organization spend its days on work that has nothing to do with it. The gap is rarely defiance. It is that most people never learn how their particular job connects to the larger aim, so they optimize for what is in front of them — the task, the deadline, the metric on their own review — which may or may not point the same direction as the strategy.
Alignment exists when an individual can explain, without prompting, how their effort contributes to a strategic objective, and when their actual priorities reflect that explanation. Both halves matter. Understanding without congruent behavior is a slogan; congruent behavior without understanding is luck that will not survive a change in conditions.
Two things make this real. A measurement or scorecard system that translates strategy into concrete indicators gives people something specific to aim at rather than an abstraction to nod along with. And leadership and managers who actively support the connection — who repeat it, resource it, and reward it — turn a stated priority into a felt one. Managers are the translation layer; when they buy in, the line from strategy to daily work becomes visible to the people doing that work.
When alignment holds, accountable and productive behavior follows almost as a byproduct, because people are no longer guessing whether their effort counts. They know it does, and they know toward what.
Why it matters. When people can't see how their work serves the strategy, effort scatters into locally rational but organizationally wasteful activity.
Myth
Leaders think that publishing the strategy widely creates alignment.
Reality
Communication produces awareness, not alignment; people align only when they can translate the strategy into concrete choices about what to prioritize and what to drop in their own role.
Some retrieved papers touch on shared goals, goal congruence, and strategic alignment of performance systems, but none directly validate the composite construct of strategic alignment and shared understanding as defined.
How to
- Have each team articulate, in its own words, how its priorities serve a named strategic objective.
- Use the scorecard to make the line-of-sight from daily work to strategy explicit and visible.
- Equip managers to interpret strategy locally so alignment survives translation down the hierarchy.
Watch out for
- Assuming a cascaded slide deck equals shared understanding on the front line.
- Alignment that exists on paper but is contradicted by what actually gets rewarded.
- Strategic Alignment of Assessment PracticesFramework — A framework for aligning an organization's assessment system with its overarching corporate strategy, as defined by models like Miles & Snow's (Prospector, Defender) or Porter's (Cost Leadership, Innovation).
- Strategic Context Clarification and MappingProcess — To develop a shared, comprehensive understanding of the organization's strategy and articulate it as a visual business model.
- Awareness of strategy is not the same as alignment to it.
- Alignment shows up as what a team decides to stop doing, not just what it pursues.
- Line-of-sight must survive translation through every layer of management.
Grounded in: 263074003-Competency-Dictionary; Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Management: Tasks, Responsibilities, Practices; Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers; Managing Staff Selection and Assessment (Managing Work and Organizations Series)
strong · 8 sources
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- Management: Tasks, Responsibilities, Practices
- GUIDELINES - Testing and Assessment
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Personnel Selection in Organizations
- The Performance Appraisal Tool Kit
- How to Measure Employee Performance (The performance management series)
- HBRs 10 Must Reads on Performance Management
This section shows you how to make ownership and discretionary effort visible and repeatable, rather than hoping it emerges on its own.
Accountable & Productive Work Behaviour
Accountable behavior is what you actually see: someone takes ownership of a commitment, puts in effort beyond the minimum, meets what they said they would meet, and works in a way that is both productive and safe. It spans the task itself and the context around it — the help offered to a colleague, the shortcut not taken. This observable pattern is the raw material of individual performance; it is the doing that results in results.
The behavior does not arrive on its own. Motivation and engagement generate it — people who care about the outcome supply the discretionary effort that no job description can compel. Feedback and coaching sustain it, correcting drift and reinforcing what works before habits harden the wrong way. And a shared understanding of where the organization is going gives the effort a direction, so that ownership attaches to the things that matter rather than to busywork.
The sequence is worth holding onto because it tells you where to intervene when the behavior is missing. Weak accountability is rarely a character defect. More often it traces back to an absent link in the chain: no clear line from the person's work to the larger aim, no feedback telling them how they are doing, or nothing that makes the effort feel worth giving. Fix the condition and the behavior tends to return; exhort the person while leaving the condition intact and it will not.
Why it matters. When employees own their commitments, performance systems measure real contribution instead of policing compliance; when they don't, you manage a workforce that does only what is inspected.
Myth
Practitioners believe accountable behaviour is a personality trait you hire for—some people have it, some don't.
Reality
Accountability is overwhelmingly a function of clarity, feedback, and felt ownership; the same person behaves accountably under clear expectations and disengages under ambiguous ones.
The retrieved papers address related constructs (task and contextual performance, OCB, discretionary effort) that partly map to the claim's components, but none defines or validates the composite 'Accountable & Productive Work Behaviour' construct as stated.
How to
- Define commitments as observable, time-bound deliverables the employee helped set, not manager-imposed quotas.
- Make contextual behaviours (helping, safety, initiative) explicit in the role scorecard so discretionary effort is recognized, not invisible.
- Close the loop weekly: name the commitment, the outcome, and the next step in the employee's own words.
Watch out for
- Rewarding only visible task output trains people to abandon the citizenship behaviours that hold teams together.
- Confusing busyness with ownership—hours logged and messages sent are activity, not accountability.
- Ownership rises when people co-author their commitments, not when they are assigned to them.
- Contextual behaviours must be named in the role definition or they will be neither seen nor sustained.
- If your best people stop going beyond the task, look at clarity and feedback before you look at motivation.
Grounded in: HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; Management: Tasks, Responsibilities, Practices; GUIDELINES - Testing and Assessment; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Personnel Selection in Organizations; The Performance Appraisal Tool Kit; How to Measure Employee Performance (The performance management series); HBRs 10 Must Reads on Performance Management
moderate · 5 sources
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- The Performance Appraisal Tool Kit
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Competency Mapping and Assessment Manual - User Guide
This section covers keeping and growing the people who matter, and building the pipeline behind them.
Retention & Talent Growth
Keeping good people is quieter than hiring them, and easier to neglect. There is no offer letter, no start date, no visible win. There is only the absence of a departure, which never shows up as an achievement. Retention and talent growth is the organization's ability to hold onto high performers, help them get better, and build a bench deep enough that a single exit does not become a crisis.
What holds talented people in place is largely what makes them want to do the work at all. Motivation and engagement produce retention; they are not adjacent to it. A person who is engaged with the work and connected to why it matters has fewer reasons to leave and more reasons to develop inside the role. When that engagement erodes, the résumé goes out long before the resignation comes in.
Growth is the other half, and it is not optional. Keeping people who stop improving builds a stable but stagnant workforce. The aim is to keep the ones who are getting better and to keep making them better, so the pipeline fills from within rather than being repurchased from the market at a premium.
Unwanted turnover is the failure this construct guards against, and its cost is easy to underestimate because it arrives as a series of small, individually excusable losses. The recognition worth keeping is that retention is produced, not preserved. It is the visible result of engagement done well, and it decays the moment that engagement is taken for granted.
Why it matters. Losing a high performer erases the return on every selection and development dollar you spent, and the replacement rarely arrives at the same level.
Myth
Retention is primarily a compensation problem solved by matching outside offers.
Reality
Pay prevents defection at the margin but rarely drives it; the strongest people leave over growth, manager quality, and being asked to do meaningful work, and counteroffers usually just delay the exit.
The literature confirms that talent management, career growth opportunities, and supportive work environments strengthen retention of high-performing employees and reduce voluntary turnover, while loss of skilled talent damages competitive advantage.
How to
- Segment your workforce and invest retention effort where the loss would be most costly, not evenly.
- Give high performers visible development paths and stretch assignments before they start looking.
- Treat exits of strong people as diagnostic signals about managers and roles, not individual choices.
Watch out for
- Reacting only when someone resigns—by then the decision is usually made.
- Protecting flight-risk stars in ways that demoralize the reliable performers who stay.
- Growth opportunity retains top talent more reliably than counteroffers do.
- Concentrate retention effort by talent segment rather than spreading it thin.
- Regretted exits are a management diagnostic, not just an HR statistic.
Grounded in: HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; The Performance Appraisal Tool Kit; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Competency Mapping and Assessment Manual - User Guide
strong · 15 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- How to Measure Employee Performance (The performance management series)
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection in Organizations
- Selection-Assessment-Methods
- Structured_Interviewing_Raising
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Management: Tasks, Responsibilities, Practices
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Who The A Method for Hiring
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- The Performance Appraisal Tool Kit
This section translates better selection and performance systems into dollars—utility, productivity, and financial value.
Organizational Utility & Financial Value
This is where the accounting closes. Every validated method, every fair process, every accurate rating exists to produce one thing the organization can actually bank: net financial and productivity benefit. Utility, cost savings, profitability, shareholder value. The rest is machinery in service of this number, and a selection system that cannot eventually be connected to it is a system running on faith.
The benefit arrives through people, one at a time. Individual performance produces organizational value directly; the aggregate of good work outcomes is the return. Better matching means more of that return per hire, which is why the quality of decisions upstream shows up, eventually, as money. The connection is real even when it is hard to trace, and the difficulty of tracing it is exactly why the value gets underclaimed.
Two quieter contributors feed the same total. When candidates experience the process as fair, that perception protects the organization's standing and its ability to attract the next round of talent, which carries a value of its own. And a process that avoids adverse impact and withstands legal challenge preserves value by preventing its destruction.
The recognition worth holding is that utility is the sum of things that individually look like soft goods. Fairness, accuracy, a good candidate experience, a defensible process. Treated as costs, they get cut. Treated as inputs to financial value, they get funded. The second framing is the correct one, and it is also the harder one to hold when the benefit is diffuse and the expense is immediate.
Why it matters. Framing assessment quality in financial terms is what earns the budget and executive attention that keep good systems funded.
Myth
The value of a better selection system is too soft to quantify, so you justify it on principle.
Reality
Utility is calculable—the productivity gain from a more valid predictor, multiplied by the number of hires and the dollar value of performance variation, produces large and defensible figures, especially in high-stakes roles.
One retrieved paper links HR practices to operational performance and profitability, and another notes the value of psychometric selection tools, but the corpus does not directly substantiate utility/cost-savings or shareholder-value claims as a construct.
How to
- Estimate the dollar spread between good and poor performers in each role before valuing any hiring improvement.
- Model utility gains against realistic selection ratios—value rises when you can be selective.
- Report net value after program costs, so the number survives a CFO's scrutiny.
Watch out for
- Publishing utility estimates so large they lose credibility with finance—discount for adoption and turnover.
- Ignoring that a valid tool creates little value when you must hire nearly everyone who applies.
- The Performance Management Framework for Value CreationFramework — A circulatory and simultaneous model (depicted in Exhibit 2.1) that integrates various methodologies to synchronize improvement and create value for customers and shareholders.
- The ACORN Test FrameworkFramework — A five-part framework for validating the mission of a job or organization to ensure it is well-defined and actionable.
- Brogden's Utility Analysis FrameworkFramework — A model for calculating the financial return on investment (utility) of a selection procedure in dollar terms.
- Organizational Life Cycle Framework for Performance ManagementFramework — A framework that tailors the focus of the performance appraisal system to the company's current stage of development (Startup, Growth, Mature, Revival).
- Railroad's ABM Model ConsolidationCase study — A large railroad organization needed to analyze both operational efficiency within departments and overall strategic profitability of its routes.
- Utility scales with performance variance and selectivity, not just predictor validity.
- Financial framing wins resources that fairness and validity arguments alone often don't.
- Credible utility numbers are net of cost and discounted for real-world adoption.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; How to Measure Employee Performance (The performance management series); Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook; Personnel Selection in Organizations; Selection-Assessment-Methods; Structured_Interviewing_Raising; Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Management: Tasks, Responsibilities, Practices; Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Who The A Method for Hiring; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; The Performance Appraisal Tool Kit
strong · 6 sources
- How to Measure Employee Performance (The performance management series)
- HBRs 10 Must Reads on Performance Management
- Management: Tasks, Responsibilities, Practices
- GUIDELINES - Testing and Assessment
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
- Selection-Assessment-Methods
This section addresses how individual performance aggregates into durable organizational effectiveness and a high-performance culture.
Sustainable Organizational Performance
Sustainable organizational performance is a downstream number, not a lever you pull directly. It shows up in aggregate: retention that holds, teams that deliver across quarters rather than in heroic bursts, a culture where good work reproduces itself. And it is always the sum of individual contributions, which means the honest way to read it is backward. Strong organizational results are the accumulated evidence that individual selection, development, and evaluation were done well over time.
The word that carries the weight is *sustainable*. A single strong year can come from a hot market, a lucky product, or people burning through their reserves. None of that lasts. What lasts is a workforce that is developed, engaged, and aligned—people who know what good looks like in their role, who have reason to keep investing, and who pull in a shared direction. When those three conditions hold, performance compounds. When they fail, the aggregate erodes even while individual quarters still look acceptable.
That is why organizational effectiveness cannot be managed as its own project. It has no direct dial. You improve it by improving the quality of the decisions one level down—who you hire, how accurately you assess, how honestly you evaluate and coach. Get those right, repeatedly, and the culture that results is high-performing almost as a byproduct.
The recognition worth holding onto: when leaders chase organizational performance as a headline, they usually neglect the individual practices that actually produce it. The number is a consequence. Treat it as one, and you spend your attention where it can do work.
Why it matters. Individual excellence that doesn't compound into organizational capability is a series of expensive one-offs rather than a sustainable advantage.
Myth
Summing up strong individual performers automatically produces a strong organization.
Reality
Aggregate performance depends on alignment, coordination, and culture; a roster of individually optimized stars can underperform a coordinated team, and short-term individual metrics can undermine long-term collective health.
The literature supports that engaged, aligned employees developed through sustainable HRM practices drive improved long-term organizational performance and effectiveness.
How to
- Align individual goals to organizational strategy so effort compounds rather than cancels out.
- Reward behaviours that build collective capability, not just personal output.
- Track leading cultural indicators over years, not just quarterly performance snapshots.
Watch out for
- Incentive structures that make individuals win while the organization loses.
- Confusing a good quarter with sustainable performance—short-term gains can erode long-term capability.
- Wells Fargo's Cross-Selling Metric FailureCase study — Wells Fargo had a corporate strategy of building long-term customer relationships, which it decided to measure using a cross-selling metric (e.g., 'Eight is great').
- Blue Cross and Blue Shield of AlabamaCase study — A large health insurance company seeking long-term, sustainable high performance and morale across the entire organization.
- Rating Inflation in the U.S. Navy Officer CorpsCase study — The U.S.
- The Classical Selection and Assessment ProcessProcess — To systematically match the right number of people with the right skills to the right jobs in order to achieve organizational goals.
- Rapid Prototyping for a New Performance Management MethodologyProcess — To quickly create a tangible, high-level model of the new system to accelerate organizational learning, demonstrate potential value, gain buy-in, and make initial design mistakes early when they are easy to fix.
- Organizational performance is an emergent property of alignment, not a sum of individuals.
- Reward collective capability-building or your best people will optimize locally at the system's expense.
- Sustainability requires multi-year cultural indicators, not quarterly output alone.
Grounded in: How to Measure Employee Performance (The performance management series); HBRs 10 Must Reads on Performance Management; Management: Tasks, Responsibilities, Practices; GUIDELINES - Testing and Assessment; Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap); Selection-Assessment-Methods
strong · 15 sources
- 263074003-Competency-Dictionary
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…
- Competency Mapping and Assessment Manual - User Guide
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Managing Staff Selection and Assessment (Managing Work and Organizations Series)
- Personnel Selection in Organizations
- The Performance Appraisal Tool Kit
- Understanding performance appraisal social, organizational, and goal-based perspectives
- Management: Tasks, Responsibilities, Practices
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection
- Job analysis a guide to assessing work activities
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
This section covers the higher-level conditions—culture, law, labor market, remote work, life-cycle stage—that change what works in assessment and performance management.
Organizational & Environmental Context
No assessment travels unchanged from one setting to another. The same structured interview, the same rating scale, the same test battery will behave differently depending on where it lands—the organization's culture, its life-cycle stage, the national and legal context it operates in, the labor market it competes in, and increasingly whether the work is done remotely or in a room. These conditions do not usually break a method outright. They bend it, and they bend it quietly.
The mechanism is moderation, not causation. Context does not decide whether a candidate is good or a rating is fair; it changes how strongly your evidence connects to the outcome you care about. A predictor with real validity in a stable, mature organization may lose its edge in a young company where the job itself is still forming. A rating process that produces clean distinctions in one legal environment may produce muted, defensive ones in another where documentation carries different risk. The tool is the same. The relationship it sits inside has shifted.
This has a practical cost when it is ignored. A method validated somewhere else, imported wholesale, arrives with borrowed credibility and untested fit. Norms drawn from one labor market misread the talent in another. Rating standards calibrated for co-located teams strain when applied to distributed ones.
The useful discipline is to name the conditions before you name the method. Ask what the culture rewards, what the legal frame permits, where the organization is in its life, how tight the labor market runs. Design against those answers. Context is not noise around the signal; it is part of what determines whether the signal means anything.
Why it matters. A method validated in one context can fail or become illegal in another, so ignoring context turns best practice into malpractice.
Myth
A validated assessment or PM design travels cleanly across settings, geographies, and business stages.
Reality
Context moderates nearly everything: validity coefficients shift by setting, ratings mean different things across cultures, and a startup and a mature firm need different systems even for the same role.
The retrieved papers address implementation science frameworks, wellness programs, and HR flexibility, but none specifically examine how organizational or environmental context shapes assessment/appraisal design, ratings, and outcomes.
How to
- Re-check validity locally before importing a tool proven elsewhere, especially across national or legal borders.
- Adapt rating instruments to cultural response tendencies and to remote versus co-located observation.
- Match system complexity to organizational life-cycle stage rather than copying enterprise designs into small firms.
Watch out for
- Assuming a globally deployed system means one that works everywhere.
- Applying appraisal norms across cultures without accounting for how rating scales are used differently.
- Validity is context-dependent; re-verify before transferring a method across settings.
- Remote and cross-cultural conditions change what ratings actually observe and mean.
- Match system design to life-cycle stage, not to the largest firm you admire.
Grounded in: 263074003-Competency-Dictionary; Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment…; Competency Mapping and Assessment Manual - User Guide; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal; Managing Staff Selection and Assessment (Managing Work and Organizations Series); Personnel Selection in Organizations; The Performance Appraisal Tool Kit; Understanding performance appraisal social, organizational, and goal-based perspectives; Management: Tasks, Responsibilities, Practices; The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success; Hiring Success The Art and Science of Staffing Assessment and Employee Selection; Job analysis a guide to assessing work activities; Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
strong · 9 sources
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development
- Competency Mapping and Assessment Manual - User Guide
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
- HBRs 10 Must Reads on Performance Management
- GUIDELINES - Testing and Assessment
- Management: Tasks, Responsibilities, Practices
- The Performance Appraisal Tool Kit
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
- Who The A Method for Hiring
This section is about the leaders and managers who make or break any assessment or performance system through their commitment and capability.
Leadership Support, Manager Capability & Buy-In
A performance system is only ever as real as the managers who run it. You can build an elegant process—clear competencies, sound rating logic, well-timed reviews—and watch it deflate on contact with a line manager who treats the review as paperwork and the coaching conversation as an ambush. The design does not enact itself. People do, and the people who matter most are the ones between senior leadership and the individual being assessed.
Three things have to hold together. Senior leaders must be visibly committed, because a practice that leaders are seen to skip becomes optional for everyone below. Line managers must be capable—able to observe, rate honestly, and coach—and they must hold the mindset that these tasks are part of the job rather than a distraction from it. And the stakeholders affected must buy in enough to engage in good faith rather than defend against the process. Missing any one, the others weaken.
This support works as a multiplier rather than an input. It moderates how well the process design actually functions: the same review structure produces candid, useful conversations under a capable manager and hollow ones under a reluctant one. It enables strategic alignment, because managers translate organizational intent into what an individual hears about their own work. And it shapes whether feedback and coaching land as development or as threat.
Which means the change-management work is not the soft edge of implementation. It is the implementation. Time spent building manager capability and legitimizing the practice does more for outcomes than another revision of the form.
Why it matters. The best-designed process delivers nothing if managers can't run it well or leaders don't visibly stand behind it—capability and buy-in are the difference between a system and a form.
Myth
Rolling out a well-designed process with training is enough to make it work in the field.
Reality
Design and training set the ceiling; line-manager capability and mindset set the floor, and a skeptical or unskilled manager will hollow out even an excellent process into a compliance ritual.
Retrieved papers support that top-management commitment and supportive leader-member exchange are components of effective performance management and change support, but the evidence for line-manager capability and stakeholder buy-in as distinct enablers is only partially addressed.
How to
- Secure and make visible senior-leader use of the system on themselves, not just endorsement of it for others.
- Build manager capability through practice and calibration, not one-time e-learning.
- Treat resistance as data about design flaws and address it in change management, not as an obstacle to override.
Watch out for
- Leaders who exempt themselves from the very process they mandate, which signals it doesn't matter.
- Assuming managers who nod in training can actually conduct a difficult feedback conversation.
- Manager capability, not process design, is usually the binding constraint on performance systems.
- Visible leader participation legitimizes the system more than any communication campaign.
- Build capability through repeated practice and calibration, not a single training event.
Grounded in: A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development; Competency Mapping and Assessment Manual - User Guide; HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…; HBRs 10 Must Reads on Performance Management; GUIDELINES - Testing and Assessment; Management: Tasks, Responsibilities, Practices; The Performance Appraisal Tool Kit; Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers; Who The A Method for Hiring
emerging · 3 sources
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers
- HBRs 10 Must Reads on Performance Management
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
This section is about using performance indicators to interrogate your assumptions rather than letting the metric quietly replace the goal it was meant to represent.
Organizational Learning & Surrogation Avoidance
A metric is a stand-in for something you cannot measure directly. Customer satisfaction scores stand in for customers who are actually satisfied; a sales figure stands in for a healthy market position. The trouble begins when people forget the substitution and start treating the indicator as the thing itself. This is surrogation: the measure quietly replaces the strategy it was meant to represent, and once that happens, improving the number and improving the business come apart.
The defense is to keep indicators in an interrogating role rather than a commanding one. Single-loop learning asks whether you are hitting the target and corrects course when you miss. That is useful, and it is not enough. Double-loop learning asks a harder question: whether the target still reflects what you actually want, and whether the assumptions behind it still hold. An organization that only runs the first loop optimizes its way toward the wrong goal with great efficiency.
Gaming is the visible symptom, and surrogation is the deeper disease. Gaming is deliberate—people manipulate the number because the number is what gets rewarded. Surrogation is often sincere—people genuinely believe the metric is the goal, because no one kept the distinction alive. Both end in the same place: a scoreboard that improves while the underlying purpose decays.
The steady practice is to treat every indicator as a question rather than an answer. Ask what it was standing in for, whether it still stands in well, and what it might be hiding. A measure used this way sharpens judgment. A measure allowed to become the objective replaces it.
Why it matters. When a measure becomes the target, people optimize the number instead of the outcome, and you get worse results while your dashboards improve.
Myth
Once you have a good metric, the job is to hit it—rising numbers mean the strategy is working.
Reality
Metrics are proxies that drift; surrogation means teams start managing the indicator instead of the underlying goal, so genuine learning requires periodically questioning whether the metric still reflects what you care about.
How to
- Pair every key metric with an explicit statement of the outcome it stands for, and revisit the link.
- Use indicators to trigger inquiry (why did this move?) rather than automatic reward or punishment.
- Watch for gaming and metric-fixation as signals to redesign the measure, using double-loop questioning.
Watch out for
- Tying high-stakes consequences to a single metric, which almost guarantees surrogation and gaming.
- Celebrating improved numbers without checking whether the real objective improved with them.
- Strategic Performance Management (SPM) FrameworkFramework — The book's core, integrated framework for defining, assessing, implementing, and continuously refining organizational strategy by linking it to performance management in a learning environment.
- Every metric is a proxy that can be gamed; keep the underlying goal explicit alongside it.
- Use measures to prompt questions, not to run judgment on autopilot.
- When people optimize the number over the outcome, the measure needs redesign, not more enforcement.
Grounded in: Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers; HBRs 10 Must Reads on Performance Management; Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap)
emerging · 1 source
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to…
This section covers the structural conditions—clear goals, roles, rules, and complementary composition—that let a group perform as a team rather than a collection of individuals.
Team Infrastructure & Composition
A team that performs well shares a few unglamorous things before it shares any talent. Members know what the group is trying to achieve, who holds which part of the work, and how they will answer for it. When any one of those is fuzzy, the group compensates with meetings, rework, and quiet resentment about who dropped what. The pattern is worth naming: most team dysfunction traces back not to weak individuals but to unstated structure. People behave sensibly given the rules they can see; if the rules are absent, they invent their own, and the invented ones rarely agree.
Goals do the first job. A goal that lives only in a leader's head produces a team that optimizes for whatever each person assumes matters. Written, specific, shared goals let members coordinate without checking in on every decision. Roles do the second. Role clarity is less about titles than about the seam between one person's work and the next — the handoffs where accountability tends to evaporate. Naming who owns each seam prevents the two failure modes of collective work: duplicated effort and orphaned tasks.
Accountability is the part teams most often leave implicit, and it costs them. Accountability is simply the agreement about who reports what, to whom, and when — and what happens when the work slips. Without it, a group has good intentions and no mechanism. With it, problems surface early enough to fix.
Composition is the quiet multiplier. A team of similar strengths shares the same blind spot; complementary skills mean the gap in one person is covered by another. The aim is coverage across the work, not a roster of identical high performers. When goals, roles, rules, accountability, and complementary skills are all present, the team stops absorbing effort and starts returning it — which is the only real evidence that the infrastructure was right.
Why it matters. Individual evaluation systems break down when the real unit of performance is a team, and unclear roles produce diffused accountability no rating scale can fix.
Myth
A high-performing team is mostly a matter of putting talented people together and having good chemistry.
Reality
Team effectiveness comes from enabling structure—clear shared goals, defined roles, real accountability processes, and complementary rather than redundant skills; chemistry follows structure more than it substitutes for it.
How to
- Establish explicit, shared team goals and the rules for how the team makes decisions and holds itself accountable.
- Define roles for complementarity, deliberately covering gaps rather than stacking similar strengths.
- Build in a mechanism for mutual accountability so obligations are to the team, not only to the manager.
Watch out for
- Assembling all-star individuals with overlapping strengths and unclear boundaries, which breeds conflict and gaps.
- Evaluating only individuals when performance is genuinely interdependent, which punishes good collaborators.
- Team performance depends on enabling structure more than on interpersonal chemistry.
- Compose teams for complementary skills, not for a concentration of the same strengths.
- When work is interdependent, individual-only evaluation misattributes credit and blame.
The playbook — the whole process
Beneath the model sits the practical spine — 45 named, end-to-end processes the source books lay out. Here they are, in sequence, each broken into the steps you actually run.
The sequence — high level first
Illumination of the parts
Process 1 · named in the source
Management Performance Appraisal and Development Process
To set goals, select competencies, review progress, assess final performance against both results and behaviors, and create a development plan.
- 1
Supervisor and employee develop performance goals based on campus/department objectives.
- 2
They discuss developmental needs for both work results and competencies.
- 3
The employee writes goals in SMART format and completes the development plan.
- 4
They select job-specific competencies and identify appropriate behavioral levels.
- 5
They hold a mid-cycle review to discuss progress and resource needs.
- 6
At year-end, the employee provides actual results and the supervisor completes the 'Actual Results' column and assigns a rating.
- 7
The supervisor rates the employee on all competencies and calculates an Overall Competency Rating.
- 8
The supervisor completes the 'Accomplishment Section' of the development plan.
- 9
The supervisor completes the 'Overall Performance Summary' and calculates the final rating.
- 10
The supervisor shares the draft appraisal with a reviewing officer.
- 11
The supervisor and employee meet to review and sign the final appraisal.
- 12
The form is sent to the reviewing officer for a final signature.
Process 2 · named in the source
Designing and Running an Assessment Centre
To objectively measure job-related competencies and improve the predictive validity of selection and development decisions.
- 1
Develop or adapt a behaviour-based competence framework relevant to the target role.
- 2
Select or devise a matrix of activities (e.g., role plays, group tasks, in-trays) ensuring each key competence is assessed at least twice.
- 3
Recruit and train a team of assessors on behavioral observation, note-taking, avoiding biases, and the specific competence framework.
- 4
Plan all logistics for the assessment day, including schedules, materials, room layouts, and candidate communications.
- 5
Conduct the assessment centre, with assessors observing specific candidates and recording behavioural evidence.
- 6
Hold an assessor 'wash-up' session to discuss evidence, calibrate ratings, and reach a consensus decision on each candidate.
- 7
Provide feedback to candidates and periodically evaluate the entire process for fairness and effectiveness.
Process 3 · named in the source
ORCE Process for Assessors
To ensure objective and systematic evaluation of participant behavior by separating observation from evaluation.
- 1
Observe the participant's behavior without making judgments.
- 2
Record verbatim what is said and done, capturing specific, concrete examples.
- 3
Classify the recorded behaviors by matching them to the relevant competencies in the model.
- 4
Evaluate the classified evidence against a rating scale to determine the level of proficiency for each competency.
Process 4 · named in the source
Model Appraisal Process
To formally review past performance, set future objectives, and identify development needs in a structured manner.
- 1
Set and clarify objectives at the beginning of the year.
- 2
Gather performance data and provide routine feedback throughout the year.
- 3
Conduct a formal appraisal interview to review successes, areas for improvement, and development needs.
- 4
Set new objectives for the coming year.
- 5
Complete a written appraisal summary for the record, with space for employee comments.
- 6
Have the appraiser's manager ('grandparent') review and sign off on the appraisal.
Process 5 · named in the source
Developing a Structured Psychometric Interview (SPI)
To create a valid and reliable interview that can empirically distinguish between superior and average performers for a specific role.
- 1
Identify a group of excellent or 'expert' performers in the target role using objective performance data.
- 2
Conduct focus groups with these experts to explore their attitudes, behaviors, and the language they use to describe their work.
- 3
Analyze transcripts of the focus groups to identify key themes, behavioral patterns, and discriminating language.
- 4
Generate a set of interview questions designed to elicit these specific themes and language patterns.
- 5
Trial the draft interview with two new groups: one of excellent performers and one of average/ineffective performers.
- 6
Analyze the responses to identify which questions effectively discriminate between the two groups.
- 7
Finalize the interview questions and create a detailed scoring and interpretation framework based on the validation data.
Process 6 · named in the source
Job Competency Mapping Process
To identify key competencies for a role and create a validated model that can be used across HR functions like recruitment, training, and performance appraisal.
- 1
Define the criteria for superior performance in the role using both qualitative and quantitative data.
- 2
Identify a sample group of superior performers and a comparative group of average performers.
- 3
Collect data using methods like Behavioral Event Interviews (BEIs), expert panels, and surveys with both groups.
- 4
Analyze the collected data to identify themes and draft a competency model that distinguishes superior from average performers.
- 5
Validate the competency model by testing it against a new set of superior performers to confirm its predictive accuracy.
- 6
Apply the validated model to HR applications such as recruitment, succession planning, and performance management.
Process 7 · named in the source
Conducting a Behavioral Event Interview (BEI)
To elicit detailed, unbiased behavioral descriptions of how a person has handled actual job-related situations.
- 1
Introduce the process, establish trust and confidentiality, and explain the objective.
- 2
Ask the interviewee to briefly describe their career path and current job responsibilities.
- 3
Ask the interviewee to describe 3-4 complete stories of critical incidents (successes and failures), probing for the situation, their thoughts, feelings, actions, and the outcome.
- 4
Ask the interviewee for their expert opinion on the characteristics, knowledge, and skills required to do the job well.
- 5
Conclude the interview, thank the participant, and reinforce the bond of trust.
Process 8 · named in the source
Collaborative Goal Setting and Planning
To collaboratively define an employee's goals for the next period and create a practical, documented plan for achieving them, ensuring alignment and shared ownership.
- 1
Ask the employee to draft a list of potential goals.
- 2
Meet to review the draft, aligning goals with organizational strategy and the employee's aspirations.
- 3
Narrow the list to 2-4 significant, challenging goals.
- 4
Establish specific metrics or qualitative measures for success for each goal.
- 5
Define key behavioral expectations alongside the performance goals.
- 6
Collaborate on a plan to achieve the goals, breaking them down into tasks, setting timelines, and identifying needed resources.
- 7
Document the agreed-upon goals and plan using a template.
- 8
Schedule regular check-in conversations to monitor progress and reassess goals as needed.
Process 9 · named in the source
Conducting a Constructive Feedback Discussion
To elicit positive change in an employee's future performance or behavior through a productive, two-way dialogue.
- 1
Set the stage by choosing an appropriate, private time and place for the conversation.
- 2
Open the conversation by soliciting the employee's perspective on the situation first.
- 3
Engage in a two-way dialogue using active listening and open-ended questions.
- 4
Share your point of view by focusing on observable behaviors and facts, not personal opinions or assumptions about intent.
- 5
Be specific about the problem and clearly explain its impact on the team or organization.
- 6
Ask the employee for their ideas on how to address the problem before offering your own suggestions.
- 7
Agree on a concrete step for improvement and check for understanding to ensure the message has been received.
Process 10 · named in the source
Developing a Struggling Employee (The Three Cs)
To diagnose the root cause of poor performance and create a structured plan for improvement, or to determine if the employee needs to be managed out of the organization.
- 1
Converse to diagnose the root cause by gathering facts and considering systemic issues or your own role.
- 2
Coach by meeting with the employee, presenting the problem directly, assessing their willingness to change, and co-creating a concrete improvement plan.
- 3
Follow up with regular meetings to monitor progress, provide real-time feedback, and praise positive changes.
- 4
Cut ties if necessary by shifting to a conversation about consequences if improvement is absent, and manage the employee's exit if they are unwilling or unable to improve.
Process 11 · named in the source
Reinvented Performance Management Cycle (Deloitte Model)
To fuel future performance by providing frequent, forward-looking coaching while collecting reliable data for compensation and promotion decisions.
- 1
Team members initiate weekly check-ins with their team leader to discuss near-term priorities and get coaching.
- 2
At the end of each project or quarter, the team leader completes a 'Performance Snapshot' by rating their own future actions regarding the team member.
- 3
Data from snapshots is aggregated over the year to create a rich picture of performance and potential.
- 4
Leaders use the aggregated data for quarterly talent reviews to discuss succession, development, and performance patterns.
- 5
Conduct an annual compensation decision process, using the aggregated snapshot data as a starting point, supplemented by qualitative factors.
Process 12 · named in the source
Set-Up-to-Fail Syndrome Intervention
To break the self-fulfilling prophecy of underperformance by candidly discussing the dynamic and resetting expectations and behaviors on both sides.
- 1
Create the right context for the discussion in a neutral location, framing it as a two-way dialogue about the relationship and performance.
- 2
Jointly agree on the specific symptoms of the problem, using facts and data, not just feelings, to identify areas of weak performance.
- 3
Explore the root causes of the weak performance, including how the boss's own behavior (e.g., micromanagement) might be contributing.
- 4
Co-create a plan for moving forward, agreeing on new performance objectives and the appropriate level of supervision.
- 5
Commit to more open communication in the future, agreeing to flag issues immediately before they escalate.
Process 13 · named in the source
Entry-Level Staffing Assessment Process
To efficiently and consistently screen large numbers of applicants to identify those with the highest potential for success and retention.
- 1
Administer an integrated electronic application containing pre-screening questions, personality measures, and basic ability/skills tests.
- 2
Automatically screen out candidates who do not meet minimum requirements based on their application results.
- 3
Conduct a structured, behavioral-based interview with candidates who pass the initial electronic screening.
- 4
Perform a background investigation on candidates who receive a contingent job offer.
- 5
Make a final hiring decision based on the combined results of all assessment hurdles.
Process 14 · named in the source
Professional Staffing Assessment Process
To conduct a thorough, multi-stage evaluation to identify the best candidate from a pool of qualified individuals, while also recruiting top talent.
- 1
Source potential candidates using tools like electronic recruiting agents to search resume databases.
- 2
Administer a short initial screening assessment (e.g., pre-screening questionnaire) to filter applicants.
- 3
Conduct a structured phone interview with promising candidates to further assess skills and build interest.
- 4
Ask shortlisted candidates to complete a more in-depth online assessment (e.g., personality and ability tests).
- 5
Invite top candidates for an on-site visit including multiple structured interviews and job simulations.
- 6
Extend a contingent offer and conduct a final background investigation.
- 7
Use assessment results to provide developmental feedback to the newly hired employee during on-boarding.
Process 15 · named in the source
Creating Employee Performance Plans
To create clear, verifiable, and motivating performance goals that align individual work with organizational priorities.
- 1
Review the organization's and manager's goals to understand strategic priorities.
- 2
Identify the position's key internal and external customers and the products/services they need using a customer diagram.
- 3
List the 5-9 most important results (value-added outputs) of the position, converting all activities to results.
- 4
Assign percentage weights to each result to reflect its relative importance, totaling 100%.
- 5
Identify specific, verifiable measures for each result, using the Quantity, Quality, Cost, and Timeliness framework.
- 6
Create goals for each measure, defining ranges for 'meets expectations' and 'exceeds expectations'.
- 7
Develop a practical plan for tracking and collecting data for each measure.
Process 16 · named in the source
The WPSS Project Process
To systematically collect, analyze, and report detailed, quantitative information about one or more target jobs.
- 1
Plan the project by defining objectives, selecting target jobs, establishing scope, and securing resources.
- 2
Develop a comprehensive list of job tasks by reviewing documents, observing incumbents, and conducting structured interviews with subject matter experts.
- 3
Design and produce a WPSS questionnaire, including task statements, personal information items, and clear instructions for rating scales.
- 4
Distribute the questionnaire to a representative sample of job incumbents and supervisors and manage the collection of completed forms.
- 5
Computerize the data by keypunching or scanning, then build a survey database using the WPSS computer programs.
- 6
Analyze the data to generate statistical summary reports (e.g., task significance, time spent) and cross-tabulations by location or job title.
- 7
Interpret the results, prepare reports for the sponsoring organization, and archive the data for future use.
Process 17 · named in the source
Shortcut Job Analysis Procedure
To efficiently gather and analyze essential job task data using a conference-based approach with Subject Matter Experts (SMEs).
- 1
A job analyst develops a preliminary "strawman" task list prior to the conference.
- 2
Convene a small group (3-6) of SMEs, such as experienced incumbents and supervisors.
- 3
Train SMEs on task statement principles and guide them in reviewing, modifying, and finalizing the task list.
- 4
Have SMEs complete a simplified questionnaire (e.g., using 3-point High/Medium/Low scales) based on the finalized task list.
- 5
Manually analyze the task data during the conference to categorize tasks and identify the most significant ones for follow-up.
- 6
Conduct follow-up ratings (e.g., for required skills) on the significant tasks, often within the same conference session.
Process 18 · named in the source
The Classical Selection and Assessment Process
To systematically match the right number of people with the right skills to the right jobs in order to achieve organizational goals.
- 1
Conduct human resource planning to forecast the organization's needs for numbers and types of people.
- 2
Perform a job analysis to systematically gather information about jobs and identify the skills required for successful performance.
- 3
Engage in recruitment to attract a sufficient pool of qualified applicants.
- 4
Execute selection and placement using various techniques (interviews, tests) to choose the best candidates.
- 5
Manage careers and performance post-hire to ensure employees maximize their potential and remain aligned with organizational needs.
Process 19 · named in the source
Life-Cycle Model of Strategic Assessment
To ensure that key managerial positions are filled by individuals whose skills and competencies match the specific strategic requirements of the business.
- 1
Specify the business situation and its strategic direction (e.g., growth, divestment).
- 2
Confirm or modify the organizational structure to support the strategy.
- 3
Develop role descriptions for key jobs based on future strategic requirements.
- 4
Assess key personnel in the management team against these future-oriented specifications.
- 5
Match individuals to positions, paying attention to overall team balance.
- 6
Implement the changes in a planned and systematic manner.
Process 20 · named in the source
Strategy Map and Scorecard Implementation
To translate the organization's high-level vision and strategy into a coherent set of actionable objectives and measurable performance indicators that align employee behavior and guide decision-making.
- 1
Agree on the organization's vision, mission, and strategic intent.
- 2
Define the high-level strategic objectives that support the strategy.
- 3
Map the strategic objectives into perspectives (e.g., Financial, Customer) and establish their cause-and-effect linkages.
- 4
Define the specific initiatives, projects, and action plans required to achieve each objective and close performance gaps.
- 5
Select appropriate Key Performance Indicators (KPIs) for each objective and cascade them to relevant parts of the organization.
- 6
Select the specific target levels or scores for each KPI for relevant time periods.
- 7
Collect the actual performance data, display the scores against the targets (e.g., using meters or traffic lights), and report them.
- 8
Manage performance by interpreting the scores, diagnosing gaps, taking corrective actions, and revising plans as needed.
Process 21 · named in the source
Rapid Prototyping for a New Performance Management Methodology
To quickly create a tangible, high-level model of the new system to accelerate organizational learning, demonstrate potential value, gain buy-in, and make initial design mistakes early when they are easy to fix.
- 1
Assemble a small cross-functional team of 4-5 employees who are knowledgeable about their respective areas.
- 2
Build the first complete, high-level model of the methodology in a short timeframe (e.g., two days), using estimates and group consensus.
- 3
Brief a peer group and selected executives on the third day, showing them the prototype and the types of insights it can generate.
- 4
Gather feedback and identify crucial areas that require more detail or fact-based data.
- 5
Iterate on the model by refining it with more accurate data in key areas, progressively scaling it into a repeatable, reliable production system.
Process 22 · named in the source
Performance Management Implementation
To systematically change behavior to produce desired organizational results.
- 1
Pinpoint the desired results and the critical behaviors that produce them.
- 2
Establish a measurement system for the pinpointed behaviors and results.
- 3
Graph the performance data to establish a baseline and track progress.
- 4
Analyze the current performance using the ABC and PIC/NIC models to understand what antecedents and consequences are currently active.
- 5
Develop and implement an intervention plan, including setting goals, providing feedback, and planning for reinforcement.
- 6
Deliver contingent positive reinforcement for improvements and goal attainment.
- 7
Evaluate the intervention's impact by analyzing the graphed data and adjust the plan as needed.
Process 23 · named in the source
Correcting Unwanted Behavior
To stop an unwanted behavior and replace it with a desired, productive one.
- 1
Pinpoint the specific behavior to be corrected.
- 2
Use data to describe the problem objectively.
- 3
Correct the behavior immediately, but never when angry.
- 4
Deliver the correcting consequence consistently for every infraction.
- 5
Maintain a high (4:1) ratio of positive to negative interactions overall.
- 6
Provide the corrective feedback in private.
- 7
Reinforce the desired, alternative behavior at a separate time.
Process 24 · named in the source
Identifying a Job Mission
To clarify the single most important outcome for a job, which focuses all other pinpointing and measurement efforts.
- 1
List all the results and key behaviors for which the job is accountable.
- 2
Extract from the list a single result that best explains why the job exists.
- 3
Check this proposed mission against the ACORN Test (Accomplishment, Control, Overall Objective, Reconcilable, Numbers).
- 4
Once the mission is validated, check each remaining result from the initial list to ensure it supports the mission.
Process 25 · named in the source
The Performance Management Cycle
To systematically improve organizational performance by developing the performance of individuals and teams in a continuous, self-renewing cycle.
- 1
Plan: Agree on objectives, competence requirements, and produce performance agreements, improvement plans, and personal development plans.
- 2
Act: Carry out the activities required to achieve the objectives and plans.
- 3
Monitor: Continuously check on progress toward achieving objectives, providing ongoing feedback.
- 4
Review: Formally and informally assess progress and achievements to prepare and agree on action plans for the next cycle.
Process 26 · named in the source
Introducing and Developing Performance Management
To successfully design, launch, and embed an effective performance management process that fits the organization's culture and business needs.
- 1
Decide on the business case for introducing performance management.
- 2
Determine objectives and guiding principles for the system.
- 3
Get commitment and active participation from top management and line managers.
- 4
Draw up guiding principles on how performance management should work.
- 5
Define the specific processes (planning, review, etc.) and design simple documentation.
- 6
Pilot-test the system in a few departments to identify issues and refine the approach.
- 7
Communicate the aims, workings, and benefits of the system to all stakeholders.
- 8
Plan and deliver comprehensive training for both managers and employees.
- 9
Implement the full system, providing ongoing guidance and support.
- 10
Evaluate the system's effectiveness after its first year and make necessary adjustments.
Process 27 · named in the source
Content Validation Process
To create a legally defensible, job-related selection test without conducting a large-scale statistical criterion-validation study.
- 1
Convene a panel of Subject Matter Experts (SMEs) such as experienced job incumbents and supervisors.
- 2
Have the panel generate a comprehensive list of critical tasks, knowledge, and skills required for the job.
- 3
Develop test items that are a representative sample of this content.
- 4
Have a separate panel of SMEs review the test items to ensure they are relevant, necessary, and correctly weighted.
- 5
Finalize the test format and scoring key based on the SME ratings.
Process 28 · named in the source
Newcomer Orientation Based on Medical Patient Preparation
To help newcomers cope with the stress of organizational entry, thereby improving both performance and retention, by moving beyond simple information provision.
- 1
Present realistic information about what will happen, including both the 'what' (events) and the 'how you will feel' (sensations).
- 2
Show models coping effectively with typical stressful situations encountered by newcomers.
- 3
Use stress inoculation techniques: alert newcomers to upcoming challenges, encourage self-reassurance, and help them practice coping methods.
- 4
Provide opportunities for active participation and rehearsal of coping skills, such as through role-playing or discussion.
- 5
Teach self-control methods, including cognitive strategies (e.g., reframing, attention-diversion) and emotional regulation (e.g., relaxation exercises).
Process 29 · named in the source
Performance Fair Referral using Test Scores
To balance the organizational goal of maximizing workforce productivity with the societal goal of ensuring fair opportunity for minority group members who score lower on average on the test than they perform on the job.
- 1
Administer the ability test (e.g., GATB) to all applicants.
- 2
Analyze existing validity data to determine the relationship between test scores and job performance separately for different racial/ethnic subgroups (e.g., Black, Hispanic, White).
- 3
Calculate the size of the score adjustment needed for minority groups to equalize the probability of referral for individuals with the same level of predicted job performance. This adjustment is a function of the group mean score difference and the test's prediction error (validity).
- 4
Apply the calculated upward adjustment to the raw scores of Black and Hispanic test takers.
- 5
Refer all candidates to employers based on a rank-ordering of their adjusted scores.
- 6
When reporting scores to applicants, provide both their within-group percentile and a total-group expectancy score to give a complete picture.
Process 30 · named in the source
Job Analysis for Content-Valid Test Development
To create a selection instrument that is a representative sample of critical job tasks and required knowledge, skills, and abilities (KSAs), thereby providing evidence of content validity.
- 1
Develop specific task statements describing what a worker does, how, to whom, and why, based on input from subject matter experts (SMEs).
- 2
Group related task statements into coherent task clusters, either rationally or statistically.
- 3
Develop specific KSA statements required to perform the tasks, indicating what the KSA is, its context, and the level required.
- 4
Use a survey to have SMEs rate the importance and frequency of tasks, and the importance of KSAs and whether they are needed at entry.
- 5
Link the critical entry-level KSAs to the critical tasks or task clusters using SME judgments on a scale of relevance (e.g., essential, helpful, not relevant).
- 6
Design test exercises or questions that simulate the critical tasks and are designed to elicit the linked critical KSAs.
- 7
Have an independent group of SMEs review the final test to judge the extent to which each KSA is actually needed to answer the questions or perform the exercises, establishing the content validity linkage.
Process 31 · named in the source
Job Analysis for Selection
To identify the critical tasks employees must perform and the knowledge, skills, and abilities (KSAs) they must possess to perform the job effectively, which then informs the content of the assessments.
- 1
Observe or interview job experts to develop a list of tasks performed on the job.
- 2
Observe or interview job experts to develop a list of the KSAs workers must possess to perform job tasks effectively.
- 3
Survey a sufficiently large and representative sample of job incumbents or their supervisors, asking them to rate which job tasks and KSAs are most critical for effective job performance.
- 4
Analyze the survey data to prioritize the most critical tasks and KSAs for the job.
- 5
Select or develop assessments that measure the most critical tasks or KSAs that a worker must possess upon entry to the job.
Process 32 · named in the source
Standardized Interviewing
To ensure that every respondent is exposed to the same measurement experience, so that differences in answers reflect true differences between respondents, not differences in the interview process.
- 1
Read the question exactly as it is worded in the questionnaire.
- 2
Listen to the respondent's initial answer.
- 3
Evaluate if the answer is complete and adequate according to the question's objectives.
- 4
If the answer is inadequate, probe for clarification or elaboration using only non-directive, pre-specified probes.
- 5
Record the final answer verbatim (for open questions) or as chosen (for closed questions) without discretion.
- 6
Maintain a neutral, non-judgmental stance regarding the content of the answers.
- 7
If the respondent shows confusion about the process, briefly explain the rules and purpose of standardization before repeating the question.
Process 33 · named in the source
Interviewer Supervision via Monitoring
To gather information on actual interviewer performance, ensure adherence to standardized procedures, and provide feedback to maintain or improve data quality.
- 1
Arrange for regular monitoring of each interviewer (e.g., one in ten interviews).
- 2
For telephone surveys, listen in on live interviews using monitoring equipment.
- 3
For in-person surveys, require interviewers to tape-record interviews (with respondent permission).
- 4
Use a standardized monitoring form to systematically evaluate the interviewer's performance on key behaviors (e.g., question reading, probing).
- 5
Schedule a timely feedback session with the interviewer to review the evaluation.
- 6
Discuss both positive performance and areas needing improvement.
Process 34 · named in the source
Strategic Context Clarification and Mapping
To develop a shared, comprehensive understanding of the organization's strategy and articulate it as a visual business model.
- 1
Clarify strategic boundary conditions by defining the organization's fundamental purpose, core values, and visionary goals.
- 2
Conduct an external strategic analysis of the macro (PESTEL) and micro (Porter's Five Forces) environments to define the stakeholder value proposition.
- 3
Conduct an internal strategic analysis using the resource-based view to identify key resources (physical, monetary, intangible) and core competencies.
- 4
Synthesize the external and internal analyses into a visual business model.
- 5
Create a 'Value Creation Map' that visually links the value proposition, core competencies, and key resources.
- 6
Write a 'Value Narrative' to describe the logic of the map in a story format.
Process 35 · named in the source
Performance Indicator Design
To create a comprehensive and unambiguous definition for each performance indicator to ensure consistent data collection, interpretation, and use for learning.
- 1
Name the indicator clearly.
- 2
Link the indicator to a specific strategic element on the Value Creation Map.
- 3
Define the indicator's purpose and why it is being introduced.
- 4
Specify the data collection method, including formula, data source, frequency, and data entry responsibility.
- 5
Assign ownership for the performance of the strategic element being assessed.
- 6
Set targets, benchmarks, and performance thresholds (e.g., for traffic lighting).
- 7
Define reporting parameters, including audience, access rights, frequency, and format.
- 8
Set an expiry or revision date for the indicator.
- 9
Estimate the cost of collecting and maintaining the indicator.
- 10
Assess and document the confidence level in the indicator's validity.
Process 36 · named in the source
Strategic Performance Improvement Meeting
To use performance data for collaborative, forward-looking strategic decision-making and learning, rather than backward-looking judgment.
- 1
Use the Value Creation Map to structure the meeting agenda, focusing on strategic elements.
- 2
Formulate key questions to be answered for each agenda item (e.g., 'Is our reputation improving?').
- 3
Analyze relevant performance indicators in advance to develop answers and proposals.
- 4
Circulate a concise pack of answers, proposals, and supporting data before the meeting.
- 5
Begin the meeting by reviewing the relevant part of the Value Creation Map to provide context.
- 6
Present performance insights as a 'story' supported by data, including both good and bad news.
- 7
Engage in a collaborative dialogue to discuss implications, evaluate options, and make joint decisions.
- 8
Agree upon and document clear actions to be taken, and assign ownership.
Process 37 · named in the source
Strategic Risk Assessment
To systematically identify, prioritize, and manage risks across all strategic elements of the business model.
- 1
Use the Value Creation Map as a guide to identify potential risks for each strategic element (resources, competencies, value proposition).
- 2
For each identified risk, create an entry in a 'Risk Log'.
- 3
Describe the essence of each potential risk.
- 4
Define the risk level (potential impact/severity) and likelihood level (probability of occurrence), each on a scale (e.g., 1-5).
- 5
Calculate a risk score by combining the risk level and likelihood level.
- 6
Prioritize risks based on their scores.
- 7
Assign ownership and a review frequency for managing each risk.
- 8
Develop and implement mitigation plans for high-priority risks.
Process 38 · named in the source
Highly Structured Employment Interviewing Technique
To increase the reliability, validity, fairness, and legal defensibility of the employment interview, making it a psychometrically sound selection tool.
- 1
Develop questions based on a job analysis. Identify critical knowledge, skills, and abilities from a job analysis and create questions (situational, job knowledge, simulation, etc.) to assess them.
- 2
Ask the same questions of each candidate. Maintain strict consistency by asking every applicant the identical questions in the same order, without prompts or follow-ups.
- 3
Anchor the rating scales for scoring answers. For each question, create a scoring guide with concrete examples of poor, marginal, and good answers.
- 4
Have an interview panel record and rate answers. Use a panel (e.g., three members) to independently record and score each candidate's response in real-time.
- 5
Consistently administer the process to all candidates. Use the same panel member to ask questions, avoid discussion between interviews, and average ratings to get a final score.
- 6
Give special attention to job relatedness, fairness, and documentation. Adhere to professional and legal guidelines (e.g., Uniform Guidelines) throughout the process.
Process 39 · named in the source
The Three-Step Assessment Process
To create a fair, accurate, and legally defensible hiring process that reduces bias and improves the quality of hires.
- 1
Define WHAT to assess by conducting a job analysis to create a detailed job profile of essential Knowledge, Skills, and Abilities (KSAs).
- 2
Define HOW to assess by building structured interview guides with job-relevant questions and objective evaluation criteria based on the job profile.
- 3
Define WHO to select by systematically evaluating candidate responses against the criteria, using data and evidence to make an informed hiring decision.
Process 40 · named in the source
Job Analysis
To systematically identify the activities, responsibilities, knowledge, skills, and abilities (KSAs) required for successful performance in a role.
- 1
Prepare a template to capture job components like purpose, activities, and qualifications.
- 2
Gather information from subject matter experts (SMEs) using methods like interviews, focus groups, or surveys.
- 3
Research existing data from internal documents or external resources like O*NET.
- 4
Synthesize findings to define the most critical activities and their corresponding KSAs.
- 5
Build a comprehensive, internal job profile and a concise, candidate-facing job description.
- 6
Develop objective evaluation criteria (e.g., BARS) for each finalized KSA.
Process 41 · named in the source
The Six Essential Steps to Reinventing Performance Management
To guide leaders through a structured process of designing and implementing a new, strategic performance management system.
- 1
Set the strategic vision for performance management with senior leadership.
- 2
Design a new performance appraisal template that reflects current organizational goals.
- 3
Craft winning content and descriptors that raise performance expectations.
- 4
Communicate the new vision and gain buy-in from all employees.
- 5
Roll up the data into a strategic enterprise dashboard for executive leadership.
- 6
Reflect, retool, and recalibrate the program annually to drive future direction.
Process 42 · named in the source
Performance Rating Calibration
To ensure managers across a department or division apply performance standards and ratings consistently, avoiding grade inflation or bias.
- 1
Senior leaders communicate the desired overall performance distribution (e.g., a bell curve).
- 2
Front-line supervisors rank their team members with proposed numerical scores and discuss the rankings with their manager.
- 3
Managers aggregate the scores from their supervisors and review the distribution with their director or VP.
- 4
Adjustments are discussed and made to ensure alignment across teams and with divisional goals.
- 5
Once there is general agreement on the numerical scores, supervisors begin writing the narrative portions of the reviews.
Process 43 · named in the source
Cognitive Process of Performance Judgment
To understand how a rater transforms observations of behavior into a subjective, evaluative judgment.
- 1
Acquire information about the ratee's performance through direct or indirect observation.
- 2
Encode and mentally represent this information, often by categorizing it based on existing schemas or prototypes.
- 3
Store the encoded information in short-term and long-term memory.
- 4
Retrieve relevant information from memory when called upon to make an evaluation.
- 5
Integrate the retrieved pieces of information to form a final, overall evaluative judgment.
Process 44 · named in the source
Designing a Goal-Oriented Appraisal System
To design a PA system by analyzing stakeholder goals first, rather than starting with a generic 'best practice' template.
- 1
Identify all key stakeholders in the appraisal process (e.g., raters, ratees, executives, HR).
- 2
Assess the primary goals each stakeholder group pursues through performance appraisal.
- 3
Analyze the goals to identify areas of conflict and compatibility between and within stakeholder groups.
- 4
Establish priorities among the identified goals, focusing on a core set that is both important and mutually compatible.
- 5
Select appraisal system features (e.g., rating source, scale format, purpose) that are most consistent with the prioritized goals.
Process 45 · named in the source
The A Method for Hiring
To systematically achieve a 90%+ success rate in hiring 'A Players'—individuals who have a 90% chance of achieving outcomes only the top 10% of candidates could.
- 1
Create a Scorecard detailing the position's mission, measurable outcomes, and required competencies.
- 2
Source a steady flow of high-caliber candidates, primarily through referrals from professional and personal networks.
- 3
Select the best candidate through a four-interview sequence: a brief phone Screen, a chronological Who Interview, a deep-dive Focused Interview, and a thorough Reference Interview.
- 4
Sell the chosen A Player on joining the team by addressing their key motivations across fit, family, freedom, fortune, and fun.
What's underneath
What the field takes for granted
Every field runs on assumptions it rarely says out loud — the beliefs its advice quietly depends on. We surface the load-bearing ones, where they hide, and when they break. Most guides never tell you this.
Placing the idea
How it compares — and where else it applies
We don't just explain the idea in isolation. We place it: against the alternative it replaces, and beyond the domain it was born in. That's the difference between knowing a method and knowing when to reach for it.
How it compares
vs Traditional unstructured interviews
Both are methods used to evaluate candidates for a job. Both typically occur after an initial screening of applications.
Assessment centres use multiple, trained assessors to reduce bias, whereas interviews often use one or two. Centres observe actual behavior via work samples, while interviews rely on self-reported or hypothetical answers. Consequently, assessment centres have much higher predictive validity.
This book makes a strong, evidence-based case for the superiority of the assessment centre method and, crucially, provides a complete practical toolkit (frameworks, ready-to-use exercises) for implementation.
vs Traditional/Unstructured Selection Methods
Both approaches aim to gather information about candidates to predict their future success in a job.
Traditional methods are subjective, intuitive, and rely on weak predictors like unstructured interviews, age, and vague definitions of 'experience'. The book's approach is objective, systematic, and uses validated tools (psychometrics, ACs, structured interviews) tied to a formal competency model.
This book advocates for an integrated system where assessment is a scientific, evidence-based discipline. It explicitly links selection (predicting future performance) with performance management (managing current and future performance), using competencies as the common language.
vs Development Center
Both use the same techniques, such as simulations, psychometric tests, and exercises. Both are based on a pre-defined set of competencies and involve observation by trained assessors.
An Assessment Center's objective is selection (a pass/fail decision), with limited feedback, and the organization owns the results. A Development Center's objective is to transform talent, with detailed individual feedback and development planning, and the participant often owns the results.
The book clearly tables the differences across multiple characteristics (objectives, feedback, ownership, expected result, etc.), treating them as related but distinct processes on a continuum.
vs Job Analysis
Both processes aim to understand the requirements of a job. Competency mapping often uses job analysis as an initial step.
Traditional job analysis focuses on describing *how* a job is done (tasks, duties). Competency-based assessment focuses on the underlying *knowledge, skills, and attitudes* required to perform the job effectively, emphasizing the 'how' and 'why' of performance.
The book positions competency mapping as an evolution of job analysis, better suited to dynamic business needs by focusing on transferable, forward-looking capabilities rather than static job descriptions.
vs Traditional, annual, cyclical performance management systems.
Both approaches typically involve setting goals, a manager assessing employee performance, and a connection to compensation decisions.
The traditional approach is a backward-looking, once-a-year event focused on ratings. This book's approach is a forward-looking, continuous process emphasizing frequent feedback, coaching, and development.
This guide provides a flexible, manager-centric framework that adapts core performance management principles to modern, agile work by de-emphasizing rigid, unpopular elements like annual ratings in favor of continuous dialogue.
vs Traditional Performance Management (TPM)
Both traditional and modern approaches share the ultimate goals of improving organizational performance, allocating rewards, and making talent decisions such as promotions and terminations.
The book advocates for a shift from an annual, backward-looking, ratings-based system focused on individual accountability (TPM) to a continuous, forward-looking, coaching-based system focused on development and team collaboration. TPM emphasizes judgment, while the new approach emphasizes growth.
This book acts as a curated collection of influential arguments against the old model and provides a diverse portfolio of concrete, company-tested alternative models (from Deloitte, Telstra, etc.), moving beyond critique to actionable solutions.
vs Traditional, unstructured, and intuitive hiring methods (e.g., 'gut feel' interviews, unsystematic resume reviews).
Both approaches share the ultimate goal of selecting a candidate to fill a job vacancy.
This book's approach is systematic, standardized, and data-driven, using validated tools to predict performance objectively. Traditional methods are subjective, inconsistent across candidates, and rely on interviewer intuition, which is often inaccurate and prone to bias.
It champions a scientific, evidence-based approach grounded in psychometrics and validation, arguing that this method is not only more accurate and efficient but also fairer to candidates.
vs U.S. Air Force's Comprehensive Occupational Data Analysis Programs (CODAP)
Both are large-scale, computer-aided systems designed to analyze quantitative data from task inventory questionnaires. Both originated from a military context and are used to create detailed, data-driven job descriptions.
WPSS was developed specifically because CODAP was not seen as sufficiently 'user-friendly' for managers inexperienced with interactive computer systems. WPSS computer output is also designed differently, focusing on side-by-side tabular comparisons of different subgroups (like locations or jobs) for a single attribute.
This book presents WPSS as a system refined for a corporate environment, emphasizing its interactive nature and accessibility for line managers, not just research specialists, and provides a complete 'how-to' guide for its implementation.
vs Four Key Paradigms of Assessment
All four paradigms (Strategic, Psychometric, Social Process, Discourse) are concerned with the process of evaluating individuals within an organizational context.
They differ fundamentally in purpose and assumptions. The Strategic view links assessment to business goals. The Psychometric view focuses on objective prediction of job performance. The Social Process view sees it as an interactional negotiation. The Discourse view analyzes it as a technology of power and control.
The book's primary contribution is to explicitly juxtapose these four often-separate perspectives, using them as lenses to analyze assessment practices like competency modeling, thereby providing a multi-faceted and critical overview of the field.
vs Siloed, stand-alone improvement programs (e.g., TQM, BPR, or just a Scorecard initiative).
Both the book's integrated PM approach and siloed programs aim to improve organizational performance, often using similar tools like process mapping and performance metrics.
Siloed programs pull one lever for improvement in isolation, often creating local optima or conflicting with other initiatives. The book's PM approach is an overarching system that integrates and orchestrates multiple methodologies (BSC, ABM, CRM, etc.) to ensure they work in harmony toward strategic goals.
This book's core thesis is the integration of these proven methodologies into a single, cohesive Performance Management framework. It argues that the real power comes not from any single tool, but from the synergistic combination that bridges the gap between strategy, operations, and financial results.
vs Business Intelligence (BI)
Both BI and Performance Management (PM) use technology to transform raw transactional data into information for decision-making. Both can involve dashboards, reporting, and analytics.
BI is the underlying data platform and toolset (the 'potential energy'). PM is the application of BI within a strategic context to improve results (the 'kinetic energy'). PM provides the 'why' and direction for BI; BI provides the 'what'.
This book positions PM as a broader, more strategic business framework that leverages BI as an essential enabling component, rather than viewing them as interchangeable terms.
vs Traditional Management (Pre-PM)
Both involve managing people and resources to achieve organizational goals. Both use budgets and performance measures.
Traditional management is often siloed, reactive, relies on flawed financial data (especially for costs), and uses budgets as a rigid control tool. PM is integrated, proactive, uses fact-based analytics for costing and customer value, and links budgets to a dynamic strategy.
The book frames PM as an evolution of management itself, moving from a command-and-control, intuition-based style to an aligned, anticipatory, and data-driven discipline.
vs Financial Accounting
Both are disciplines within the broader field of accounting and deal with the financial data of an organization.
Financial accounting is for external stakeholders (investors, regulators), is compliance-driven (GAAP/IFRS), focuses on historical accuracy and valuation. Managerial accounting is for internal managers, is decision-support driven, focuses on future-oriented value creation, and has no mandated rules.
The book argues that managerial accounting is far more critical for creating value and that over-reliance on financial accounting principles for internal decisions is a primary cause of poor performance.
vs Traditional Management by Results
Both approaches are concerned with achieving organizational results like profit, quality, and productivity.
PM is proactive, focusing on managing the daily behaviors that create future results. Management by Results is reactive, analyzing outcomes after they occur. PM uses data to reinforce behavior, while Management by Results often uses data to assign blame or punish.
This book provides a systematic, repeatable technology for managing behavior directly, rather than just holding people accountable for outcomes they may not fully control.
vs Management Styles Relying on Punishment/Negative Reinforcement
Both approaches use consequences to influence behavior.
PM overwhelmingly prioritizes positive reinforcement (R+) to build and sustain performance. Traditional punitive styles rely on negative reinforcement (R-) and punishment (P+/P-), which creates fear and encourages only minimum performance to avoid negative outcomes.
The book makes a scientific and ethical case for why positive reinforcement is more effective for creating discretionary effort, high morale, and long-term success.
vs Common Sense/Trait-Based Management
Both are concerned with why people behave as they do.
PM focuses on observable, measurable behavior and its environmental causes (antecedents and consequences). Trait-based approaches rely on unobservable internal states like 'attitude,' 'motivation,' or 'personality,' which the book argues are vague labels that don't lead to effective action.
This book provides tools (like Pinpointing and the ABC model) to move beyond subjective labels and analyze performance with scientific objectivity.
vs Performance Appraisal
Both processes typically involve a manager and an employee, and often culminate in some form of annual meeting to discuss performance over a period.
Performance Appraisal is a top-down, retrospective assessment, often a bureaucratic annual event owned by HR with a focus on ratings and paperwork. Performance Management is a continuous, forward-looking joint process of dialogue, owned by line managers, focused on development, values, and behaviors as well as objectives, with ratings being less common.
This book positions Performance Management as a holistic and natural process of management itself, fundamentally distinct from the isolated, often punitive event of traditional appraisal. It emphasizes partnership, continuous dialogue, and development over judgement and control.
vs European 'Social Negotiation' Perspective
Both the US psychometric approach and the European perspective are concerned with the process of matching individuals to jobs.
The US 'predictivist' approach, which dominates the book, views selection as a technical problem of maximizing predictive validity to enhance productivity. The European perspective gives more weight to applicant rights, privacy, and fairness, viewing selection as a two-way social negotiation.
While written by a UK author, the book overwhelmingly adopts and advocates for the American-style psychometric and utility-focused approach as the most effective way to add value through people.
vs Unstructured (Traditional) Interview
Both are conversational methods used to assess candidates' suitability for a job.
The unstructured interview is intuitive, informal, and varies between candidates. The structured interview, based on a job analysis, uses standardized questions and systematic scoring to improve reliability and validity.
The book presents a large body of meta-analytic evidence to argue for the clear superiority of structured interviews, framing the continued use of unstructured interviews as a costly and legally risky mistake.
vs Specific Aptitude Battery Approach
Both general mental ability (GMA or 'g') tests and specific aptitude batteries measure cognitive abilities to predict performance.
The GMA approach posits that a single, general factor of intelligence is the primary driver of performance. The specific aptitude approach argues that different jobs require different combinations of specific abilities (e.g., spatial, numerical).
The book reviews compelling evidence suggesting that the predictive power of specific aptitude batteries comes almost entirely from their shared measurement of 'g', making simpler and cheaper GMA tests a more efficient choice for most selection purposes.
vs The Traditional Psychometric/Utilitarian Paradigm of Personnel Selection
Both approaches acknowledge the importance of using valid predictors of job performance. Both are concerned with making effective personnel decisions for the organization.
The traditional paradigm's primary goal is maximizing predictive validity and economic utility for the organization, viewing the applicant as an object to be measured. This book's approach views the applicant as an active participant whose perceptions, reactions, and welfare are important considerations. The traditional paradigm focuses on statistical fairness (e.g., differential prediction), while this book incorporates social and procedural fairness ('social validity').
This book's distinctive contribution is its explicit argument for balancing the organizational and individual perspectives. It uniquely reframes applicant reactions not as noise or error, but as valid data points that have ethical implications and practical consequences for organizational effectiveness (e.g., recruitment success, long-term commitment).
vs Traditional, purely empirical criterion-related validation.
Both approaches aim to support the inference that a selection procedure is predictive of job performance. Both often rely on job analysis as a starting point and use statistical measures to evaluate relationships.
The traditional model focuses almost exclusively on the empirical correlation between the predictor measure and the criterion measure (Linkage 1 in Binning & Barrett's model), often treating both as a black box. This book's approach emphasizes a construct-oriented theory, requiring explicit hypotheses about the psychological constructs being measured by both the predictor and the criterion, and their theoretical relationship.
This book champions a 'unitarian' view of validity, where all validation is a form of construct validation. It argues that a simple correlation is not enough; one must understand *why* a predictor works by linking it to a theory of job performance.
vs Staffing Model 1 (Matching Individuals to Jobs).
Both Model 1 and the more advanced models presented (Models 2 & 3) are concerned with acquiring human resources for the organization and use common tools like job analysis and selection tests.
Model 1 treats staffing as a discrete, operational activity focused on filling specific, stable jobs based on technical fit. Models 2 and 3, described in Chapter 14, frame staffing as a strategic activity. Model 2 aligns staffing with a pre-existing business strategy, while Model 3 uses the acquisition of human capital to drive the formation of strategy.
This book, particularly in Chapter 14, moves the discussion of staffing from a purely micro-level, psychological process to a macro-level, strategic management issue, arguing that staffing can be a source of competitive advantage.
vs Informal and Unstructured Selection Processes
Both aim to identify the best candidates for a job and are used by organizations to make hiring decisions.
This book advocates for formal, structured, and validated methods (e.g., structured interviews, work samples) which are based on job analysis and have proven predictive validity. Informal methods (e.g., unstructured interviews) are haphazard, lack standardized criteria, and research shows they are not particularly useful for predicting job performance and can be legally risky.
The book's entire premise is that organizations should replace unstructured, intuition-based hiring with systematic, evidence-based assessment methods to improve workforce quality and legal defensibility.
vs Commercially Available (Off-the-Shelf) Assessments
Both commercially available and custom-developed assessments are formal tools used to measure candidate KSAs.
Commercial tests can be implemented quickly and are maintained by a publisher, but involve ongoing licensing fees and may raise security concerns. Custom-developed tests are tailored to the organization's unique needs and owned outright, but require significant upfront time and cost for development and validation, plus ongoing internal maintenance.
The book presents this as a practical business decision, outlining the advantages and disadvantages of each approach to help practitioners choose the best path for their organization's resources and strategy.
vs Other types of interviews (e.g., talk show, medical history).
All involve a question-and-answer format with differentiated roles for an interviewer and a respondent.
Standardized survey interviews uniquely use the respondent's answers directly as data to produce quantitative descriptions of a population. Their goal is measurement, not entertainment (talk show) or individual diagnosis (medical history). This goal necessitates strict standardization of questions and procedures, which is absent in the other types.
The book establishes that because the survey interview is a measurement tool, it must adhere to the principles of scientific measurement, with standardization being the most critical principle.
vs The Balanced Scorecard (BSC)
Both frameworks use visual maps (Strategy Map vs. Value Creation Map) to depict strategy, emphasize linking measures to strategic objectives, and advocate for moving beyond purely financial metrics.
The book claims its approach is superior because BSC is too prescriptive, has a narrow shareholder focus, and an incomplete classification of resources. The SPM framework is presented as more holistic, with a broader stakeholder view and a more explicit grounding in the resource-based view of the firm, particularly intangible assets.
This book's distinctive contribution is the Value Creation Map, which explicitly integrates the market-based and resource-based views of strategy on a single page. It also places a much stronger emphasis on creating an 'enabled learning environment' for dialogue and challenging assumptions, as opposed to a system for cascading and controlling strategic execution.
vs Paper-and-Pencil Cognitive Aptitude Tests
Both can be highly reliable and valid predictors of job performance. The study shows this structured interview has a strong cognitive component, similar to the tests.
The interview is administered orally, allows for social interaction, and may have higher face validity for applicants and managers. Tests are cheaper to administer per person but may be more difficult to content validate for a specific job.
It demonstrates that an interview, a tool managers prefer, can be engineered to achieve the same psychometric rigor as standardized tests, resolving the conflict between managerial preference and predictive accuracy.
vs Unstructured, 'gut-feel' interviewing and reliance on shortcuts like brain teasers or the 'beer test'.
Both approaches aim to find the best candidate for a role through a conversational assessment.
This book's method is systematic, evidence-based, consistent, and legally defensible. Unstructured methods are subjective, inconsistent, highly prone to bias, and have been scientifically shown to be poor predictors of job performance.
It translates decades of I-O psychology research into a practical, accessible three-step toolkit (WHAT, HOW, WHO) specifically for hiring managers and business owners, not just HR specialists, bridging the gap between theory and real-world application.
vs Traditional, static performance appraisal systems common in corporate America.
Both systems typically use a form to rate employees on a set of competencies, include a goal-setting component, and are linked to annual merit increases.
This book's system is dynamic, advocating for annual redesigns of the template and content. It uses more aspirational language, promotes calibration for consistency, and treats appraisal as a continuous process rather than a single event.
The primary distinction is its 'tool kit' approach with customizable templates for different company life stages, and its strong emphasis on rolling up the data to create an enterprise-level 'human capital scorecard' for strategic decision-making.
vs The traditional psychometric or measurement-oriented perspective of performance appraisal.
Both perspectives aim to understand and improve the effectiveness of performance appraisal in organizational settings. Both acknowledge issues like rating inflation (leniency) and halo.
The traditional view treats PA as a measurement instrument and focuses on improving its psychometric properties (e.g., scale formats, rater error training). This book treats PA as a social, goal-directed communication process, arguing that so-called 'errors' are often rational adaptations to the organizational context.
Its primary thesis is that the organizational context and the rater's goals are the most powerful drivers of rating behavior. It shifts the focus from the rater's *ability* to be accurate to their *motivation and willingness* to be accurate within a given system.
vs Traditional or 'Voodoo' Hiring Methods
Both the A Method and traditional methods share the ultimate goal of filling an open position and typically involve some form of interviewing.
The A Method is a systematic, consistent, and data-driven process based on gathering facts about past performance. 'Voodoo' hiring is an ad-hoc collection of techniques relying on gut instinct, trick questions, unstructured conversations, and unscientific personality tests.
It presents a single, simple, end-to-end process (Scorecard, Source, Select, Sell) that is easy for any manager to learn and apply immediately. Its credibility is built on a massive collection of interviews with successful leaders and a large-scale academic study, combining practical advice with empirical validation.
Where else it applies
The model, taken beyond its home domain
Hiring and Selection
The competency definitions and behavioral indicators can be used to create behavioral interview questions to assess whether candidates possess the necessary skills for a management role.
Succession Planning
The framework can identify high-potential employees by assessing their readiness for senior roles based on demonstrated proficiency in 'Strategic Leadership' competencies like 'System Thinking'.
Training Program Design
Aggregated data from performance appraisals can identify common competency gaps across the organization, providing a clear basis for designing targeted training workshops (e.g., a program on 'Change Leadership').
University Admissions (e.g., for MBA or Medical School)
Group problem-solving activities and ethical dilemma role plays could be used to assess non-academic competencies like teamwork, communication, and judgment, which are critical for success in these professions but are not captured by academic grades.
Non-Profit Volunteer Leadership Selection
The book's group activities (e.g., 'Charity Allocation') could be used to identify volunteers with leadership and project management potential for key roles, providing a more objective measure than seniority or self-nomination.
Internal 'Talent Pool' Identification
The methods described for development centres can be used to assess the potential of current employees, identifying skill gaps and creating targeted development plans as part of a succession planning or talent management initiative.
Personal Relationships / Marriage
The book opens with an anecdote of a colleague using a structured interview and profile matching to select a spouse. This illustrates how the principles of defining success criteria (compatibility, values) and using systematic assessment can be applied to high-stakes personal decisions, moving beyond intuition alone.
Venture Capital and Private Equity
Chapter 17 describes 'assessments linked to private equity initiatives.' The methods are used for due diligence on the management teams of potential investment or acquisition targets to assess leadership capability, team dynamics, and the ability to execute a business plan, thereby reducing investment risk.
Educational Assessment
The book notes that psychometrics originated in education. The tools and principles, especially for ability and aptitude testing, can be applied to assess student attainment, diagnose learning difficulties (e.g., dyslexia), and provide educational and vocational guidance.
Education and Tutoring
A teacher can manage a student's learning by setting clear objectives (goals), providing regular feedback on assignments (ongoing feedback), using questioning to help a student find answers (coaching), and creating a long-term learning plan (development plan).
Parenting
The principles of setting collaborative goals (family expectations), providing regular, specific feedback (rather than letting issues fester), and focusing on a child's development and strengths can improve communication and foster growth within a family.
Personal Goal Achievement
An individual can apply the framework to themselves by setting effective goals, creating a plan with milestones, tracking their own progress (self-assessment), identifying their own performance gaps, and seeking 'feedback' from mentors or peers.
Higher Education
The principles of continuous feedback and a focus on development over evaluation could transform student assessment, moving away from high-stakes final exams toward more frequent, low-stakes coaching and project-based check-ins to foster genuine learning.
Parenting and Family Dynamics
The 'Set-Up-to-Fail Syndrome' framework can be applied to parent-child relationships, where a parent's low expectations can create a vicious cycle of micromanagement and a child's withdrawal or rebellion.
Professional Sports
Team performance metrics could be redesigned using the Four-Part Scorecard model, balancing individual player statistics with team-level goals (e.g., defensive efficiency) and long-range goals (e.g., developing rookie talent) to foster a more collaborative, less 'me-first' culture.
Internal Promotions and Succession Planning
The same principles of using validated assessments to predict performance can be applied to internal candidates. Assessments can identify high-potential employees for leadership pipelines, ensuring promotion decisions are based on objective data about capabilities rather than just past performance in a different role.
Team Composition and Formation
Assessment data, particularly from personality and work style measures, can be used to construct teams with a complementary mix of skills and behavioral tendencies. This can help ensure a team has a balance of, for example, creative thinkers, detail-oriented implementers, and relationship builders.
Employee Training and Development
Assessment results gathered during hiring can be repurposed post-hire to create individualized development plans. The data can highlight areas where a new employee might need coaching or training to succeed in their new role, facilitating a faster on-boarding process.
University Admissions
The principles of using multiple, validated hurdles to predict future success are directly applicable to university admissions. This could involve combining standardized tests (ability), essays (situational judgment), and interviews in a structured way to predict academic and extra-curricular success, moving beyond a simple reliance on grades and test scores.
Personal Goal Setting and Self-Management
An individual can apply the 7-step framework to their personal life. They can identify their 'customers' (e.g., family, future self), define key 'results' ('Financial security,' 'Improved health'), assign weights, create measures ('Monthly savings rate,' 'Average hours of sleep'), and set specific goals to track their progress.
Project Management and Definition of Done
A project manager can use the framework to define project success criteria. The stakeholders are the 'customers,' the key deliverables are the 'results,' weights represent priorities, and the measures and goals become the explicit 'Definition of Done' (e.g., 'Uptime of 99.9%,' 'End-user satisfaction score of 4.5/5').
Entrepreneurship and Business Planning
A startup founder can use the model to define the key results for their business. 'Customers' are target market segments, 'results' are the core value propositions (e.g., 'Reduced customer acquisition cost,' 'Increased user engagement'), and the measures and goals become the startup's key performance indicators (KPIs).
Vocational Education and Curriculum Design
The detailed, validated task list produced by a job analysis serves as a direct blueprint for a training curriculum. The tasks identified as most important, difficult to learn, or time-consuming become the core learning objectives and instructional modules, ensuring that training is directly relevant to on-the-job performance.
Legal Compliance and Litigation Support
In the context of equal employment opportunity (EEO) regulations, employers must demonstrate that their selection and promotion criteria are job-related. The systematic, data-driven, and well-documented output of a WPSS analysis provides strong evidence of a job's content and its required skills, helping to legally defend the validity of employment tests and other selection procedures.
Venture Capital and Startup Investment
The frameworks for matching manager types to business life-cycle stages ('question mark,' 'star,' 'cash cow') can be directly applied by investors to assess if a founding team has the right leadership competencies for the startup's current growth phase and whether leadership changes are needed later.
Public Policy and Social Services
The discourse perspective on assessment as a 'technology of government' is a powerful tool for analyzing how welfare, healthcare, or criminal justice systems use criteria and assessments to categorize, measure, and manage populations, revealing underlying power dynamics and social constructions.
Personal Career Management
Individuals can use the book's frameworks to understand the 'game' of selection. By understanding an organization's strategic type (e.g., 'Academy' vs. 'Baseball Team'), a candidate can better tailor their application and interview strategy to match the implicit criteria being used.
Government and Public Sector
The PM framework is universally applicable. The ultimate goal shifts from 'profit' to 'mission accomplishment'. Strategy maps align agency activities to strategic goals, scorecards measure progress against public service targets, and ABM calculates the true cost of delivering services to different citizen groups, enabling better resource allocation with finite budgets.
Healthcare
Hospitals can use strategy maps to link clinical practices to patient outcomes and financial stability. ABM can determine the true cost of different treatment paths ('care maps') for various patient conditions, and scorecards can track metrics like patient safety, readmission rates, and operational efficiency.
Non-Profit Organizations
A non-profit can use a strategy map to show how donor development activities and volunteer training (Learning & Growth) lead to better program execution (Internal Process), which creates more value for beneficiaries (Customer/Stakeholder), ultimately leading to greater financial sustainability (Financial).
Social and Environmental Performance Management ('Going Green')
The book advocates for a 'triple bottom line' (profit, people, planet). The PM framework can be used by replacing monetary units with environmental units (e.g., CO2 emissions) in an ABC model to create a 'carbon footprint model,' tracing emissions to their sources and enabling targeted reduction efforts.
Public Sector and Government Agencies
Instead of maximizing shareholder wealth, the goal is to maximize value for citizens and taxpayers ('more-for-less' or 'value-for-money'). Strategy maps and scorecards can align agency activities with policy objectives, and ABC can provide cost transparency for services to justify budgets and improve efficiency.
Human Capital Management (HCM)
The PM framework's emphasis on analytics is applied directly to the workforce. Predictive models can be built to identify employees at risk of leaving, optimize recruiting efforts, and align employee skills with future strategic needs, treating human capital as a key asset to be managed.
Parenting and Family Life
The book explicitly states that PM principles can be applied at home. For example, instead of giving a child candy to stop a tantrum (reinforcing crying), a parent can use extinction (ignoring the tantrum) and positively reinforce asking politely for a treat at an appropriate time.
Personal Habit Change
The book uses examples like smoking, weight loss, and exercise to illustrate behavioral principles. A person could use a PIC/NIC analysis to understand why they procrastinate and then apply the Premack Principle: 'After I finish this difficult work report (low-probability behavior), I can spend 30 minutes on my favorite hobby (high-probability behavior).'
Sports Coaching
The book features a detailed case study on coaching Little League football. Coaches can use PM by pinpointing the exact physical movements for a skill (a golf swing, a free throw), using checklists for feedback, and using shaping to reinforce small improvements toward the final, perfected form.
Education and Teaching
The book references B.F. Skinner's work on teaching, noting that shaping is critical. A teacher can break a complex math problem into small steps (chaining) and provide frequent positive reinforcement for mastering each successive step, rather than only grading the final answer.
Personal Life and Self-Improvement
Individuals can adapt the performance management cycle for personal goals. They can 'Plan' by setting SMART objectives (e.g., for fitness or learning a new skill), 'Act' on them, 'Monitor' progress using defined measures, and conduct periodic 'Reviews' to assess achievements and set new goals.
Education
Teachers and students could use the principles to create a 'learning agreement.' This would involve jointly setting learning objectives, defining what success looks like (measures), having ongoing dialogue (feedback), and conducting reviews to assess progress and plan next steps, fostering student ownership of their learning.
Freelancer/Client Relationships
A freelancer can use this framework to manage client projects. A 'performance agreement' (statement of work) would define objectives and success criteria. 'Managing performance throughout the year' becomes regular project check-ins, and the 'review' is a post-project debrief to improve future collaboration.
Military Selection
The military is presented as a primary source of high-quality selection research due to its large sample sizes and critical need for effective personnel. The book frequently uses military research (e.g., Project A, WOSB, ASVAB data) as direct evidence for the validity of methods in civilian contexts.
Customer Relationship Management / Sales
Rynes's suggestion to 'view applicants as customers' can be applied to complex sales processes. Providing realistic previews of a service, ensuring procedural fairness in negotiations, and treating the potential customer with respect can build long-term commitment, much like with a job applicant.
Judicial and Legal Processes
The concepts of procedural justice, fairness, and the impact of evaluator/assessor characteristics (race, gender) on judgments are highly relevant to the legal system. Perceptions of fairness in court proceedings affect public trust, and the analysis of potential bias in assessment center ratings has direct parallels to research on judicial sentencing disparities.
Medical Doctor-Patient Relationships
Wanous explicitly uses the medical context as an analogy. The core idea that preparing an individual for a stressful process by managing expectations, teaching coping skills, and providing information can improve outcomes is directly transferable from preparing patients for surgery to preparing newcomers for organizational entry.
Educational Admissions
The principles of using predictors (e.g., standardized tests, interviews, biodata) to forecast future performance (e.g., academic success) are directly parallel. The debates over validity, fairness vs. utility (merit vs. diversity), and the meaning of the criterion construct are identical to those in university admissions.
Team and Project Composition
Instead of selecting one individual for one job, the principles can be used to select a group of individuals to form an effective team. This involves predicting not just individual task success but also contextual performance, such as cooperation and communication, and considering the optimal mix of KSAs and personality traits for team synergy, as hinted at in Chapter 3.
Clinical Psychology and Diagnosis
The process of using multiple pieces of information (predictors like test scores, interviews) to make a prediction about a future state (a diagnosis or prognosis) is analogous. The emphasis on construct validity—ensuring measures accurately assess underlying psychological traits—is central to both fields.
Credit Scoring and Financial Underwriting
Financial institutions use historical data (predictors) to build statistical models that predict a future outcome (criterion), such as loan default. The process of empirical keying of biographical data to predict a criterion is methodologically similar to developing credit scoring models.
Employee Development
The book notes that assessment centers, while used for selection, can also be used to provide comprehensive developmental feedback to participants on their managerial and supervisory competencies.
Internal Promotions
The book states that the assessment methods discussed can be used for both internal selection (hiring or promoting from within) and external selection (hiring from outside), not just initial hiring.
Medical History Taking
Physicians and nurses could benefit from using non-directive probing techniques to elicit patient symptoms. This would help them gather more accurate information without suggesting answers, which can lead patients to agree with a condition they don't actually have, ultimately improving diagnostic accuracy.
Journalistic Interviewing
While journalism often requires adaptive questioning, a reporter conducting a series of 'person on the street' interviews for a quantitative story could use standardized questions to ensure that the quotes they gather are responses to a consistent stimulus, making comparisons more valid.
Personal Career Development
An individual can create a personal Value Creation Map to manage their career. The 'value proposition' is their unique offering to the job market, 'core competencies' are their key skills, and 'resources' include their education, network, and experience. This framework can guide goal-setting and skill development.
Non-Profit Program Management
A non-profit program can use a Value Creation Map to align its activities with its mission. The 'value proposition' is the social impact delivered to beneficiaries, 'competencies' are key program activities, and 'resources' are funding, volunteers, and partnerships. This helps in communicating impact to donors and ensuring resources are focused on the mission.
New Venture/Startup Planning
Entrepreneurs can use the framework to articulate and test their business model. The Value Creation Map serves as a dynamic business plan, visualizing the link between the customer problem (value proposition), the proposed solution (competencies), and the required assets (resources), which can then be tested and refined.
Academic Research Project Management
A research team can map their project. The 'value proposition' is the contribution to knowledge, 'core competencies' are the research methodologies and analytical skills, and 'resources' are the research team's expertise, lab equipment, data access, and funding. This helps in planning, securing funding, and communicating the project's logic.
Performance Appraisals
The principles of using a job-analysis basis, behavioral examples (anchors), and multiple raters can be applied to create structured performance review conversations, making them more objective, fair, and legally defensible.
Grant or Funding Application Reviews
Review panels for grants or venture capital could use a structured protocol with consistent, pre-determined questions and anchored rating scales to evaluate proposals or founder pitches, ensuring a more equitable and systematic decision-making process.
Performance Management and Employee Development
The job profile created during job analysis defines 'what good looks like,' serving as an objective basis for setting performance goals, conducting reviews, and identifying specific training needs for current employees.
Promotion and Internal Mobility
The structured interviewing and assessment framework can be applied to internal candidates to make promotion decisions more objective, fair, and based on merit rather than tenure or office politics.
Team and Role Design
The job analysis process can be used proactively for existing teams to clarify roles, identify skill gaps or overlaps, and redesign responsibilities to improve team effectiveness and collaboration.
Project Management
A project team could adapt the framework to evaluate its performance post-launch, defining the project's 'strategic initiatives,' 'core values' (project principles), and key 'performance factors' to create a comprehensive lessons-learned document.
Non-Profit Volunteer Management
Volunteer coordinators can use the goal-setting and quarterly check-in processes to provide structure and recognition for volunteers, focusing on contribution and skill development in the absence of monetary rewards.
Academic Advising
An academic advisor and a student could use the self-evaluation and goal-setting templates to structure a multi-year development plan, focusing on academic performance, skill acquisition, and career preparation.
Personal Annual Review
An individual could use the template structure to conduct a personal annual review, defining their own 'core values,' assessing performance against last year's goals, and setting measurable objectives for the year ahead.
Managerial Decision-Making (e.g., budget allocation, project assignments)
The book's goal-based analysis can be used to understand how managers make decisions beyond just PA. A manager's decision to allocate resources to a specific project may be less about objective ROI and more about strategic goals (making their department look good) or interpersonal goals (rewarding a loyal subordinate with a high-profile project), mirroring the motivations behind rating behavior.
Organizational Change Initiatives
The book's emphasis on context and stakeholder goals can be applied to understand why change initiatives succeed or fail. A technically sound new system may be rejected if it conflicts with the hidden goals and political realities of the managers and employees expected to implement it, much like a psychometrically perfect PA system fails in a dysfunctional context.
Internal Promotions & Talent Management
Instead of promoting someone based on their success in a current role, create a Scorecard for the new, more senior role. Then, use the Who Interview to assess the internal candidate's entire career history against the new requirements, preventing the 'Peter Principle'.
Personal 'Who' Decisions
The method can be adapted for hiring a nanny (as the author did), a financial advisor, or a contractor. Create a personal 'scorecard' of desired outcomes and competencies, 'source' candidates through referrals, and 'select' by asking about their past performance patterns.
Mergers & Acquisitions Due Diligence
An acquiring company can use the A Method to assess the quality of the target company's management team. Conducting Who Interviews with key executives provides crucial data on their capabilities and cultural fit, informing valuation and post-merger integration plans.
Board Member Selection
A nominating committee can create a scorecard for a new board seat, specifying outcomes (e.g., 'provide credible challenge on cybersecurity risks') and competencies (e.g., 'discretion,' 'financial acumen'). The selection process can then follow the A Method to find a director who truly fits the board's needs.
Extracted per book (comparative_analysis, alternate_applications) and reconciled across the corpus. Placing an idea — its rivals and its reach — is reasoning a summary never does.
Movement III · The run-it-now depth
The Playbook
The run-it-now material, pulled straight from the source and reconciled: the frameworks to apply, the checklists to work through, and real cases — including the failures. This is the depth a summary can't give you.
Frameworks
State System Competency Framework
A behavioral framework that defines performance through a dictionary of 19 competencies, each with scaled indicators of proficiency. It is used for performance assessment and development planning.
Start hereAn employee and supervisor select three or more job-specific competencies from the dictionary to complement the five mandatory System Core Competencies.
PathProgression is demonstrated by exhibiting behaviors at higher, cumulative levels on the scale for each competency, aligned with one's management level (e.g., from 'Operational Leadership' to 'Strategic Leadership').
- 1Identify the manager's role in the 'Levels of Contribution' table (e.g., Tactical Leadership).
- 2Adopt the five mandatory 'System Core Competencies' (e.g., Results Orientation).
- 3Select at least three additional job-specific competencies relevant to the role (e.g., Change Leadership).
- 4Determine the expected level of proficiency for each competency based on the role.
- 5Assess performance by comparing observed behaviors against the descriptive indicators for that level.
The Sample Competence Framework
A framework of 13 competencies with specific positive and negative behavioral indicators tailored for assessment centre activities.
Start hereIdentify the critical competencies for the target role using the provided list (e.g., 'Planning and Organizing', 'Leadership').
◆ The full 6-step framework — unlock with membership
Rodger's Seven-Point Plan
A classic framework for structuring a selection interview to ensure comprehensive coverage of a candidate's background and attributes.
Start herePlanning the content and flow of a selection interview.
◆ The full 7-step framework — unlock with membership
Munro-Fraser's Five-Fold Grading System
A framework for organizing and evaluating information gathered during an interview, categorizing it into five key areas.
Start hereAfter an interview, when synthesizing notes and making a selection decision.
◆ The full 5-step framework — unlock with membership
Hudson's 5 + 1 Competency Model
A flexible framework for structuring an organization's competencies. It combines five generic competency clusters applicable to most roles with one cluster for company-specific technical competencies.
Start hereAn organization seeking to build its first competency framework can use this model as a starting structure.
◆ The full 5-step framework — unlock with membership
The Ongoing Performance Management Cycle
A continuous, flexible approach to managing performance that replaces or supplements the traditional annual review. It integrates goal setting, observation, feedback, coaching, and development into a manager's regular work rhythm.
Start hereA manager decides to move from a once-a-year evaluation to a more continuous dialogue to better support their team in a fast-paced environment.
◆ The full 5-step framework — unlock with membership
Career Lattice Model
A career development framework that views career paths as a flexible 'lattice' with multidirectional movements (upward, lateral, diagonal), rather than a rigid, one-way 'career ladder'. It prioritizes skill acquisition and adaptable career moves.
Start hereAn employee or manager recognizes that a traditional upward promotion is not the only, or best, path for career growth and satisfaction.
◆ The full 5-step framework — unlock with membership
Four Mechanisms for Creating a Thriving Workforce
A framework identifying four essential conditions managers must create to foster a workforce that is both energized (vitality) and growing (learning).
Start hereA manager notices employee burnout or disengagement and wants to build a more sustainable high-performance culture.
◆ The full 4-step framework — unlock with membership
Incremental Assessment Improvement Framework
A tiered approach to systematically improve hiring accuracy and efficiency by progressively implementing more sophisticated assessment methods.
Start hereStarting with no standardized assessments (e.g., using only unstructured interviews) and recognizing their ineffectiveness.
◆ The full 7-step framework — unlock with membership
The 7-Step Performance Plan Creation Framework
A systematic, cascading framework for translating high-level organizational strategy into specific, measurable, and trackable individual employee performance goals.
Start hereThe process begins with an understanding of the organization's strategic goals for the upcoming performance period.
◆ The full 7-step framework — unlock with membership
WPSS Follow-Up Procedure
A structured method that uses the output of a WPSS survey (a list of significant tasks) as the input for a subsequent data collection effort to link job activities to other factors like required skills, abilities, or job design characteristics.
Start hereA list of significant tasks selected from a completed WPSS data analysis based on pre-set criteria (e.g., high average importance rating and performed by a majority of incumbents).
◆ The full 5-step framework — unlock with membership
Strategic Alignment of Assessment Practices
A framework for aligning an organization's assessment system with its overarching corporate strategy, as defined by models like Miles & Snow's (Prospector, Defender) or Porter's (Cost Leadership, Innovation).
Start hereIdentify the organization's dominant corporate strategy (e.g., Prospector seeking new markets).
◆ The full 4-step framework — unlock with membership
Competency-Based Human Resource Management
A framework that uses a defined set of competencies (underlying characteristics that drive superior performance) as the common language for integrating all HR activities.
Start hereIdentify the core competencies required for strategic success through a future-oriented job analysis.
◆ The full 5-step framework — unlock with membership
The Balanced Scorecard Framework
A strategic planning and management framework used to align business activities to the vision and strategy of the organization, improve internal and external communications, and monitor organizational performance against strategic goals.
Start hereThe executive team defines the organization's strategy and develops the top-level corporate strategy map and balanced scorecard.
◆ The full 6-step framework — unlock with membership
The Performance Management Framework for Value Creation
A circulatory and simultaneous model (depicted in Exhibit 2.1) that integrates various methodologies to synchronize improvement and create value for customers and shareholders. It moves beyond 'better, faster, cheaper' to include 'smarter'.
Start hereUnderstanding customer needs and satisfaction is the starting point that informs the organization's strategy.
◆ The full 6-step framework — unlock with membership
Risk-Based Performance Management Framework
A four-step framework (depicted in Exhibit 4.3) that integrates risk management with strategy formulation and execution to maximize stakeholder value. It links risk performance to business performance.
Start hereAssessing key value drivers and identifying Key Risk Indicators (KRIs) to understand the root causes of risk.
◆ The full 4-step framework — unlock with membership
The ACORN Test Framework
A five-part framework for validating the mission of a job or organization to ensure it is well-defined and actionable.
Start hereYou have a draft mission statement for a job role (e.g., 'Jobs filled with qualified personnel').
◆ The full 5-step framework — unlock with membership
Performance Management Development Framework
A conceptual model illustrating the key elements to consider when designing and implementing a performance management system. It emphasizes the interplay between the organization's environment and the system's design.
Start hereAnalyzing the organization's existing context, particularly its culture, management style, and structure.
◆ The full 4-step framework — unlock with membership
The Five Factor Model (FFM) of Personality
A dominant framework organizing personality into five broad traits: Neuroticism (vs. Emotional Stability), Extraversion, Openness to Experience, Agreeableness, and Conscientiousness.
Start hereUse a job analysis to identify which of the five personality dimensions are most crucial for success in a particular role.
◆ The full 4-step framework — unlock with membership
Brogden's Utility Analysis Framework
A model for calculating the financial return on investment (utility) of a selection procedure in dollar terms.
Start hereGather necessary data: the validity of the selection procedure (r), the standard deviation of job performance in dollars (SDy), the average test score of selected applicants (Z), and the cost of the procedure.
◆ The full 5-step framework — unlock with membership
ASCII Control Codes for Team Proficiency
A framework for assessing a candidate's fit within a team by evaluating five key interpersonal proficiencies. It shifts the focus from purely individual job performance to the candidate's potential contribution to collaborative work.
Start hereDuring the selection process, especially when team performance is a critical criterion.
◆ The full 7-step framework — unlock with membership
Campbell's Theory of Performance Determinants
A model positing that individual differences on any component of job performance are a direct function of three, and only three, major determinants.
Start hereUnderstanding the components of job performance for a given role.
◆ The full 6-step framework — unlock with membership
Strategic Staffing Models
A set of three conceptual models that describe the relationship between an organization's staffing practices and its competitive strategy.
Start hereAn organization seeks to align its human resource practices with its overall business goals.
◆ The full 3-step framework — unlock with membership
Strategic Performance Management (SPM) Framework
The book's core, integrated framework for defining, assessing, implementing, and continuously refining organizational strategy by linking it to performance management in a learning environment.
Start hereRecognizing that traditional performance management is failing due to the 'strategy, measurement, and management traps'.
◆ The full 5-step framework — unlock with membership
Enabled Learning Environment Framework
A cultural and procedural framework for shifting from a top-down, control-oriented management style to one that fosters inquiry, dialogue, and continuous learning at all levels.
Start hereThe failure of command-and-control systems, which lead to dysfunctional behavior, fear, and a lack of innovation.
◆ The full 4-step framework — unlock with membership
The Six-Step Structured Interview Framework
A systematic framework for creating and implementing a psychometrically sound and legally defensible employment interview.
Start hereAn organization's need to hire employees for a specific job or job family where traditional interviews are proving ineffective or risky.
◆ The full 6-step framework — unlock with membership
Structured Interviewing Framework
A systematic method for conducting interviews where all candidates for a role are asked the same predetermined, job-relevant questions and evaluated against a consistent, objective rating scale.
Start hereAfter a job analysis has been completed and the critical KSAs for the role have been defined.
◆ The full 6-step framework — unlock with membership
Organizational Life Cycle Framework for Performance Management
A framework that tailors the focus of the performance appraisal system to the company's current stage of development (Startup, Growth, Mature, Revival).
Start hereAn HR leader or executive identifies their company's current stage in the organizational life cycle.
◆ The full 4-step framework — unlock with membership
The Golden Cycle of Performance Management
A three-step framework illustrating that performance management is a continuous process, not a singular annual event.
Start hereThe framework begins at the start of the review year with goal setting.
◆ The full 3-step framework — unlock with membership
The Four-Component Model for Understanding Performance Appraisal
A holistic framework that approaches PA as a social process occurring within a context, breaking it down into four key components for analysis and improvement.
Start hereAnalysis of a PA system can begin with any of the four components, but the book argues for starting with the 'Rating Context' as it shapes all other aspects.
◆ The full 4-step framework — unlock with membership
Checklists
Effective Assessor Behaviors in Group Decision Making
- Draw conclusions from several pieces of connected data.
- Link observed data to relevant competencies.
- Interpret candidates’ behaviour from more than one cultural perspective.
- Discuss candidates strictly in terms of evidence observed during the assessment.
- Involve colleagues by asking for their information and perspectives.
- Listen actively to others' viewpoints, asking questions to clarify.
- Avoid imposing personal opinions or introducing hearsay.
Job Characteristic Checklist
◆ All 4 checkpoints — unlock with membership
Ethical Considerations in Competency Based Assessments
◆ All 10 checkpoints — unlock with membership
Managing the 'Peer' in Peer Appraisal Checklist
◆ All 6 checkpoints — unlock with membership
Good Performance Plan Checklist
◆ All 8 checkpoints — unlock with membership
Problems with Traditional Budgeting
◆ All 8 checkpoints — unlock with membership
Quiz: Our Annual Budgeting Exercise
◆ All 9 checkpoints — unlock with membership
Housekeeping Quality Audit
◆ All 7 checkpoints — unlock with membership
Little League Football Play Execution (Option Play)
◆ All 5 checkpoints — unlock with membership
Preparation Checklist for an Individual's Performance Review
◆ All 9 checkpoints — unlock with membership
Adverse Impact Reduction Strategy Check
◆ All 6 checkpoints — unlock with membership
Positive Applicant Reaction Checklist
◆ All 4 checkpoints — unlock with membership
Seven Criteria for Good Scenarios
◆ All 7 checkpoints — unlock with membership
Ten Aspects of a Successful Strategic Performance Improvement Meeting
◆ All 10 checkpoints — unlock with membership
Structured Interview Development and Administration Checklist
◆ All 10 checkpoints — unlock with membership
Job Profile Components Checklist
◆ All 8 checkpoints — unlock with membership
Interview Evidence Note-Taking Checklist
◆ All 6 checkpoints — unlock with membership
Checklist for Legally Defensible Appraisals
◆ All 8 checkpoints — unlock with membership
How to Select an A Player
◆ All 6 checkpoints — unlock with membership
Red Flags to Watch for in the Hiring Process
◆ All 8 checkpoints — unlock with membership
Case studies — including what didn't work
Playing Favourites: When the Interview Rewards the Wrong Instincts
An HR professional faces pressure to rubber-stamp a departmental head's biased promotion choice, exposing how little a traditional interview actually reveals.
This case shows how the conventional interview leaves selection vulnerable to office politics and undocumented reputation. It matters because the tool meant to identify the best team leader instead becomes a vehicle for personal preference.
The story, in brief
Abstract
During internal promotion interviews for a team leader role, a departmental head pressed hard to appoint his preferred candidate despite a weak performance, while dismissing a strong candidate on a vague, undocumented reputation for being pushy. The HR professional, unwilling to rubber-stamp a decision she found unjustified, recognised the manager's motivation as rooted in friendship and a desire to avoid challenge. The episode illustrates how the traditional interview fails to deliver objective, defensible selection.
Situation
At the close of a series of internal promotion interviews for a team leader role, two candidates presented starkly. The departmental head's favoured candidate seemed very nervous, communicated poorly, was unclear about what strengths she could bring to the role and preferred to dwell on her years of experience in the department. On a hypothetical about handling an under-performing staff member she came across as overly aggressive. A second candidate, by contrast, performed extremely well: articulate, giving appropriate answers to the same under-performance issue and well prepared about the challenges and opportunities of the move to team leader.
The decision
The HR professional was not persuaded by the manager's preference and pushed back. When challenged, the manager conceded he had only agreed to shortlist the strong candidate to avoid the conflict her early rejection would generate. His objection was that she had a reputation for being 'pushy and aggressive in the workplace' — yet her performance appraisals were fine, with no documented feedback about aggression. The HR professional weighed this against her own read that the manager's motivation was based more on personal friendship, and a wish to appoint someone who would not challenge his approach or decisions.
What happened
The manager remained adamant. The evidence in the room pointed one way — a strong, prepared interviewee versus a nervous, unclear one — while the manager's stated grounds rested on an undocumented reputation that his own appraisal records contradicted. The HR professional found herself pressured toward endorsing an appointment she believed was unjustified, caught between the observed interview performance and the political weight of the departmental head's preference.
Outcome
The case is presented deliberately as an unresolved dilemma rather than a tidy result. The HR professional does not want to be 'sucked in to rubber-stamping' the appointment. No figures attach to this episode; its value lies in exposing the failure mode. Research context underscores the stakes: 48 per cent of respondents to the CIPD's 2006 Recruitment, Retention and Turnover Survey reported using assessment centres 'to some degree', part of a steady rise over 30 years toward tools with stronger validity than the interview.
The lesson
The traditional interview observes only a narrow range of behaviour in an artificial situation, where candidates can adapt their manner — a determined person may play quiet, a forceful person may over-present. That thinness leaves selection open to office politics, personal friendship and reputations that live nowhere in the record. Decisions grounded in observable, work-relevant behaviour are far harder to bend to preference.
How to apply it
- Insist that any negative judgement about a candidate — such as 'pushy' or 'aggressive' — be backed by documented evidence like performance appraisals, not undocumented reputation.
- Separate observed interview behaviour from inferences about a candidate's fixed 'internal state' (personality, attitudes), which are poor and imprecise predictors of on-the-job behaviour.
- Name the political dynamics openly: probe whether a decision-maker's preference reflects job fit or a wish to appoint someone who will not challenge them.
- Supplement the interview with higher-validity tools — competence-based interviews, work samples, ability tests — so a single artificial observation does not carry the whole decision.
- Treat a manager's admission that a candidate was shortlisted only to avoid conflict as a signal the process, not the candidate, needs scrutiny.
The Politics of the Madhouse: When a Promotion Exam Fails the Face Validity Test
A Chief Constable's public denunciation of a role-play promotion exam became a textbook illustration of what happens when candidates don't believe a test measures what it claims to.
The promotion process required officers to demonstrate leadership and problem solving through role plays. Officers the Chief Constable considered ready to promote were failing the exam, or refusing to sit it at all, meaning capable people were blocked from advancement.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
The Privatized Utility's New Sales Force
A newly privatized, formerly monopolistic utility company attempted to create a sales force by reassigning existing engineering staff.
◆ What happened, and the outcome — unlock with membership
The Acme Engineering and Plastics Company
A manager in a traditional manufacturing firm is tasked with recruiting a new administration manager and reflects on past hiring failures.
◆ What happened, and the outcome — unlock with membership
Assessment of Merged Management Team
Following a merger between a complacent, reputable firm and an innovative but less commercially-focused one, the combined management team of a division was assessed.
◆ What happened, and the outcome — unlock with membership
Spacemen and Barmen Selection
The author reflects on the economic significance of selection at opposite ends of the job spectrum.
◆ What happened, and the outcome — unlock with membership
Historical Origins of Assessment Centers
The book traces the history of assessment centers to provide context and credibility for the method.
◆ What happened, and the outcome — unlock with membership
Deloitte's Performance Management Reinvention
Deloitte found its traditional performance management system was not driving employee engagement or high performance.
◆ What happened, and the outcome — unlock with membership
Netflix's Feedback Culture
Netflix sought a more effective and agile way to manage performance than traditional formal evaluations.
◆ What happened, and the outcome — unlock with membership
The Struggling Budget Submitter (Philippe)
A manager (Allie) has an employee (Philippe) who consistently submits late, incomplete, and incorrect budgets despite previous feedback.
◆ What happened, and the outcome — unlock with membership
The Ineffective Presenter (Deepa)
An employee (Deepa) delivers a rocky new-employee orientation presentation.
◆ What happened, and the outcome — unlock with membership
The Ambitious but Misaligned Sales Rep (Cory)
A sales manager, Natasha, learns her new rep, Cory, is only in the job to gain skills for his real goal of a career in market research.
◆ What happened, and the outcome — unlock with membership
Deloitte's Reinvention of Performance Management
Deloitte, a global professional services firm, found its traditional annual review process consumed nearly 2 million hours a year and produced biased, backward-looking data.
◆ What happened, and the outcome — unlock with membership
Wells Fargo's Cross-Selling Metric Failure
Wells Fargo had a corporate strategy of building long-term customer relationships, which it decided to measure using a cross-selling metric (e.g., 'Eight is great').
◆ What happened, and the outcome — unlock with membership
The 'Set-Up-to-Fail Syndrome' of Steve and Jeff
A new manager, Jeff, worried about a subordinate, Steve, who submitted subpar reports. Jeff's real goal was to generate data and help Steve learn.
◆ What happened, and the outcome — unlock with membership
Telstra Splits the Manager Role
As part of an agile transformation, Australian telecom company Telstra flattened its hierarchy and recognized the traditional manager role had become impossibly broad.
◆ What happened, and the outcome — unlock with membership
The Man Who Was Never Tested: Michael Brown and the Cost of Hiring Without Assessment
A political appointment made on personal relationships rather than rigorous evaluation collapsed under the weight of Hurricane Katrina, costing lives, a career, and a reputation.
Brown was hired largely on the strength of personal relationships with the administration, with little prior experience in disaster management and no rigorous assessment of whether he had the skills to lead a large disaster relief organization. The gap became visible only after the storm struck.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
Gut Feel and 100 Resumes: How Ian Swanson's Unstructured Hire Fell Apart
A newly promoted project manager tried to hire a technically skilled assistant on intuition alone, and paid for it three months later.
Ian ran an unstructured hiring process: he posted the job with no screening assessment, drowned in a flood of unqualified resumes, and had no systematic way to identify who could actually do the technical work. The cost was a failed hire, wasted training, and lost project momentum.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
Born to Train: How Assessment Screening Found the Right Trainer 1,000 Miles Away
A Denver training director used a structured job analysis and online assessments to identify a candidate whose lack of experience masked a natural aptitude for the role.
The role demanded a rare combination: knowledge of employee records management, strong technical savvy, excellent presentation skills, and willingness to travel extensively. By October 10, over fifty people had applied and none had the unique requirements Maggie was seeking — a hard-to-fill role where a wrong hire wastes weeks, as a parallel case in the source (Ian's failed administrative-assistant hire, who quit within three months) demonstrates.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
The Test That Works but Nobody Trusts: The Case of the Raven
An abstract reasoning test that looks nothing like the job predicts performance better than most assessments that do.
The Raven's questions—inferring the patterns underlying a series of geometric shapes—bear little in common with the actual information or problems found in most jobs. This gives it very low face validity: to hiring managers, employees, and candidates it simply doesn't look relevant. That perception carries real costs: reluctance to use it, adverse candidate reactions, and elevated risk of legal challenge, since face validity rests on informal, subjective judgments by subject-matter experts.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
Performance Plan for a Process Development Engineer
An example demonstrating how the book's methodology can be applied to a complex, white-collar technical role where performance is not easily quantified.
◆ What happened, and the outcome — unlock with membership
Performance Plan for an Administrative Secretary
An example for a support role, demonstrating how to measure contributions that are often seen as qualitative or task-based.
◆ What happened, and the outcome — unlock with membership
Analysis of Seven Clerical Jobs for Qualification Requirements
A study conducted within the Bell System to determine the job qualifications (skills and abilities) for seven different clerical roles, including service order clerk and computer operator.
◆ What happened, and the outcome — unlock with membership
Comparison of Business vs. Residence Service Center Manager Jobs
An analysis comparing manager jobs in two different types of service centers—Business (BSC) and Residence (RSC)—which perform similar functions for different customer segments.
◆ What happened, and the outcome — unlock with membership
National and Provincial Building Society's Strategic Shift
A UK building society facing increased competition due to deregulation in the late 1980s and 1990s.
◆ What happened, and the outcome — unlock with membership
ICL's Integrated Assessment Strategy
A major UK electronics and communications company in the 1980s seeking to strategically manage its human resources.
◆ What happened, and the outcome — unlock with membership
Caledonian Paper's Greenfield Site Selection
A new, integrated paper mill established in Scotland in 1987 by a Finnish parent company.
◆ What happened, and the outcome — unlock with membership
British Army Officer Selection
The selection process for officers in the British Army, which uses a seemingly scientific and objective assessment board.
◆ What happened, and the outcome — unlock with membership
BP's Cross-Cultural Competency Model
Global oil company BP undergoing major changes in the late 1980s, including internationalization and a push for a more entrepreneurial culture.
◆ What happened, and the outcome — unlock with membership
Road Maintenance Department Profitability
A government road maintenance department seeking to understand its cost structure.
◆ What happened, and the outcome — unlock with membership
Distillery's Scotch vs. Vodka Profitability
A distillery wanted to understand the true relative profitability of its scotch versus its vodka, suspecting its accounting system was misleading.
◆ What happened, and the outcome — unlock with membership
Railroad's ABM Model Consolidation
A large railroad organization needed to analyze both operational efficiency within departments and overall strategic profitability of its routes.
◆ What happened, and the outcome — unlock with membership
Wal-Mart's Sustainability Initiative
A large retail corporation looking to align with the 'going green' movement and improve both environmental and financial performance.
◆ What happened, and the outcome — unlock with membership
Capital One's Use of Analytics
A credit card company competing in a highly analytical industry.
◆ What happened, and the outcome — unlock with membership
Crown Castle's Balanced Scorecard Implementation
An organization implementing a Balanced Scorecard and linking it to employee compensation.
◆ What happened, and the outcome — unlock with membership
Blue Cross and Blue Shield of Alabama
A large health insurance company seeking long-term, sustainable high performance and morale across the entire organization.
◆ What happened, and the outcome — unlock with membership
The George Odiorne Story
A company president was frustrated with a new vice president who was 'not cutting it'.
◆ What happened, and the outcome — unlock with membership
Movie Theater Concession Sales
A movie theater company wanted to increase profits by having staff 'up-sell' customers to larger sizes of popcorn and drinks.
◆ What happened, and the outcome — unlock with membership
Komaki & Barnett's Little League Football Coaching
A youth football coach wanted to improve the execution of specific offensive plays.
◆ What happened, and the outcome — unlock with membership
Watergate Scandal
The Committee to Re-elect the President wanted to get information on the Democratic Party's strategy.
◆ What happened, and the outcome — unlock with membership
Halifax Bank of Scotland (HBOS) Retail
Implementation of a performance management system in a large retail banking environment.
◆ What happened, and the outcome — unlock with membership
Raytheon Inc.
A US-based defense and aerospace supplier implementing a company-wide 'Performance Development' process.
◆ What happened, and the outcome — unlock with membership
Standard Chartered Bank
A global banking business aiming to accelerate a high-performing organization.
◆ What happened, and the outcome — unlock with membership
Griggs v. Duke Power Company (1971)
A US power company implemented a high-school diploma requirement and aptitude test scores for hiring into non-labor jobs after the Civil Rights Act of 1964.
◆ What happened, and the outcome — unlock with membership
AT&T Management Progress Study (MPS)
A landmark longitudinal study begun in the 1950s using an Assessment Center (AC) to evaluate the potential of young managers at AT&T.
◆ What happened, and the outcome — unlock with membership
Bertrand and Mullainathan (2004) Resume Study
A field experiment investigating racial bias at the initial application screening stage in the US.
◆ What happened, and the outcome — unlock with membership
The Paddington Guards Case (UK)
A UK legal challenge in the 1990s where British Rail used cognitive tests for promoting guards to train drivers.
◆ What happened, and the outcome — unlock with membership
Negative Applicant Recruitment Experiences
Recruitment of university students by various large companies, as described in Sara Rynes's chapter.
◆ What happened, and the outcome — unlock with membership
The U.S. Employment Service's Use of the GATB
A nationwide public employment testing program in the US during the 1980s, aiming to improve referral quality using the General Aptitude Test Battery (GATB).
◆ What happened, and the outcome — unlock with membership
Texas Instruments' Anxiety Reduction Orientation Program
An orientation program for new hires at Texas Instruments in the 1960s, described in John Wanous's chapter.
◆ What happened, and the outcome — unlock with membership
German Military Officer Candidate Selection
A study by Wiebke Putz-Osterloh comparing traditional assessment center ratings with performance on a complex problem-solving simulation for German officer candidates.
◆ What happened, and the outcome — unlock with membership
State Police Radio Operator Test Development
A state police agency needed to develop a content-valid selection test for the job of radio operator.
◆ What happened, and the outcome — unlock with membership
Supermarket Checkout Personnel Performance
A study by Sackett, Zedeck, and Fogli (1988) examined the performance of supermarket checkout personnel.
◆ What happened, and the outcome — unlock with membership
Student Reactions to Recruiting Practices
Chapter 8 describes anecdotes from graduate students about their experiences with corporate selection and recruiting procedures.
◆ What happened, and the outcome — unlock with membership
The School Rating Question
A respondent is asked to rate their child's school as 'very good, good, fair, or poor' but finds it complicated because the school is good in some ways (recreation) and bad in others (academics).
◆ What happened, and the outcome — unlock with membership
Interviewer Race and Voting Reports
A study by Anderson et al. (1988) where black respondents were interviewed by either black or white interviewers about their voting behavior, with responses later validated against voting records.
◆ What happened, and the outcome — unlock with membership
Fujitsu Services Call Centre Transformation
In 1999, Fujitsu's IT helpdesk function was suffering from high staff turnover (42%), low customer satisfaction, and a focus on dysfunctional efficiency metrics (e.g., call duration).
◆ What happened, and the outcome — unlock with membership
DHL Greece's Value Creation Map
DHL Greece, a market leader, wanted to establish a more sophisticated performance management system to maintain its market share against new competitors.
◆ What happened, and the outcome — unlock with membership
Novo Nordisk's Knowledge Strategy
Novo Nordisk, a world leader in diabetes care, initiated a project to identify and prioritize strategic value drivers to increase future value creation.
◆ What happened, and the outcome — unlock with membership
Pharmaceutical Pre-Merger Assessment
Two seemingly identical pharmaceutical organizations, 'PharmaScience' and 'PharmaLab,' were considering a merger based on their similar resource structures and complementary products.
◆ What happened, and the outcome — unlock with membership
Validation of a Structured Interview for Entry-Level Production Employees
Hiring for entry-level labor-pool jobs in a large pulp and paper mill in the rural Southeast. 149 hires were included in the validation study.
◆ What happened, and the outcome — unlock with membership
The Tech Industry Over-hiring Frenzy (2018-2022)
During the pandemic, major tech companies engaged in massive hiring sprees, often without clearly defined roles or a true business need.
◆ What happened, and the outcome — unlock with membership
The 'Beer Test'
An interviewer rejected a candidate with the note, "I would definitely not have a beer with this candidate."
◆ What happened, and the outcome — unlock with membership
Uber's Flawed 'Achieve at Any Cost' Profile
In its early startup days, Uber built a precise and effective hiring process to find people who fit its aggressive, results-obsessed culture.
◆ What happened, and the outcome — unlock with membership
Amazon's Biased AI Recruiting Tool
Amazon developed an experimental AI tool to screen resumes, training it on ten years of the company's past hiring data.
◆ What happened, and the outcome — unlock with membership
The Underfunded Telecom Company
A telecom company with very low turnover needed to hire new employees but found they had to pay new hires more than long-tenured existing employees.
◆ What happened, and the outcome — unlock with membership
GE's 'Rank and Yank' System
The book discusses forced ranking systems as a historical approach to ensuring performance score distribution.
◆ What happened, and the outcome — unlock with membership
Susan the Underpaid Admin
A highly-valued administrative assistant, Susan, retired after ten years of service.
◆ What happened, and the outcome — unlock with membership
Robert Owen's Character Cubes
Early 1800s cotton mills in New Lanark, Scotland, managed by industrialist Robert Owen.
◆ What happened, and the outcome — unlock with membership
The Lead Balloon Rises
A private equity board fixed a stagnant portfolio company by fixing its CEO — then cascading his hiring discipline through every manager.
The company's value had been so flat over five years that some investors called it a 'lead balloon.' The prior CEO wasn't confident enough to surround himself with A Players, and without top talent the business had no way out of its stagnation.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
The Fired Banker Bank One Bet On
A distressed bank turned a disciplined sourcing process—and a candidate's blunt honesty—into one of the most celebrated CEO recruitments in recent history.
By the summer of 1999, Bank One's First USA credit card business warned of a serious earnings shortfall and rising loan losses, with trends forecast to worsen. First USA had been an important source of earnings, and no one had confidence in how bad things might get or who would take control. The board and senior management were not integrated, riven by disagreements over strategy, personnel, and compensation. When chairman and CEO John McCoy left, the bank was leaderless and eroding.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
The CEO Transplant That the Body Rejected
A founder hired a big-company CEO who could not decide, and nearly lost his company to cultural rejection.
Kennedy hired a CEO from a big company without appreciating how many aspects of the company's philosophy needed alignment. The chain's culture was fast-moving, aggressive, and decisive; the new CEO was not. Leadership team meetings ran four hours with no decisions made or communicated. Morale, energy, and financial performance fell far enough that key early leaders dreaded coming to work and were contemplating quitting.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
The CEO Who Couldn't Ski: Nate Thompson's 'Who' Problem
A thorough interviewer kept hiring the wrong people—until the cost of getting 'who' wrong forced a reckoning at Spectra Logic.
Thompson's hires kept failing. One sales VP embezzled over $90,000 by altering commission sheets—turning the accountant's 1's into 4's to inflate his pay fourfold. The constant crises made it impossible for Thompson to step away from the office. He estimates his early 'who' mistakes cost Spectra Logic as much as $100 million in value.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
America Cubed: How an Amateur Sailor Out-Hired the Field
An oil and gas magnate with little sailing pedigree won yachting's most prestigious prize by treating crew selection as a talent problem, not a sailing one.
Koch was not the most experienced sailor, and his team faced 100-to-1 odds in Vegas; at least two dozen newspapers predicted his America³ crew would be watching the other boats' wakes. Early on, he underinvested in selection — he hired a charming, glib hot shot from the America's Cup industry and put him in charge of the sailing team without working with him first, and the man then attempted a hostile takeover, trying to convince the directors to fire Koch.
◆ The full case — situation, decision, outcome, and the lesson — unlock with membership
Templates
Competency Proficiency Scale
To provide a standardized rubric for assessing an employee's proficiency level for a specific competency by matching observed behavior to descriptive indicators.
Example for 'Analytical Thinking':\n1. Breaks Down Problems: Breaks problems into simple lists.\n2. Sees Basic Relationships: Identifies a single cause-and-effect relationship.\n3. Sees Multiple Relationships: Makes multiple causal links or anticipates multiple steps.\n4. Makes Complex Plans or Analyses: Uses several analytical techniques to break complex problems into component parts.
Competence-to-Exercise Mapping Matrix (Table 2.2)
To aid in designing an assessment centre by linking specific competencies to the most appropriate exercises provided in the book.
◆ The fillable template — unlock with membership
Assessor Observation Form (based on Table 4.1)
A structured template for assessors to record behavioral evidence directly against specific competence indicators during an activity.
◆ The fillable template — unlock with membership
Sample Assessor Observation Grid (Table 4.5)
To organize and schedule which assessor observes which participant(s) during each group activity.
◆ The fillable template — unlock with membership
Who Sees Whom Matrix
To plan and track assessor assignments in an assessment center, ensuring each candidate is observed by multiple assessors across different exercises.
◆ The fillable template — unlock with membership
Participant Review Test
To assess a participant's understanding of core concepts after a competency mapping training program.
◆ The fillable template — unlock with membership
Training Program Feedback Form
To collect feedback from participants on the quality and effectiveness of a training program.
◆ The fillable template — unlock with membership
Goal-Setting Template
To document an employee's primary goals, measures of achievement, and the detailed plan for accomplishing them, ensuring clarity and alignment between manager and employee.
◆ The fillable template — unlock with membership
Individual Development Plan (IDP) Template
To outline an employee's long-term development goals and the specific tactics, tasks, resources, and timeline needed to achieve them.
◆ The fillable template — unlock with membership
Performance Evaluation Form Template
To formally document a manager's assessment of an employee's performance, including accomplishments, goal achievement, and ratings on key competencies, to be used in a formal review.
◆ The fillable template — unlock with membership
Deloitte's Performance Snapshot Questions
To capture a team leader's assessment of a team member's performance and potential by asking about their own future intentions, thereby reducing idiosyncratic rater bias.
◆ The fillable template — unlock with membership
Performance Plan Worksheet
To provide a standardized format for employees and managers to draft and finalize a complete performance plan.
◆ The fillable template — unlock with membership
Organizational Measures Worksheet
To document the relevant high-level goals that the individual's performance plan must align with.
◆ The fillable template — unlock with membership
Job Observation Recording Sheet
To systematically record information about a work activity while directly observing an employee on the job.
◆ The fillable template — unlock with membership
Guide for Selecting Task Attribute Questions
To assist a job analyst in choosing which questions (e.g., about significance, difficulty, time) to include in a WPSS questionnaire to meet the project's specific objectives.
◆ The fillable template — unlock with membership
Function Assignment Table
To systematically assign identified job functions to different job types (e.g., management, craft, clerical) as part of a job design or redesign effort.
◆ The fillable template — unlock with membership
Task-Oriented Rating (TOR) Form
To create a performance evaluation tool based on the specific, important tasks of a job, allowing for more objective and detailed feedback.
◆ The fillable template — unlock with membership
Customer Profitability Matrix
To classify customers into four types based on their profitability profile, enabling targeted strategies to migrate them toward higher profitability or manage them more cost-effectively.
◆ The fillable template — unlock with membership
Checklist for Evaluating a Pinpoint
To determine if a chosen pinpoint (behavior or result) is well-defined and useful for a PM intervention.
◆ The fillable template — unlock with membership
Performance Matrix Template
To create a single, weighted index to measure and track the total performance of a person or group across multiple accountabilities.
◆ The fillable template — unlock with membership
Troubleshooting Tool
To diagnose why a performance improvement initiative is not working as expected.
◆ The fillable template — unlock with membership
Performance and Development Agreement and Review Summary Form
To provide a simple, structured document for recording the key elements of a performance agreement and the outcomes of a performance review.
◆ The fillable template — unlock with membership
Performance Matrix (Visual Assessment Tool)
To provide a visual, non-mechanistic assessment of an individual's overall contribution by plotting them on a two-dimensional grid, facilitating a balanced discussion about performance.
◆ The fillable template — unlock with membership
KSA-Task Linkage Rating Scale
To be used by Subject Matter Experts (SMEs) during a job analysis to systematically and quantitatively link required knowledge, skills, and abilities (KSAs) to specific job tasks.
◆ The fillable template — unlock with membership
Assessment Method Evaluation Criteria
To provide a framework for making rational choices among available assessment methods by comparing them on four key criteria.
◆ The fillable template — unlock with membership
Structured Interview Question & Rating Scale
To provide a concrete example of a behavioral interview question with a standardized scale for rating candidate responses.
◆ The fillable template — unlock with membership
Interviewer Monitoring Form
To provide a standardized template for supervisors to evaluate interviewer performance during an interview, ensuring all key behaviors are assessed consistently.
◆ The fillable template — unlock with membership
Adverbial Equivalents Decision Tool
To help question designers replace ambiguous adverbial question formulations (how, when, why) with more specific alternatives that reduce interviewer discretion and error.
◆ The fillable template — unlock with membership
Performance Indicator Design Template
To provide a structured format for comprehensively defining a performance indicator, ensuring clarity and consistency.
◆ The fillable template — unlock with membership
Risk Log Template
To systematically document, assess, and manage risks identified in relation to the organization's strategy.
◆ The fillable template — unlock with membership
Software Selection Matrix
A decision tool to systematically evaluate and compare different software vendors based on a weighted set of organizational requirements.
◆ The fillable template — unlock with membership
Anchored Rating Scale for Interview Questions
To provide a standardized, objective scoring guide for evaluating and scoring candidate responses to specific interview questions.
◆ The fillable template — unlock with membership
Interview Guide Template
To provide interviewers with a consistent script and structure for conducting a fair and effective structured interview.
◆ The fillable template — unlock with membership
Decision Tree for Selecting From Multiple Qualified Candidates
To make a fair and defensible final hiring decision when there are more qualified candidates than available positions.
◆ The fillable template — unlock with membership
Basic Proficiency Evaluation Scale Template
To provide a simple yet specific evaluation criterion for interviewers to score a candidate's performance on a given KSA.
◆ The fillable template — unlock with membership
Employee Self-Evaluation Form
To gather employee input on their accomplishments, development needs, and future goals prior to the manager writing the formal performance review.
◆ The fillable template — unlock with membership
Model Performance Appraisal Template (Structure)
To provide a comprehensive, ready-to-use template for assessing employee performance that can be adapted by any organization.
◆ The fillable template — unlock with membership
Mixed Standard Scale (MSS) Example Template
To construct a rating scale that reduces halo and leniency biases by mixing behavioral items from different performance dimensions and quality levels.
◆ The fillable template — unlock with membership
Behaviorally Anchored Rating Scale (BARS) Example Template
To create an unambiguous rating scale by defining scale points with concrete examples of work behavior.
◆ The fillable template — unlock with membership
Job Scorecard
To replace a vague job description with a precise blueprint for success, ensuring alignment and providing objective criteria for evaluation.
◆ The fillable template — unlock with membership
Skill-Will Bull's-eye
A final decision tool to determine if a candidate is a true A Player for the role by systematically rating them against the scorecard.
◆ The fillable template — unlock with membership
Extracted per book (actionable_frameworks, clean_checklists, case_studies) and reconciled across the corpus. Free tier shows the exemplars; the full Playbook is a member depth layer.
Movement IV
Reflect
How good is it — the evidence, where the field disagrees, and how far to trust the advice.
How good is it — the evidence, where the field disagrees, and how far to trust the advice.
- — What the research substantiates (and doesn't)
- — 6 tensions the canon hasn't settled
Before you apply it
Using it well
Where the method fits, who it’s for, and the honest case for and against — so you apply it where it works.
When it applies — and when it doesn’t
- High-volume entry-level hiring with large candidate pools — modest validity delivers large ROI across many hires
- Defending selection decisions against legal challenge — validity evidence makes decisions more fair and defensible
- Filling a defined executive or key role with clear outcomes — Scorecard and Who Interview shine when the role's outcomes can be articulated
- Manager with strong personal and professional network to tap — Referral sourcing depends on having a network to work
- Persuading a top candidate and their family to accept an offer — The five F's framework is designed exactly for this closing stage
- Selecting off-the-shelf tools without job analysis first — even good assessments fail if not matched to defined outcomes
- Hiring one senior executive from a tiny candidate pool — low performance variance and small pool shrink assessment value
- Replacing all human judgment with automated scores — assessments predict indirectly and must be integrated, not blindly trusted
- Screening for jobs with little variation in performance — low job performance variance limits the payoff of assessment
- High-volume, low-skill or seasonal hiring — Four structured interviews are costly overhead for interchangeable roles
- Hiring for a role whose requirements are still undefined or rapidly shifting — Scorecard requires clarity on mission and outcomes you may not yet have
- Small startup with no HR function or recruiting support — Method still applies but you personally carry the process discipline
- Using graphology or unvalidated novelty tools — empirical research shows no relationship to job performance
- Building or engineering an assessment yourself from this book — it explicitly omits statistical construction methods
- Judging candidates on gut feel in short interviews — Book directly identifies 'Art Critic' voodoo hiring as unreliable
- Making an offer without a completed Who Interview and rated scorecard — The method treats these as gatekeeping requirements before any hire
Tensions — choices to make, not settled answers
Movement IV · Measure · The evidence
The evidence behind the advice
We don’t just assert — we show the research the ideas rest on: the study, its key finding, what it means for you, and the citation to chase it yourself. Then a curated path to go deeper. Grounded, not hand-waved.
The studies
The empirical backing, with findings and citations — trace any claim to its source.
The identification of specific, observable behaviors (competencies) that distinguish superior performers from average or poor performers in management and leadership roles.
Hay/McBer Research on Behaviors Supporting Effective Performance
That performance is a function of both results (what is achieved) and behaviors (how it is achieved), and these effective behaviors can be systematically identified, defined, scaled, and developed.
This research provides a structured, behavioral basis for performance management, leadership development, succession planning, and compensation systems.
This research is the direct foundation of the book's entire competency-based performance management approach.
The document states the dictionary is 'based on research conducted by Hay/McBer'.
The predictive validity of different employee selection methods.
Meta-Analyses of Predictor Validity (e.g., Schmidt & Hunter)
Work samples and ability tests have high predictive validity for job performance (correlation ≈ 0.5+), while unstructured interviews and most personality inventories have low validity (correlation < 0.3).
Organizations can significantly improve hiring quality by using high-validity predictors like work samples, which are the core of assessment centres.
This is the foundational evidence for the book's central claim that assessment centres are a scientifically superior method of selection.
Schmidt, F E and Hunter, J E (1977) ‘Development of a general solution to the problem of validity generalization’, Journal of Applied Psychology, 62, pp 529–40 (and subsequent work).
Competency-based assessment is a better predictor of job success than traditional academic aptitude and knowledge tests.
David McClelland's Research on Competencies and Job Performance
Traditional tests like academic aptitude and knowledge tests did not predict success in a job. Students who did poorly in university (as long as they passed) did just as well in life as top students. Superior performance is related to hidden traits and qualitative behaviors (competencies), not just test scores.
Organizations should focus on identifying, measuring, and developing specific competencies rather than relying solely on traditional selection measures like academic performance or aptitude tests.
This is the foundational scientific evidence that underpins the book's entire premise and methodology.
The book refers to David McClelland of Harvard and his company McBer, from the 1970s.
The ineffectiveness of traditional performance management systems from the perspective of executives.
Global Human Capital Trends 2014 (Deloitte Survey)
58% of executives surveyed felt their current performance management method neither drove employee engagement nor promoted high performance, as it focused too much on past results.
The findings provided a major impetus for companies like Deloitte to rethink and redesign their performance management processes to be more forward-looking.
This study provides quantitative evidence supporting the book's central premise that traditional performance management is broken and needs replacement.
Deloitte Consulting LLP and Bersin by Deloitte, “Global Human Capital Trends 2014: Engaging the 21st-Century Workforce,” Deloitte University Press, 2014.
The negative impact of workplace incivility on employee performance and motivation.
Research on Incivility and Performance (by Spreitzer and Porath)
Half of employees who experienced incivility intentionally decreased their efforts, and over a third deliberately decreased the quality of their work. A majority reported their performance had declined.
Managers must actively cultivate a culture of respect and stop incivility to maintain team motivation and performance.
Provides evidence for creating a respectful culture as a foundation for motivating employees, a key component of ongoing performance management.
Gretchen Spreitzer and Christine Porath, “Creating Sustainable Performance,” Harvard Business Review, January–February 2012 (product #R1201F).
The subjectivity and bias inherent in performance ratings.
Idiosyncratic Rater Effects Study
62% of the variance in performance ratings could be attributed to the individual rater's peculiarities of perception (idiosyncratic rater effects). Actual performance accounted for only 21% of the variance.
Traditional numerical performance ratings are highly unreliable measures of an individual's actual performance.
Provides core scientific evidence that the foundational tool of traditional performance management—the numerical rating—is fundamentally flawed and unreliable.
Michael Mount, Steven Scullen, and Maynard Goff, published in the Journal of Applied Psychology in 2000.
Identifying the key drivers of high team performance and engagement.
Gallup High-Performing Teams Study
The most powerful differentiating factor was strong agreement with the statement 'At work, I have the opportunity to do what I do best every day.' Business units where employees agreed with this were significantly more likely to have high customer satisfaction, low turnover, and high productivity.
Performance management should focus on identifying and leveraging employee strengths rather than solely correcting weaknesses.
Supports the shift towards individualized, development-focused performance management by highlighting the power of a strengths-based approach.
Gallup study from the late 1990s onward, results of which are referenced in the book.
Establishing the psychometric reliability of data collected via job inventory checklists.
Development of Worker Activity Checklists for Use in Occupational Analysis
Task occurrence information was found to be the most reliable, followed by time spent, task importance, and task difficulty. Shorter recall periods improved reliability for time and difficulty judgments.
The job inventory method can be considered a useful and reasonably reliable procedure for collecting a variety of job information, providing an empirical foundation for its use.
This study provides the essential empirical evidence for the reliability of the core data collection method that the entire WPSS approach is built upon.
McCormick, E. J., and Ammerman, H.L. WADD-TR-60-77. Lackland Air Force Base, Tex.: Personnel Laboratory, Wright Air Development Division, 1960.
The application of behavioral feedback and praise to improve complex skill execution in a team sport.
A behavioral approach to coaching football: improving play execution of the offensive backfield on a youth football team
Performance on each of the three plays improved by more than 10 times the baseline level. The percentage of perfectly executed plays rose from 2% (2 of 84) during baseline to 25% (22 of 89) during the intervention.
Complex skills in sports and other domains can be taught and improved rapidly and effectively using behavioral methods, specifically pinpointing and contingent feedback/praise.
This study is a core illustrative case for the book's thesis that pinpointing behavior and providing immediate, positive consequences (feedback and praise) are highly effective at improving performance.
Komaki, J., & Barnett, F. (1977). A behavioral approach to coaching football... Journal of Applied Behavior Analysis, 10, 657-664.
The study uses meta-analysis and validity generalization to create a definitive 'league table' of selection methods, establishing cognitive ability as the most powerful and generalizable predictor of performance.
"Validity and utility of alternative predictors of job performance" (Hunter & Hunter, 1984)
General Mental Ability (GMA) tests are the most valid single predictor for job performance (operational validity ≈ 0.51). Work samples are also highly valid (0.54). Traditional unstructured interviews (0.14) and education level (0.10) have very low validity.
Organizations should prioritize selection methods with high demonstrated validity, like GMA tests and structured interviews, over traditional but ineffective methods to maximize workforce productivity.
This study provides the core quantitative evidence for the book's central thesis: that using scientifically validated selection methods adds significant value to an organization.
Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.
Investigates the relationship between the Five Factor Model (FFM) of personality and various measures of job performance.
"The Big Five personality dimensions and job performance: a meta-analysis" (Barrick & Mount, 1991)
Conscientiousness was a consistently valid predictor across all job groups studied (corrected validity ≈ 0.22). Extraversion predicted performance in jobs with a strong social component, like sales and management. Agreeableness, Neuroticism, and Openness were not general predictors.
After decades of skepticism, this study re-established personality assessment as a valuable tool in personnel selection, particularly for the 'will-do' aspects of performance.
It provides strong evidence for the validity of a major non-cognitive selection method, supporting the book's argument for a multi-faceted, scientific approach to selection.
Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: a meta-analysis. Personnel Psychology, 44, 1–26.
Balancing productivity and fairness in large-scale employment testing.
Fairness in Employment Testing: The Case of the General Aptitude Test Battery
The GATB has modest but real predictive validity (avg. .30). Using unadjusted scores leads to severe adverse impact, disproportionately screening out qualified Black applicants. A 'performance fair' score adjustment is recommended to ensure that individuals who would perform equally well on the job have an equal chance of being referred.
The pursuit of maximum predictive utility for the organization can be fundamentally unfair to individuals from lower-scoring groups. A fair selection *system* must account for imperfect prediction and its differential impact on subgroups.
This study is a central case that crystallizes the book's core tension between the organizational perspective (maximizing predictive utility) and the individual/societal perspective (ensuring fairness and equal opportunity).
Hartigan, J. A., & Wigdor, A. K. (1989). Fairness in employment testing. National Academy Press.
User perceptions and acceptance of different interview formats.
Perceived Practicality of Unstructured, Patterned, and Situational Interviews
Managers and attorneys rated the situational interview as the most practical and legally defensible. However, inexperienced student applicants preferred the unstructured interview, believing it allowed them more control and opportunity to present themselves.
The most psychometrically sound selection methods (structured interviews) may not be the most preferred by all user groups, particularly applicants. This highlights a conflict between organizational goals (validity) and individual preferences (perceived control).
Directly compares organizational (manager) and individual (applicant) perspectives on a specific selection tool, revealing a key conflict of objectives that illustrates the book's central theme.
Presented within Chapter 4 by Latham & Finnegan.
The psychological impact of participation in a selection process on the individual.
Effects of Assessment Center Participation on Self-Esteem
Specific, relevant components of self-concept (e.g., mathematical, problem-solving) showed a curvilinear change: they decreased during the AC exercises and then increased back to baseline after receiving positive feedback. Participants rated simulation exercises and the interview most positively, while personality tests were seen as least transparent and least positive.
Selection procedures are not neutral experiences; they can have measurable, albeit subtle and temporary, effects on an individual's self-concept. The design of the process, especially the feedback component, is critical for a positive individual outcome.
Provides direct empirical evidence for the book's thesis that the individual perspective, including psychological reactions like changes in self-esteem, is a crucial but often overlooked aspect of assessment.
Presented within Chapter 8 by Schuler & Fruhner.
Large-scale validation of selection and classification measures and the development of a comprehensive model of soldier performance.
Project A (U.S. Army Selection and Classification Project)
Soldier performance is multidimensional, consisting of five core factors including Job-Specific Task Proficiency, General Soldiering Proficiency, Effort and Leadership, Personal Discipline, and Physical Fitness. General cognitive ability was the best predictor of task proficiency, while temperament/personality measures (like dependability) added significant incremental validity for predicting dimensions like effort and discipline.
Validation research should be guided by a theory of performance. Selection systems can be improved by using a broader set of predictors tailored to a multidimensional criterion space. The findings support the generalizability of some predictor-criterion relationships.
Serves as a primary, recurring example throughout the book of a modern, theory-driven, construct-oriented approach to personnel selection, supporting many of the book's central themes.
Campbell, J. P., & Zook, L. M. (Eds.). (1990). Improving the selection, classification, and utilization of army enlisted personnel: Final report on Project A.
The differential effects of varying levels of interviewer training and supervision on interviewer skills, orientation, and resulting data quality (bias and variance).
Authors' Large-Scale Experiment on Interviewer Training and Supervision
Minimal training (<1 day) is inadequate for teaching core skills like probing. Two to five days of training appears optimal. Intensive supervision (tape recording) significantly reduces interviewer variance (rho) and, for adequately trained interviewers, reduces bias.
Simply lecturing is insufficient; supervised practice is essential for training. Systematic monitoring of the interview process is a critical and cost-effective method for reducing interviewer-related error.
This is the primary empirical study that underpins the book's central arguments and conclusions about how to practically reduce interviewer-related error.
Fowler, F.J. & Mangione, T.W. 1986. Reducing Interviewer Effects on Health Survey Data.
The impact of the interview's context and the interviewer's standard-setting behaviors on the quality and completeness of respondent reporting.
Cannell et al. Experiments in Interviewing Techniques
All of these interventions led to more complete and accurate reporting of health events. For example, asking respondents for a commitment to be accurate significantly improved reporting quality with very few refusals.
How an interviewer establishes the context for the interview is as important as how they ask questions. Standardizing this context-setting is a powerful way to reduce error.
This work demonstrates that standardization must extend beyond the question-and-answer process to include how interviewers frame the task for respondents, providing a key set of actionable techniques.
Cannell, C. F., Oksenberg, L., and Converse, J. M. 1977b. Experiments in Interviewing Techniques.
The causal link between employee attitudes, customer behavior, and financial performance.
The Employee-Customer-Profit Chain at Sears
A 5-point increase in employee satisfaction led to a 1.3-point increase in customer satisfaction, which in turn led to a 0.5% increase in sales volume over a 9-month period.
Provides quantitative evidence for the business case of investing in employee satisfaction as a leading indicator of financial performance.
Serves as a prime example of how an organization can 'test value creation assumptions' (Chapter 7) by using performance data to validate the causal links in its business model.
Cited in the book as Rucci, A. J., Kirn, S. P. and Quinn, R. T. (1998). The Employee-Customer-Profit Chain at Sears. Harvard Business Review. The book does not provide a full academic citation.
A highly structured interview process can achieve psychometric properties (reliability, validity, fairness, utility) comparable to standard cognitive aptitude tests, thereby making it a much-improved selection device.
Structured Interviewing: Raising the Psychometric Properties of the Employment Interview
The structured interview showed high interrater reliability (r=.88), predictive validity (corrected r=.56), and utility. Its psychometric properties were comparable to a battery of cognitive tests, and correlations suggested the interview measures a strong cognitive component.
Structured interviews are a psychometrically sound and legally defensible selection tool that can be used in place of or alongside paper-and-pencil tests, with the added benefit of incorporating managerial involvement.
The entire article is a report of this single, central study, which serves to validate the proposed interview technique.
Campion, M. A., Pursell, E. D., & Brown, B. K. (1988). Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25-42.
The predictive validity of various employee selection methods.
The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings
Structured interviews have significantly higher predictive validity (0.63 cited in the book) for job performance compared to unstructured interviews (0.38). This makes structured interviews one of the most powerful and effective selection tools available.
Organizations should replace subjective, unstructured interviews with structured, evidence-based methods to improve hiring accuracy, fairness, and business outcomes.
This study is the foundational evidence for the entire book's argument, proving that the proposed methodology is not just theory but is backed by decades of scientific research.
Schmidt, F. L. and Hunter, J. E. (1998), Psychological Bulletin, 124(2), pp. 262–74.
Identifying the behavioral traits of CEOs that correlate with superior financial performance for investors.
Predicting CEO Success in Private Equity (inferred)
Two distinct CEO profiles emerged: 'Lambs' (strong soft skills: good listeners, open to feedback, respectful) and 'Cheetahs' (strong action-oriented skills: move fast, aggressive, persistent, high standards). Lambs were successful 57% of the time, while Cheetahs were successful 100% of the time.
Boards and investors should prioritize 'Cheetah' characteristics when creating scorecards and selecting CEOs for roles requiring significant value creation. Soft skills are valuable but insufficient without a strong propensity to get things done.
This study provides powerful empirical evidence for the book's core argument that focusing on specific, fact-based 'who' characteristics is the key to predicting performance. It offers a data-backed profile of an A Player CEO.
A study conducted by ghSMART in collaboration with Dr. Steven N. Kaplan and his team at the University of Chicago Graduate School of Business. Mentioned throughout the book.
Test it yourself
Field experiments this shelf implies — designed so you can put the claim to the test.
Hypothesis
Using scientifically validated selection methods leads to higher company productivity and success compared to using poor or random selection.
Create three identical companies. Company A selects staff using the best available techniques. Company B fills vacancies at random. Company C employs the people Company A identified as least suitable.
Company performance after one year, measured by productivity, profitability, and survival ('which companies are still in business').
Company A will be the most successful, Company C will be the least successful or will have failed, and Company B's performance will be in the middle.
Hypothesis
A newcomer orientation program based on the 'medical patient preparation' model (including information, modeling, stress inoculation, and rehearsal) will lead to higher job performance, higher job satisfaction, and lower turnover compared to a traditional information-provision orientation.
A field experiment with random assignment. A large cohort of new hires at an organization would be randomly assigned to one of two groups: (1) The experimental group receives a multi-component orientation focused on stress-coping skills. (2) The control group receives the organization's standard, information-focused orientation.
Primary outcomes: turnover rates and supervisory performance ratings at 6 and 12 months. Secondary outcomes: self-reported measures of role clarity, job satisfaction, and organizational commitment collected at 1, 3, and 6 months.
The experimental group will exhibit significantly lower turnover and receive higher performance ratings than the control group, with these effects being mediated by higher levels of role clarity and satisfaction in the initial months of employment.
Go deeper
A curated reading ladder — not a dump. Each with why it’s worth your time.
- Design, Implementation and Evaluation of Assessment and Development Centres; Best practice guidelines · British Psychological Society (BPS)
Cited by the author as an authoritative source for best practice, covering key issues like fairness, design, and evaluation that are central to the book's guidance.
- Assessment Centres (3rd edn) · C Woodruffe
Recommended for readers seeking a broader overview and history of the assessment centre method.
- The big five personality dimensions and job-performance; a meta-analysis · Barrick, M R and Mount, K M
Provides the empirical support for the book's caution against over-relying on personality tests in selection, a key topic in Chapter 5.
- A theory of the validity of predictors in selection · M Smith
Offers a theoretical framework for understanding why different selection tools have varying levels of effectiveness, underpinning the book's core argument.
- Competence at Work · Spencer, L M and Spencer, S M
A foundational text on the concept of competence, relevant to Chapter 2 on developing a competence framework.
- Development and Assessment Centres · Charles Woodruffe
Cited as a key text for readers wanting a more recent and in-depth exposition of assessment centre work, a core topic of the book.
- Performance Management: The new realities · Michael Armstrong and Angela Baron
The book uses Armstrong and Baron's definition of performance management as its foundation, making their work a primary source for understanding this core concept.
- The Competent Manager: A model for effective performance · R. F. Boyatzis
The author attributes the current usage and definition of 'competency' to Boyatzis, making this a foundational text for a central theme of the book.
- Appraisal and Feedback: Making performance review work · Clive Fletcher
Fletcher is cited as an authority on appraisals, a key one-to-one interaction within performance management, providing deeper insight into this specific practice.
- The Easy Guide to Repertory Grids · D. Jankowicz
The book presents the repertory grid as a powerful technique for developing interview models; this book is recommended as a highly accessible introduction to the method.
- The Achievement Motive · McClelland D.C., Atkinson J.W., Clark R.A., and Lowell E.L.
Provides foundational background on the motivational theories that underpin the concept of competencies, particularly achievement orientation.
- The Handbook of. Competency Mapping: Understanding, Designing and. Implementing Competency Models in Organizations · Seema Sanghi
Offers a comprehensive guide to the practical steps of designing and implementing competency models, aligning with the book's purpose.
- A Preparation Guide for the Assessment Center Method 2nd Edition · Tina Lewis Rowe
Provides in-depth information on Assessment Centers, one of the key evaluation tools discussed extensively in the manual.
- How to Be Good at Performance Appraisals · Dick Grote
This book is cited several times as a foundational text for the guide's approach to formal appraisals, making it relevant for managers who want a deeper dive into conducting effective reviews.
- The Performance Management Revolution · Peter Cappelli and Anna Tavis
This cited HBR article provides context and examples of how companies are shifting away from traditional appraisals, which is central to the book's thesis.
- Reinventing Performance Management · Marcus Buckingham and Ashley Goodall
This HBR article details the Deloitte case study, a cornerstone example in the book of how to innovate performance management, making it essential reading to understand this shift.
- Why Incentive Plans Cannot Work · Alfie Kohn
Cited in the chapter on motivation, this classic HBR article challenges the reliance on extrinsic rewards, relevant for managers seeking deeper insights into motivation.
- Job Sculpting: The Art of Retaining Your Best People · Timothy Butler and James Waldroop
This HBR article, cited in the development section, explains how to align employees' deep-seated interests with their roles to increase satisfaction and retention.
- Nine Lies About Work: A Freethinking Leader’s Guide to the Real World · Marcus Buckingham and Ashley Goodall
The authors of the 'Reinventing Performance Management' chapter expand on their critique of traditional HR practices and their data-driven alternatives in this book.
- The Set-Up-to-Fail Syndrome: Overcoming the Undertow of Expectations · Jean-François Manzoni and Jean-Louis Barsoux
This book provides a deeper exploration of the psychological dynamics described in their chapter on how managers can unintentionally sabotage employee performance.
- Getting Unstuck: A Guide to Discovering Your Next Career Path · Timothy Butler
Co-author of the 'Job Sculpting' chapter, Butler's book likely provides more detailed guidance for individuals and managers on identifying 'deeply embedded life interests' and aligning careers with them.
- Knowledge for Action: A Guide to Overcoming Barriers to Organizational Change · Chris Argyris
Cited in the 'Set-Up-to-Fail Syndrome' chapter as foundational work explaining why people avoid threatening conversations, which is a key barrier to resolving performance issues.
- Works on human resource metrics, utility analysis, and human capital · Jac Fitz-Enz, Wayne Cascio, and John Boudreau
Provides more in-depth discussions on calculating the financial value and return on investment (ROI) of human resource strategies, including staffing assessments.
- Psychometric Theory / Essentials of psychological testing · J.C. Nunnally and L.J. Cronbach
These are cited as 'classic' texts for readers who want a more detailed, technical understanding of psychometrics, the science of measuring psychological characteristics.
- Society for Industrial and Organizational Psychology (www.siop.org) · N/A
An online resource for finding additional scientific and professional information about the design and use of staffing assessments.
- Society for Human Resource Management (www.shrm.org) · N/A
A professional association offering resources for HR practitioners on a wide range of topics, including employee selection and assessment.
- Electronic Recruiting Exchange (www.ere.net) · N/A
An online source of articles and discussions on practical applications and trends in recruiting and staffing, including the use of assessments.
- The Instructor, The Man, and The Job (1919) · C. R. Allen
Cited in the book as an important historical precursor to the modern job inventory approach, as it advocated creating lists (inventories) of trade activities for the purpose of developing training courses during World War I.
- Job and Task Analysis (Chapter in Handbook of Industrial and Organizational Psychology) · E. J. McCormick
Referenced as a canonical source for definitions of key job analysis terms like task, function, and job, and for general principles of the field.
- Dictionary of Occupational Titles (DOT) · U.S. Department of Labor
Used as a point of contrast to highlight the value of the WPSS approach. The DOT provides broad, generic job descriptions, whereas WPSS is designed to produce highly detailed, specific, and quantitative descriptions of a particular job in a particular organization.
- Work Psychology and Organisational Behaviour · W. Hollway
Represents the critical 'discourse perspective,' analyzing how psychometric assessment acts as a form of power and knowledge to construct and regulate employees.
- Designing Strategic Human Resource Systems · R. E. Miles and C. C. Snow
Provides the influential strategic typology (Prospector, Defender, etc.) that the book uses to frame the entire strategic management perspective on assessment.
- Selection as a Social Process · P. Herriot
Articulates the core tenets of the 'social process' model, which views selection as an interaction and negotiation between parties rather than a simple predictive measurement.
- Competitive Strategy · M. E. Porter
The book uses Porter's generic strategies (cost leadership, differentiation, focus) as a primary framework for linking HRM and assessment practices to business objectives.
- Activity-Based Cost Management: An Executive's Guide · Gary Cokins
The author's previous book, which provides a deeper dive into the Activity-Based Management (ABM) methodology that is a foundational pillar of the Performance Management system described in this book.
- The Balanced Scorecard: Translating Strategy into Action · Robert S. Kaplan and David P. Norton
The foundational text for the strategy map and balanced scorecard methodology, which this book identifies as a core component of its integrated Performance Management framework.
- The Strategy-Focused Organization · Robert S. Kaplan and David P. Norton
A follow-up book by the creators of the Balanced Scorecard that focuses on making strategy a continuous process and is central to this book's theme of executing strategy.
- Relevance Lost: The Rise and Fall of Management Accounting · H. Thomas Johnson and Robert S. Kaplan
A seminal work that critiqued traditional management accounting and introduced the concepts that led to Activity-Based Management (ABM), a key topic in this book.
- Economic Value Management · Eleanor Bloxham
Cited as a groundbreaking book for understanding how to measure and manage the creation of shareholder wealth, which this book links to operational performance via ABM and scorecards.
- The Five Dysfunctions of a Team · Patrick Lencioni
The author cites this book to emphasize that organizational health (trust, commitment, accountability) is as important as being 'smart' (analytics, strategy), and that team dysfunction is a major barrier to implementing performance management.
- Competitive Strategy: Techniques for Analyzing Industries and Competitors · Michael E. Porter
Cited as the seminal work that established formal strategic planning. The book's performance management framework is presented as the primary means of executing the kinds of strategies Porter advocates.
- Return on Customer: Creating Maximum Value from Your Scarcest Resource · Don Peppers and Martha Rogers
This book supports the thesis that value creation comes from customers. It aligns with this book's focus on customer lifetime value (CLV) and managing customer relationships as financial assets.
- The Fifth Discipline: The Art and Practice of the Learning Organization · Peter Senge
The author references Senge's idea that the rate of organizational learning is the key differentiator for success, which aligns with the book's advocacy for rapid prototyping and using PM for continuous learning.
- Oops! 13 Management Practices that Waste Time and Money (and What to Do Instead) · Aubrey C. Daniels
Written by the book's primary author, it details common management failures from a behavioral perspective, complementing this book's focus on successful practices.
- Bringing Out the Best in People · Aubrey C. Daniels
Another foundational text by the author that explores the power of positive reinforcement in more detail, serving as a companion to this book.
- The Checklist Manifesto: How to Get Things Right · Atul Gawande
The book recommends this text, as its advocacy for using simple checklists to reduce errors in complex fields like medicine and aviation aligns with PM's use of behavior checklists as a measurement and antecedent tool.
- 1001 Ways to Reward Employees · Bob Nelson
Cited as a good source for ideas for creating themes and finding reinforcers for performance improvement plans.
- Human Competence: Engineering Worthy Performance · Thomas F. Gilbert
The book frequently cites Gilbert's work, particularly his focus on 'Worthy Accomplishment' and the ACORN test, making his book a key theoretical underpinning for the results-focused aspect of PM.
- Leadership from an Operant Perspective · Judi Komaki
The book links to this resource via QR code and cites Komaki's research extensively, suggesting it as a deeper dive into the behavioral analysis of leadership.
- The Practice of Management · Peter Drucker
Cited as a foundational text, likely for its early articulation of management by objectives (MBO), a precursor to modern performance management's focus on goal setting.
- 360-Degree Feedback · Peter Ward
The book dedicates a chapter to 360-degree feedback, and this source is cited as a key reference, providing deeper insight into its definition and application.
- Understanding the People and Performance Link: Unlocking the black box · J. Purcell et al.
Cited for its research on 'discretionary behavior' and the pivotal role of front-line managers, which supports the book's emphasis on motivation and manager capability.
- Appraisal: Routes to improved performance · C. Fletcher
Referenced for its insights into the concept of alignment in performance management, supporting the book's core argument that the process should create a shared vision.
- Experiencing Recruitment and Selection · Billsberry, J.
The book highlights this work as a rare and urgent necessity, as it presents 52 first-hand accounts of selection from the applicant's perspective, revealing unprofessional behavior and bias that are missed by surveys of HR managers.
- Methods of Meta-Analysis: Correcting Error and Bias in Research Findings · Hunter, J. E., & Schmidt, F. L.
This is identified as the key technical reference for understanding the details of meta-analysis and Validity Generalization Analysis (VGA), which is the methodological foundation for many of the book's core arguments about test validity.
- Fairness in Employment Testing · Hartigan, J. A., & Wigdor, A. K.
This work is presented as a major and influential critique of early validity generalization studies, offering a more conservative re-analysis of key data and highlighting the complex trade-offs between validity and fairness.
- Assessment Centers in Human Resource Management · Thornton, G. C., & Rupp, D. E.
Cited as a key reference that provides a detailed, comprehensive account of modern assessment center practices and theory.
- Behavior in organizations · Porter, L. W., Lawler, E. E., & Hackman, J. R. (1975)
The book's foundational 'attraction-selection framework,' which models the dual perspectives of the organization and the individual, is drawn from this classic text.
- Organizational entry: Recruitment, selection, and socialization of newcomers · Wanous, J. P. (1980)
Cited throughout the book as a key source on the individual's experience of joining an organization, particularly for its seminal work on Realistic Job Previews (RJPs) and socialization.
- The employment interview: A summary and review of recent research · Arvey, R. D., & Campion, J. E. (1982)
Referenced as a foundational review of research on the interview, a selection method whose user perceptions are a key topic in several chapters.
- Performance rating · Landy, F. J., & Farr, J. L. (1980)
Identified in the book as a 'watershed' article that shifted performance appraisal research from a purely psychometric focus to a more cognitive, process-oriented one, aligning with the book's theme of looking beyond pure technical criteria.
- Fairness in selecting employees · Arvey, R. D., & Faley, R. H. (1988)
Cited as a key resource on the topic of fairness, a central theme discussed from both American and European legal and social perspectives in the book.
- Career Development in Organizations · Douglas T. Hall (Ed.)
Mentioned in the Foreword as part of the same 'Frontiers of Industrial and Organizational Psychology' series, this book would provide context on what happens to employees after they are selected.
- Productivity in Organizations · John P. Campbell & Richard J. Campbell (Eds.)
Part of the same 'Frontiers' series, this work directly addresses the ultimate goal of many selection systems—improving productivity—and would complement the utility analysis chapter.
- Training and Development in Organizations · Irwin L. Goldstein (Ed.)
Also in the 'Frontiers' series, this book covers the primary alternative to selection for creating a capable workforce, offering a parallel perspective on developing human capital.
- Organizational Climate and Culture · Benjamin Schneider (Ed.)
A volume in the 'Frontiers' series that explores the organizational context, which several chapters in this book argue is a critical and often overlooked factor in selection system effectiveness and performance.
- Work, Families, and Organizations · Sheldon Zedeck (Ed.)
Part of the same series, this book delves into the changing nature of the workforce and the work-life interface, a key theme in the chapter on future trends in personnel selection.
- Staffing organizations, 5E · Heneman, H.G., III, & Judge, T.A.
Provides a comprehensive, user-friendly book on all aspects of the staffing process, including models, legal compliance, recruitment, selection, and retention.
- Principles for the validation and use of personnel selection procedures: Fourth edition · Society for Industrial and Organizational Psychology (SIOP)
Outlines the official principles and policies from the primary professional organization (SIOP) on good practices for choosing, developing, evaluating, and validating selection procedures.
- The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings · Schmidt, F. L., & Hunter, J. E.
Summarizes 85 years of research, presenting the predictive validity of 19 different selection procedures and their combinations, providing a strong empirical basis for making decisions.
- A review of structure in the selection interview · Campion, M. A., Palmer, D. K., & Campion, J. E.
Identifies and evaluates 15 components that can add structure to a selection interview, enhancing its reliability and validity.
- Interviewing in Social Research · Hyman, H. A., Feldman, J., and Stember, C.
This is the landmark 1954 book that first systematically documented the various ways interviewers can influence survey data. The current book frequently refers to it as the foundation upon which later research, including its own, is built.
- Questions and Answers in Attitude Surveys · Schuman, H. and Presser, S.
Cited throughout the book for its rigorous experimental research on the effects of small changes in question wording, format, and context, providing evidence for why reading questions exactly as written is critical.
- The Body of Work by Charles F. Cannell and Associates · Charles F. Cannell et al.
The book heavily relies on and extends the decades of research by Cannell's team on the dynamics of the interview interaction, particularly on respondent motivation, standard-setting, and experimental techniques to improve reporting accuracy.
- Perspectives on Intellectual Capital: Multidisciplinary Insights into Management, Measurement and Reporting · Bernard Marr (ed.)
The author explicitly recommends this as a companion book for readers who want a deeper, multidisciplinary dive into the management and measurement of intangible assets, a core theme of the main book.
- Contemporary Strategy Analysis · Robert Grant
The book cites Grant's work to explain the resource-based view of strategy, which is a cornerstone of the author's internal analysis and the Value Creation Map. This book provides a deeper theoretical underpinning.
- The Performance Prism: The Scorecard for Measuring and Managing Business Success · Andy Neely, Chris Adams, and Mike Kennerley
Mentioned as another advanced performance management framework, this book offers a complementary, stakeholder-centric perspective that expands on some of the critiques of traditional models.
- On Organizational Learning · Chris Argyris
The author's concept of an 'enabled learning environment' and the distinction between single- and double-loop learning are drawn directly from Argyris's seminal work on organizational learning.
- The situational interview (Latham, Saari, Pursell, & Campion, 1980) · Latham, Saari, Pursell, & Campion
Cited as a key precursor and research theme for the current study, establishing the validity of using hypothetical job situations in a structured format.
- The validity and utility of alternative predictors of job performance (Hunter & Hunter, 1984) · J. Hunter & R. Hunter
This meta-analysis provides the baseline validity data for traditional interviews (.14) and cognitive ability tests (.53) against which this study's structured interview (.56) is compared, demonstrating its dramatic improvement.
- Uniform Guidelines on Employee Selection Procedures (1978) · EEOC, Civil Service Commission, Dept. of Labor, Dept. of Justice
This legal document is cited throughout the article as the standard to which the structured interview process was designed to conform, emphasizing the importance of job-relatedness and fairness.
- The critical incident technique (Flanagan, 1954) · J.C. Flanagan
This is the foundational job analysis technique mentioned for developing both situational interview questions and the performance appraisal instrument (BOS) used in the study.
- Moneyball: The Art of Winning an Unfair Game · Michael Lewis
Used as a key analogy to illustrate how a data-driven, objective process can uncover non-obvious predictors of success and create a competitive advantage, similar to how structured hiring identifies undervalued talent.
- Super Pumped: The Battle for Uber · Mike Isaac
Cited as a case study on the dangers of a precisely executed but fundamentally flawed hiring profile, demonstrating that 'what' you assess is as important as 'how' you assess it.
- Thinking, Fast and Slow · Daniel Kahneman
Referenced to explain the underlying cognitive biases that make unstructured, 'gut-feel' interviews unreliable and why a deliberate, structured process is necessary to counter these natural human tendencies.
- Hiring for Attitude · Mark Murphy
Cited for its finding that 81% of new hire failures are due to non-technical skills (interpersonal, coachability, etc.), which reinforces the book's emphasis on assessing behavioral skills.
- The Talent Delusion · Tomas Chamorro-Premuzic
Referenced to support the argument about the high costs of bad hiring decisions, advocating for data-driven methods over intuition to unlock human potential.
- Built to Last: Successful Habits of Visionary Companies · James Collins and Jerry Porras
Referenced for the concept of 'Big, Hairy, Audacious Goals' (BHAGs) to distinguish them from the book's focus on more immediate, one-year strategic initiatives.
- The ROI of Human Capital · Jac Fitz-enz
Cited as a source for specific metrics that can be used to quantify the return on investment from human capital initiatives, tying HR efforts to financial results.
- The HR Scorecard: Linking People, Strategy, and Performance · Brian Becker and Dave Ulrich
Mentioned as a key text for linking people management strategies to overall business performance, supporting the book's thesis of using appraisals strategically.
- 2600 Phrases for Effective Performance Reviews and 2600 Phrases for Setting Effective Performance Goals · Paul Falcone (co-author of this book)
Recommended as companion resources for managers looking for specific language and phrases to use when writing reviews and setting goals within the book's framework.
- "Performance rating" (Psychological Bulletin, 1980) · Landy, F. J., & Farr, J. L.
This seminal literature review is cited by the authors as a catalyst for the field's shift from focusing on rating scale formats to examining the cognitive processes of the rater, a shift this book builds upon.
- "Performance appraisal: A process focus" (Research in Organizational Behavior, 1983) · Ilgen, D. R., & Feldman, J. M.
This paper presented a foundational cognitive model of performance appraisal that heavily influences the book's discussion of the 'Performance Judgment' component, particularly regarding schemas, categorization, and memory.
- "The politics of employee appraisal" (Academy of Management Executive, 1987) · Longenecker, C. O., Sims, H. P., & Gioia, D. A.
This study, based on interviews with executives, provides empirical grounding for the book's argument that political considerations and goal-directed manipulation are central to understanding how appraisal functions in real organizations.
- Good to Great · Jim Collins
The book's opening epigraph is from Collins, establishing the foundational idea that 'who' decisions (getting the right people on the bus) are more important than 'what' decisions (strategy).
- Topgrading · Brad Smart
Credited as the intellectual origin of the chronological 'Who Interview.' The author's father pioneered this interview style, which forms the core of the A Method's 'Select' step.
- What Got You Here Won’t Get You There · Marshall Goldsmith
Goldsmith is interviewed and his work on behavioral derailers is cited as a key resource for identifying red flags and warning signs during the interview process.
Extracted per book (scientific_studies, further_research_and_reading) and reconciled across the corpus. When a book carries field experiments, they render here too.
Movement V
Measure
The instruments that already exist, a way to assess yourself, and what we'd measure next.
A way to assess yourself, the instruments the field gives you, and what we'd measure next.
- — Your feedback loop: rate → find your weakest lever → act
- — Measures the books give you
Learning curriculum
After mastering this field, you can…
The field's learning objectives, reconciled across the books, classified by Bloom's taxonomy and ordered so each builds on the ones before it.
- UnderstandingAfter mastering this field you can design a recruiting funnel and multi-hur
- explainAfter mastering this field you can explain the foundational premise that observable, controllable behavior predicts job performance more reliably than inferred internal states, and trace the causal chain by which measured attributes drive job-relevant behaviors and outcomes.Check: Given a selection or performance scenario, write an explanation of why behavior is a stronger predictor than values/motives/personality and diagram the attribute-behavior-outcome causal chain.
- explainAfter mastering this field you can define a competency as an underlying characteristic causally related to effective performance, explain McClelland's iceberg model and its layers, and distinguish competency from competence and learning objectives.Check: Write a definition of competency, diagram the iceberg model with its six layers, and correctly classify sample constructs as above- or below-the-surface.
- conceptualizeAfter mastering this field you can define individual job performance as goal-relevant behavior under individual control and conceptualize it as a multidimensional criterion including task, contextual/citizenship, counterproductive, and adaptive components.Check: Given a job, map its performance criterion domain across task, contextual, counterproductive, and adaptive dimensions and justify the boundaries.
- defineAfter mastering this field you can define the dimensions of validity (predictive, concurrent, content, face, construct) as a unitary concept and explain reliability as consistency that sets an upper bound on validity.Check: Explain each validity dimension and reliability, and justify why reliability is a prerequisite for and upper bound on validity.
- explainAfter mastering this field you can explain the individual-difference constructs (cognitive ability, personality, interests, physical ability, self-evaluations), describe the hierarchical organization of cognitive ability and why general mental ability is the most valid and versatile predictor across jobs.Check: Summarize the major predictor constructs and argue, with evidence, why general mental ability is broadly predictive and how job knowledge mediates its link to performance.
- calculateAfter mastering this field you can interpret the correlation coefficient between predictor and job performance, correct observed correlations for statistical artifacts, and calculate how selection ratio and cut-off level interact with predictive power to determine hiring success.Check: Given validity, selection ratio, and cut-off data, correct correlations for artifacts and compute the proportion of successful hires.
- conductAfter mastering this field you can conduct a rigorous job analysis—including task inventory, construct-oriented, and strategic future-oriented approaches—that identifies critical tasks, KSAOs, and performance dimensions to anchor all assessment activity.Check: Plan and execute a job analysis for a target role, producing task statements (action verb + object + qualifier), a KSAO list, and critical performance dimensions.
- trainAfter mastering this field you can train and calibrate assessors to observe, record, classify, and rate behavior neutrally in structured wash-up sessions, and identify and mitigate biases such as stereotyping, halo/horns, primacy/recency, leniency, conformity, and the exercise effect.Check: Deliver an assessor-training and calibration session with bias-mitigation protocols and demonstrate raised inter-rater agreement.
- computeAfter mastering this field you can compute and interpret interrater reliability and predictive validity from panel interview ratings, including corrected coefficients, and evaluate whether a structured interview meets professional and legal standards.Check: From panel rating data, compute interrater reliability and corrected predictive validity and judge the interview against fairness and documentation standards.
- standardizeAfter mastering this field you can standardize briefing, timing, materials, scoring, and administration and apply consistent structured processes and documented evidence across all candidates to raise reliability and legal defensibility while preserving hiring-manager authority.Check: Produce a standardized administration and documentation protocol for a multi-candidate selection event and show how it improves reliability and defensibility.
- manageAfter mastering this field you can manage candidate experience as a two-way conversation, foster transparent communication treating candidates as valued customers, and use generative AI responsibly with human oversight to draft hiring content.Check: Design a candidate-experience and communication plan that protects employer brand and specify a responsible AI-use protocol with human verification.
- administerAfter mastering this field you can design and administer a job inventory questionnaire (e.g., WPSS), determine an adequate respondent sample and site selection, and assess the reliability and validity of the resulting data through correlational comparisons.Check: Build a job inventory questionnaire, define a representative sampling plan, administer it, and compute reliability across raters and incumbent-supervisor responses.
- distinguishAfter mastering this field you can distinguish predictor constructs (what is measured) from measurement methods (how it is measured) and identify the major categories of formal assessment methods and what each measures.Check: Classify a set of assessment tools by predictor construct and measurement method, and describe what each of the major method categories measures.
- compareAfter mastering this field you can compare the criterion validity of major selection methods (mental ability tests, structured interviews, work samples, biodata, assessment centres, personality questionnaires, references) and rank them by predictive accuracy, applying meta-analysis and validity generalization to cumulate evidence beyond local studies.Check: Rank selection methods by validity using meta-analytic evidence and justify reduced reliance on local validation via validity generalization.
- analyseAfter mastering this field you can define adverse impact and the diversity-validity dilemma, assess fairness using moderated regression to detect differential prediction, and recommend strategies to reduce adverse impact without sacrificing validity.Check: Analyze a selection procedure for adverse impact, run differential-prediction checks, and recommend evidence-based mitigations that preserve validity.
- distinguishAfter mastering this field you can distinguish results (value-added outputs expressed as nouns) from activities (verbs) and behaviors for any job, applying the Dead Man's Test to identify true behavior.Check: Given a job description, correctly separate its results from its activities and pinpoint observable behaviors that pass the Dead Man's Test.
- distinguishAfter mastering this field you can distinguish core System-wide/organizational competencies from job-specific competencies and connect defined behavioral expectations to organizational values and strategic priorities.Check: For a given role, separate core from job-specific competencies and map each behavioral expectation to an organizational value or strategic priority.
- differentiateAfter mastering this field you can differentiate Assessment Centers from Development Centers and select the appropriate one for a given talent purpose, deciding when to use ability tests as primary evidence and personality inventories only as secondary evidence.Check: Given a talent purpose, choose between an Assessment and Development Center and specify which test types serve as primary versus secondary evidence, with justification.
- analyzeAfter mastering this field you can treat selection as a two-way social attraction process, analyzing applicant perceptions, reactions, faking/impression management, and social validity (information, participation, transparency, feedback) and how they affect yield, self-selection, and utility.Check: Analyze a selection scenario for social validity components and applicant reactions, explaining how they influence recruitment yield and decision accuracy.
- constructAfter mastering this field you can build a fit-for-purpose competency framework and dictionary using specific, observable, jargon-free, duplication-free behavior indicators with incremental additive proficiency scales and BARS, executing a validated mapping process including Behavioral Event Interviews.Check: Produce a validated competency model with a dictionary of BARS-anchored, cumulative proficiency scales derived from job analysis and BEIs, meeting stated quality criteria.
- designAfter mastering this field you can design valid work-sample and assessment-center activities (role plays, in-trays, analytical exercises, group tasks) set at the right level, assessing few competencies each, measuring each competence at least twice to control the exercise effect, using multiple exercises and multiple assessors against a formal competency model.Check: Design an assessment center with a competency-exercise matrix demonstrating multiple exercises, multiple assessors, and each competence assessed at least twice.
- constructAfter mastering this field you can distinguish structured from unstructured interviews, derive job-related questions from job analysis, construct example-anchored rating scales, and analyze the method (standardization) and content (job-relatedness/cognitive load) explanations for why structured interviews work.Check: Build a structured interview with the six structuring components—job-analysis-derived questions and behaviorally anchored rating scales—and explain what it measures.
- designAfter mastering this field you can define and apply the standardized survey interviewing craft—reading questions as worded, nondirective probing, discretion-free recording, neutral relationship, respondent training, and supervision—to minimize interviewer-related measurement error.Check: Design an end-to-end standardized interviewing data-collection plan (scripted questions, probing rules, respondent training, monitoring) and detect interviewer effects in the data.
- evaluateAfter mastering this field you can describe the legal and ethical obligations governing selection assessments—Uniform Guidelines, data protection, equal opportunities, disability, professional standards, and cross-regional differences—and evaluate a practice against them.Check: Audit a described assessment practice against legal, privacy, and ethical standards across jurisdictions and identify compliance gaps.
- appraiseAfter mastering this field you can estimate the economic utility, ROI, and cost-effectiveness of valid selection methods against their resource costs, modeling parameters realistically rather than reporting inflated figures.Check: Calculate the dollar utility of a selection method across many hires, weighing validity, performance variance, and pool size, and defend the estimate credibly.
- evaluateAfter mastering this field you can evaluate any assessment method against the full set of criteria—validity, reliability, adverse impact/fairness, cost, applicant reactions, acceptability, utility, and impact—and distinguish evidence-based methods from folklore or pseudo-scientific ones such as graphology and voodoo hiring.Check: Score a set of assessment methods (including graphology and unstructured interviews) against the multi-criteria framework and justify which to adopt or reject.
- designAfter mastering this field you can build a hiring Scorecard specifying role mission, ranked outcomes, and competencies, set the performance bar to screen out weaker candidates, source high-quality candidates, conduct structured interviews (screening, chronological, focused, reference) using TORC, and sell chosen candidates on joining.Check: Implement the A Method end-to-end: produce a Scorecard, sourcing plan, four structured interviews, and a candidate-close plan addressing the five F's.
- critiqueAfter mastering this field you can write and critique task statements for structure, specificity, overlap, and completeness, and combine task data into functions linked to abilities, skills, and job design dimensions.Check: Review a set of task statements, correct structural and specificity flaws, and roll them into functions linked to KSAs.
Validated instruments — where the research already has a measure
Position Information Questionnaire (PIQ)
validated“inferred: What are the key behaviors necessary to perform your job effectively?”
Employee Self-Evaluation Form
validated“What are your most important accomplishments since your last review?”
Reinforcer Survey (Sample)
validated“Spending time on hobbies (list specific hobbies)”
Performance management attitude survey questionnaire
validated“I am quite satisfied that the objectives I agreed were fair.”
Redesigning and Customizing XYZ Company’s Performance Appraisal Program
validated“What features of the current performance appraisal system do you like and would like to see carried over into the new system?”
How to measure it
Turning each idea into a measure
For each construct: how to operationalize it, the observable signals to look for, and how well it holds up.
Presence and quality of documented SMART goals and Expected Results in the appraisal form's Areas of Performance and Expected Results columns.
- Written goal statements
- Expected Results in quality/cost/quantity/timeliness terms
- alignment with department objectives
Assessable through document review of appraisal forms.
Anchored in explicit SMART format guidance. · Consistency depends on adherence to the SMART format across managers.
Supervisor rating on a 3-point scale against behavioral indicators for each System Core and Job Specific competency.
- Behavioral indicators at each competency level
- supervisor ratings
- documented examples of behavior
3-point scale: Below Expectations, At or Above Expectations, Significantly Exceeds Expectations.
Grounded in Hay/McBer competency research on effective performance. · Cumulative behavior structure aids consistent leveling; rater judgment introduces variance.
Classification into Strategic Leadership, Tactical Leadership/Senior Professional, Operational Leadership/Professional, or Management Support Staff per salary grade.
- Salary grade
- scope of impact
- position description
Categorical tier mapped to grade ranges.
Directly defined by the Level of Contribution/Grade table. · High reliability given grade-based classification.
Completion of competency- and results-based developmental goals and mid-cycle progress reviews documented in the Development Plan.
- Development Plan entries
- mid-cycle review notes
- supervisor accomplishment comments
Documented presence and quality of development activities.
Anchored in explicit instruction steps. · Varies with supervisor engagement.
Supervisor-assigned 1-3 rating per goal and calculated Overall Results Rating based on Actual Results.
- Actual Results entries
- goal ratings
- Overall Results Rating
3-point rating aggregated into an overall results rating.
Tied to predefined Expected Results. · Depends on measurable goal definitions.
Overall Performance Rating calculated in the Overall Performance Summary section from results and competency ratings.
- completed Overall Performance Summary
- final rating value
Composite rating derived from component ratings.
Reflects the results-plus-behaviors equation. · Consistency depends on component rating reliability.
Compensation adjustments and recognition linked to performance ratings, plus attraction/retention outcomes.
- compensation changes
- retention rates
- competitive pay benchmarks
Archival compensation and workforce metrics.
Aligned with stated program goals. · Objective archival data supports reliability.
Assessment of goal cascade linkage and achievement of System strategic goals and change initiatives.
- achievement of System goals
- progress on change initiatives
- alignment of objectives
System-level aggregation of alignment and outcomes.
Anchored in program purpose statements. · System-level measurement is indirect and multi-source.
Expert audit of behaviour indicators against criteria of specificity, single-behaviour focus, observability, neutrality, realism, and jargon-free wording.
- Presence of positive and negative behaviour indicators
- Absence of vague or judgmental terms
- Alignment with activity contexts
Qualitative rubric-based rating; not a scored survey.
Framework quality underpins construct and content validity of the assessment. · Tailored frameworks improve rating reliability per the text.
Design audit against the book's activity criteria (neutral context, resource fairness, competence count, achievable time-frames).
- Number of competencies assessed per activity
- Reliance on no specialized knowledge
- Achievable-but-stretching time limits
Design checklist evaluation.
Directly linked to work-sample criterion validity. · Standardized, well-designed activities aid consistency.
Records of training completion, practice-rating exercises, and observed assessor competence in mock assessments.
- Behaviourally specific notes
- Consistency in mock ratings
- Use of coaching feedback style
Mixed archival and observational assessment.
Training improves accuracy of behavioural judgements. · Cited research shows training improves inter-rater reliability.
Process audit of adherence to standardized scripts, timings, deployment grids, and constraint handling.
- Use of informal scripts
- Strict timing adherence
- Documented assessor observation grids
Behavioural audit checklist.
Consistency supports comparable and defensible ratings. · Core driver of inter-rater and inter-event reliability.
Comparison of practice against BPS/CIPD/ITC codes, policy statements, and validity evidence.
- Ability tests linked to specific competencies
- Personality profiles used as hypotheses, not filters
- Presence of a psychometric policy statement
Conditional aggregation depending on instrument type.
Ability tests have strong criterion validity; personality tests generally weak except conscientiousness. · Reliability varies by instrument and administration standardization.
Analysis of assessor records for behaviourally specific, time- and context-anchored evidence versus inferential statements.
- Verbatim quotes and described actions in notes
- Absence of personality/inference statements
- Time and silence recorded
Behavioural coding of assessor notes.
Aligns construct and criterion validity for work samples. · Behavioural focus improves cross-assessor agreement.
Inference from rating patterns (halo, leniency, skew), cross-assessor discrepancies, and wash-up dynamics.
- Uniformly high or central ratings
- Rating shifts toward senior assessors
- Low cross-exercise correlations for same dimension
Conditional aggregation; inferred rather than directly self-reported.
Bias threatens the validity of ratings. · Bias reduces inter-rater reliability.
Agreement or correlation statistics between independent assessors' ratings of the same candidates.
- Concordant independent ratings
- Stable ratings across activities
Archival statistical measure.
Precondition for criterion validity. · Is itself a reliability metric, improved by training and consistency.
Perception surveys or feedback from candidates and stakeholders on activity relevance.
- Candidate comments on relevance
- Applicant attraction/withdrawal
- Stakeholder acceptance
Perceptual self-report.
Distinct from criterion validity; primarily a PR/attraction factor. · Perceptions may vary by candidate background and culture.
Correlation coefficients between assessment scores and job performance or other criteria via validity studies.
- Correlation coefficient magnitude
- Consistency of prediction across studies/meta-analyses
Archival correlational study; coefficient 0 to 1.
Central outcome; work samples/ability tests rated 0.5+. · Bounded by reliability of measures and criteria.
Statistical comparison of performance/scores across demographic groups to detect unjustified differences.
- Group score differences investigated
- Culturally adapted frameworks/activities
- Tracked demographic outcomes
Archival group-difference analysis.
Unjustified group differences may indicate invalidity or illegality. · Requires ongoing monitoring across events.
Utility analysis estimating performer value differentials against recruitment, turnover, and assessment costs.
- Estimated value gap between good and average performers
- Recruitment and turnover cost figures
Monetary archival estimation.
Depends on utility analysis assumptions. · Estimates are approximate rules of thumb.
Audit of the presence, quality, and objectivity of documented behavioural evidence supporting decisions.
- Recorded behavioural evidence per decision
- Standardized process records
Qualitative audit.
Strengthened by behaviour capture and process consistency. · Depends on completeness of records.
Attitude surveys, participation rates, and adoption/support indicators among stakeholders and candidates.
- Willingness to volunteer as assessors
- Positive candidate feedback
- Reduced resistance to change
Perceptual self-report and behavioural adoption metrics.
Enhanced by involvement, feedback, and matched influencing strategies. · May fluctuate with organizational context and communication.
Assessed by evaluating documented goals against the book's effective-goal criteria and by employee-reported perceptions of goal clarity, challenge, and involvement in setting them.
- Written goals with clear metrics and deadlines
- Employee can articulate how goals link to strategy
- Goals revised as circumstances change
Combine archival review of goal documents with perceptual ratings; feasibility is medium as goal quality is partly judgmental.
Risk of surface compliance (goals meet SMART form but lack importance); the book warns SMART alone is insufficient. · Multiple raters reviewing goal documents can improve consistency.
Measured through frequency counts of feedback interactions plus recipient perceptions of the feedback's specificity, fairness, and usefulness.
- Regular check-ins and debriefs
- Feedback describes behaviors not motives
- Recipient reports feedback is actionable
Frequency is countable; quality best captured via perceptual survey; medium self-report suitability.
Vague praise or motive-guessing undermines validity; the book stresses staying on your side of the net. · Recipient ratings across several instances improve reliability.
Assessed via observation of coaching sessions (question-to-tell ratio, listening behaviors) and employee-reported perceptions of being helped to solve problems independently.
- Approximately 4:1 ratio of questions to advice
- Employee generates own solutions
- Manager withholds premature answers
Perceptual and observational; medium self-report suitability due to manager blind spots.
Distinguish coaching from teaching; the book notes teaching is limited to what the manager knows. · Trained observers can code coaching behaviors reliably.
Measured via employee perceptions of feeling recognized and valued, plus records/scorecards tracking recognition frequency and its match to achievements.
- Thank-you notes and public acknowledgments
- Recognition tied to organizational values
- Employees report feeling appreciated
High self-report suitability; employees can reliably report perceived recognition.
Generic or mismatched rewards can demotivate, reducing construct validity if measured only by count. · Regular scorecards improve consistency of frequency measures.
Assessed through the presence and execution quality of development plans and employee perceptions of growth support and opportunity.
- Documented development plans
- Employees taking on new challenges
- Mentor/sponsor relationships established
Mixed mode; combine plan documentation with perceptual measures.
Invisible promotions (more work without recognition) reduce validity of development as growth. · Plan reviews plus periodic employee surveys enhance reliability.
Captured via the presence and completeness of a team contract and member-rated clarity of goals, roles, and rules of conduct.
- Signed team contract
- Members can state their roles and rules
- Documented process goals posted or referenced
Perceptual member ratings aggregated to team level; medium self-report suitability.
Contracts that are ignored in practice weaken validity; the book stresses treating them as living documents. · Aggregating multiple members' ratings improves reliability.
Assessed through skills/expertise inventories and work-style diagnostics mapped across team members to gauge complementarity and spread.
- Skills inventory covering required competencies
- Distribution of work-style diagnostic results
- Presence of both big-picture and detail-oriented members
Mixed mode; low self-report suitability for the team-level construct itself.
Diversity must be relevant to the task; irrelevant diversity does not improve outcomes. · Standardized diagnostics improve reliability of style mapping.
Assessed via the scheduling and use of continuous-improvement/plus-delta meetings and member perceptions of fair, consistent accountability.
- Scheduled plus/delta or continuous-improvement meetings
- Peers giving each other feedback
- Documented decisions from review meetings
Mixed mode; medium self-report suitability.
Accountability perceived as unfair or purely punitive undermines the construct's intended effect. · Meeting logs plus member surveys improve reliability.
Inferred from manager self-report of assumptions plus observation of how they frame feedback and coaching conversations (open vs. narrow/binary/frozen).
- Manager considers alternative explanations before concluding
- Manager asks questions rather than issuing verdicts
- Manager reflects on own contribution to problems
Perceptual/observational; medium self-report suitability; aggregation not meaningful (individual-level moderator).
Managers may lack awareness of restrictive framing, biasing self-report. · Combining self-report with observer coding improves reliability.
Measured via perceptual self-report of trust, rapport, and safety in the relationship or team.
- Employees share problems and ask for help
- Candid feedback given without defensiveness
- High ratio of positive to negative interactions
High self-report suitability; standard trust/safety scales apply.
Trust ratings may be inflated when relationships are new; behavioral corroboration helps. · Established trust/safety instruments are generally reliable.
Measured via engagement surveys and self-report of energy, commitment, and willingness to exert discretionary effort.
- Voluntary extra effort
- Positive engagement survey scores
- Proactive problem solving
High self-report suitability; engagement is commonly perceptually measured, as cited in the text.
Engagement measures can be confounded with satisfaction; distinguish drive from mere contentment. · Validated engagement instruments provide good reliability.
Assessed via self-reported insight plus observable demonstration of new or improved skills over time.
- Employee accurately describes own development areas
- Demonstrated new competencies on tasks
- Applies feedback to change behavior
Mixed mode; self-awareness via self-report, skills via observation/performance.
Self-reported awareness may not match demonstrated behavior; triangulate. · Repeated skill observations improve reliability.
Measured behaviorally via observation, deadline and commitment adherence, and follow-through on feedback.
- Tasks completed on time and to standard
- Volunteering and follow-through
- Behavior change after feedback
Behavioral mode preferred; low self-report suitability due to social desirability.
Behavioral indicators are more valid than self-report for effort and compliance. · Objective adherence records improve reliability.
Measured via a combination of archival results (metrics against goals), manager assessment, and 360-degree feedback, recognizing that much knowledge work is hard to quantify.
- Achievement of goal metrics
- Positive 360-degree feedback
- Demonstrated competencies in role
Mixed mode; low self-report suitability; the book cautions that ratings are subjective and hard to standardize.
Ratings can reveal more about the rater than the ratee; supplement numbers with specific behavioral examples. · Multiple independent sources (360) improve reliability.
Measured via archival turnover/retention rates and internal promotion/readiness metrics.
- Low regretted attrition
- High-potential employees staying
- Employees ready for advancement
Archival mode preferred; low self-report suitability for the outcome itself.
Retention is influenced by external labor market factors beyond managerial practice. · Archival HR data provide high reliability.
Assessed via deliverable quality and timeliness, stakeholder assessment of outputs, and team process ratings across dimensions like decision making and conflict management.
- On-time, high-quality deliverables
- Rigorous decisions incorporating dissent
- Conflicts surfaced and resolved constructively
Mixed mode; combine output metrics, stakeholder ratings, and member process ratings.
Perceived harmony can be a consequence of perceived performance, not a cause; avoid conflating the two. · Multiple stakeholders and repeated process ratings improve reliability.
Characterized via archival status (e.g., remote vs. colocated), cultural context assessment, and work-style/learning-style diagnostics.
- Employee works remotely/across time zones
- Divergent cultural norms for feedback
- Documented learning-style preferences
Mixed mode; some elements archival, some perceptual; aggregation is conditional on the specific factor.
Treating context as monolithic reduces validity; distinct sub-conditions require distinct measures. · Standardized diagnostics and clear status categories improve reliability.
Presence, frequency, and structure of manager-employee check-ins and the degree to which formal annual ratings are retained or eliminated.
- weekly or per-project check-ins
- use of feedback apps
- elimination of once-a-year ratings
Assess cadence categorically (annual, quarterly, monthly, weekly) and content orientation.
Content orientation should be verified against actual conversation topics, not just stated policy. · App and calendar logs provide reliable frequency data.
Proportion of review content and stated objectives devoted to development versus rating and pay.
- development-focused conversation content
- stated system goals
- training investment
Perceptual survey plus content analysis of review documentation.
Stated orientation may diverge from practice; triangulate. · Content coding requires trained raters for consistency.
Use of future-focused rater questions, multiple metrics, and validity-tested items in the evaluation process.
- performance snapshot items
- multi-metric scorecards
- construct and criterion validity checks
Archival review of instrument design and validity statistics.
Deloitte tested items for construct and criterion validity. · Standard deviations and mean responses used to check differentiation.
Composition and weighting of scorecard components across collective and individual goals.
- scorecard weightings
- shared customer-satisfaction targets
- cross-functional task forces
Archival analysis of scorecard weightings and goal types.
Overweighting collective goals recommended to counter individual bias. · Documented scorecards provide reliable records.
Degree of match between an employee's assigned tasks and their identified deeply embedded life interests.
- performance-review discussions of interests
- reassignment to interest-aligned work
- interest inventory alignment
Perceptual assessment plus review of assignment changes.
Distinguish life interests from skills and values. · Interest inventories provide stable measures over time.
Presence of opt-in consent, data aggregation/anonymization, transparent communication, and mixed-method interpretation in analytics programs.
- signed consent forms
- town halls and communications
- aggregate-only reporting
Audit of program governance and rollout practices.
Anonymity via name removal alone is insufficient; behavior can re-identify individuals. · Governance documentation supports reliable auditing.
Differential boss behaviors and subordinate perceptions of trust, autonomy, and support.
- freedom to choose approaches
- monitoring intensity
- tone of feedback
Perceptual surveys of subordinates and observation of boss behavior.
Bosses often unaware or believe intentions are hidden; subordinate perception is key. · Corroborate self-report with behavioral observation.
Frequency of reported uncivil incidents and presence of civility-focused norms and hiring criteria.
- employee reports of rude behavior
- retention linked to culture
- civility background checks
Perceptual survey of incivility experiences.
Self-report of incivility is generally credible given consistency across studies. · Repeated surveys can track civility trends.
Disparities in ratings, advancement, and treatment across groups, and biased language in reviews.
- rating disparities by race/gender
- biased review language
- advancement gaps
Mixed: statistical disparity analysis plus textual analysis.
Small sample sizes limit statistical proof; combine with social-science evidence. · Textual analysis requires consistent coding.
Behaviors that maximize a metric at the expense of the underlying strategic goal.
- gaming of metrics
- actions harming strategy to hit numbers
- overreaction to narrow targets
Behavioral inference; studied via experiments and fMRI in cited research.
Occurs subconsciously whenever metrics are present. · Difficult to measure directly; infer from behavior.
Engagement survey scores, net promoter scores, and manager assessments of commitment.
- engagement survey results
- voluntary contribution
- attendance
Perceptual engagement surveys aggregated at team/org level.
Widely validated construct in HR research. · Repeated surveys support trend reliability.
Scores on validated vitality and learning scales.
- feeling energized
- gaining new skills
- low burnout
Self-report scales measuring vitality and learning.
Both components needed; one alone is unsustainable. · Established scales from cited multi-year research.
Rates of cross-team participation, knowledge sharing, and help-giving.
- cross-division project participation
- intranet knowledge communities
- resource sharing
Mixed: network data plus perceptual reports.
Distinguish genuine collaboration from cross-selling. · Behavioral/network data provide reliable signals.
Turnover and retention rates, especially of high performers.
- retention rate
- first-year attrition
- quit rates
Archival HR turnover metrics.
Distinguish regretted from non-regretted attrition. · HR records provide reliable data.
Combination of manager-rated performance, productivity, customer satisfaction, and financial results over time.
- performance ratings
- revenue growth
- customer satisfaction scores
- low burnout
Mixed archival and perceptual measures.
Guard against short-term metric maximization masking value destruction. · Multiple metrics improve robustness.
Established via criteria validity coefficients (correlations between assessment scores and performance measures) ranging from 0 to 1, and via content validity through job analysis documentation.
- validity coefficients
- statistical relationships between scores and performance criteria
- documented job analysis linkages
Criteria validity expressed as correlation coefficient; most effective assessments range .10 to .50.
Criteria validity provides strongest empirical evidence; content validity acceptable for well-defined requirements. · An assessment cannot be consistently valid if it is not reliable (reliability coefficients typically .60-.90).
Assessed through review of the development methodology, rigor of job analysis, scoring algorithm sophistication (including localized/non-linear scoring), and standardization of administration.
- documented development process
- use of subject-matter experts
- consistency of administration across candidates
Qualitative/expert judgment; no standard numeric scale.
Poor design produces assessments that look valid but predict nothing. · Standardized administration improves measurement reliability.
Counted as the ratio of applicants to openings from applicant tracking data.
- applicants per requisition
- selection ratio
Ratio scale; larger ratios increase assessment value.
When pool equals one, assessments provide no selection value. · Directly counted, high reliability.
Estimated from performance and financial metrics comparing revenue generated or costs incurred across performance levels.
- revenue differences across performers
- cost of catastrophic hires
Expressed in monetary terms per employee.
Constrains maximum financial value any assessment can provide for a job. · Depends on quality of performance measurement systems.
Estimated indirectly through candidate assessment scores across categories of what candidates have done, can do, and want to do.
- personality scale scores
- ability test scores
- biodata responses
- stated interests
Measured via multi-item scales; intangible attributes estimated statistically.
Many attributes are intangible and candidates may lack self-awareness of them. · Behavior is stable over time, supporting reliable measurement of stable traits.
Evaluated through manager, co-worker, or customer behavioral ratings using structured rating scales.
- supervisor behavioral ratings
- observed workplace behaviors
- BARS evaluations
Behavioral rating scales; cannot usually be directly observed.
Best performance criteria for validating assessments are behavioral ratings of individual employees. · Requires well-designed rating forms and rater training for accuracy.
Inferred from validity coefficients and comparison of assessment-based hires' performance to non-assessment-based hires.
- performance of hires
- reduction in bad hires
- improved retention
Indirectly indexed via validity and downstream performance metrics.
Accuracy is realized only when data is used systematically and appropriately. · Standardized processes increase consistency of decisions.
Measured via applicant reaction surveys and dropout/self-selection rates during the hiring process.
- applicant survey ratings
- dropout rates
- litigation frequency
Perceptual survey scales; behavioral dropout counts.
Face validity strongly drives perceptions independent of predictive accuracy. · Self-report reactions can be reliably aggregated across applicants.
Tracked via aggregate performance metrics, retention rates, and Human Value Added over time.
- aggregate performance data
- turnover rates
- HVA figures
Aggregated archival metrics; changes gradually over time.
Improvement depends also on management practices and retention. · Depends on quality of underlying performance data.
Estimated through utility analysis and ROI calculations linking assessment use to financial value (e.g., HVA, turnover cost savings).
- ROI estimates
- profitability changes
- reduced cost per hire
Monetary; often estimated via simplified ROI/utility formulas.
Financial gains rarely attributed directly to assessments in financial reports. · Estimates vary with assumptions; intangible HVA introduces uncertainty.
Presence and traceability of position results to recorded organizational and manager goals, with goals the position can affect checked off.
- completed organizational measures worksheet
- results explicitly supporting listed org goals
Assessed qualitatively via worksheet completeness; not scored numerically.
Depends on availability and accuracy of finalized organizational goals. · Reliable when goals are documented; less so when goals are informal.
Completeness of the customer diagram showing all customer types and the products/services each needs.
- customer diagram with arrows and needs
- no omitted customers or needs on checklist
Qualitative completeness check rather than numeric scale.
Risk of confusing interaction partners with true customers. · Improved by facilitator or peer review of the diagram.
Proportion of plan items expressed as noun-based results covering at least 80% of the job with fewer than nine results.
- results list using nouns
- absence of verb-based activity statements
Checklist-based judgment of results vs activities.
Distinguishing results from activities can be subjective at the margin. · Supported by the practice exercise answer key and criteria.
Weights in five-percent increments summing to 100% that reflect importance not time spent.
- percentage weights next to each result
- highest weight on most important result
Percentage scale totaling 100.
Weights should reflect importance, not time, per the book. · Discipline of 100 points reduces inflation of priorities.
Presence of numeric units or descriptive judge-plus-factors matched to relevant general measures (quantity, quality, cost, timeliness).
- specified units tracked
- named judge and evaluation factors
Mixed numeric and descriptive; evaluated against checklist.
Descriptive measures require identifiable judges to remain verifiable. · Borrowing validated examples improves consistency.
Coverage of every measure with data collection decisions (what, when, who, receiver, how) that are relevant, frequent, immediate, specific, and cost-justified.
- completed 'How to Track' column
- use of existing reports
- practical data collection plan
Assessed via tracking checklist rather than a score.
Value of data must exceed collection cost or the measure is dropped. · Employee-collected, job-based feedback increases reliability.
Self-reported understanding of manager expectations, goals, and role in achieving them.
- agreement with 'I understand what my manager expects of me'
- knowledge of how one is doing vs expectations
Perceptual, from employee satisfaction survey items.
Self-report may overstate clarity absent objective goals. · Recurring survey administration supports consistency.
Employee reports and records showing feedback delivered on how performance compares with goals.
- feedback reports received by employee
- employee awareness of standing vs goals
Perceptual and archival; presence and quality of feedback.
Feedback from others may be delayed or nonspecific. · Job-based, immediate feedback is more reliable than third-party.
Frequency of self-managed corrections and reduction in escalated performance problems.
- fewer problems reaching manager
- employees solving issues independently
Behavioral counts inferred from tracking data.
Hard to isolate from other performance drivers. · Requires consistent tracking to observe over time.
Actual performance recorded against numeric ranges and descriptive goals in the performance plan and tracking reports.
- actual vs goal entries in tracking reports
- meets/exceeds ratings on measures
Mixed numeric and descriptive per measure.
Validity depends on measure and goal quality. · Repeatable when tracking systems are practical and used.
Attainment of organizational goals and metrics such as customer satisfaction, cost savings, revenue, and quality.
- organizational goal metrics met
- improved customer and cost measures
Archival organizational metrics.
Attribution to individual plans requires alignment established in Step 1. · Depends on existing organizational reporting systems.
Rated by expert review of each statement for presence of an action verb, immediate object, and appropriate qualifier; consistency of specificity level; use of familiar and specific terminology; and stand-alone intelligibility, supplemented by respondent write-in and confusion rates.
- Low respondent write-in rates
- Few comprehension questions in pretesting
- Absence of passive/process verbs and ambiguous terms
- Alphabetical grouping by function without overlap
Feasible as an expert-rated categorical judgment (adequate/inadequate) or dimensional quality index; no scoring rules specified here.
Face and content validity anchored in the book's explicit writing guidelines. · Multiple trained reviewers applying the same guidelines can achieve consensus, as with the function-sorting eyeball method.
Assessed through structured pretesting with a small group of typical incumbents and examination of draft and returned questionnaires for errors, omissions, and difficulties in answering.
- Completed items with few omissions
- Appropriate (accurate) responses relative to scales and intent
- Positive pretest evaluation-sheet feedback
- Efficient completion time
Feasible as a checklist-based quality appraisal; measurement feasibility only, no scoring rules provided.
Grounded in the book's questionnaire construction and pretesting guidance. · Consistent appraisal across reviewers achievable with standardized pretest protocol.
Documented by the project record indicating which techniques were used, at how many sites, with how many informants, and how they were sequenced and combined.
- Number of documents reviewed
- Number of observation sessions and sites
- Number and type of interviews conducted
- Rate of new task statements uncovered per site
Feasible as an archival count/coverage index of techniques applied; no scoring rules specified.
Content-valid as it directly enumerates the prescribed techniques. · Objective archival counts are highly reliable.
Determined by sample size relative to the incumbent population (rule of thumb 300-400 respondents), number and representativeness of survey sites, and coverage of local practice variations.
- Percent of incumbent population sampled
- Number of sites selected (e.g., random 25% of locations)
- Sufficient subsample sizes for planned comparisons
Feasible as an archival ratio and coverage assessment; no statistical scoring rules imposed here.
Supported by studies showing stable statistics from adequate samples. · Archival sample records are highly reliable.
Observed during pretesting by recording questions asked, problems raised, and difficulties experienced, and by examining returned questionnaires for evidence of confusion.
- Few clarifying questions during administration
- Correctly completed example items
- Absence of systematic miscompletion patterns
Feasible via perceptual self-report and observed difficulty counts; measurement feasibility only.
Directly observable in pretest settings, supporting content validity. · Observation across multiple pretest respondents yields consistent signals.
Inferred from veracity ('lie detector') task statements, duplicate task consistency, and comparisons of responses with observed or clocked performance where available.
- Consistent responses to duplicate task statements
- Correct zero responses to tasks not performed
- Agreement with observed performance
Feasible through mixed behavioral/archival checks; no scoring formulas specified.
Anchored in USAF veracity-check methodology cited in the book. · Consistency of veracity responses across administrations was demonstrated in USAF studies.
Estimated via test-retest correlations, inter-rater agreement, duplicate task statement comparisons, and split-sample (consolidated) comparisons of task attribute values.
- Correlation coefficients (often .90s for pooled data)
- Agreement percentages between raters
- Stability across split samples
Feasible as archival correlation/agreement indices; the book reports these as feasibility evidence, not as prescribed scoring.
Extensively supported by USAF and telephone company studies. · Reliability itself is the construct; pooled data reliability is very high while individual reliability is moderate.
Established by comparing incumbent and supervisor responses, comparing responses with actual performance (e.g., clocked time or daily records), inferring from logical relationships (e.g., tenure-capability), and treating high inter-respondent agreement as an indication of validity.
- Agreement correlations between incumbents and supervisors
- Correlation of task time with clocked time
- Sensible tenure-capability relationships
Feasible as archival comparison indices; direct validation is difficult so validity is often inferred.
The construct itself; the book cautions reliability is necessary but not sufficient. · Validity estimates depend on the reliability of the comparison data.
Indicated by successful execution of the WPSS procedures (e.g., QDEF, QBLD, QRPT) to produce statistical summary and cross-tabulation reports from the survey data base.
- Successful survey data base build
- Generated statistical and cross-tabulation reports
- Retrievable, updatable stored data
Feasible as an archival presence/correctness indicator; not aggregable across individuals.
Grounded in the Part Two user manual procedures. · Deterministic computer processing yields consistent outputs given the same inputs.
Judged by whether results enable direct and follow-up applications (job descriptions, training requirements, selection procedures, job design, evaluation) and satisfy the objectives that prompted the analysis.
- Application of task selections to training or selection
- Ability involvement ratios and job profiles produced
- Achievement of stated project objectives
Feasible through mixed perceptual and archival evidence of application; conditional aggregation across programs.
Anchored in the book's enumeration of direct and follow-up uses. · Depends on documented application outcomes; consistency achievable through project records.
Assessed through documentary and case analysis of whether assessment criteria and methods track strategic type, plus interviews with senior managers about HR-strategy integration.
- explicit strategy-derived competency frameworks
- assessment criteria changing with strategic change
- HR represented in strategic planning
Best captured on an organizational maturity continuum from reactive/downstream to proactive/resource-based.
Case studies (National and Provincial, ICL, Caledonian Paper) illustrate but do not quantify alignment. · Relies on consistent coding of documents and interviews across raters.
Presence and rigour of job analysis procedures (workshops, scenario planning, critical incident, repertory grid, future task ratings) evidenced in the analysis record.
- documented person specifications derived from analysis
- future task importance ratings
- use of behavioural event interviews
Can be rated on presence/absence and rigour of components rather than a numeric scale.
Book stresses that systematic job analysis is rarely done in practice, limiting real-world variance. · Depends on documented evidence and independent back-translation checks.
Indexed by validity coefficients from validation studies, degree of method structure, and correspondence to meta-analytic evidence on method types.
- use of assessment centres, work samples, structured interviews
- documented validation studies
- correlation coefficients between predictor and criterion
Validity typically expressed as correlation coefficients; method type serves as a proxy where local validation is absent.
Assessment centre construct validity is contested (ratings cluster by exercise, not dimension). · Reliability is a defined subcomponent; meta-analysis corrects for artifactual error.
Measured via comparative hiring/selection rates across groups, differential validity analyses, and bias/item checks.
- proportionate shortlisting and offer rates by group
- validated tests across subgroups
- equal opportunity audit results
Adverse impact often expressed as ratios of selection rates between groups.
Formalization can mask discrimination, so outcome monitoring is necessary alongside method audits. · Requires consistent, ongoing monitoring across cohorts.
Assessed via cross-national surveys of method usage combined with cultural dimension scores and legal/regulatory analysis.
- country-level differences in method use (graphology, tests, assessment centres)
- consent requirements and works council involvement
- prevalence of clinical vs psychometric traditions
Cultural dimensions on continuous scales; legal context categorical.
Hofstede dimensions only partly explain observed national differences. · Comparative surveys vary in scale and sampling across countries.
Measured through candidate self-report of perceptions of procedural and distributive justice, accuracy, and process quality.
- reported perceptions of fairness/friendliness/thoroughness
- preference for certain methods
- reactions differing by pass/fail
Well suited to perceptual rating instruments; content only (no scoring rules specified here).
Perceptions vary with selection outcome and career stage. · Standard attitude self-report is generally reliable when contextualized.
Assessed via self-report of self-efficacy, self-esteem, need for achievement, and self-understanding, ideally pre- and post-assessment.
- reported confidence to perform tasks
- reported self-worth after feedback
- internalization of assessment feedback
Perceptual self-report; feasibility high for these constructs.
Effects moderated by individual differences and feedback quality. · Established self-report constructs; aggregation only conditional across contexts.
Measured through self-report of organizational commitment, trust in management, and career attitudes.
- reported intention to stay
- expressed trust in the organization
- career plan changes after development centres
Perceptual self-report scales; content only.
Procedural justice is a strong antecedent per cited studies. · Commitment/trust measures are widely used and generally reliable.
Indexed by subsequent job performance, tenure, training success, promotion, and person-job/person-organization fit.
- supervisor performance ratings
- retention/turnover
- training and promotion outcomes
Multiple archival criteria; the choice and validity of criteria are themselves contested.
Criteria such as promotion are increasingly problematic as career structures flatten. · Depends on reliability of the chosen performance criteria.
Measured via observable withdrawal actions such as offer decline rates, dropout, and turnover.
- declined job offers
- voluntary turnover
- non-completion of selection stages
Behavioural/archival counts and rates.
Hypothesized as an outcome of negative psychological states in the impact model. · Behavioural records generally reliable; attribution to assessment requires care.
Monitored through workforce representation audits and comparative hiring/progression rates by gender, race, age and disability.
- proportional representation at all levels
- reduced adverse impact over time
- equal opportunity audit outcomes
Archival ratios and representation statistics.
Equal outcomes may not follow formalization if it legitimizes bias. · Requires consistent monitoring categories over time.
Inferred from firm performance, resource inimitability assessments, and utility gains from selection.
- superior productivity/quality
- distinctive capabilities
- hard-to-imitate HR practices
No single metric; combines archival performance and qualitative resource appraisal.
Attribution to assessment specifically is difficult; generic HR practices may be imitable. · Conditional aggregation given multiple contributing factors.
Identified interpretively through discourse analysis, historical study of assessment practices, and observation of how candidates internalize assessment feedback and language.
- candidates describing themselves in feedback terms
- legitimation of organizational change via assessment
- assessment used to justify decisions
Not amenable to conventional measurement; interpretive/qualitative only.
A critical-theoretical construct challenging positivist measurement; validity is interpretive. · Not reliability-testable in psychometric terms.
Assessed via behavioural event interviews, assessment centres, competency profiling, and functional analysis against defined standards.
- demonstrated behaviours in exercises
- ratings against competency frameworks
- achievement of occupational standards
Mixed perceptual/behavioural; construct boundaries are ambiguous.
Book highlights conceptual ambiguity, overlap between competencies, and no proven universal set. · Assessors struggle to discriminate more than a few competencies reliably.
Documented ratings and descriptions of task frequency, importance, and criticality, and linked KSAOs, produced through worker- or work-oriented analysis methods.
- Task inventories
- Importance and frequency ratings
- O*NET-type descriptors
- SME judgments
Typically ordinal/interval rating scales aggregated across subject-matter experts.
Foundation for content validity and legal defensibility of selection systems. · Inter-rater agreement among SMEs is a key reliability index.
Classification of the selection procedure used (interview, biodata, simulation, self-report, web-based test, individual assessment) and its design characteristics.
- Procedure type
- Degree of structure
- Administration mode
- Standardization level
Categorical classification with associated psychometric quality indices.
Same method can measure different constructs; validity depends on construct-method match. · Reliability varies by method and structure (e.g., structured interviews more reliable).
Scores on standardized cognitive/mental ability tests exhibiting positive manifold across subtests.
- Test scores on reasoning, verbal, quantitative, spatial items
- Speed and accuracy of problem solving
Interval-scaled standardized test scores; large subgroup mean differences observed.
Strong, generalizable criterion-related validity across jobs. · High internal consistency and test-retest reliability typical of ability tests.
Scores on self-report personality inventories measuring Neuroticism, Extroversion, Openness, Agreeableness, and Conscientiousness and their facets.
- Self-report questionnaire responses
- Facet-level scale scores
- Behavioral consistency patterns
Likert-type self-report scales aggregated to trait and facet scores; feasibility only, no scoring rules specified.
Modest predictive validity; vulnerable to faking though faking has limited effect on overall validity. · Adequate internal consistency for established inventories.
Scores on vocational interest inventories (e.g., RIASEC types) and work value taxonomies.
- Preference ratings for activities
- Occupational interest profiles
- Value priority rankings
Self-report preference scales, often structured to reduce social desirability bias.
Predict vocational choice and satisfaction more than performance. · Interest measures show high stability from late teens through adulthood.
Indices of match between person characteristics and environment characteristics (needs-supplies and demands-abilities fit).
- Perceived fit ratings
- Profile-similarity indices
- Correspondence measures
Perceptual or computed correspondence scales; measurement approach contested.
Linked to satisfaction and retention; performance links sometimes weak. · Reliability depends on fit operationalization.
Measured via cultural dimension scores, legal environment classifications, strategic alignment indices, and aggregated climate/leadership ratings.
- Culture dimension scores
- Employment law provisions
- Climate survey aggregates
- Strategic alignment indicators
Mixed-mode, often aggregated to unit or organizational levels.
Argued to exert direct effects on KSAOs and performance, not merely moderate validity. · Aggregate reliability depends on within-unit agreement.
Observed and corrected correlation coefficients between predictor and criterion measures, aggregated via meta-analysis.
- Correlation coefficients
- Meta-analytic mean validities
- Corrections for artifacts
Correlation metric (-1 to 1), corrected for unreliability and range restriction.
Central to establishing job-relatedness and legal defensibility. · Estimates stabilized through meta-analytic cumulation across studies.
Ratings and objective indices of task performance, citizenship, counterproductive behavior, adaptability, and safety.
- Supervisory performance ratings
- Objective output measures
- Behavioral records
- Incident reports
Mixed archival and rating measures; source of rating affects intercorrelations.
Multidimensionality per Campbell et al. theory; criterion choice affects predictor usefulness. · Rating reliability depends on rater training and number of raters.
Self-reported ratings of procedural justice, fairness, and satisfaction with selection processes.
- Fairness perception ratings
- Satisfaction surveys
- Withdrawal behavior
Perceptual self-report scales aggregated across applicants.
Reactions can affect the value and effectiveness of practices and applicant pool quality. · Adequate for established justice measures.
Audit whether component methodologies exist, whether they share common data sources, and whether outputs of one feed inputs of another across the end-to-end management cycle.
- Shared data warehouse feeding multiple methods
- ABM outputs feeding scorecards
- Budget linked to strategy map
- Single version of the truth across systems
Best assessed as a maturity index from fragmented to unified.
Grounded in the book's umbrella-concept framing of PM. · Requires consistent audit criteria across evaluators.
Assess presence and quality of a strategy map with linked strategic objectives across perspectives and evidence of discarded non-supportive projects.
- Documented strategy map
- Terminated pet projects
- Weighted strategic objectives
- Line-of-sight paths
Perceptual quality rating combined with artifact review.
Reflects Kaplan-Norton derived framework as presented by Cokins. · Artifact-based portions are reliable; perceptual quality less so.
Determine existence of cascaded weighted KPIs, mix of leading/lagging indicators, and reporting frequency answering 'How am I doing on what is important?'
- Meter gauges and traffic lights
- Vital few (3-4) measures per team
- Web-enabled scorecard dialogues
- Target vs actual comparisons
Combination of artifact review and reporting cadence.
Distinguishes scorecard from mere reporting system. · Depends on consistent classification of leading vs lagging.
Verify existence of an ABM cost assignment network tracing resource expenses through activities to final cost objects using activity drivers rather than arbitrary allocation.
- ABM cost assignment network
- Customer profit and loss statements
- Unit cost trends
- Cost-of-quality attributes
Archival assessment of model design and output accuracy.
ABM is presented as the accepted proven costing solution. · Right-sized (not overengineered) models yield reliable, repeatable outputs.
Assess maturity along the information value chain from raw data capture through ETL, storage, business intelligence, to analytical intelligence.
- Consolidated data warehouse
- Data mining and forecasting tools
- What-if scenario capability
- Position on maturity staircase
Maturity staircase from fragmented/historical to unified/predictive.
Reflects the book's assertion that technology enables but does not replace thinking. · Archival infrastructure assessment is reliable.
Survey or interview employees asking them to describe the strategy and their line of sight to strategic objectives.
- Ability to summarize strategy
- Awareness of contribution
- Reduced helpless reacting
Self-report perceptual scale plus articulation test.
Directly addresses the communication gap the book identifies. · High self-report suitability but subject to social desirability bias.
Analyze project portfolio alignment to strategic objectives and cascaded measure scores; identify degree of suboptimization and goal noncongruency.
- Terminated non-aligned initiatives
- Focused work on vital few
- Coordinated cross-functional efforts
Mixed archival and perceptual assessment.
'Measures drive behavior' underpins this construct. · Portfolio analysis is reliable; behavioral judgment less so.
Assess whether decision processes use predictive models, evaluative metrics, and business modeling to reduce and quantify risk before acting.
- What-if scenario testing before decisions
- Business modeling of proposed strategies
- Willingness to be decisive with facts
Perceptual assessment of decision practices.
Distinguishes leadership (risk-taking) from management (risk-avoiding). · Conditional aggregation; individual leadership varies.
Evaluate whether trade-off decisions demonstrably improve profit margins and value net of costs and balance stakeholder interests.
- Improved profit margins after decisions
- Reduced political self-interest
- Balanced customer/shareholder value
Mixed archival outcome and process assessment.
Central to the book's 'all decisions involve trade-offs' principle. · Difficult to isolate decision quality from external factors.
Measure attainment of strategic objectives and scorecard targets over successive periods.
- Scorecard targets met
- Reduced executive turnover from failed strategy
- Traction on strategic initiatives
Mixed outcome metrics over time.
PM defined as translating plans into results—execution. · Depends on stable strategic objective definitions.
Compute ABM customer P&L statements and profit distribution profiles (fishing pole/whale curves); track migration on the profitability matrix.
- Customer profitability matrix position
- Unrealized profit graph
- Costs-to-serve by segment
Archival monetary measures per customer or segment.
Depends on accurate ABM cost tracing. · Reliable when ABM model is well designed and maintained.
Calculate economic profit as adjusted net income less a capital charge (average invested capital times WACC), and aggregate via economic value decomposition trees.
- Positive economic profit stream
- Reduced cash gap
- ROAIC exceeding WACC
Archival financial measurement over multiple periods.
Accounting profits are not economic profits; capital charge must be included. · Sensitive to cost-of-capital assumptions but approximations are acceptable.
Assess via an inventory of methodologies present (strategy maps, balanced scorecards, ABC, budgeting/forecasting, CRM, supply chain, Six Sigma/lean, capacity planning), the degree of data/system interconnection among them, and use of a shared business-intelligence platform.
- Number of methodologies implemented
- Existence of shared data platform
- Reduction of disconnected spreadsheets
- Cross-methodology data flow
Composite maturity assessment combining systems inventory (archival) and manager perception; no scoring rules prescribed here.
Risk that methodologies exist in name only ('a fool with a tool'); validity depends on genuine, functioning integration. · Systems inventory portion is reliable; perceptual portion may vary by respondent role.
Assess via inventory of analytical models and tools in use, their embeddedness within methodologies (e.g., correlation analysis in strategy maps), and the degree to which decisions are anticipatory versus after-the-fact.
- Presence of predictive/statistical models
- Rolling forecasts and scenario analysis
- Test-and-learn experimentation
- Alert/exception messaging
Maturity assessment along the intelligence hierarchy (raw data to optimization, Exhibit 2.2); mixed archival and perceptual.
Validity depends on data accuracy, completeness, and analytical talent; poor data undermines analytics value. · Tool inventory reliable; assessment of decision-making style more subjective.
Determine costing methodology in use (activity-based vs. broad allocation), examine whether indirect/shared costs are traced by drivers, and compare reported margins against cause-and-effect-based margins.
- Use of ABC/ABM
- Product/channel/customer P&L statements
- Absence of broad-average allocations
- Visibility into hidden overhead costs
Costing stages-of-maturity framework (traditional to expanded ABM, Exhibit 21.7); largely archival/technical.
Precision is a myth—costs depend on assumptions; validity assessed against the causality principle, not absolute 'correctness.' · Methodology classification is reliable; margin comparisons depend on assumptions used.
Assess via employee/manager perceptions of strategy clarity, ability to articulate strategy, trust levels, empowerment, and observed leadership behaviors (coaching vs. command-and-control).
- Employees can articulate the strategy
- Presence of a communicated strategy map
- Coaching/mentoring behaviors
- Willingness to take calculated risks
Perceptual survey-based assessment aggregated across the organization; no scoring rules prescribed.
A key diagnostic (whether employees can explain the strategy) is a strong face-valid indicator Cokins repeatedly cites. · Perceptual measures may vary by hierarchical level and social desirability bias.
Assess via presence and quality of a communication plan (distinct from implementation plan), degree of employee involvement in design (e.g., KPI selection), use of rapid prototyping, and measured resistance levels.
- Existence of a communication plan
- Involvement of employees in method design
- Rapid prototyping with iterative remodeling
- Reduced overt resistance
Perceptual and process-audit based; acts as a moderator on design-lever effectiveness.
Strongly emphasized as make-or-break; validity supported by Cokins's (D×V×F)>R framework. · Process audit reliable; perceptual resistance measures more variable.
Assess via presence of risk assessment maps, key risk indicators, quantified risk appetite and exposure, and integration of risk into strategy and performance processes.
- Risk assessment maps
- Key risk indicators (KRIs)
- Documented risk appetite
- Risk mitigation budgeting
Maturity assessment combining archival (risk artifacts) and perceptual (integration quality); moderator role.
Validity depends on genuine quantification versus vague contingency planning. · Artifact presence reliable; quantification quality varies.
Assess via market-level indicators of volatility, competitive intensity, rate of technological/competitor change, and speed of customer preference shifts.
- Frequency of disruptive competitor moves
- Price/margin pressure
- Shortened product life cycles
- Demand volatility
External/archival market indicators; conditional aggregation depending on industry scope.
A genuinely exogenous contextual condition; moderates the payoff of analytics and integration. · Market indicators reasonably reliable but industry-specific.
Assess via whether employees can articulate the strategy and explain how their weekly/monthly work contributes, and via the presence of cascaded, linked KPIs derived from a strategy map.
- Employees can explain the strategy
- Cascaded KPIs tied to strategy map
- Funded strategic projects/initiatives
- Answer to 'How am I doing on what is important?'
Perceptual survey plus artifact review of strategy maps and cascaded KPIs; mediator role.
The 'can employees articulate strategy?' test is a strong face-valid indicator. · Perceptual measures aggregate reliably at organization level.
Assess via engagement/commitment surveys, degree of involvement in selecting measures, ownership behaviors, and levels of resistance or skepticism.
- Involvement in KPI selection
- Accepted accountability for measures
- Low turnover, high morale
- Active participation in improvement
Perceptual survey-based; mediator role between change management/leadership and alignment.
Face-valid; strongly emphasized as necessary for traction. · Standard engagement measures are reasonably reliable.
Assess via decision cycle times, proportion of decisions using fact-based inputs, use of trade-off/what-if analysis, and post-decision outcome quality.
- Reduced decision cycle time
- Use of analytics in decisions
- Fewer decisions on intuition/politics
- Better predicted vs. actual outcomes
Mixed archival (cycle times, outcomes) and perceptual (fact-based orientation); mediator role.
Validity depends on whether information is actually used ('information is not a decision'). · Archival cycle-time measures reliable; outcome attribution harder.
Measure via customer-level and segment-level profitability, customer lifetime value (CLV/customer equity), retention/attrition rates, cost-to-serve, and marketing spend efficiency.
- Customer P&L statements
- CLV/customer equity scores
- Retention and churn rates
- Share of wallet; profitable sales growth
Archival financial and behavioral metrics; requires ABC and CLV modeling with forecasting assumptions.
CLV involves uncertain assumptions (retention, future spend); sensitive to forecasting models. · Historical profitability reliable; forward-looking CLV subject to assumption variance.
Measure via free cash flow, ROI, economic value added, market capitalization/share price, and cost of capital.
- Positive net free cash flow
- ROI above cost of capital
- Rising market capitalization
- Lower earnings volatility
Archival financial metrics at organization level; the dependent outcome of the model.
Relationship to customer value is optimal not monotonic—overspending on customers can destroy wealth. · Financial metrics are audited and highly reliable, though attribution to PM practices is complex.
The degree to which target descriptions pass the criteria of measurability, observability, reliability, performer control, and active performance, and correctly distinguish behaviors from results.
- Two independent observers agree on counts
- Description passes the Dead Man's Test
- Statements specify what someone does, not who they are
Assessed qualitatively via a pinpoint checklist (yes/no across criteria); no scoring rules prescribed.
Validity depends on the pinpointed behavior being genuinely correlated with the valued result (verified via troubleshooting tool). · Reliability estimated by inter-observer agreement on independent counts of the pinpoint.
The presence, frequency, immediacy, individualization, and graphic quality of feedback, along with whether it is self-monitored and paired with reinforcement.
- Posted or self-kept feedback graphs
- Frequency and immediacy of feedback delivery
- Improvement following feedback introduction
Feedback quality judged against ten characteristics of effective feedback; measurement uses counting or judgment (ranking/rating) as feasible.
Feedback is valid only if it informs the performer which behavior to change; otherwise it is mere information. · Counting yields high reliability; judgment methods require inter-rater reliability training to improve consistency.
The degree to which antecedents are present, clear, immediate, and reliably correlated with the consequences they signal.
- Compliance rate following an antecedent
- Correlation between antecedent and consequence (trust)
- Response to novel versus familiar antecedents
Assessed by antecedent-consequence correlation and behavioral response rates; no formal scale.
Antecedents alone do not cause behavior; validity of the construct rests on its short-term triggering function. · Reliability inferred from consistency of behavioral response across occasions of the antecedent.
The frequency, immediacy, specificity, sincerity, personalization, and positive-to-negative ratio of reinforcers delivered, using reinforcers meeting CARE criteria.
- Entries in a reinforcement log (who, what, when, how)
- Observed increase in the reinforced behavior
- Performer comments and reactions when reinforced
Tracked via reinforcement logs and behavioral outcome; effectiveness defined solely by behavior increase, not by intent.
A consequence is validly a reinforcer only if it increases behavior; delivery errors (delay, insincerity, non-contingency) invalidate the attempt. · Reliability supported by consistent behavioral effects across repeated contingent deliveries.
The classification of reinforcement timing relative to behavior (time-based vs. response-based; fixed vs. variable) and the resulting performance pattern.
- Break-and-run pattern (FI)
- High-and-steady rate (VR)
- Post-reinforcement pause (FR)
- Resistance to extinction
Inferred from timing/frequency of reinforcer delivery; distinctive cumulative response patterns index the schedule.
Well-established from decades of laboratory and applied research; validity high for behavior-pattern prediction. · Schedule effects are highly replicable across species and settings.
The frequency and severity of aversive consequences delivered and the presence of behavioral side effects such as escape, avoidance, and aggression.
- Temporary suppression of behavior
- Escape/avoidance behaviors (hiding, lying, absenteeism)
- Aggression, recovery of behavior when contingency removed
Assessed by frequency of aversive consequences and observed side effects; effectiveness confirmed only if behavior decreases.
Punishment validly decreases behavior only temporarily and never increases desired performance; must be verified as actually aversive to the performer. · Side effects (escape, avoidance, aggression, recovery) are consistently observed across settings.
The degree to which a given consequence increases behavior for a specific performer under current motivating-operation conditions.
- What people choose when given a choice (Premack)
- Reinforcer survey responses
- Behavior increase when a consequence is applied
Identified via asking (surveys), observing (Premack Principle), and testing consequences; revealed by behavior, not self-report alone.
Stated preferences may not predict actual reinforcer value; validity rests on behavioral test. · Value shifts over time with deprivation and satiation, so measures are momentary and not aggregated across individuals.
The frequency of above-minimum, voluntary, initiative-taking, and cooperative behaviors distinguished from mere compliance.
- Volunteering to help others
- Effort above the required minimum
- Positive statements about the company and boss
Observed behaviorally; distinguished from compliance driven by negative reinforcement.
Valid indicator of engagement only when initiative is not required or coerced. · Best assessed through repeated behavioral observation over time.
Percent-safe or percent-correct behavioral observations and frequency counts of pinpointed value-added behaviors over time.
- Behavioral observation checklists
- Percent of safe behaviors performed
- Frequency counts of pinpointed behaviors
Measured by counts and percentages via observation and checklists; graphed over time.
Valid to the extent the behaviors observed are the critical few correlated with valued results. · Reliability enhanced by trained observers and inter-observer agreement.
Archival business metrics such as yield, cost per unit, claims settled per day, accident/recordable rates, turnover, and return on investment.
- Units produced or claims settled per day
- OSHA recordable and DART rates
- Return on investment ratios
Tracked through existing archival organizational records and lagging indicators.
Results reflect behavior only when the behavior-result link is validated; results alone can mislead (correlation vs. causation). · Archival metrics are typically reliable but may lag and obscure behavioral causes.
Assessed by auditing whether the organization operates performance agreements, continuous review, minimal documentation, and forward-looking planning, and by perceptions of process clarity and simplicity.
- Existence of role profiles and performance agreements
- Frequency of interim reviews
- Length/complexity of forms
- Whether treated as continuous vs annual
Feasible via process audit and perceptual survey; no scoring rules specified.
Risk that documented process differs from enacted process. · Audit consistency depends on clear criteria applied across units.
Assessed by whether objectives explicitly reference higher-level goals and whether employees can describe how their work contributes to organizational aims.
- Objectives that reference corporate/team goals
- Employee ability to articulate contribution
- Two-way objective-setting dialogue
Perceptual survey and document review; feasibility only.
Alignment may be espoused but not real. · Depends on consistent interpretation of 'alignment'.
Assessed by auditing the existence and quality of performance measures and the methods used to assess and summarize performance.
- Agreed measures in performance agreements
- Presence/absence of ratings
- Use of visual/matrix assessment
- Verifiability of evidence
Mixed archival and perceptual; feasibility only.
Ratings are subjective and of contested validity; over-quantification can distort. · Consistency of ratings across managers is a known problem addressed via calibration.
Measured by employee reports of the frequency and quality of feedback and coaching received and by 360-degree/attitude survey data.
- Feedback given within days of events
- Feedback based on facts not personality
- Coaching opportunities used
- Employee satisfaction with feedback
Perceptual survey; feasibility only.
Self-report may be biased by relationship quality. · Multiple sources (360-degree) improve reliability.
Assessed by existence and use of personal development plans and perceived usefulness of learning support.
- Completed development plans
- Range of learning activities used
- Follow-through on development actions
Mixed archival and perceptual; feasibility only.
Plans may exist without implementation. · Consistency depends on documentation standards.
Assessed by presence/type of pay linkage (ratings, pay matrix, holistic assessment) and by employee perceptions of reward fairness and motivational effect.
- Use of pay matrix or ratings for pay
- Separation of pay and development reviews
- Recognition practices
Mixed archival and perceptual; feasibility only.
Motivational effect of pay is contested and context-dependent. · Archival pay-linkage data reliable; perceptions vary.
Assessed via perceptions of leadership engagement and observable sponsorship (participation, communication, championing).
- Senior leaders participating in PM
- Leadership communications on PM
- Mission/values articulation
Perceptual survey; feasibility only.
Perceived vs actual support may differ. · Aggregated perceptions improve reliability.
Evidenced by employee reactions, 360-degree/upward feedback and evaluations of review meetings.
- Quality of review meetings
- Employee ratings of manager PM behaviour
- Willingness to conduct reviews
Mixed perceptual and behavioural; feasibility only.
Skill and commitment are distinct and both matter. · Multi-source feedback improves reliability.
Assessed via culture/values surveys and evaluation of fit between process assumptions and prevailing norms.
- Consensus vs command management style
- Openness of feedback culture
- Espoused vs enacted values
Perceptual survey; feasibility only.
Culture is complex and hard to measure directly. · Established culture instruments improve reliability.
Measured via self-reported clarity of expectations and role.
- Employees can state their objectives
- Understanding of standards
- Perceived clarity of role
Perceptual survey; feasibility only.
Directly self-reportable with good face validity. · Established clarity items reliable.
Measured through engagement/attitude surveys including post-review reactions.
- Post-review motivation levels
- Engagement survey scores
- Intent to stay
Perceptual survey (e.g., Gallup-type engagement measures cited); feasibility only.
Well-established engagement constructs available. · Validated engagement scales are reliable.
Best observed behaviourally through extra effort, initiative and willingness to take on responsibility.
- Going beyond job requirements
- Volunteering for extra tasks
- Attention to quality and customer service
Behavioural observation with partial self-report; feasibility only.
Concept drawn from Bath University research. · Behavioural indicators may be difficult to standardize.
Assessed via demonstrated new skills, completion of development actions and competence evidence.
- Evidence of new skills applied
- Completed learning activities
- Improved competence ratings
Mixed behavioural and perceptual; feasibility only.
Application (not just acquisition) is the valid target. · Competence evidence improves reliability.
Measured via self-reported perceived fairness, trust and clarity of mutual obligations.
- Perceived fulfilment of obligations
- Trust in manager/organization
- Clarity of mutual expectations
Perceptual survey; feasibility only.
Established psychological contract measures exist. · Validated scales reliable.
Measured through achievement against agreed objectives, performance standards and competence evidence.
- Objectives met
- Standards achieved
- Competence demonstrated
Mixed archival and perceptual; feasibility only.
Both results and behaviours must be captured (mixed model). · Consistency across assessors is a challenge.
Measured via key organizational metrics such as balanced scorecard financial, operational and people indicators.
- Financial results
- Operational KPIs
- Employee/customer satisfaction
- Continuous improvement behaviours
Archival metrics; feasibility only.
Direct causal attribution to performance management is difficult. · Archival organizational metrics are generally reliable.
Assessed by whether a formal job analysis method (e.g. PAQ, critical incident technique, O*NET) was used, the inter-rater reliability of resulting ratings, and the correspondence between selection content and identified job requirements.
- Documented job description and person specification
- Use of statistical analysis of job data
- Match between test content and job tasks
- Expert consensus on required competences
Assessed archivally and via reliability coefficients; not a self-report scale.
Job analysis validity supported by demonstrations that results make sense and lead to more accurate selection. · Inter-rater reliability higher for specific tasks (~0.77) than for generalized activities or attributes (~0.46-0.61).
Correlation between predictor scores and a criterion of work performance, corrected for restricted range and criterion unreliability (operational validity), and established cumulatively through meta-analysis and validity generalization.
- Validity coefficients
- Meta-analytic mean validities
- Variance accounted for
- Incremental R over other predictors
Expressed as correlation coefficients; feasibility is archival/statistical, not self-report.
Distinguishes core validity types from marginal ones (face, faith, factorial, mythical). · Validity is bounded by predictor and criterion reliability; corrections applied in VGA.
Measured as retest reliability, inter-rater reliability, or internal consistency (alpha) correlation coefficients across a sample.
- Correlation between two administrations
- Agreement between raters
- Alpha coefficient
Reported as correlation coefficients (0 to 1); archival/statistical feasibility.
Reliability is necessary but not sufficient for validity; sets its upper bound. · Standard error of measurement derived from reliability and SD estimates score stability.
Identified by increases in scores relative to honest/research conditions exceeding the error of measurement, or by applicant-vs-present-employee score differences.
- Score increases in selection vs research settings
- Elevated conscientiousness/low neuroticism in applicants
- Lie scale elevations (weak indicator)
Behavioural/statistical detection preferred; self-report of faking is unreliable.
Directed faking overestimates real faking; lie scales are poor detectors and partly measure real traits. · Detection via change scores depends on reliability of the underlying instrument.
Measured by applicant surveys assessing liking for methods, procedural and distributive justice perceptions, and perceived invasion of privacy.
- Favourability ratings of methods
- Intention to accept offer
- Intention to recommend organization
- Complaint/litigation likelihood
Perceptual self-report; feasibility high for surveying applicants.
Many studies use students and hypothetical scenarios, limiting generalizability; direction of cause often ambiguous. · Not detailed; standard survey reliability applies.
Computed from group selection ratios (four-fifths rule) and d-statistics comparing group mean scores.
- Selection ratio below four-fifths of highest group
- Group mean score differences (d)
- Workforce composition vs applicant pool
Archival statistical computation; estimates can be misleading in small or pre-screened samples.
Assesses effect not intent; can be inflated by indirect range restriction or pre-screening. · Small-sample selection ratios fluctuate, sometimes breaching four-fifths by chance.
Represented as the mean standard score (Z) of recruits on the selection test, dependent on validity, applicant pool quality and selection ratio.
- Standard scores of recruits
- Proportion of high scorers accepting offers
- Selection ratio
Mixed: test scores (behavioural) plus acceptance data (archival).
Overestimated if all offers assumed accepted; better applicants may decline, lowering realized calibre. · Depends on reliability of the assessment used to define calibre.
Assessed by job knowledge/achievement tests and work sample performance.
- Job knowledge test scores
- Work sample proficiency
- Speed of learning the job
Behavioural/demonstrated evidence with right and wrong answers.
Job knowledge tests show high validity (up to ~0.62 when content closely job-related); mediate ability-performance link. · Generally high for well-constructed knowledge tests.
Measured by supervisor ratings and/or objective criteria (output, sales, quality, absence, work samples, training grades).
- Supervisor performance ratings
- Production/sales figures
- Absence and turnover records
- Work sample scores
Mixed: subjective ratings and objective archival indices; ratings prone to halo, leniency and bias.
Criterion may be deficient (missing important aspects) or contaminated (irrelevant aspects); supervisor ratings dominated by a large general factor that may reflect halo. · Inter-rater reliability of supervisor ratings modest (~0.52); internal consistency higher (~0.86).
Estimated via utility analysis using SDy (standard deviation of employee value) and the Brogden equation; corroborated by organization-level productivity and profitability correlations.
- SDy estimates (rational estimates)
- Return-on-selection savings
- Firm profitability and sales growth linked to selection practices
Archival/financial estimation; rational estimates may be criticized as subjective and salary-anchored.
Utility estimates may be over-optimistic (assume all offers accepted, ignore interdependence/teamwork); organization-level correlations risk reverse causation. · SDy estimates vary with elicitation wording and order; distribution may not be perfectly normal.
Applicant-reported discrepancies between desired and received information and ratings of the informational content of selection instruments.
- Requests for more information about climate/development
- Perceived informativeness of work samples versus tests
- Reported adequacy of information for self-selection
Percentage-agreement items and Likert-type perceptual ratings used across cited studies.
Well-supported that applicants desire social-psychological organizational information; needs measured relative to current fulfillment. · Multi-item inventories showed acceptable internal consistency in referenced studies.
Perceived situational control ratings and experimental manipulations of representative participation.
- Perceived ability to influence one's result
- Satisfaction under participation conditions
- Preference for methods offering control (e.g., work samples)
Perceptual rating scales; some experimental group comparisons.
Linked to basic control needs; a possible lulling effect complicates performance interpretation. · Limited direct studies; reliability inferred from broader social-psychological measures.
Applicant agreement with transparency-related statements about instruments and semantic-differential transparency scales.
- Clarity about which traits are assessed
- Understanding of scoring/interpretation
- Higher ratings for work samples and interviews
Percentage-agreement items and multi-item semantic differential factor.
Consistently distinguishes accepted from rejected instruments; related to face validity. · Semantic-differential transparency factor emerged reliably across samples.
Ratings of feedback content and form and observed reactions to assessment-center feedback sessions.
- Positive reactions to critical feedback
- Improved self-ratings after feedback
- Perceived helpfulness of feedback session
Perceptual ratings; repeated-measures self-concept change as indirect indicator.
Feedback is a substantial contributor to social acceptability but effects are moderated by person variables. · Indirect via repeated self-concept measures; direct measures limited.
Applicant ratings of recruiter warmth/thoughtfulness and experimental manipulation of interviewer behavior on videotape.
- Eye contact and acknowledging feelings
- Favorable impressions of recruiter and organization
- Willingness to pursue further contact
Likert perceptual ratings; experimental manipulations with manipulation checks.
Robust experimental effects on organizational impressions; effect stronger when recruiter is representative. · Standardized manipulations and multi-item scales support reliability.
Acceptance inventories and perceptual ratings of fairness, comfort, respect, and organizational impressions.
- Ratings of being fairly and respectfully treated
- Impressions of organizational climate
- Acceptance versus rejection of instruments
Multi-factor acceptance inventories (e.g., validity, emotional reaction, stress).
Distinct domains of perception identified (interviewer, climate, commitment, offer likelihood). · Multi-item inventories reported acceptable internal consistency.
Self-concept questionnaires (e.g., SDQ-III adaptation), state self-concept, and stress ratings across repeated occasions.
- Decline then recovery of self-ratings around feedback
- Stress ratings for tasks
- Self-esteem change
Eight-point self-concept scales and semantic-differential stress factor.
Curvilinear changes tied to assessment-measured dimensions support construct relevance. · Repeated-measures design with control groups; reactivity effects noted.
Offer acceptance/rejection rates, self-selection indicators, and observed impression-management or motivational distortion.
- Willingness to accept a job offer
- Withdrawal from selection
- Faking-good on questionnaires
Behavioral and archival indicators plus self-report intentions.
Behavioral outcomes may be driven partly by outcome (offer) and characteristics, not only procedure. · Archival behavioral measures generally reliable; self-reported intentions less so.
Longitudinal self-reports of occupational choice, position, income, responsibility, and job satisfaction.
- Congruence of interests and job
- Reported satisfaction
- Attained occupational level
Single-item and rating-scale self-reports over multi-year follow-up.
Predictability of occupational choice moderate-high; of success low, partly due to weak criteria. · Single-item measures limit reliability; no correction for unreliability applied.
Subgroup selection ratios, adverse-impact analyses, and joint distributions of test scores and job performance.
- Proportion of good workers referred by subgroup
- False rejection/acceptance rates by subgroup
- Compliance with equal-opportunity law
Statistical distributions and legal criteria rather than psychometric scales.
Distinguishes fairness of a measure from fairness of a system; central to public policy analysis. · Depends on quality and size of validation samples; range restriction corrections contested.
Documented job analysis outputs: task and KSA statements, importance/frequency ratings, task-KSA linkage judgments by subject matter experts, and specification of constructs.
- detailed task/KSA lists
- SME linkage ratings
- survey-based importance ratings
- content-validity documentation
Judgment-based ratings (e.g., essential/helpful/not relevant linkages) aggregated across SMEs; feasibility only, no scoring rules specified.
Foundational for content and construct validity; deficiencies here compromise downstream validity inferences. · Enhanced by multiple SMEs and replication; single-informant analyses risk idiosyncrasy.
Construct validity evidence for a predictor: convergent/discriminant correlations, factor structure, item analyses, and job-relevance judgments.
- convergent/discriminant validity patterns
- factor loadings
- reliabilities
- expert construct-relevance ratings
Mixed modes (perceptual, behavioral); feasibility varies by predictor type.
Central to justifying inferences from scores; construct validity evidence is multifarious. · Depends on standardization and measurement mode; consistency across administrations important.
Coded surface features: job-analysis basis, standardized questions, note-taking, behaviorally anchored scales, decomposed and mechanically combined ratings, multiple/trained interviewers.
- presence of structured question protocol
- behavioral rating scales
- mechanical vs. clinical combination
- interviewer training
Continuous/multidimensional construct treated categorically (structured vs. unstructured) for convenience.
Higher structure associated with higher criterion-related validity. · Structure increases inter-rater agreement and reliability of judgments.
Archival and demographic indicators: organization size, strategy type, selection ratios, unemployment/labor supply, workforce composition, and regulatory constraints.
- number of incumbents/applicants
- strategy classification
- selection ratio
- demographic composition
- legal challenges
Primarily archival/objective; aggregation to unit or market level appropriate.
Functions as a moderating condition; may represent situational strength affecting individual-difference effects. · Objective indicators generally reliable.
Accumulated validity evidence: criterion-related coefficients (corrected for artifacts), content/construct evidence, validity generalization, and inferential linkage documentation.
- corrected validity coefficients
- meta-analytic generalization
- content-linkage judgments
- nomological network fit
A theoretical linkage inferred from multiple evidence sources, not a single coefficient; artifact corrections essential.
All validation is construct validation; linkage 5 (test to performance domain) is the central selection inference. · Generalizability across samples/settings assessed via validity generalization.
Self-reported perceived fairness, job-relatedness, and need-to-know; behavioral indicators of faking, coaching, and impression management; behavioral intentions (offer acceptance, recommendations).
- fairness ratings
- withdrawal from process
- offer turndowns
- faking on inventories
- interview self-presentation
High self-report suitability for perceptions; behavioral observation for gaming.
Perceptions can spill over to organizational attractiveness; faking may or may not attenuate validity. · Self-report reactions reasonably measurable; gaming harder to detect.
Job-knowledge tests (declarative), work-sample/skill demonstrations (procedural), and motivational choice indicators; measurement can control which determinants influence scores.
- job-knowledge test scores
- work-sample proficiency
- effort/persistence indicators
Mixed modes; measurement objective determines which determinants are allowed to vary.
Only these three directly determine performance; antecedents (abilities, personality, training) act through them. · Depends on standardization; distinguishing determinants requires careful design.
Supervisory/peer ratings of task proficiency, work-sample performance, and job-knowledge tests reflecting core job behaviors.
- task proficiency ratings
- work-sample scores
- job-knowledge test scores
Behavior-focused; results used only when under individual control.
Distinguished from effectiveness (results) and productivity (output/input). · Ratings improved by behavioral anchors, training, and multiple raters.
Supervisor/peer ratings of citizenship, prosocial, effort, discipline, and allegiance behaviors (e.g., 16-item organizational citizenship questionnaire).
- altruism ratings
- conscientiousness/compliance ratings
- volunteering/initiative
- organizational loyalty
Perceptual ratings; central features common across jobs though peripheral details vary.
Predicted largely by personality/volitional variables; contributes to organizational effectiveness. · Rating-based; subject to halo and rater effects.
Utility estimates (validity x SDy x selected mean minus costs, with discounting, tenure, tax adjustments) and organizational performance indicators; expressible in dollars, output units, or workforce reductions.
- output gains (%)
- dollar-valued utility
- turnover/absenteeism reductions
- quality metrics
Archival/aggregated at organizational level; multiple metrics; NPV for capital-budgeting comparisons.
Credibility depends on realistic parameter estimation; dollar figures often distrusted. · Parameter uncertainty addressed via standard errors, Monte Carlo, or break-even analysis.
Assessed through the presence and quality of task-based and KSA-based analyses, representative incumbent/supervisor surveys, and prioritization of critical tasks and KSAs.
- documented task lists
- documented KSA lists
- survey ratings of task/KSA criticality
- expert observation and interviews
Best captured through archival documentation and expert judgment of comprehensiveness rather than a single scale.
Directly underpins content validity of assessments derived from it. · Reliability enhanced by using large representative samples of incumbents.
Captured by cataloging the specific methods used, their content, mode of administration, and alignment to job requirements.
- selection process documentation
- test manuals and licensing records
- assessment content
Categorical/archival classification of methods in use.
Method choice determines standing on validity, adverse impact, cost, and reactions. · Consistent classification across raters supports reliability.
Evaluated by mapping the constructs measured across all assessments against the full task and contextual performance domain identified in job analysis.
- construct-to-requirement mapping
- inclusion of contextual performance predictors
- weighting of contextual vs technical
Judged qualitatively via domain mapping; not self-report.
Broader coverage shown to raise validity and reduce adverse impact. · Depends on consistent construct classification.
Measured via expenditure on development (expert time, exercise design) and administration (equipment, evaluators, licensing, maintenance).
- dollar development budget
- per-administration cost
- licensing fee schedules
Continuous monetary scale, often summarized as low/high in the evaluation table.
Cost should be weighed against utility gains, not in isolation. · Archival cost records are reliable when consistently tracked.
Assessed by comparing documented validity evidence, adverse impact analyses, and reasonable accommodation practices against regulatory standards.
- validity documentation on file
- adverse impact analyses conducted
- accommodation procedures in place
Compliance judged against legal standards; not a self-report scale.
Compliance coincides with best selection practice per the book. · Depends on consistent legal/technical audit.
Measured via job performance of hires, the number of successful hires relative to prior methods, and turnover/attrition rates.
- performance appraisal outcomes of hires
- proportion of successful hires
- turnover rates
Archival performance and retention metrics, aggregable across cohorts.
Dependent on accurate performance measurement. · Improved by objective, unbiased criteria.
Calculated via utility formulae relating revenue from high-performing hires to assessment costs, incorporating validity, applicant numbers, and tenure.
- revenue-to-cost ratio
- productivity increases
- documented cost savings
Monetary utility estimates from established formulae.
Grounded in staffing utility research (Heneman & Judge). · Sensitive to input parameter estimates.
Rated and behaviorally indexed by rates of misreading, clarification requests, and probing observed when questions are administered, plus expert/cognitive evaluation.
- Low rate of interviewer misreading
- Few respondent requests for clarification
- Low probing demand
- Adequate answers on first reading
Behavioral rates from coded pretest interviews; comparative ratings.
Grounded in the book's three standards for reliable questions; validated against interviewer-effect intraclass correlations. · Coding requires trained coders and stable samples (~25 pretest interviews recommended).
Measured by program length and components (manual, lectures, demonstrations, supervised practice, exercises); manipulated experimentally from half-day to ten days.
- Hours of training
- Presence of supervised practice
- Coded skill ratings post-training
Archival program records; time in minutes/days.
Content held constant across conditions to isolate training intensity effects. · Program delivery standardized across interviewer groups.
Operationalized as supervision level: productivity/response-rate feedback only; plus completed-schedule review; plus tape-recorded monitoring of the interview process with feedback.
- Proportion of interviews monitored
- Use of standardized monitoring forms
- Timeliness of feedback
Categorical levels of supervision intensity.
Levels chosen to replicate common practice and an intensive tape-recording condition. · Monitoring requires trained monitors and common standards.
Recorded demographic attributes (age, gender, race, ethnicity, religion, education, status); effects estimated by comparing matched respondent samples.
- Interviewer-reported demographics
- Respondent-inferred attributes (name, accent, appearance)
Archival categorical variables.
Effects generally negligible except topic-relevant items; interpretation of which answers are 'true' is ambiguous for subjective items. · Demographics reliably recorded; comparability of interviewer pools is a limitation.
Coded from monitored or taped interviews via counts (correct/directive/failed probes, misreadings, recording errors, feedback instances) and satisfactory/excellent ratings.
- Rate of exact question reading
- Directive probe counts
- Verbatim recording accuracy
- Absence of evaluative feedback
Behavior counts per interview and categorical ratings.
Behaviors correlated with intraclass correlations of items. · Requires check-coding; probing is hardest to code reliably.
Assessed via respondent perceptions of whether exact answers were wanted and accuracy was important, and behaviorally via reporting completeness and record-checking.
- Reports that 'exact' answers were wanted
- Higher reporting indices
- Record-checking behavior
Perceptual reports plus archival validation.
Perceptions correlated with reporting quality, especially for higher-education respondents. · Self-reports subject to acquiescence; corroborate with behavior.
Measured via respondent ratings (friendliness, professionalism) and interviewer rapport ratings; effects validated against accuracy records.
- Respondent friendliness/professionalism ratings
- Interviewer rapport ratings
- Post-interview chatting/digression
Rating scales (e.g., 1-10) and categorical preferences.
High rapport can correlate with bias; no single optimal style demonstrated. · Respondents are lenient/insensitive raters of interviewers.
Counted from coded interactions as rates of probing, directive probing, and failure to probe per question.
- High probe counts
- Requests for clarification
- Inadequate initial answers
Behavioral rates per question from taped interviews.
Strongest correlate of interviewer effects among question characteristics. · Reliable with trained coders; ~25 interviews recommended for stability.
Indexed inversely by the intraclass correlation (rho); near-zero rho indicates high standardization.
- Low rho
- Answers not predictable from interviewer identity
Rho computed via analysis of variance under representative subsample assignment.
Requires representative subsamples per interviewer and roughly equal assignments. · Formulas complex; see Kish (1962), Groves & Magilavy (1980).
Detected via direct observation, association of interviewers with answers (intraclass correlation and design effect), and validation against records.
- Nonzero rho
- Inflated design effect (DEFT)
- Discrepancies with validating records
Rho and DEFT multipliers of standard errors.
Effect multiplied by interviews per interviewer; requires special study designs. · Depends on representative interviewer assignments and adequate sample sizes.
Assessed via bias relative to validating records, standard errors/design effects, and reliability coefficients.
- Lower standard errors
- Answers correlating with valid criteria
- Reduced under/over-reporting
Archival and statistical indicators; correlations with criteria for validity.
For subjective items no direct true value exists; inferred from consistency and criterion correlations. · Reliability estimated from variance decomposition; validation studies are rare.
Presence and quality of a value creation map and value narrative, and the extent to which they accurately represent and communicate the organization's strategy.
- existence of a current value creation map
- accompanying value narrative under ~500 words
- cascaded maps for units
- employees able to answer key strategy questions from the map
Assessed qualitatively via document review and perceptual ratings of clarity and completeness.
Face-valid representation of strategy; validity depends on participative development. · Consistency improved by workshop consensus and periodic revision.
Identified and rated set of intangible resources (importance and strength) elicited through interviews, surveys, and workshops.
- skills and know-how
- culture, processes, intellectual property
- reputation, customer/supplier relationships
Relative importance/strength rated (e.g., 0-10) with narrative commentary; proxies used for intangibles.
Context-specific; standalone valuation impossible when interactions are intense. · Triangulation across sources and methods improves reliability.
Identified competencies passing tests of market access, customer benefit contribution, and imitation difficulty, mapped between resources and value proposition.
- areas the organization performs better than others
- competitive advantage sources
- central strategic activities
Assessed via capability audits and relative competitive benchmarking.
Validated by the three Hamel/Prahalad tests. · Consensus workshops reduce subjective variance.
Set of indicators designed via a template specifying strategic element, purpose, data collection method, ownership, targets, reporting, and confidence level.
- indicators mapped to value creation elements
- narrative plus traffic-light assessments
- documented confidence levels
Indicators may be numerical, narrative, symbolic, or colour-coded; feasibility over scoring emphasized.
Confidence level captures how well an indicator assesses the intended element. · Consistent definitions and documentation reduce ambiguity.
Perceived degree to which measures are imposed, linked to rewards/targets, and used in 'on trial' style reviews.
- gaming of measures
- defensive reasoning in reviews
- fear and protectionism
Perceptual climate ratings; higher scores indicate stronger control orientation.
Contrasted with enabled learning environment as its opposite pole. · Employee perception surveys can provide aggregate reliability.
Perceived presence of line-of-sight relationships, sense of community, common purpose, systems thinking, and forward-looking improvement meetings.
- constructive Strategic Performance Improvement Meetings
- willingness to share insights
- low blame, high dialogue
Perceptual survey ratings aggregated at unit/organization level.
Grounded in social capital and 'Ba' concepts. · Multi-source perceptions improve reliability.
Degree of alignment among employees' stated interpretations of the organization's strategy and value proposition.
- consistent descriptions of strategy across roles
- engagement with value creation map
- sense of common purpose
Perceptual; measured by convergence of interpretations across levels.
Face-valid indicator of communication effectiveness. · Aggregation across many respondents increases reliability.
Observed frequency and quality of assumption testing, dialogue, and strategy refinement in review processes.
- testing/validating causal models
- revising business model
- collaborative decision-making in meetings
Behavioral coding of meetings and evidence of strategy revision.
Distinguished from mere reporting or compliance. · Observer coding requires clear protocols for reliability.
Assessed via outcomes of decisions, validated causal models, risk logs, and M&A/pre-merger assessments.
- confirmed value creation relationships
- completed risk logs
- pre-merger value creation map comparisons
Mixed archival and perceptual evidence of decision quality.
Supported by fact-based analysis examples (Sears, Calia Salotti, Shell). · Depends on data availability and analytic rigor.
Composite of customer and employee satisfaction, financial results, reputation, and competitive advantage indicators in strategic context.
- higher satisfaction scores
- reduced attrition
- revenue/cost improvements (e.g., Fujitsu results)
Mixed archival financial and perceptual satisfaction indicators.
Must be put into strategic context to be meaningful. · Triangulated indicators improve reliability.
Documented linkage of each interview item to job analysis results, importance/time-spent ratings of duties, and appropriate complexity level, reviewed by job experts including protected-group members.
- item-to-requirement mapping documentation
- duty importance ratings
- expert bias review records
Assessed as procedural completeness/quality via audit rather than a numeric scale.
Content validity supported by explicit job analysis and expert review; central to legal defensibility. · Reproducibility supported by independent expert reclassification of analysis inputs.
Comparison of the fixed question list administered to all candidates and observation of the absence of follow-up probing during interviews.
- fixed interview schedule
- interview transcripts showing uniform questioning
Binary/procedural fidelity assessment.
Supports comparability of candidate responses; foundational to standardization. · Improves consistency of the stimulus across administrations.
Existence of anchored scoring keys (5/3/1 example answers) for each item generated by job experts and personnel representatives.
- documented scoring key per item
- example answers derived from job experts
- cutting score via Angoff procedure
Quality audit of scoring documentation; item scoring uses 1-5 anchors operationally.
Explicit scoring is essential to justifying content validity. · Anchoring enhances consistency and objectivity across raters.
Panel composition (typically three: two supervisors and a personnel representative), rater-error training completion, and independent recording of ratings during interviews.
- panel roster
- training program records
- independent rating sheets
Procedural fidelity plus derived interrater indices.
Reduces single-interviewer bias per Validation Principles. · Directly linked to high interrater reliability observed (.88).
Procedural audit confirming same member asks all questions, no discussion of candidates between interviews, extensive note taking, and unit weighting of averaged item ratings.
- administration protocol
- note records
- averaging/weighting procedure
Procedural compliance assessment.
Minimizes changing standards and comparison bias. · Supports stable measurement across candidates and time.
Completeness of documentation (job analysis, responses/scores, validity evidence, adverse impact analyses) and compliance with Uniform Guidelines and Validation Principles.
- validation report
- adverse impact statistics
- documentation package
Compliance/completeness audit.
Enhances likelihood of validity and legal defensibility. · Documentation supports reproducibility of the process.
Composite index inferred from the fidelity of standardization levers and evidenced by rater consistency and agreement metrics.
- interrater agreement
- consistency of scores
- procedural fidelity checks
Latent construct indexed via multiple procedural and psychometric indicators.
Proposed method-based mechanism for reliability and validity. · Manifested in the high observed interrater reliability.
Assessed via correlations of interview scores with cognitive aptitude tests and content coverage of job knowledge and ability requirements.
- interview-test correlations (multiple r up to .75 corrected)
- content coverage analysis
Correlational/construct-oriented assessment.
Construct validity evidence from strong test correlations. · Internal consistency of interview items was .72, indicating some heterogeneity.
Correlation between interview scores and behavioral observation performance appraisal collected six months after hire, corrected for range restriction and criterion unreliability.
- r = .34 uncorrected
- r = .56 corrected
Validity coefficient (correlation).
Comparable to cognitive aptitude tests and far above traditional interview (.14). · Criterion (performance appraisal) interrater reliability was .76.
Moderated regression testing intercept and slope differences by race and sex, with unfairness defined as underprediction of protected-group performance.
- no slope differences by race/sex
- common line slightly overpredicts minorities/females (not unfair)
Regression-based statistical fairness tests.
Fairness demonstrated; overprediction is not unfair to protected groups. · Based on same reliable interview and criterion measures.
Computed via Schmidt et al. (1979) utility formulas using validity, selection ratio, mean standard score of selectees, SD of performance in dollars, and costs.
- ~$100,000-$168,000 first-year gain for 149 hires
- >$1 million over 10 years NPV
Dollar-valued estimate.
Comparable to aptitude tests despite higher development costs. · Depends on accuracy of SD-of-performance estimate ($5,000/yr).
Assessed by the presence of interview guides with predetermined questions, consistency of questions/topics across candidates, and use of standardized scoring.
- Interview guides in use
- Same KSAs assessed per role
- Predetermined question banks
- Documented rating scales
Mixed measurement: archival (guides) plus behavioral observation of interview conduct.
Cited as up to twice as predictive as unstructured interviews (0.63 vs 0.38). · Associated with higher inter-rater reliability (0.67-0.74 vs 0.37).
Measured by presence of defined rating scales (e.g., BARS, proficiency scales), clarity of anchor descriptors, and alignment to job profile KSAs.
- Written evaluation criteria documents
- Behavioral anchors for scale points
- Consistent scale application across interviewers
Archival assessment of criteria documents; scale choice (3-, 4-, or 5-point) documented.
Job-related, pre-defined criteria enhance content validity and defensibility. · Clear anchors and calibration reduce central tendency and strictness biases.
Evidenced by training completion, post-training knowledge checks, and calibration/audit activities comparing scoring across interviewers.
- Training records and quizzes
- Scoring audits
- Calibration sessions
- Consistent use of full rating range
Mixed: archival records plus behavioral audit of scoring consistency.
Supports valid application of structured methods; poorly trained interviewers can undermine validity. · Directly targets inter-rater reliability improvement.
Documented screening methods, stage sequencing, and applicant flow decisions tailored to volume and role type.
- Defined screening steps
- ATS applicant flow data
- Stage-specific rigor decisions
Primarily archival via ATS and process documentation.
Appropriate funnel design ensures rigor is applied where it adds most value. · Consistency depends on documented, repeatable stage design.
Assessed via documentation of job-relatedness, adverse impact analyses, consent and data retention practices, and adherence to regional laws (e.g., Civil Rights Act, GDPR).
- Validation/job analysis records
- Adverse impact calculations
- Consent forms and secure storage
- Retention schedules
Archival compliance review; region-specific.
Compliance underpins the legal defensibility of otherwise valid selection processes. · Consistent documentation practices improve auditability.
Inferred from rating-evidence discrepancies, adverse impact patterns, and biases such as halo/horns, similarity, confirmation, anchoring, and recency effects.
- Ratings not supported by notes
- Systematic group differences in outcomes
- Snap judgments and 'red flags' unrelated to KSAs
Behavioral/archival inference; difficult to self-report accurately.
Central threat to selection validity and fairness; cannot be fully eliminated. · Detected via audits comparing evidence to ratings across interviewers.
Measured via inter-rater reliability coefficients across interviewers scoring the same candidates or KSAs.
- High inter-rater reliability coefficients
- Consistent scoring across raters
- Aligned use of criteria
Archival: reliability coefficients (e.g., 0.67-0.74 for structured).
Precondition for predictive validity. · This construct is itself a reliability metric of the process.
Assessed via candidate experience surveys and perceptions of fairness and respect during the process.
- Positive candidate feedback
- Low complaint rates
- Willingness to reapply or refer
Perceptual self-report from candidates.
Linked to employer brand and willingness to engage fully in the process. · Survey-based measures can be aggregated across candidates.
Correlation between selection scores/ratings and subsequent on-the-job performance measures.
- Validity coefficients (e.g., 0.63 structured vs 0.38 unstructured)
- Concurrent/predictive validation study results
Archival correlation; requires performance criterion data.
The book's core outcome claim for structured, job-relevant assessment. · Depends on reliable predictors and criteria.
Assessed via adverse impact analyses, quality of documentation, and legal challenge outcomes.
- No/limited adverse impact
- Robust job analysis and rating records
- Favorable or absent legal outcomes
Archival compliance and outcome review.
Depends on job-relatedness and documentation quality. · Consistent processes produce reproducible, defensible records.
Measured via performance reviews, retention/turnover rates, and early-tenure failure rates.
- High performance ratings
- Low early turnover (e.g., <18-month failure)
- Long tenure
Archival performance and HR data.
Ultimate business-relevant outcome of the model. · Depends on reliable performance and tenure data.
Calculated via interviewer time-in-dollars, number of interviews per hire, and turnover-related replacement/legal costs.
- Reduced interviews per hire
- Lower time-per-candidate
- Cost savings estimates (e.g., $462 per candidate)
Archival cost/time calculations.
Cost figures are illustrative estimates; underestimation acknowledged by authors. · Depends on consistent time and cost tracking.
Document analysis of template content, revision frequency, and alignment with stated organizational goals and life-cycle stage.
- template updated within last two to three years
- competencies match current strategic initiatives
- distinct templates for different workforce types
Assess feasibility via archival review; not survey-based.
Content validity depends on comparison against organizational strategy documents. · Reliable when multiple reviewers code template features against a rubric.
Comparison of descriptor language against benchmark traditional versus enhanced phrasing categories.
- proactive versus reactive wording
- subject-matter-expert level expectations
- specificity of behavioral descriptions
Coded categorically from document analysis.
Face valid based on the book's example comparisons. · Inter-rater agreement feasible with coding guidelines.
Presence of calibration sessions, score distribution shape versus bell curve, and departmental variance statistics.
- documented pre-review scoring meetings
- score distribution approximating bell curve
- interdepartmental variance indices
Mixed archival and process observation.
Validity supported by statistical distribution analysis. · Statistical measures are reliable; process presence is binary observable.
Analysis of compa-ratio progression, salary increase matrix funding levels, and time to midpoint.
- compa-ratio progression trend line
- meaningful percentage differentiation between performance levels
- time to reach midpoint
Archival payroll and compensation data.
Objective financial data provides strong validity. · Highly reliable given payroll records.
Classification based on financial, operational, and structural indicators.
- cash flow stability
- sales growth rate
- organizational structure formality
- risk posture
Categorical classification; not aggregatable.
Validity from established organizational life-cycle theory. · Reliable with defined stage criteria.
Employee perception surveys, focus group feedback, and communication frequency counts.
- number and clarity of announcements
- employee-reported understanding
- focus group participation
Perceptual self-report feasible.
Perceptual measures valid for buy-in construct. · Survey reliability depends on instrument design.
Employee perceptions of trust, development opportunities, and leadership beingness.
- reported autonomy
- availability of rotational assignments and training
- perceived caring leadership
Perceptual self-report at team level.
Aligns with self-determination concepts. · Reliable with validated climate items.
Climate surveys, stay-interview responses, and engagement indices.
- survey engagement scores
- stay-interview happiness ratings
- willingness to recommend employer
Perceptual self-report; aggregatable to group.
Consistent with engagement literature. · Reliable with established engagement instruments.
Tracking of quarterly achievement calendar entries, self-evaluation bullet points, and goal completion.
- documented achievements in dollars/percentages
- resume-worthy accomplishments
- goal completion rates
Behavioral records feasible.
Behavioral evidence gives strong validity. · Reliable via documented records.
Overall performance review scores combined with quantified achievement metrics.
- overall appraisal score
- revenue generated
- costs saved
- time saved
Mixed perceptual and behavioral/archival.
Validity strengthened by calibration and quantified metrics. · Reliability improved by consistency practices.
Voluntary versus involuntary turnover rates segmented by performance score.
- turnover rate of 4s and 5s
- exit interview reasons
- retention risk ratings
Archival turnover data.
Objective turnover data provides strong validity. · Highly reliable from HR records.
Enterprise performance dashboards, 9-box distributions, and human capital ROI metrics.
- 9-box roll-up placement
- enterprise overall scores over time
- HCVA and HCROI metrics
Archival aggregation; not self-report.
Validity depends on accurate underlying individual scores. · Reliable when calibration ensures consistent inputs.
Assessed through a combination of perceptual measures of distal factors (e.g., perceived economic, legal, technical environment; culture, climate, values) and archival/objective descriptions of proximal and administrative conditions.
- Perceived munificence/turbulence of environments
- Organizational complexity and coordination
- Group composition and norms
- Consequences attached to ratings
Distal factors via perceptual scales; proximal/administrative via classification or archival records.
Perceived context may diverge from objective context; both are relevant to behavior. · Multi-item perceptual measures improve reliability of climate/culture assessments.
Measured by documenting the organizationally specified purposes and by surveying raters' beliefs about how ratings will be used.
- Stated administrative vs. developmental use
- Rater beliefs about consequences of ratings
Categorical classification of purposes plus perceptual ratings of perceived purpose.
Actual and perceived purposes may differ, both affecting behavior. · Consistency between stated and perceived purpose can be checked.
Documented via description of scale format, rating sources, frequency, participation, training, comparison basis, and communicated information.
- Type of rating form
- Number and level of raters
- Appraisal frequency
- Presence of appeal or participation mechanisms
Primarily archival/categorical documentation of system design.
Formal features may differ from actual practice. · System documentation is generally stable and reliably coded.
Inferred through a construct-validation-like process combining limited self-report with behavioral and choice-based inference (e.g., preferences among appraisal outcomes).
- Patterns of inflation across ratees
- Discrepancies between recorded ratings and feedback given
- Choices among outcome scenarios
Combine self-report with inference; direct self-report alone is insufficient.
Raters may be unaware of or unwilling to disclose goals, threatening self-report validity. · Multi-method triangulation improves reliability of goal inference.
Approximated through judgments obtained under conditions minimizing distortion (e.g., research or confidential ratings), and through cognitive process measures.
- Behavior recognition accuracy
- Consistency of confidential evaluations
- Integration patterns across time
Perceptual/evaluative ratings under low-consequence conditions approximate judgment.
Judgment is not directly observable and differs from recorded ratings. · Multiple raters or occasions improve estimation of underlying judgment.
Modeled via multiattribute utility/expectancy assessment eliciting valued outcomes, their perceived probabilities, and values under accurate vs. inflated rating strategies.
- Elicited outcome values and probabilities
- Degree of inflation under differing consequence conditions
Utility/expectancy elicitation rather than a single scale.
Social desirability may bias self-reported motives. · Structured elicitation improves consistency of estimates.
Measured directly from recorded appraisal scores and their distributional properties (e.g., mean level, variability, intercorrelations).
- Recorded rating scores
- Distribution shape
- Discrepancy from judgment/feedback
Archival rating data; distributional statistics computed at rater or unit level.
Distributional 'errors' do not necessarily indicate inaccuracy. · Recorded ratings are directly observable and stable as recorded.
Assessed through utility estimates for relevant outcomes, reaction criteria, practicality criteria, decision-process criteria, and goal-attainment measures tied to the system's purposes.
- Utility (e.g., productivity gain) estimates
- Improvement in targeted goals (e.g., motivation, feedback quality)
- Perceived usefulness
Multiattribute utility scaling and outcome-specific criteria; metric should match goals.
Context-free accuracy is an inadequate proxy for effectiveness. · Multiple criteria and designs strengthen inference about effectiveness.
Measured via perceptual surveys of procedural and distributive fairness, satisfaction, and perceived accuracy and utility.
- Fairness ratings
- Satisfaction with appraisal
- Acceptance of outcomes
Perceptual scales aggregated across raters and ratees.
Reactions depend on both process and outcome features. · Multi-item justice/satisfaction scales are typically reliable.
Assessed by the presence, specificity, and strategic alignment of a written scorecard for a given role, including a mission statement, 3-8 ranked outcomes, and a tailored competency list.
- Written scorecard exists per role
- Outcomes are objective/measurable
- Stakeholders agree on the role without clarifying questions
- Cultural competencies appear on every scorecard
Best captured as a presence/quality rubric applied to documents; not a self-report scale.
Face validity high; case histories (Sewickley, Centerbridge) show alignment predicts fit. · Consistency improves when scorecards are standardized across roles.
Measured by frequency of sourcing activity, share of hires from referrals, and use of tracking systems, deputies, recruiters, and researchers.
- Weekly sourcing time blocked
- High referral hire percentage
- Maintained candidate lists/databases
- Referral bonus programs
Behavioral/archival counts (e.g., candidates sourced per year, referral rate).
77% of interviewed leaders cite referrals as top technique; supports construct relevance. · Stable when embedded in scorecards and recurring calendar routines.
Measured by adherence to the four standardized interviews (screening, Who, focused, reference) and completion of rated scorecards.
- Standardized question sets used
- Chronological career walk-through conducted
- Scorecard ratings recorded
- Seven reference calls completed
Protocol-adherence checklist; behavioral observation of interview practice.
Supported by claim that structured/biographical interviewing is the most valid predictor per decades of I/O research. · Standardization across candidates enhances inter-rater consistency.
Measured by attention to the five F's and by sustained engagement across the five selling waves through offer acceptance and onboarding.
- Tailored appeals to candidate's dominant F's
- Engagement of candidate's family
- Consistent follow-up between offer and start
- Strong onboarding in first 100 days
Behavioral touchpoint tracking plus offer-acceptance and early-retention rates.
Illustrated by multiple executive recruiting cases (Malone, Howard, Buckley). · Depends on consistent, sincere application; conditional aggregation across hires.
Inferred from consistency between candidate self-reports and reference data, and from responses elicited via TORC, reciprocity, and curiosity probing.
- Candidate volunteers real weaknesses
- Ratings match reference feedback
- Absence of body-language stop signs
- Detailed, specific stories vs generalities
Perceptual/inferential; not a direct self-report scale.
TORC examples (Dimon, VP-of-sales slap story) demonstrate elicitation of candor. · Sensitive to interviewer skill; lower reliability without protocol adherence.
Measured by rated scorecards assigning A/B/C grades on skill (outcomes) and will (competencies) and explicit 90%+ confidence judgments.
- Completed skill-will bull's-eye rating
- Explicit 90% confidence statements
- Documented strengths/weaknesses per outcome
Self-reported confidence tied to a structured rating rubric (A/B/C).
Grounded in accumulated interview facts rather than gut instinct. · Improved by tandem interviewing and cross-checking with references.
Assessed by comparing candidate track record and demonstrated competencies to scorecard outcomes and cultural competencies.
- Accomplishments match role outcomes
- Competencies match required list
- Behavior consistent with cultural adjectives
- Enthusiasm aligned to the role
Mixed perceptual and archival comparison against scorecard.
1-in-3 leaders cite ignoring cultural fit as a top failure cause, supporting relevance. · Consistency higher when cultural competencies are explicitly defined.
Assessed via Who Interview trait ratings distinguishing fast-and-focused (Cheetah) from collaborative-and-deliberate (Lamb) profiles.
- Rapid decisive moves
- Killing unprofitable lines quickly
- Holding people accountable
- Setting and enforcing high standards
Perceptual trait ratings from structured assessment; used categorically (Cheetah vs Lamb).
University of Chicago study of 313 CEOs found Cheetah traits statistically predictive of success. · Based on standardized SmartAssessments; generalizability beyond private equity untested.
Measured by hiring success rate (target 90%+) and post-hire achievement of scorecard outcomes.
- Percentage of hires rated A
- Delivery against scorecard outcomes
- Low early-departure/mishire rate
Archival performance metrics and success-rate percentages.
Cases (Zillmer's 90% success rate; Centerbridge 90%) support measurability. · Requires consistent post-hire outcome tracking.
Measured via company value/stock growth, deal returns, competitive performance, and manager-reported income, satisfaction, and time.
- Stock or valuation increases
- High deal multiples
- Manager reports better work-life balance
- Team energizes and self-replicates A Players
Primarily archival financial metrics plus self-reported quality-of-life indicators.
Supported by cases (Middleby +3,500%, Allied Waste +67%) and leader survey attributing >50% of success to talent. · Financial metrics reliable; personal outcomes rely on self-report.
Your feedback loop · assess yourself
Rate yourself on the model's forces
This is a structured self-diagnostic built from the model — a mirror for reflection, not a validated psychometric scale. For validated measurement, see the instruments below.
1 = Strongly Disagree · 7 = Strongly Agree
- Before I design an assessment, I conduct a systematic analysis of the role's critical tasks and the knowledge, skills, abilities, and other characteristics required to perform it.
- The competency model I use relies on vague traits or generic labels rather than specific, observable, job-relevant behaviors.(reverse)
- I select and construct assessment methods, such as work samples or structured interviews, based on evidence of what actually predicts job performance for the role.
- I administer, score, and combine information the same standardized way for every candidate or respondent I assess.
- I have received hands-on training and calibration practice on observing, recording, and coding behavior consistently with other assessors before rating candidates.
- My completed work consistently meets quality and timeliness standards and delivers measurable value toward my goals.
- The assessment tools I use have not been checked against actual job performance data to confirm they predict what they claim to measure.(reverse)
- I can point to concrete cost savings or productivity gains that resulted from the selection or performance processes I helped implement.
- When different raters or occasions review the same evidence, they arrive at closely matching ratings.
- I regularly check my selection and appraisal outcomes for adverse impact across demographic groups and can document the process if challenged.
- I feel energized and personally invested in my work most days.
- Candidates who go through my assessment process often tell me it felt irrelevant, disrespectful, or unfair.(reverse)
- I can clearly explain how my day-to-day priorities and tasks connect to my organization's overall strategy.
- When rating someone, I sometimes find my judgment shaped by gut feelings about cultural fit rather than by documented evidence of their behavior.
- I know exactly what results and standards I need to hit to be considered meeting versus exceeding expectations in my role.
- When designing or interpreting assessments, I take into account factors like organizational culture, legal context, and labor market conditions that could affect results.
- Senior leaders and line managers in my organization show little visible commitment to supporting or properly using assessment and performance management practices.(reverse)
- I use data management and analytics tools, including predictive analytics, to inform and improve assessment and performance decisions.
Proposed measures — starter instruments where no validated one was found
Work Outcome Quality & Impact Index
proposed · not validatedRated for your team or hiring process — not a personal self-check.
- Completed work products meet documented acceptance criteria before being marked done.
- Deliverables are submitted on or ahead of agreed deadlines across the last quarterly cycle.
- Work outputs are traceable to measurable business or customer impact reported by stakeholders.
Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.
Role Requirement Definition Rigor Index
proposed · not validatedRated for your team or hiring process — not a personal self-check.
- Each role has a written task inventory ranked by criticality that is updated at least annually.
- Required KSAOs and competencies for each role are documented and linked to specific tasks before hiring or promotion decisions begin.
- Role requirement documents include anticipated future task or skill shifts validated by incumbents and managers.
Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.
Assessment Predictive Accuracy Index
proposed · not validatedRated for your team or hiring process — not a personal self-check.
- Assessment scores are statistically compared against actual on-the-job performance data on a recurring schedule.
- Documentation exists showing the assessment measures the specific competencies it claims to measure.
- Score-performance correlation results are reviewed and used to revise or retire assessment items that fail to predict outcomes.
Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.
Sources
- 263074003-Competency-Dictionary
- A Practical Guide to Assessment Centres and Selection Methods Measuring Competency for Recruitment and Development — Ian Taylor M.B
- Assessment Methods in Recruitment, Selection Performance A Managers Guide to Psychometric Testing, Interviews and Assessment… — Robert Edenborough
- Competency Mapping and Assessment Manual - User Guide
- HBR Guide to Performance Management. HBR Guide to Coaching Employees. HBR Guide to Delivering Eff ective Feedback. HBR Guide to… — Harvard Business Review
- HBRs 10 Must Reads on Performance Management — Harvard Business Review
- Hiring Success The Art and Science of Staffing Assessment and Employee Selection — Steven Hunt
- How to Measure Employee Performance (The performance management series) — Jack Zigon
- Job analysis a guide to assessing work activities — Gael, Sidney
- Managing Staff Selection and Assessment (Managing Work and Organizations Series) — Paul Iles
- Oxford Handbook of Personnel Assessment and Selection (Schmitt, Neal
- Performance Management - Finding the Missing Pieces (to Close the Intelligence Gap) — Gary Cokins
- Management: Tasks, Responsibilities, Practices — Peter F. Drucker
- Management: Tasks, Responsibilities, Practices — Peter F. Drucker
- GUIDELINES - Testing and Assessment
- Personnel Selection Adding Value Through People, Fifth Edition (Mark Cook
- Personnel Selection and Assessment — Heinz Schuler James L. Farr Mike Smith
- Personnel Selection in Organizations — Neil Schmitt, Walter C. Borman
- Selection-Assessment-Methods
- Standardized Survey Interviewing - Minimizing Interviewer Error
- Strategic Performance Management Leveraging and Measuring Your Intangible Value Drivers — Bernard Marr
- Structured_Interviewing_Raising
- The Hiring Handbook A Toolkit for Recruitment, Assessment, and Selection Success — Kasey Harboe Guentert, Mollie Berke
- The Performance Appraisal Tool Kit
- Understanding performance appraisal social, organizational, and goal-based perspectives — Murphy, Kevin R., 1952-, Cleveland etc.
- Who The A Method for Hiring — Geoff Smart Randy Street
The cheat sheet
Everything, on one page
One essential takeaway per section — the claim ledger of the whole guide, scannable in a minute.
- Job & Role Analysis / Requirement DefinitionDerive selection criteria from evidence about what differentiates performance, not from the job description.
- Competency / Criterion Framework QualityReplace trait labels with observable behavioral indicators that two assessors could agree on.
- Assessment / Activity Method Design & ChoiceSelect methods by which competency they can validly elicit, not by convention.
- Structure & Standardization of ProcedureStandardize questioning AND scoring AND how information is combined — partial structure leaks validity.
- Assessor/Rater Training & CalibrationPractice coding real evidence, don't just explain the framework.
- Reliability / Inter-Rater ConsistencyReliability enables validity but never substitutes for it.
- Validity / Predictive AccuracyFace validity is not predictive validity — measure predictions against real outcomes.
- Rater Bias & Evaluation ErrorBias is reduced by structure and calibration, not by exhortation to be fair.
- Observable Behaviour / Construct CoverageScore behavior you observed, not traits you inferred.
- Goal Setting & Objective AlignmentTie every goal to a named strategic objective so people see the connection.
- Feedback & CoachingFeedback's value decays with delay — deliver it close to the behavior.
- Development Planning & Capability BuildingBuild plans from assessed gaps, not from available course catalogs.
- Reward, Recognition & Compensation LinkagePerceived fairness of allocation predicts motivation more than absolute reward magnitude.
- Performance Management Process DesignContinuous PM demands more manager discipline than the annual model it replaces.
- Measurement / Scorecard SystemA few weighted leading indicators outperform a long list of lagging ones.
- Enabling Data, Analytics & TechnologyAnalytics scale the quality of your data and questions, including their flaws.
- Strategic Alignment & Shared UnderstandingAwareness of strategy is not the same as alignment to it.
- Goal Clarity & Shared ExpectationsClarity requires defining 'exceeds' concretely, not just naming the target.
- Motivation & EngagementExtrinsic rewards protect motivation more than they create it.
- Self-Awareness & Skill GrowthFeedback changes behaviour only once the recipient accepts it as valid.
- Candidate/Applicant Reactions & Perceived FairnessFace validity and transparency drive acceptance independent of statistical validity.
- Applicant Faking / Truthful DisclosureFaking distorts rank order, not just adds cancellable noise.
- Candidate Attributes / KSAOsCognitive ability and relevant personality facets usually out-predict raw experience.
- Person-Role / Culture FitFit is need-supply congruence, not resemblance to the existing team.
- Accountable & Productive Work BehaviourOwnership rises when people co-author their commitments, not when they are assigned to them.
- Rating / Selection Decision QualityConsistency and accuracy are different properties; you can have one without the other.
- Individual / Job PerformanceDefine performance dimensions per role before measuring, or you will measure the measurable rather than the important.
- Retention & Talent GrowthGrowth opportunity retains top talent more reliably than counteroffers do.
- Fairness, Adverse Impact & Legal DefensibilityAdverse impact accumulates across stages, so analyze each gate separately.
- Organizational Utility & Financial ValueUtility scales with performance variance and selectivity, not just predictor validity.
- Sustainable Organizational PerformanceOrganizational performance is an emergent property of alignment, not a sum of individuals.
- Organizational & Environmental ContextValidity is context-dependent; re-verify before transferring a method across settings.
- Leadership Support, Manager Capability & Buy-InManager capability, not process design, is usually the binding constraint on performance systems.
- Appropriate Psychometric & Norm UseValidity is conditional on role, population, and norm group—not a fixed property of the instrument.
- Organizational Learning & Surrogation AvoidanceEvery metric is a proxy that can be gamed; keep the underlying goal explicit alongside it.
- Team Infrastructure & CompositionTeam performance depends on enabling structure more than on interpersonal chemistry.