Assessment criteria — DevOps Engineer Senior DevOps Engineer

Evaluation criteria 32

• 01Delivers on: Optimize CI/CD workflows.

  canon · responsibility · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 02Delivers on: Mentor junior engineers.

  canon · responsibility · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 03Delivers on: Design and implement infrastructure solutions.

  canon · responsibility · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 04Delivers on: Lead automation initiatives.

  canon · responsibility · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 05Delivers on: Ensure system reliability and scalability.

  canon · responsibility · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 06Performs to standard: Troubleshoot program and system malfunctions to restore normal functioning.

  O*NET task · observed · IM 4.24
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 07Performs to standard: Provide staff and users with assistance solving computer-related problems, such as malfunctions and program problems.

  O*NET task · observed · IM 4.05
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 08Performs to standard: Test, maintain, and monitor computer programs and systems, including coordinating the installation of computer programs and systems.

  O*NET task · observed · IM 4
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 09Performs to standard: Use the computer in the analysis and solution of business problems, such as development of integrated production and inventory control and cost analysis systems.

  O*NET task · observed · IM 3.97
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 10Performs to standard: Coordinate and link the computer systems within an organization to increase compatibility so that information can be shared.

  O*NET task · observed · IM 3.78
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 11Performs to standard: Use object-oriented programming languages, as well as client and server applications development processes and multimedia and Internet technology.

  O*NET task · observed · IM 3.71
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 12Performs to standard: Analyze information processing or computation needs and plan and design computer systems, using techniques such as structured analysis, data modeling, and information engineering.

  O*NET task · observed · IM 3.6
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 13Performs to standard: Review and analyze computer printouts and performance indicators to locate code problems, and correct errors by correcting codes.

  O*NET task · observed · IM 3.6
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 14Performs to standard: Consult with management to ensure agreement on system principles.

  O*NET task · observed · IM 3.57
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 15Performs to standard: Specify inputs accessed by the system and plan the distribution and use of the results.

  O*NET task · observed · IM 3.48
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 16Performs to standard: Expand or modify system to serve new purposes or improve work flow.

  O*NET task · observed · IM 3.47
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 17Performs to standard: Interview or survey workers, observe job performance, or perform the job to determine what information is processed and how it is processed.

  O*NET task · observed · IM 3.44
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 18Effectiveness at: Test computer system operations to ensure proper functioning.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 19Effectiveness at: Implement security measures for computer or information systems.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 20Effectiveness at: Collaborate with others to determine design specifications or details.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 21Effectiveness at: Collaborate with others to resolve information technology issues.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 22Effectiveness at: Analyze data to identify trends or relationships among variables.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 23Effectiveness at: Analyze data to identify or resolve operational problems.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 24Effectiveness at: Create databases to store electronic data.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 25Effectiveness at: Install computer software.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 26Effectiveness at: Recommend changes to improve computer or information systems.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 27Effectiveness at: Modify software programs to improve performance.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 28Effectiveness at: Update knowledge about emerging industry or technology trends.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 29Effectiveness at: Write computer programming code.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 30Effectiveness at: Troubleshoot issues with computer applications or systems.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 31Effectiveness at: Develop computer or information security policies or procedures.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

• 32Effectiveness at: Evaluate utility of software or hardware technologies.

  O*NET work activity · observed
  Rating frame (5-point BARS)

  5 · Exceeds

  — rating anchor pending —

  3 · Meets

  — rating anchor pending —

  1 · Below

  — rating anchor pending —

  Rating anchors are completed by the rater against observed behavior — leveled anchor text lands with the next source edition.

Performance standards at this level 21

What good looks like at this level, by dimension — verbatim level and JFM rubric text, with this profile's performance metrics attached where a real keyword match exists. Work activities are O*NET-derived (basis: derived).

• Scope

  canon · level dimension · observed

  Features or a sub-system end-to-end

• Autonomy

  canon · level dimension · observed

  Works independently on standard work; reviewed on the non-standard

• Complexity

  canon · level dimension · observed

  Diverse problems; adapts existing approaches

• Impact

  canon · level dimension · observed

  Project / team outcomes

• Decision rights

  canon · level dimension · observed

  Owns implementation decisions for own scope

• Leadership

  canon · level dimension · observed

  Mentors juniors informally

• Work activities

  O*NET work activity · derived

  Effectiveness at: Test computer system operations to ensure proper functioning.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Implement security measures for computer or information systems.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Collaborate with others to determine design specifications or details.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Collaborate with others to resolve information technology issues.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Analyze data to identify trends or relationships among variables.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Analyze data to identify or resolve operational problems.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Create databases to store electronic data.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Install computer software.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Recommend changes to improve computer or information systems.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Modify software programs to improve performance.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Update knowledge about emerging industry or technology trends.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Write computer programming code.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Troubleshoot issues with computer applications or systems.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Develop computer or information security policies or procedures.

• Work activities

  O*NET work activity · derived

  Effectiveness at: Evaluate utility of software or hardware technologies.

Structured-interview dimensions

The work-style constructs a structured interview for this occupation should probe (importance-ranked). Pair with past-behavior questions and anchored rating scales — the evidence-backed format.

Level-calibrated behavioral anchors 28

Verbatim anchors from open leveled frameworks, mapped onto this profile's level (basis: derived — competency-scoped, not per-criterion). Use them to calibrate what "exceeds / meets" looks like at this level.

• Creativity and Innovation

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Creates a new quality control system to monitor unit processes Uses cutting-edge ideas to develop business unit services Works with coworkers to coordinate a project using a creative process

• External Awareness

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Gathers and summarizes information to predict stakeholder views on a new policy Considers external policies and trends when reviewing correspondence, reports, and policy documents

• Flexibility

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Uses staff feedback to streamline processes in order to meet deadlines Adjusts project plan based on input from staff and stakeholders

• Resilience

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Meets with employees resistant to organizational change to address concerns Maintains composure and direction in high- pressure situations Accepts negative feedback in a constructive manner and adjusts behavior accordingly

• Strategic Thinking

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Considers customer needs and trends in the development of strategic plans Implements strategic objectives and develops metrics to assess attainment of work unit goals

• Vision

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Involves staff in setting annual goals to ensure buy-in Conducts interviews with staff to ascertain organization's needs Conveys vision of agency to staff and stakeholders

• Conflict Management

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Implements changes to ensure work environment is fair and equitable based on employee concerns Ensures employees receive mediation to resolve issues affecting the workgroup Resolves issues by meeting one-on-one with team member

• Leveraging Diversity

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Adheres to EEO policies, goals, objectives, and philosophies of valuing diversity in performing everyday duties and responsibilities Builds teams leveraging diverse capabilities of staff

• Developing Others

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Encourages employees to participate in mentoring programs and other learning opportunities Pairs new staff with seasoned employees to facilitate understanding of the position and organization Provides orientation to new employees

• Team Building

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Encourages staff to share skills and abilities within work group to facilitate completion of challenging tasks Forms teams to identify and address agency concerns Informs team members of issues requiring resolution and considers input

• Accountability

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Investigates claims of employee violations and encourages staff to take responsibility for actions Outlines goals and assesses workgroup progress towards goal achievement Plans and researches safety issues and contacts agency to ensure safety standards are fully utilized Distributes workload among staff to ensure staff meet key deliverables

• Customer Service

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Develops guides and user manuals for customers Ensures products and services comply with customer requirements Streamlines procedures based on customer feedback

• Decisiveness

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Makes sound and timely decisions for a project, team, or work unit Seeks out best practices to make organizational decisions

• Entrepreneurship

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Identifies concepts for new programs, products, or services Seeks feedback for new products or services based on customer needs

• Problem Solving

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Addresses routine organizational problems by leading a team to brainstorm solutions Establishes guidelines to clarify complex and/or controversial processes

• Technical Credibility

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Provides staff with feedback and support on technical issues Makes technically sound recommendations to develop effective work products

• Financial Management

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Justifies requested budget allocation to management in relation to program objectives Allocates program budget across multiple projects

• Human Capital Management

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Recognizes and addresses deficiencies of human resources processes or tools Provides positive feedback to high-performing staff and rewards exceptional performance Considers impact of personnel decisions on current staff

• Technology Management

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Works with contractors to implement an IT system change to meet requirements of a new legislative mandate Researches information technology systems to meet specific program needs Adapts processes to keep pace with new technological developments

• Partnering

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Considers stakeholder input when developing strategies to ensure mutually agreeable initiatives Coordinates with various agencies to plan and conduct annual events Coordinates across and within organizations to determine required resources to support goals Works with a team of managers or employees across agencies to address mutual issues and concerns

• Political Savvy

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Addresses political issues that may impact internal and external stakeholders Develops relationships with new political leaders in the agency

• Influencing/Negotiating

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Meets with team leaders to gain buy-in for new direction of division Uses factual information to support own point of view when meeting with team members

• Interpersonal Skills

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Shows employees empathy and respect Welcomes new employees into organization by explaining mission and agency goals

• Oral Communication

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Communicates effectively with staff by conducting regular meetings to discuss initiatives and current events Explains and clarifies policy to affected parties Provides status updates to management team during quarterly division meeting

• Integrity/Honesty

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Provides staff with accurate information about the vision of the agency and outlines changes in an upfront manner Remains fair and objective when determining skill set needed for projects to select effective team members

• Written Communication

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Writes daily briefs or guidelines to ensure employees are provided with updated information Develops press releases to ensure important issues are addressed

• Continual Learning

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Solicits periodic feedback to continually improve quality of own work Visits other work sites to gain understanding of staff functions and daily tasks

• Public Service Motivation

  OPM Leadership Proficiency Levels · Level 2 - Basic

  Reviews unit's policies and procedures on a regular basis to ensure they are consistent with public needs Determines community needs by surveying citizens