DevOps KPIs – Software Delivery Performance & Organizational Culture : Classifying Culture and Creating a Tool to Measure Software Delivery Performance at a Swedish Defence Company
Year: 2024
Type: dissertation
Abstract: The DevOps methodology has shown that software delivery performance (SDP) as well as organizational culture are key drivers of organizational performance and should be measured. SDP can be measured using Four Key Metrics (FKM): Lead Time for Change, Deployment Frequency, Mean Time to Restore and Change Failure Rate. Existing tools for measuring SDP often lack full automation or require practices that prepare code for release to production. Also, their application in real-world contexts, especially concerning the FKM and team culture, remains underexplored. The aim of this study was to fill this gap by, first, investigating attributes needed for tool development and implementation and, second, relating the measurements to perceived performance and team culture. Using FKM, a tool was developed measuring the part of the software process where code changes are merged to a main code-branch. The measurements were visualized in a dashboard and evaluated by stakeholders. A survey was distributed to assess the team’s perceived SDP and team culture, and an interview with the team leader provided additional insights. The results of measured and perceived SDP, were congruent and indicated no single performance category. According to the tool-evaluation, the FKM appeared to have value and the graphics showed potential bottlenecks as well as product development quality and speed. Limitations were measurement of product quality after delivery. The interview and survey both indicated a generative culture characterized by high information sharing, supporting that such culture is desirable for high SDP. The study produced a guide for organizations to develop a tool measuring SDP. Findings indicate that automatic measuring of KPIs can give value to researchers and the industry.
Authors: Selinder, Emelie, Enocksson, Fanny
Institution: KTH Royal Institute of Technology
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7055987490
