DevOps

Print Print
Reading time 24:16

DevOps is a set of practices that combines software development (Dev) and IT operations (Ops). It aims to shorten the systems development life cycle and provide continuous delivery with high software quality.[1][2] DevOps is complementary with Agile software development; several DevOps aspects came from the Agile methodology.

Definition

Other than it being a cross-functional combination of the terms and concepts for "development" and "operations," academics and practitioners have not developed a unique definition for the term "DevOps".[a][b][c][d] The idea behind this practice is to make delivery teams responsible for the production issues and fixes, whether legacy or new. In traditional practices, delivery would only be responsible for the changes put in by them, within the warranty period.

From an academic perspective, Len Bass, Ingo Weber, and Liming Zhu—three computer science researchers from the CSIRO and the Software Engineering Institute—suggested defining DevOps as "a set of practices intended to reduce the time between committing a change to a system and the change being placed into normal production, while ensuring high quality".[6]

The term DevOps, however, has been used in multiple contexts.[7][unreliable source?]

History

Many of the ideas fundamental to DevOps practices are inspired by, or mirror, practices such as Lean and Deming's Plan-Do-Check-Act cycle, through to The Toyota Way and the Agile approach of breaking down components and batch sizes. In 1993 the Telecommunications Information Networking Architecture Consortium (TINA-C) defined a Model of a Service Lifecycle that combined software development with (telecom) service operations.[8] Some say that DevOps emerged in part as a reaction to the "top-down" proscriptive approach of ITIL in the 1990s. DevOps, as a "bottom-up" approach, gained traction and persisted because it was created by software engineers for software engineers, and is a flexible practice rather than a rigid framework.[9]

In 2009, the first conference named devopsdays was held in Ghent, Belgium. The conference was founded by Belgian consultant, project manager and agile practitioner Patrick Debois.[10][who?][11] The conference has now spread to other countries.[12]

In 2012, the State of DevOps report was conceived and launched by Alanna Brown at Puppet.[13][14] As of 2014, the annual State of DevOps report was published by Nicole Forsgren, Gene Kim, Jez Humble and others.[15][16] In 2014, they found that DevOps adoption was accelerating.[15] Also in 2014, Lisa Crispin and Janet Gregory wrote the book More Agile Testing, containing a chapter on testing and DevOps.[17][18]

Toolchains

As DevOps is intended to be a cross-functional mode of working, those who practice the methodology use different sets of tools—referred to as "toolchains"—rather than a single one.[19] These toolchains are expected to fit into one or more of the following categories, reflective of key aspects of the development and delivery process:[20][unreliable source?][21][unreliable source?]

  1. Coding – code development and review, source code management tools, code merging.
  2. Building – continuous integration tools, build status.
  3. Testing – continuous testing tools that provide quick and timely feedback on business risks.
  4. Packaging – artifact repository, application pre-deployment staging.
  5. Releasing – change management, release approvals, release automation.
  6. Configuring – infrastructure configuration and management, infrastructure as code tools.
  7. Monitoring – applications performance monitoring, end-user experience.

Some categories are more essential in a DevOps toolchain than others; especially continuous integration (e.g. Jenkins, Gitlab, Bitbucket pipelines) and infrastructure as code (e.g., Terraform, Ansible, Puppet).[22][unreliable source?][23][unreliable source?]

Metrics

Forsgren et al. found that IT performance is strongly correlated with DevOps practices like source code management and continuous delivery.[15] The authors later summarised their 4 year experience working with Puppet on the State of DevOps Report (SODR) in a book called Accelerate.[24] The authors analysed 23,000 data points from a variety of companies of various different sizes (from start-up to enterprises), for-profit and not-for-profit and both those with legacy systems and those born digital.[25] Their research identified four key metrics that are indicators of software delivery performance, which lead to higher rates of profitability, market share and customer satisfaction for their respective companies.[26] The authors identified that “highest performers are twice as likely to meet or exceed their organizational performance goals.”[27][28]

The four metrics identified are as follows:[29][30][31]

  • Change Lead Time or Cycle Time[32] - Time to implement, test, and deliver code for a feature (measured from first commit to deployment)
  • Deployment Frequency - Number of deployments in a given duration of time
  • Change Failure Rate (CFR) - Percentage of failed changes over all changes (regardless of success)
  • Mean Time to Recovery (MTTR) - Time it takes to restore service after production failure

Relationship to other approaches

Agile

The motivations for what has become modern DevOps and several standard DevOps practices such as automated build and test, continuous integration, and continuous delivery originated in the Agile world, which dates (informally) to the 1990s, and formally to 2001. Agile development teams using methods such as Extreme Programming couldn't "satisfy the customer through early and continuous delivery of valuable software"[33] unless they subsumed the operations / infrastructure responsibilities associated with their applications, many of which they automated. Because Scrum emerged as the dominant Agile framework in the early 2000s and it omitted the engineering practices that were part of many Agile teams, the movement to automate operations / infrastructure functions splintered from Agile and expanded into what has become modern DevOps.[11] Today, DevOps focuses on the deployment of developed software, whether it is developed via Agile or other methodologies.[34]

ArchOps

ArchOps presents an extension for DevOps practice, starting from software architecture artifacts, instead of source code, for operation deployment.[35] ArchOps states that architectural models are first-class entities in software development, deployment, and operations.

TestOps

TestOps is often considered a subset of DevOps, focusing on accelerating the practice of software testing within agile development methodologies. It includes the operations of test planning, managing test data, controlling changes to tests, organizing tests, managing test status, and gaining insights from testing activities to inform status and process improvements. [36]

Continuous delivery

Continuous delivery and DevOps have common goals and are often used in conjunction, but there are subtle differences.[37][38]

While continuous delivery is focused on automating the processes in software delivery, DevOps also focuses on the organizational change to support great collaboration between the many functions involved.[37]

DevOps and continuous delivery share a common background in agile methods and lean thinking: small and frequent changes with focused value to the end customer.[39][unreliable source?]Lean management and continuous delivery are fundamental to delivering value faster, in a sustainable way.[16] Continuous delivery focuses on making sure the software is always in a releasable state throughout its lifecycle.[15] This makes it cheaper and less risky to deliver the software.[15]

Improved collaboration and communication both between and within organizational teams can help achieve faster time to market, with reduced risks.[40][41]

DataOps

The application of continuous delivery and DevOps to data analytics has been termed DataOps. DataOps seeks to integrate data engineering, data integration, data quality, data security, and data privacy with operations.[42][unreliable source?] It applies principles from DevOps, Agile Development and the statistical process control, used in lean manufacturing, to improve the cycle time of extracting value from data analytics.[43][unreliable source?]

Site-reliability engineering

In 2003, Google developed site reliability engineering (SRE), an approach for releasing new features continuously into large-scale high-availability systems while maintaining high-quality end-user experience.[44] While SRE predates the development of DevOps, they are generally viewed as being related to each other.[45][unreliable source?]

Systems administration

DevOps is often viewed as an approach to applying systems administration work to cloud technology.[46]

WinOps

WinOps is the term used for DevOps practices for a Microsoft-centric view.[citation needed]

Toyota production system, lean thinking, kaizen

Toyota production system, also known under the acronym TPS, was the inspiration for lean thinking with its focus on continuous improvement, kaizen, flow and small batches. The Andon cord principle to create fast feedback, swarm and solve problems stems from TPS.[47][48]

DevSecOps, Shifting Security Left

DevSecOps is an augmentation of DevOps to allow for security practices to be integrated into the DevOps approach. The traditional centralised security team model must adopt a federated model allowing each delivery team the ability to factor in the correct security controls into their DevOps practices. Shifting security left is an approach to software security whereby security practices and testing are performed earlier in the development lifecycle.

BizOps

BizOps is contrasted with DevOps because of its more integrated approach. While DevOps is more focused on IT and software development, BizOps integrates technology into daily organizational decisions and business operations.[49]

Goals

IT performance can be measured in terms of throughput and stability.[15] Throughput can be measured by deployment frequency and lead time for changes; stability can be measured by mean time to recover. The State of DevOps Reports found that investing in practices that increase these throughput and stability measures increase IT performance.[15][16]

The goals of DevOps span the entire delivery pipeline. They include:[citation needed]

  • Improved deployment frequency;
  • Faster time to market;
  • Lower failure rate of new releases;
  • Shortened lead time between fixes;
  • Faster mean time to recovery (in the event of a new release crashing or otherwise disabling the current system).

Simple processes become increasingly programmable and dynamic, using a DevOps approach.[50][unreliable source?] DevOps aims to maximize the predictability, efficiency, security, and maintainability of operational processes.[citation needed] Very often, automation supports this objective.

DevOps integration targets product delivery, continuous testing, quality testing, feature development, and maintenance releases in order to improve reliability and security and provide faster development and deployment cycles.[citation needed] Many of the ideas (and people) involved in DevOps came from the enterprise systems management and agile software development movements.[51][unreliable source?]

Practices that correlate with deployment frequency are:[15]

  • Continuous delivery
  • Using version control for all production artifacts

Practices that correlate with a lead time for change are:[15]

  • Using version control for all production artifacts
  • Automated testing

Practices that correlate with a mean time to recovery for change are:[15]

  • Using version control for all production artifacts
  • Monitoring system and application health

Companies that practice DevOps[failed verification] have reported significant benefits, including: significantly shorter time to market, improved customer satisfaction, better product quality, more reliable releases, improved productivity and efficiency, and the increased ability to build the right product by fast experimentation.[40]

The 2014 State of DevOps Report found that "IT performance strongly correlates with well-known DevOps practices such as the use of version control and continuous delivery."[15]

Cultural change

DevOps initiatives can create cultural changes in companies[52] by transforming the way operations, developers, and testers collaborate during the development and delivery processes.[2] Getting these groups to work cohesively is a critical challenge in enterprise DevOps adoption.[53][54] DevOps is as much about culture, as it is about the toolchain.[55]

DevOps as a job title

While DevOps describes an approach to work rather than a distinct role (like system administrator), job advertisements are increasingly using terms like "DevOps Engineer".[56][unreliable source?][57]

While DevOps reflects complex topics, the DevOps community uses analogies to communicate important concepts,[relevant?] much like "The Cathedral and the Bazaar" from the open-source community.[58]

  • Cattle not Pets: the paradigm of disposable server infrastructure.[59]
  • 10 deployments per day: the story of Flickr adopting DevOps.

Building a DevOps culture

Organizational culture is a strong predictor of IT and organizational performance. Cultural practices such as information flow, collaboration, shared responsibilities, learning from failures and new ideas are central to DevOps.[15]Psychological safety is a fundamental enabler of DevOps cultures, and is reflected in Gene Kim's "Five Ideals" of DevOps. Team-building and other employee engagement activities are often used to create an environment that fosters this communication and cultural change within an organization.[60] Team-building activities can include board games, trust activities, and employee engagement seminars.[61][unreliable source?] DevOps as a service approach allows developers and operations teams to take greater control of their applications and infrastructure without hindering speed. It also transfers the onus of owning a problem on to the development team, making them much more careful in their stride.

The 2015 State of DevOps Report discovered that the top seven measures with the strongest correlation to organizational culture are: 1. Organizational investment in DevOps:[16] 2. Team leaders' experience and effectiveness. 3. Continuous delivery. 4. The ability of different disciplines (development, operations, and infosec) to achieve win-win outcomes. 5. Organizational performance. 6. Deployment pain. 7. Lean management practices.

Deployment

Companies with very frequent releases may require knowledge on DevOps.[citation needed] For example, the company that operates image hosting website Flickr developed a DevOps approach to support ten deployments a day.[62] Daily deployment cycles would be much higher at organizations producing multi-focus or multi-function applications.[citation needed] Daily deployment is referred to as continuous deployment[63][unreliable source?] or continuous delivery[64][unreliable source?] and has been associated with the lean startup methodology.[65][unreliable source?]Professional associations and blogs posts have formed on the topic since 2009.[66][unreliable source?][67][unreliable source?]

Architecturally significant requirements

To practice DevOps effectively, software applications have to meet a set of architecturally significant requirements (ASRs), such as: deployability, modifiability, testability, and monitorability.[68] These ASRs require a high priority and cannot be traded off lightly.

Microservices

Although in principle it is possible to practice DevOps with any architectural style, the microservices architectural style is becoming the standard for building continuously deployed systems.[41] Small size service allows the architecture of an individual service to emerge through continuous refactoring,[69] hence reducing the need for a big upfront design,[citation needed] allows for releasing the software early[citation needed] and continuously.

DevOps automation

DevOps automation can be achieved by repackaging platforms, systems, and applications into reusable building blocks[70] through the use of technologies such as virtual machines and containerization.[71][unreliable source?][72]

Implementation of DevOps automation in the IT-organization is heavily dependent on tools,[15][73][unreliable source?] which are required[citation needed] to cover different areas of the systems development lifecycle (SDLC):

  1. Infrastructure as code
  2. CI/CD
  3. Test automation
  4. Containerization
  5. Orchestration
  6. Software deployment
  7. Software measurement

Adoption

DevOps practices and adoption

Jabbari et al.[74] identified DevOps practices and their dependencies. They developed a benefits dependency network which connects potential benefits to an ordered chain of practices. Using this network organizations can choose a path that enables fulfillment of their goals.

Some articles in the DevOps literature assume or recommend significant participation in DevOps initiatives from outside an organization's IT department, e.g.: "DevOps is just the agile principle, taken to the full enterprise."[75][unreliable source?]

In a survey published in January 2016 by the SaaS cloud-computing company RightScale, DevOps adoption increased from 66 percent in 2015 to 74 percent in 2016.[citation needed] And among larger enterprise organizations, DevOps adoption is even higher – 81 percent.[76][unreliable source?]

Adoption of DevOps is being driven by many factors – including:[citation needed]

  1. Use of agile and other development processes and methods;
  2. Demand for an increased rate of production releases – from application and business unit stakeholders;
  3. Wide availability of virtualized[77][unreliable source?] and cloud infrastructure – from internal and external providers;
  4. Increased usage of data center automation[78][unreliable source?] and configuration management tools;
  5. Increased focus on test automation[79][unreliable source?] and continuous integration methods;
  6. A critical mass of publicly available best practices.

See also

Notes

  1. ^ Dyck et. al (2015) "To our knowledge, there is no uniform definition for the terms release engineering and DevOps. As a consequence, many people use their own definitions or rely on others, which results in confusion about those terms."[3]
  2. ^ Jabbari et. al (2016) "The research results of this study showed the need for a definition as individual studies do not consistently define DevOps."[4]
  3. ^ Erich et. al (2017) "We noticed that there are various gaps in the study of DevOps: There is no consensus of what concepts DevOps covers, nor how DevOps is defined."[5]
  4. ^ Erich et. al (2017) "We discovered that there exists little agreement about the characteristics of DevOps in the academic literature."[5]

References

  1. ^ Mala, D.J. (2019). Integrating the Internet of Things into Software Engineering Practices. Advances in Systems Analysis, Software Engineering, and High Performance Computing. IGI Global. p. 16. ISBN 978-1-5225-7791-1. Retrieved 4 April 2019.
  2. ^ a b Loukides, Mike (7 June 2012). "What is DevOps?". O'Reilly Media.
  3. ^ Dyck, Andrej; Penners, Ralf; Lichter, Horst (19 May 2015). "Towards Definitions for Release Engineering and DevOps". Proceedings of the 2015 IEEE/ACM 3rd International Workshop on Release Engineering. IEEE: 3. doi:10.1109/RELENG.2015.10. ISBN 978-1-4673-7070-7. S2CID 4659735.
  4. ^ Jabbari, Ramtin; bin Ali, Nauman; Petersen, Kai; Tanveer, Binish (May 2016). "What is DevOps?: A Systematic Mapping Study on Definitions and Practices". Proceedings of the 2016 Scientific Workshop. Association for Computing Machinery.
  5. ^ a b Erich, F.M.A.; Amrit, C.; Daneva, M. (June 2017). "A Qualitative Study of DevOps Usage in Practice". Journal of Software: Evolution and Process. 29 (6): e1885. doi:10.1002/smr.1885. S2CID 35914007.
  6. ^ Bass, Len; Weber, Ingo; Zhu, Liming (2015). DevOps: A Software Architect's Perspective. ISBN 978-0134049847.
  7. ^ "Surprise! Broad Agreement on the Definition of DevOps". DevOps.com. 13 May 2015.
  8. ^ Chapman, M., Gatti, N: A model of a service life cycle, Proceedings of TINA '93, pp. I-205–I-215, Sep., 1993.
  9. ^ "The History and Evolution of DevOps | Tom Geraghty". Retrieved 29 November 2020.
  10. ^ Mezak, Steve (25 January 2018). "The Origins of DevOps: What's in a Name?". devops.com. Retrieved 6 May 2019.
  11. ^ a b Debois, Patrick. "Agile 2008 Toronto". Just Enough Documented Information. Retrieved 12 March 2015.
  12. ^ Debois, Patrick. "DevOps Days". DevOps Days. Retrieved 31 March 2011.
  13. ^ Alana Brown; Nicole Forsgren; Jez Humble; Nigel Kersten; Gene Kim (2016). "2016 State of DevOps Report" (PDF). Puppet Labs, DORA (DevOps Research. Retrieved 6 May 2019.
  14. ^ "Puppet - Alanna Brown". Puppet Labs. Retrieved 27 April 2019.
  15. ^ a b c d e f g h i j k l m Nicole Forsgren; Gene Kim; Nigel Kersten; Jez Humble (2014). "2014 State of DevOps Report" (PDF). Puppet Labs, IT Revolution Press and ThoughtWorks. Retrieved 27 April 2019.
  16. ^ a b c d "2015 State of DevOps Report" (PDF). Puppet Labs, Pwc, IT Revolution Press. 2015. Retrieved 6 May 2019.
  17. ^ "More Agile Testing" (PDF). October 2014. Retrieved 6 May 2019.
  18. ^ Crispin, Lisa; Gregory, Janet (October 2014). More Agile Testing. ISBN 9780133749571. Retrieved 6 May 2019.
  19. ^ Gartner Market Trends: DevOps – Not a Market, but Tool-Centric Philosophy That supports a Continuous Delivery Value Chain (Report). Gartner. 18 February 2015.
  20. ^ Edwards, Damon. "Integrating DevOps tools into a Service Delivery Platform". dev2ops.org.
  21. ^ Seroter, Richard. "Exploring the ENTIRE DevOps Toolchain for (Cloud) Teams". infoq.com.
  22. ^ Theakanath, Thomas (5 February 2016). "DevOps Stack on a Shoestring Budget". devops.com. Archived from the original on 27 May 2016. Retrieved 23 February 2016.
  23. ^ "Stronger DevOps Culture with Puppet and Vagrant". Puppet Labs. Archived from the original on 29 January 2016. Retrieved 22 October 2015.
  24. ^ Linders, Ben; Humble, Jez. "Q&A on the Book Accelerate: Building and Scaling High Performance Technology Organizations". InfoQ. Retrieved 5 April 2021.
  25. ^ Overby, Stephanie. "7 takeaways to "Accelerate" your DevOps". TechBeacon. Retrieved 5 April 2021.
  26. ^ Colina, Julian. "Beginner's Guide to Software Delivery Metrics". www.usehaystack.io. Retrieved 5 April 2021.
  27. ^ Mangot, Dave (17 March 2021). "Get good at delivering software". CIO. Retrieved 5 April 2021.
  28. ^ Colina, Julian. "Beginner's Guide to Software Delivery Metrics". www.usehaystack.io. Retrieved 7 April 2021.
  29. ^ Colina, Julian. "Does engineering performance affect profitability? Here's what the data says". www.usehaystack.io. Retrieved 5 April 2021.
  30. ^ "Are you an Elite DevOps performer? Find out with the Four Keys Project". Google Cloud Blog. Retrieved 5 April 2021.
  31. ^ Drugeot, Constance (30 March 2021). "Why is a DevOps assessment important, and how to do it right?". DevOps Online. Retrieved 5 April 2021.
  32. ^ "Measure Engineering Efficiency & Developer Experience with Haystack Metrics". support.usehaystack.io. Retrieved 7 April 2021.
  33. ^ "Principles behind the Agile Manifesto". agilemanifesto.org. Retrieved 6 December 2020.
  34. ^ Watts, Stephen; Kidd, Chrissy (10 August 2017). "DevOps vs Agile: What's the Difference and How Are They Related?". bmc.com. Retrieved 1 March 2019.
  35. ^ Castellanos, Camilo; Correal, Dario (15 September 2018). Executing Architectural Models for Big Data Analytics. Lecture Notes in Computer Science. 11048. pp. 364–371. doi:10.1007/978-3-030-00761-4_24. ISBN 978-3-030-00760-7.
  36. ^ Infopulse (9 April 2020). "INTRODUCING TESTOPS: A NEW APPROACH TO QUALITY ASSURANCE". Retrieved 16 February 2021. TestOps is a methodology that promotes close collaboration between QA, Dev and Ops, in order to reduce development costs and ensure quality.
  37. ^ a b Humble, Jez; Farley, David (2011). Continuous Delivery: reliable software releases through build, test, and deployment automation. Pearson Education Inc. ISBN 978-0-321-60191-9.
  38. ^ Hammond, Jeffrey (9 September 2011). "The Relationship between DevOps and Continuous Delivery". Forrester Research.
  39. ^ Ambler, Scott W. (12 February 2014). "We need more Agile IT Now!". Dr. Dobb's the World of Software Development.
  40. ^ a b Chen, Lianping (2015). "Continuous Delivery: Huge Benefits, but Challenges Too". IEEE Software. 32 (2): 50–54. doi:10.1109/MS.2015.27. S2CID 1241241.
  41. ^ a b Chen, Lianping (2018). Microservices: Architecting for Continuous Delivery and DevOps. The IEEE International Conference on Software Architecture (ICSA 2018). IEEE.
  42. ^ "From DevOps to DataOps, By Andy Palmer - Tamr Inc". Tamr Inc. 7 May 2015. Retrieved 23 August 2017.
  43. ^ DataKitchen (15 March 2017). "How to Become a Rising Star with Data Analytics". data-ops. Retrieved 23 August 2017.
  44. ^ Beyer, Betsy; Jones, Chris; Petoff, Jennifer; Murphy, Niall Richard (April 2016). Site Reliability Engineering. O'Reilly Media. ISBN 978-1-4919-2909-4.
  45. ^ "SRE vs. DevOps – a False Distinction? - DevOps.com". 18 May 2017.
  46. ^ "How to stay relevant in the DevOps era: A SysAdmin's survival guide".
  47. ^ Analyzing the DNA of DevOps, Brent Aaron Reed, Willy Schaub, 2018-11-14.
  48. ^ The DevOps Handbook: How to Create World-Class Agility, Reliability, and Security in Technology Organizations, Gene Kim, Patrick Debois, John Willis, Jezz Humble, 2016
  49. ^ "Aligning business and IT: 'BizOps Manifesto Unveiled' focuses on software development and operations". SiliconANGLE. 9 October 2020. Retrieved 26 March 2021.
  50. ^ "What is DevOps?". NewRelic.com. Retrieved 21 October 2014.
  51. ^ Nasrat, Paul. "Agile Infrastructure". InfoQ. Retrieved 31 March 2011.
  52. ^ Emerging Technology Analysis: DevOps a Culture Shift, Not a Technology (Report). Gartner.
  53. ^ "Gartner IT Glossary – devops". Gartner. Retrieved 30 October 2015.
  54. ^ Jones, Stephen; Noppen, Joost; Lettice, Fiona (21 July 2016). Proceedings of the 2nd International Workshop on Quality-Aware Dev Ops - QUDOS 2016 (PDF). pp. 7–11. doi:10.1145/2945408.2945410. ISBN 9781450344111. S2CID 515140.
  55. ^ Mandi Walls (25 September 2015). "Building a DevOps culture". O'Reilly.
  56. ^ "Is DevOps a Title? - DevOps.com". DevOps.com. 20 March 2014. Retrieved 22 July 2017.
  57. ^ "DevOps: A Job Title or a School of Thought?". Monster Career Advice. Retrieved 22 July 2017.
  58. ^ "What are known useful and misleading memes in the DevOps culture?". devops.stackexchange.com. Retrieved 29 June 2017.
  59. ^ Sharwood, Simon. "Are Your Servers Pets or Cattle?". The Register. Retrieved 2 July 2018.
  60. ^ Walls, Mandi (15 April 2013). Building a DevOps Culture. OReilly Media. ISBN 9781449368364.
  61. ^ Roach, Patrick (8 October 2015). "Dice Breakers: Using DevOps principles and nerdery to reimagine Team building". DevOps.com.
  62. ^ "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr". 23 June 2009.
  63. ^ "SAM SIG: Applied Lean Startup Ideas: Continuous Deployment at kaChing". SVForum. Archived from the original on 20 October 2012. Retrieved 20 June 2011.
  64. ^ Humble, Jez. "Why Enterprises Must Adopt Devops to Enable Continuous Delivery". Cutter IT Journal.
  65. ^ "Applied Lean Startup Ideas: Continuous Deployment at kaChing". 26 May 2010.
  66. ^ "DevOps Days 2009 Conference".
  67. ^ Edwards, Damon. "DevOps Meetup Recap".
  68. ^ Chen, Lianping (2015). Towards Architecting for Continuous Delivery. The 12th Working IEEE/IFIP Conference on Software Architecture(WICSA 2015). Montréal, Canada: IEEE. doi:10.1109/WICSA.2015.23.
  69. ^ Chen, Lianping; Ali Babar, Muhammad (2014). "Towards an Evidence-Based Understanding of Emergence of Architecture through Continuous Refactoring in Agile Software Development". The 11th Working IEEE/IFIP Conference on Software Architecture(WICSA 2014). IEEE. doi:10.1109/WICSA.2014.45.
  70. ^ Klein, Brandon; Miner, John (2018). DevOps: Images, Scripts, APIs, Oh my!. NLIT Summit 2018. OSTI. OSTI 1512856.
  71. ^ "Unleashing the Full Potential of Containerization for DevOps". 20 September 2017. Retrieved 20 June 2018.
  72. ^ "Containers vs. virtual machines: A simplified answer to a complex question".
  73. ^ "DevOps best practices: How much automation do you need?". TechBeacon. Retrieved 14 November 2018.
  74. ^ Jabbari, Ramtin; Ali, Nauman bin; Petersen, Kai; Tanveer, Binish (November 2018). "Towards a benefits dependency network for DevOps based on a systematic literature review". Journal of Software: Evolution and Process. 30 (11): e1957. doi:10.1002/smr.1957. S2CID 53951886.
  75. ^ "DevOps is Agile for the Rest of the Company". DevOps.com. 4 March 2015. Archived from the original on 13 September 2016. Retrieved 11 October 2015.
  76. ^ Harvey, Cynthia (9 January 2017). "10 Ways DevOps is Changing the Enterprise". Datamation.
  77. ^ "Virtual Infrastructure products: features comparison". Welcome to IT 2.0: Next Generation IT infrastructures.
  78. ^ Ellard, Jennifer. "Bringing Order to Chaos through Data Center Automation". Information Management. SourceMedia. Archived from the original on 11 June 2010.
  79. ^ "Impact of DevOps on Testing". DevOps.com. 21 August 2015. Archived from the original on 21 August 2015. Retrieved 26 August 2015.

Further reading

  • Davis, Jennifer; Daniels, Ryn (30 May 2016). Effective DevOps : building a culture of collaboration, affinity, and tooling at scale. Sebastopol, CA: O'Reilly. ISBN 9781491926437. OCLC 951434424.
  • Kim, Gene; Debois, Patrick; Willis, John; Humble, Jez; Allspaw, John (7 October 2015). The DevOps handbook : how to create world-class agility, reliability, and security in technology organizations (First ed.). Portland, OR. ISBN 9781942788003. OCLC 907166314.
  • Forsgren, Nicole; Humble, Jez; Kim, Gene (27 March 2018). Accelerate: The Science of Lean Software and DevOps: Building and Scaling High Performing Technology Organizations (First ed.). IT Revolution Press. ISBN 9781942788331.

By: Wikipedia.org
Edited: 2021-06-18 19:14:02
Source: Wikipedia.org