Archive

The Dulin Report

Browsable archive from the WordPress export.

Results (42)

On the role of Distinguished Engineer and CTO Mindset Apr 27, 2025 The future is bright Mar 30, 2025 2024 Reflections Dec 31, 2024 The day I became an architect Sep 11, 2024 Are developer jobs truly in decline? Jun 29, 2024 Form follows fiasco Mar 31, 2024 Thanksgiving reflections Nov 23, 2023 Working from home works as well as any distributed team Nov 25, 2022 Book review: Clojure for the Brave and True Oct 2, 2022 The Toxic Clique Sep 28, 2022 All developers should know UNIX Jun 30, 2022 Good developers can pick up new programming languages Jun 3, 2022 Java is no longer relevant May 29, 2022 There is no such thing as one grand unified full-stack programming language May 27, 2022 Best practices for building a microservice architecture Apr 25, 2022 Kitchen table conversations Nov 7, 2021 What programming language to use for a brand new project? Feb 18, 2020 On elephant graveyards Feb 15, 2020 Microsoft acquires Citus Data Jan 26, 2019 Teleportation can corrupt your data Sep 29, 2018 What does a Chief Software Architect do? Jun 23, 2018 Leaving Facebook and Twitter: here are the alternatives Mar 25, 2018 When politics and technology intersect Mar 24, 2018 The technology publishing industry needs to transform in order to survive Jun 30, 2017 Why it makes perfect sense for Dropbox to leave AWS May 7, 2016 LinkedIn needs a reset Feb 13, 2016 In memory of Ed Yourdon Jan 23, 2016 IT departments must transform in the face of the cloud revolution Nov 9, 2015 We Live in a Mobile Device Notification Hell Aug 22, 2015 What Every College Computer Science Freshman Should Know Aug 14, 2015 On Maintaining Personal Brand as a Software Engineer Aug 2, 2015 Book Review: "Shop Class As Soulcraft" By Matthew B. Crawford Jul 5, 2015 The Clarkson School Class of 2015 Commencement speech May 5, 2015 On Managing Stress, Multitasking and Other New Year's Resolutions Jan 1, 2015 Software Engineering and Domain Area Expertise Nov 7, 2014 Infrastructure in the cloud vs on-premise Aug 25, 2014 On anti-loops Mar 13, 2014 On working from home and remote teams Nov 17, 2013 Thanking MIT Scratch Sep 14, 2013 Thoughts on Wall Street Technology Aug 11, 2012 Scripting News: After X years programming Jun 5, 2012 Eminence Grise: A trusted advisor May 13, 2009

Infrastructure in the cloud vs on-premise

August 25, 2014

[caption id="attachment_250" align="aligncenter" width="300"]Cloud Cloud[/caption]

I made a comment on twitter saying that if you are still operating an on-premise data center in the second decade of the 21st century you are wasting a ton of money. I was talking specifically about AWS vs on-premise. I got some pushback on that assertion in the form of private messages. Here is the summary of the feedback I received:

  1. AWS only makes sense if you need to spin up hundreds of servers fast. Otherwise it is a costly low quality proposition.

  2. In AWS you have zero control of your infrastructure and therefore you have no control over the outcome of failures.

  3. On premise data centers are built to stay operational whereas on AWS you must build your infrastructure with the expectation of failure.


As an application developer my experience is quite the opposite. In the AWS environment I am able to provision resources as needed based on the requirements of my application. I cannot do so in an on-premise data center where any sort of an upgrade or installation can take weeks or months of red tape. At this point in my career, having seen what is possible in AWS and in the cloud in general I have zero interest in building anything out in an on-premise data center.

As for control of the infrastructure, where is the delineation ? At what point do you say with certainty that you have full control over your infrastructure ? Even if you have control over your LAN and other on-premise resources you still have to rely on your power company for electricity. Power companies solved the problem of offering energy as a utility, why not IT infrastructure companies offering their resources as a utility ?

The only way an on-premise datacenter can be better than anything AWS can offer is if you build the exact same infrastructure as they have, with the same resources and tools to help design for failure. Yes, that includes multiple data centers in geographically distinct regions (as in Virginia and California). Sure, there are flaws in AWS, and they do on occasion have outages. But so do on-premise data centers and in my experience with much greater frequency and with greater impact.

Consider the April 2011 EBS outage at Amazon in one of their availability zones:
What about Netflix, an AWS customer that kept on going because they had proper "design for failure"? Try doing that in your private IT infrastructure with the complete loss of a data center. What about another AWS/enStratus startup customer who did not design for failure, but took advantage of the cloud DR capabilities to rapidly move their systems to California? What startup would ever have been able to relocate their entire application across country within a few hours of the loss of their entire data center without already paying through the nose for it?

Sure, when you move to the cloud you give up control over your infrastructure, but the whole point of designing your applications for failure is to make your lack of control less relevant.