Category: Engineering

This is a more detailed write-up of a lightning talk I gave at the Open Infrastructure Summit in 2019. Slides are available here, and the video here. (See also the related talk, “Don’t Repeat Our Mistakes: Lessons Learned from Running Go Daddy’s Private Cloud“) Currently I work on the TechOps team at Twilio SendGrid, which […]
The following is a rough transcript of my DevOpsDays Rockies 2019 Ignite talk entitled “Be a Boat Lifter! A Rising Tide that Lifts Everyone Around You.” I also gave a longer lightning talk version of this at Develop Denver 2019. Slides are available here, and the video from the event is here. Additional resources about this topic are […]
The following is a rough transcript of my DevOpsDays Rockies 2018 Ignite talk entitled “The New Hire: Navigating Your First Days.” Slides are available here, and the video from the event is here. Most of us are going to change jobs every four to five years during our careers.  The problem with that is when […]
Slides from our talk at the OpenStack Queens Summit in Sydney, Australia in November 2017.  The video is also posted here. Don’t Repeat Our Mistakes! Lessons Learned from Running Go Daddy’s Private Cloud (OpenStack Sydney Summit) from Mike Dorman
Like many OpenStack operators, we use Open vSwitch on our hypervisors.  Unfortunately, when running Open vSwitch, you lose some ability to do some functions on the lower level physical interfaces on the box (packet flows do not pass through the regular netfilter path in the kernel, for example.)  This has a side effect of LLDP […]
(Note: Credit goes to Sam Morrison at NeCTAR for passing this tip on to us!) We use the Ceilometer notification agent to collect notification events from the various OpenStack services, and then republish those events to a Kafka cluster.  Those events are consumed by other teams within the company that want to be notified about […]
We’ve published our Ansible playbook and associated scripts we used to handle upgrading our CentOS 6 OpenStack hypervisor hosts to CentOS 7: https://github.com/godaddy/centos7-upgrade-scripts The README describes how it all works, but you will almost certainly have to make some changes for it to work in your environment.  Use at your own risk!  But hopefully this […]
We have given a few “show and tell” talks at the last summits and operators’ meetups about the OpenStack architecture we’re running at Go Daddy. We thought we’d some more in-depth posts to dive into it further.
As mentioned previously we do some customizations in Neutron in order to support our layer 3 networking model.  There are no tenant networks, tunneling or overlays.
After our first two posts detailing OpenStack architecture at Go Daddy, this third one in the series focuses on Nova.
Servers that were upgraded from CentOS 6 to CentOS 7 (or RedHat or other derivative) end up with an inconsistent boot loader configuration.  While the grub2 package is actually installed during the CentOS 7 upgrade, it is not actually installed to the MBR/boot sector of the disk. This causes issues later on, because sometimes new […]
Lately I’ve been trying to get the RabbitMQ management plugin to listen on more than one port.  This is in an effort to resolve these comments on the puppetlabs-rabbitmq Puppet module.  I want one listener on localhost only, in non-SSL mode, and a second listener on a different port which serves SSL requests from external […]
Craig Jellick and I speaking about integrating OpenStack with Active Directory, at the OpenStack Juno Summit in Atlanta, May 2014. Video  Slides
While visiting my in-laws last week, I took a day trip down to the Garrison Dam for a tour of the hydroelectric power plant.  I wasn’t sure how much I’d really get to see, not knowing the security stance of those type of places these days.  However, I was pleasantly surprised.  Not only did we […]
Ever since the Lake Cedar Group began broadcasting from the new consolidated DTV transmitter on Lookout Mountain earlier this year, I’ve had a dream of being able to receive all the over-the-air signals at our house here in Castle Rock.  I would like nothing more than to stop flushing $22 a month down the toilet to […]
About a month ago, I was having a lot of trouble with my cable modem. Going offline a few times a day, poor transfer speeds, etc.  Comcast decided I needed a new drop to the street (which, I can’t really complain about too much: it’s been working great since.)  Anyway, I’ve had a coax cable […]