a reckoning for tech by the humans that work with it

It’s turtles all the way down for OpenStack. TechReckoning Dispatch v4n3

Hi friends,

It turns out I had some thoughts on OpenStack after talking with a lot of interesting people at the latest summit in Boston as a co-host of theCUBE a few weeks back.

My tl;dr on OpenStack: It’s still hard to set up and manage. If the project improves in these areas, then the economics of productivity will drive more usage. If not, then people will use OpenStack only when they have very specific needs and skills. The project seems aware of these issues, but the platform is complex and there are a lot of stakeholders and use cases. As usual, “easy” is not simple.

Some observations on OpenStack

OpenStack is real. I talked with attendees with production deployments and others who were ready to start their brand new OpenStack deployments. The average age of a cloud in the latest OpenStack survey was under 1.7 years, and the median company was using OpenStack for 60-80% of their cloud infrastructure. With about 5000 folks, attendance was down but it didn’t feel like some dying remnant of an old project. A few people apologized for OpenStack being “boring,” but as all infrastructure folks know, boring is good.

The OpenStack community is self-aware but still lacks a singular sense of purpose. It’s been a project notoriously plagued by questions of what they’re building and why. At the opening keynote, the foundation spent the first 15 minutes talking about how OpenStack wasn’t dead and what marketing and technical arterial stents it was inserting to keep the OpenStack pulse detectable. This could be seen as introspective and self-aware, or it could be seen as defensive, but it certainly was unlike the opening of any corporate keynote I’ve ever seen. It’s hard to tease out the ultimate OpenStack vision: “open infrastructure” is great but leaves a lot of details to be determined.

OpenStack is useful. There are increasingly clear models for deciding when to rent vs buy cloud capacity. I saw a few different drivers of OpenStack users at the conference:

  • Special requirements in latency, hardware, tops, etc. that are hard or very expensive to get in a public cloud

  • Need for the privacy, control, or compliance benefits of a non-public cloud

  • Cost reduction, especially for apps with large, steady resource or data needs

  • Academic research, especially when you want to get under the hood in a way you can’t in a public cloud

OpenStack on the Edge. This was the coolest thing I saw. Edge in this case with the telco meeting   can Verizon has a box you can put in your own facilities where, instead of running an embedded OS or even a Linux kernel, they’re running a full (but stripped down and containerized) OpenStack cloud. They can use this platform to manage services and push out entire new services (apps), and since they run OpenStack in their network core, they can manage this cloud-of-clouds under the same umbrella. (Beth Cohen’s keynote segment, interview on theCUBE)

OpenStack can be used by non-rocket scientists. Using a strong partner or especially using a managed service from Rackspace, Platform9, Canonical and others makes OpenStack viable even if your team is not a bunch of wizards. Consuming platforms as a managed services (deployed either on public or private clouds) in general is pretty hot – worth paying attention to.

OpenStack wants to integrate with other open source projects. OpenStack has been notoriously insular. An example is Keystone, its identity service (and curiously, its service catalog). As you might imagine, there are many other ways to do these things, and the world probably didn’t need another way to do it.

As an example of how things might work in the future, OpenStack will likely use etcd for distributed locking instead of writing its own distributed key-value store. (Etcd is used many other places, including Kubernetes. Writing a new distributed key-value store in 2017 is about as crazy as writing your own encryption stack. It’s mostly a solved problem and it you write a new one you’re going to screw it up.) That’s a positive sign.

As a sign of this ecosystem friendliness, organizations like Cloud Foundry, CNCF, OpenDaylight, and OpenNFV were there at the show with “Open Source Day” sessions. The cynics view this as a weakness, but let’s view it as a strength and a good outcome.

OpenStack wants to be simpler and more modular. They are pulling back from their “big tent” stance and emphasizing the core modules, while deprecating others that aren’t as important. We’re still talking 6-10 projects in a typical installation, with lots of options, so the “simple” map they showed in the keynote still looks complicated to an outsider. They’d also like to see individual OpenStack projects be useful outside of OpenStack: e.g., using Cinder and its ecosystem of drivers as a block storage service for containers. I gather, however, that the individual OpenStack projects are still pretty interdependent.

OpenStack *and* containers, not *or* containers. Of course, the biggest open source ecosystem conversation was around containers and especially Kubernetes. OpenStack primarily concerns itself with managing infrastructure resources like storage and networking. Container platforms mostly take those resources for granted.  Containers, on the other hand, are a great way to package and distribute applications. Containerizing OpenStack can help with things like upgradability and resiliency of the OpenStack components themselves (at the cost of another layer of complexity). Questions remain around final evolved form of this kaiju — does it use Kubernetes or “plain old containers”, does it containerize just the control plane or also the workloads, and where does it sit on the so far un-emerging consensus on container storage and networking? But it will no doubt be monstrous and amazing.

On top of OpenStack, it’s looking like some form of container system, probably Kubernetes-based, will be how apps will be deployed and managed. So yes, we will end up with some sort of multiply nested set of VMs and containers, but hey, it’s 2017 and we are OK with our infrastructure being an infinite stack of Gamera monster turtles all the way down.

OpenStack may have a skills issue. Because it is customizable and modular, each OpenStack installation is different. Everybody in the room should be thoughtfully nodding and saying ‘uh-oh’ at this point. Companies want to be able to hire people with transferable skills, and if each OpenStack engineer has worked with a different networking or storage setup, that common skill set may not be present. The trend in infrastructure is towards more automation, more value right off the shelf rather than custom, more converged and pre-packaged solutions, fewer nerd knobs — in short, more cars and fewer pallets of car parts. If OpenStack remains an enterprise architect’s custom hot rod, it will be hard to fit it into the modern IT assembly plant.

OpenStack and ideology. A few speakers did preach the “open source good, commercial software bad” thing. I love open source for many reasons, but I find this characterization unhelpful. Open source has shaken up proprietary software business models, but vendors still need to get paid — very few companies should be taking a complex open source project for mission-critical use without a vendor to package, integrate, offer training, and support it.

Surprise keynote guest Edward Snowden also made the connection between the current centralized internet services (like Facebook, Google, Amazon, and Microsoft) and a lack of privacy and control in society in general.

Security shouldn’t be an issue in the public cloud — your apps should be more secure running in AWS than they are in your marginally-equipped data center with your surly security staff. But you’ve got to admit that putting all our eggs in just a few giant cloud baskets gives those basket owners — a few giant commercial and governmental actors — a lot of power over your apps and data, given what we know in a post-Snowden world. Monoculture agricultural crops are biologically unsustainable, and there’s an argument that monoculture clouds may be as well.

(Funny story behind Snowden’s appearance and a domain name — see Mark Collier’s story in this video.)

Takeaway. There are real reasons to choose putting apps in a private cloud, and companies are going to continue to use a mix of apps hosted all over the place. OpenStack is a very viable choice if you need a private cloud, but you’ve got to really want to use it. If there is going to be a “universal deployment platform” it’s looking more like Kubernetes than VMware or OpenStack.

As Ben Kepes said in this DockerCon recap, “OpenStack as a project is a real good thing. OpenStack as a business maybe not so much.”

As far as keeping it easy to consume, though, keep your eye on “managed private cloud” that is hosted either publicly or privately — this could be an increasingly important consumption model because it’s easy to get started and easy to run. Please throw out any old-fashioned IaaS, PaaS, SaaS assumptions you’re working with. There are many kinds of aaSes these days.

Thanks to Stu and whole SilconAngle and Wikibon gang for inviting me to be part of theCUBE!

Worth a Click

The eternal battle for OpenStack’s soul will conclude in three years. Again. by Michael Coté at the Register.

With public vs. private cloud costs, it’s hard to account for the optionality of future price drops, likely better security and middleware, and the overall benefits of scale when it comes to innovation, costs, and operations excellence that public cloud can provide.

Nonetheless, the analysis persists: 451 Research says that breakpoint is somewhere around 400 VMs per operations engineer. They also have a really boss chart that uses a sort of “after-hours” version of those sizzling, Spring Breakers-inspired color palettes that are all the rage in the football boot community nowadays.

If you find yourself wanting to build private cloud, my executive friend went on, it’s certainly possible to hire a team to spin up OpenStack. Vendors like Mirantis, SUSE, Canonical, Red Hat, and even VMware are happy to help.

Let’s give Rob Hirschfeld (@zehicle) the last word this time on OpenStack. How is OpenStack so dead AND yet so very alive to SREs? on VMblog.com.

If not dead, then what has OpenStack become? It remains a central open infrastructure community.

A focus on open operations software and hardware is the core reason that I continue to invest in the OpenStack community. From the beginning, the project has attracted people who believe that running IT in an open, shared way creates value for everyone. We’ve felt that we could be more innovative together and knew that there was an profitable ecosystem to build. Along the way, we’ve hit a few bumps including run-away vendoring and losing sight of core. I see that the community is making adjustments that include fully embracing technologies that were once considered competitive.

Infrastructure is not that sexy, but it is essential.

Telcos becoming cloud providers doesn’t seem to work also by Coté on his blog, pointing to a 451 report on CenturyLink and Verizon. (From my experience 15 years ago I’d also point to expertise — many of you know the kinds of skills you to bring to the table, both pre- and post-sales, to be a valued IT partner; it’s tough for a telco to bring that kind of higher-valued knowledge when they’re used to selling just connectivity.)

Since the late 2000’s, one of the cloud strategy theories was that existing telcos and network providers could become public cloud providers. Many, if not all have tried and/or trying. Thus far, it’s been a rocky road: few synergies seem to be sleeping on the ground, ready to roused up to go fight the giants, or, at least, carve out niche spaces.

How AWS Cloud is demolishing the cult of youth by James Governor on his Redmonk blog. Noting the recent hire of James Gosling joining James Hamilton, Tim Bray, Adrian Cockroft, there may be a trend.

When you sit down with one of the AWS engineering teams you’re sitting down with grownups. At a guess median age would be 40-45, someone like Andi Gutmans, now 41, one of the original creators of PHP, who now runs Search and New NoSQL for the firm.

Getting Nerdy on the Oracle Ravello Cloud Service by Chris Wahl on his blog

The idea is to target most of the enterprise that has been ignored by the remainder of the world. Those unsexy, heavy, old applications that chug along and fill most company’s coffers with cash. It’s not all that feasible to refactor these applications in the near term, so providing a cloud environment that can go down to the bare metal for the 5% of “really tough” applications is offered as something the enterprise would like to consume when compared to co-locations or running their own data centers. For the remainder – the 95% or so of general purpose and “simpler” applications – the use of Ravello can be leveraged to essentially do a binary copy of the applications directly into Oracle’s cloud offering. These level of effort is advertised as being quite low due to the presentation of network, storage, and compute topologies by Ravello.

Let’s Catch Up

For those of you who are Marketeers:

We’re having a great time in the Influence Marketing Council; here’s an update. We had a lovely dinner with executives and some blogger types in Boston at OpenStack Summit. Thanks to all who came, including IMC members from NetApp, HPE, and Big Switch Networks.

Our new podcast, the Influence Marketing Podcast, may already be launched by the time you read this. Check it out if you’re interested in how companies can work better with the humans around them.

OK, we’re back.

TechReckoning organized the Oracle Ravello Blogger Day event this week in Redwood City. Chris Wahl wrote about it above, and  check out hashtag “#RBD1” for more of the action.

Geek Whisperers #131: Evangelists, Find Your Career Bucket in which we revisit the topic of evangelists, org charts, and connecting back to the business.

Geek Whisperers #132: Preparing to Keynote at Events with Renee and Emily. So you want to start giving conference keynotes? Renee and Emily have seen a million of them and know what works and what doesn’t.

I made a guest appearance on the In Tech We Trust podcast Episode #122 – Dependable Tech. Love the new magazine/anthology style format built from segments around a theme! Very NPR-ish.

Right now I’ve just got Pure Accelerate and maybe Cloud Foundry Summit on the calendar. Let me know when you’re in the Bay Area – we’d love to say hi!

Just hit reply

I’ve been wondering lately: what do you see as the role of a personal blog in 2017? And confession time: what’s the state of your blog at the moment?