Author: Alan Shimel

  • New DevOps Book: Leading the Transformation

    New DevOps Book: Leading the Transformation

    When I first started researching DevOps and was looking for early enterprises that were successful but not “Unicorns” I was introduced to Gary Gruver. At the time Gary had led the transformation at Macy’s and he was talking about it at several DevOps events.  For me it was strong proof that DevOps could work beyond the native-cloud companies and start ups. Gary had made it work at Macy’s and at HP before that. In fact Gary had co-authored a book on his experience at HP, “A Practical Approach to Large-Scale Agile Development: How HP Transformed LaserJet FutureSmart Firmware (Agile Software Development Series)”

    I was lucky enough to meet Gary around then and have stayed in touch since then. He left Macy’s and was consulting helping companies transform from waterfall to agile and DevOps.  I knew that he was working on another book.  Well finally I am happy to report that Gary’s new book is now available:

    leading the transformationLeading the Transformation: Applying Agile and DevOps Principles at Scale. Gary is actually co-author of this along with Tommy Mouser. The forward is by Gene Kim and the book is published by Gene’s IT Revolution.  I have just started reading it, but knowing Gary and from what I have read all ready, it should be a must read on your DevOps book list.

    As a special treat for readers of devopsy.kinsta.cloud, we are very happy and proud to offer our readers a sneak peek at this exciting new book. At the bottom of this article is a link to a PDF with the first two chapters of the book free for you to read! Of course we are sure that once you read the first two chapters you will head over to IT Revolution and buy the full copy.

    BTW, don’t take our word about how good Gary’s book is.  Here is what Jez Humble, VP Chef, author and DevOps leader said:

    “If you want to understand how to lead a Continuous Delivery or DevOps transformation in your company, there’s no better book than this. Concise, practical, and based on hard-won executive experience, this book is essential reading for every IT executive.”

    So click the link and enjoy!

    Leading the Transformation

  • Alert Logic lends more agile, cloud-native security to DevOps architects

    Alert Logic lends more agile, cloud-native security to DevOps architects

    Amid the avalanche of research and product news emerging from this year’s Black Hat USA 2015 conference, held in Las Vegas this week, at least one vendor is attempting to advance a new solution aimed at empowering DevOps architects to streamline and improve security workflow.

    Houston-based Alert Logic announced the release of its Cloud Insight solution on Tuesday, positioning the offering as a cloud-native vulnerability and configuration management package designed for customers running on Amazon Web Services (AWS). Cloud Insight promises to integrate with AWS native security features, providing an integrated view of potential host and application-level vulnerabilities.

    By empowering operational teams, including DevOps architects, to identify and move to remediate vulnerabilities before affected applications code is pushed into production, company officials claim, the solution promises to both improve the configuration of resulting infrastructure and remove obstacles related to traditional cloud security management.

    “This solution is specifically aimed at helping AWS users who are not security professionals, such as operations and DevOps teams who deploy the infrastructure, address inherent security issues,” said Rahul Bakshi, Senior Director of Product Management at Alert Logic.

    “When you think of rolling security into the existing model, typically it interrupts the notion of continuous deployment, as historically it hasn’t integrated via the application or plugged into automated orchestration systems, becoming a hindrance,” Bakshi said. “That’s where this approach introduces a significant advantage, allowing organizations to identify and fix high risk vulnerabilities before the code gets pushed to production.”

    Unlike traditional vulnerability management specialists, such as Qualys or Tenable Network Security, which require users to manually configure and review data and provide only a “partial” view of cloud platforms such as AWS, Alert Logic claims that Cloud Insight lends critical automation to involved processes and allows ops teams to gain far deeper visibility into AWS services level security.

    Alert Logic has already won some customers over with its ability to enable greater control over applications security in the cloud. Speaking at the annual AWS Summit, held in San Francisco in April, Colin Bodell, Chief Technology Officer at publishing giant Time Inc., highlighted some of the work his company has done leveraging the vendor’s existing Security-as-a-Service offerings.

    “AWS is great for physical security, or for network security, but when you’re building an application you need to own security of the application yourself,” Bodell said. “AWS doesn’t know how you’re building things and you can build them in any weird and whacky way that you like; Alert Logic has been an amazing partner.”

    In the recent report, “Market Overview: Cloud Workload Security Management Solutions – Automate or Die”, published in June, analysts at Forrester Research highlighted the specific need for new security methodologies that integrate and automate processes to stem potential DevOps bottlenecks.

    “One of the key benefits of DevOps is to enable continuous integration of code and continuous delivery of apps and infrastructure,” the Forrester report notes. “To keep up, [security and risk management] pros must make security processes more embedded, faster, and more continuous – otherwise, security will slow down code release.”

    In terms of bringing Cloud Insight – which exists as a solution, rather than a SaaS service offering – to market, Alert Logic claims that it is successfully appealing to organizations’ hopes to embed AWS vulnerability management further within operations, despite introducing an altogether new and unfamiliar approach.

    “Beta customers seem very positive as we’re reducing the security workload and time related to remediation handoff for cloud architects,” Bakshi said. “There’s always a continuum for education, but with the culture of responsibility [for AWS security] evolving, we think that we’re meeting demand at just the right place.”

    Dan Raywood, Analyst at 451 Research, said that Alert Logic could take advantage of related demand by leveraging the combination of its existing cloud security expertise along with capabilities added via its January 2015 acquisition of Critical Watch.

    “I think it’s a very interesting move for them as even though they did have something offering this‎ type of scanning previously; the acquisition of Critical Watch added the engine to do continuous scanning and change management,” said Raywood. “The major bugs of the last year have driven business to assess and respond immediately, and having something which tells you if you are vulnerable or not a few clicks away is a really useful tool for businesses.”

    About the Author/ Matt Hines

    matthinesMatt Hines has over 18 years as an IT marketing/communications professional at companies ranging from ground-floor startups to established industry leaders with emphasis on advancing broader understanding of key technology industry trends, market drivers, customer requirements and innovative products to highlight value, increase awareness and drive revenue growth. Additionally Matt has a decade-plus writing in IT journalism covering leading trends for a wide array of industry-leading business technology publications including eWeek, InfoWorld, CNet and TechTarget. You can reach him on LinkedIn

  • DevOps fast food: Chef on the AWS marketplace,

    DevOps fast food: Chef on the AWS marketplace,

    News from the AWS Summit in NYC today is that Chef is now available as a one click install on AWS via the AWS marketplace. While the ability to use Chef on AWS is not new (it is the leading configuration management tool on AWS), being on the marketplace makes both install and billing a one click deal. This should make it really simple to get Chef installed and running for anyone looking to leverage the many benefits Chef brings to configuration management and automation. Literally with one click install what could be simpler?

    As part of this new arrangement not only will Chef on the AWS marketplace be available, but it will also be a featured offering.  Chef and AWS already enjoyed a cozy relationship (they are both based in Seattle and there is a cross-pollination of personnel). This deal takes the relationship to a higher level.  Both Chef and AWS are dedicating significant resources to marketing, sales and support of this initiative.

    I know from speaking to AWS in the past and other marketplace vendors that AWS will often let partners list on the marketplace, but they don’t often then dedicate resources to roll out, marketing and support. Further, as far as I know Chef is the only configuration management/automation solution that is available via the marketplace like this. I don’t know if this will remain the case or for how long, but for now it is somewhat of an exclusive relationship.

    I had a chance to catch up with Ken Cheney, VP of Business Development and Jay Wampold, VP of Marketing at Chef about this expanded relationship the other day.  They both emphasized that this is much more than just listing Chef in the AWS marketplace.  Some estimates I have seen have Chef deployed on something like 70% of AWS deployments.  Ken and Jay believe that this number will continue to remain high and may even go higher as a result of the marketplace presence and the push from both Chef and AWS.

    On top of their previously released expanded relationship with Microsoft via Azure, it seems Chef is putting a stranglehold on two of the largest cloud platform providers in the world. That doesn’t mean that other configuration managers don’t have presence on AWS or Azure, but Chef seems poised to be in a dominant position on these platforms.

    As we see more enterprises continue to migrate more and more infrastructure to the cloud this presence will become more and more important. For now you can get Chef fast on the AWS marketplace.

    Chef on AWS Marketplace

  • Managing many hosts is more than a Big Data problem

    Managing many hosts is more than a Big Data problem

    Back in my days at StillSecure a major problem we had with our vulnerability management platform was managing vulnerabilities over a large number of hosts. How can you effectively manage so many hosts, visualize them across the entire deployment? It gave our GUI designers and developers fits.

    In today’s world of virtual instances, containers and apps, managing a large number of hosts is even a bigger challenge. It is a daunting task that even the largest companies struggle with. In fact in some ways the bigger the company, the greater the amount of hosts and the harder it is to manage. I wanted to highlight today how one company, Datadog has tackled this problem with their Host Maps feature.

    The trick to managing large numbers of hosts is to balance a global view with an individual host view. It is harder than it sounds though. It is almost like joining Einstein’s Theory of Relativity with Quantum Mechanics. How can we use one view to see things on both the galactic scale and the molecular level at the same time. Datadog has developed one of the best ways to do this with their instant grouping and drill down capability.

    Instant grouping allows you to virtually (no pun intended) define groups on the fly by a large number of tags and filters. So for instance you can use standard AWS tags. You can also group hosts by tags and they will be visualized this way.

    This was where we ran into the wall on our vulnerability manager. We were never able to create groups on the fly. You could define groups by certain filters but drilling down from there was out of reach. With Host Map feature you can create a group of hosts that have a certain feature or attribute in common and then drill down into that group with the click of a mouse. The YouTube video below shows you much better than I have described what I am talking about:

    Datadog’s designers have also made great use of color selection and shaping to help make visualization much easier for the end user. Pretty nifty use of simple technology.

    Not to turn this into a love fest for Datadog Host Map, but I am not aware of others who have instituted this kind of on the fly grouping and drill down capability to address this Big Data type of problem. If you know of one, I would love to hear about it.

    From the point of view of looking at how the state-of-the-art has evolved from when we were trying to tackle this issue 10 years ago, it is impressive to see how far GUI has progressed. I think it is a clear case of “mother is the necessity of invention”. It would be near impossible to manage the kind of host deployments we see now without this type of functionality.

    I did have a chance to speak to a few Datadog customers when I reached out to Datadog about Host Maps. It was unanimous that they feature was as valuable to them as it looked to me. Now of course one could say that Datadog wouldn’t refer me to customers who didn’t like the product. But my impression was that this feature was indeed a big help to them.

    As we continue learn to better manage data flows and manage ever growing infrastructure, I think we will continue to see the evolution of management GUIs like what Datadog has done here.

    What about you? What GUI functionality have you run across that you think is worthy of praise? I am sure others would like to know.

  • Say hello to Container Journal

    Say hello to Container Journal

    Today we launched a sister site to devopsy.kinsta.cloud – Container Journal. The url for the site is http://www.containerjournal.com. The site is dedicated to spotlighting everything about containers and computing (as opposed to containers like in the Container Store). This includes not only the containers themselves, but everything that goes along with it.  Topics wil include container management, data management for containers, container security, networking for containers – in short the entire container ecosystem.

    Right now most of the content on Container Journal was container related content that was originally on devopsy.kinsta.cloud. However, over time Container Journal will have more and more of its own original content that will not appear here devopsy.kinsta.cloud. So you will need to check Container Journal to stay up on the latest container related content.  A good way of doing that is to sign up for the Container Journal newsletter.

    In addition to articles Container Journal will feature webinars on container related topics, as well as other special features including ebooks and surveys. Many of the outstanding authors who contribute to devopsy.kinsta.cloud will also be writing for Container Journal as well.

    We are looking for good container related content though. If you would like to contribute to Container Journal, write me at editor@devops.com with your request.  We are also seeking sponsors, partners and advertisers for Container Journal as well.  In a relatively short time, we think Container Journal will be largest media site with a dedicated collection of container related content.  This is your chance to be part of it. Sponsor info can be had at sponsor@devops.com.

    Also be sure to check out the Daily Poll on Container Journal. We will be asking some great questions with rapid feedback on what others are saying.

    Like any new venture, I am sure there will be growing pains with Container Journal. Please keep me posted if you notice anything.

  • ElasticBox enhances Container support with new release

    ElasticBox enhances Container support with new release

    ElasticBox announced a new version of their product today that enhances Container support. In yet another example of how important Containers are becoming to today’s software development scene, ElasticBox will now allow you to define microservices as Docker files in containers.

    Other enhancements include (from the press release) :

    UI Enhancement: Tags now make it easier to sort and find items quickly throughout the product. The rich interface enables IT Ops and Development teams to visually assess the latest status of instances, share and manage boxes, and collaborate easily.

    Deployment Policies:  New functionality allows policies to be boxes, enabling customers to share virtual infrastructure resources from providers like AWS (Amazon Web Services) without having to expose AWS account specifics. Policies have claims that enable IT Ops to tag virtual machine properties, such as platform, instance type, OS family and more. Like all boxes, these deployment policies are reusable and sharable.

    Script Boxes: Script boxes are powerful building blocks that can be shared and reused. Variables and script events are stored here. With the addition of requirements, Script boxes have tags to identify the platform, runtime and infrastructure dependencies of the box. At the time of deployment, the requirements and policy claims can be easily married, so developers can self-service the appropriate infrastructure, and IT Ops has the reassurance that the right infrastructure resources are being consumed.

    Automatic Updates: With semantic versioning of boxes, customers can now choose automatic updates for major, minor and patches of instances. This enables rapid, efficient updates at scale for enterprises.

    Enhanced Container Support: As more customers experiment and deploy to containers, ElasticBox can now support containers, such as Docker, as a new box type. This enables enterprises to define microservices as Dockerfiles in containers, which then can be linked via bindings. With this enhancement, the lifecycle of application services can be easily managed.

    vCloud Air and vCloud Director Support: ElasticBox supports a multitude of private and public cloud infrastructure providers. Enterprises with VMWare’s vCloud Air or vCloud Director workloads can now leverage ElasticBox for complete workload automation. At deploy time, ElasticBox auto provisions vApps, one template per VM, and orchestrates automation.

    I had a chance to speak with Carol Carpenter, CEO of ElasticBox on the new release:

    Q. Why is this latest release so important?

    As DevOps matures, we see that companies seek to not only provision applications faster but reduce inter-dependencies between development, QA, and IT Ops. Kill the cruft in the application cycle.

     This latest release of ElasticBox brings deployment policies for DevOps to retain needed control and visibility while enhanced container support delivers more flexibility to application teams.

    Q. What’s changed?

    Many enterprises have built their application deployment workflows around a handcrafted potpourri of tools and processes. When faced with scale challenges from the business, existing tools are fragile and expensive in terms of failed builds and troubleshooting time. ElasticBox brings an adaptive off-the-shelf management solution so enterprises can spend less time re-tooling and more time shipping code.

    Q. What’s next?

    ElasticBox is built by developers who want to ship code faster to the cloud, and we’re committed to this mission. We’ll continue to ensure our platform adapts to customers’ evolving environments, regardless of which technologies they choose for their development and operational stack.

    More information on the new release can be gleaned from ElasticBox CTO Alberto Arias Maestro’s blog.

    devopsy.kinsta.cloud is working with ElasticBox on a new DevOps survey right now. You can take the survey and win an Amazon Gift Card or 3dr Drone by taking the survey here.

  • Visualizing and defining requirements comes to DevOps

    Visualizing and defining requirements comes to DevOps

    We have all seen the nice circular diagrams of a DevOps methodology for application lifecycle management (ALM) like the one above. We interject some automation, make the two halves work closer together, get some feedback loops going and go as fast as we can. But lets look at those first two steps in the diagram, the ones labeled consult and design. What and how do we accomplish this? There is a company called iRise that has built a great business by allowing for rapidly visualizing and defining requirements for building applications. It is high time we recognize this as the important piece of the puzzle that it is.

    I recently had a chance to meet with some of the executive team of iRise while I was in London for the CD Summit.  The premise of iRise is so simple I was thinking to myself, “why hasn’t anyone else thought of this?”  If the old adage of crap in is crap out is true, why wouldn’t we take the time to define and plan our software better early on? I know everyone thinks they do, but do they really? Do we quickly visualize to help define the requirements and to help the team buy in and sign off? If it is set up right to begin with, it flows a lot faster later.

    Now the folks at Tasktop creators of the Eclipse Mylyn open source tool have teamed with iRise to OEM iRise into the Tasktop Software Lifecycle Integration system. In speaking with Stephen Brickley, EVP of iRise, he thinks this partnership will be a key factor in bringing iRise into the mainstream DevOps tools market.

    iRise’s customers, like software departments everywhere are adopting new ways of developing and operating software. New times and new ways don’t mean that you throw out what works though. To me it is a no brainer. If you have a tool that lets you quickly visualize, prototype and communicate to the rest of the team before investing a lot of effort into development, it really has to help.  It is the ultimate shift left.

    I guess the issue is how quickly can you do this without adding extra steps to the development process. From what I saw of iRise it makes it really easy and fast. Of course I would be interested to hear from anyone who has used iRise or even a similar tool on your own experience. But if it all is as it seems, I would expect iRise to be a welcome addition to the DevOps toolbox.

    What do you think? What tool do you use for this now or do you just skip this in planning and initial requirements? We are always on the lookout for new tools to report on at devopsy.kinsta.cloud, but ultimately we depend on our readers to tell us what is really useful or not.  So let us know.

  • There is only one DevOps Connect

    There is only one DevOps Connect

    They say that imitation is the sincerest form of flattery. If that is true I guess the folks over Informa Telecoms and Media Ltd are very, very sincere. Why else would they change the name of their DevOps Conference from “DevOps Summit” (which name they “borrowed” from the Sys-Con folks) to DevOps Connect Europe.  No matter that we here at devopsy.kinsta.cloud have already held several events in Europe and London specifically with our DevOps Connect name. No matter that we have a website and own the domain http://www.devopsconnect.com.  Why shouldn’t they just use our name and employ the “colorful” technique of registering a hyphenated play on the domain name? I guess that alone should tell you all you need to know about this company and the events they produce.

    Now of course we can go hire some International copyright attorneys and litigate first usage and ask for injunctions and damages. But why bother? I am a big believer in letting the market be the judge, jury and executioner.  I am perfectly fine with using devopsy.kinsta.cloud to get out the word about these kinds of business practices and letting the market act.

    The event these people want to put on will probably be no better than the several DevOps Summit events they put on previously. I have heard from exhibitors, speakers and attendees of those events that they were less than successful. Mind you I haven’t attended any, just reporting on what I was told. Ultimately though if they were successful they wouldn’t be trying to rebrand using someone else’s name.  Hard to argue with that logic.

    I am asking our readers (and there are many of you in London,  as it is our single biggest city for viewers) to let this company know that copying others business names will not stand. The best way to do this is to not attend, don’t participate and get the word out that this is not the way business is done.

    Don’t be fooled by the attempt to piggyback our brand and success, we have nothing to do with that event. In fact we will be holding several DevOps Connect events in London and elsewhere in Europe in the fall.  Details will be announced shortly but there will be lots of opportunities to participate.

    Some of you may ask, “you haven’t given us the link to this event?” You’re right, I have not and for good reason. I have already given this company and their event more ink than they are probably due.

    So be aware of imitators, remember there is only one DevOps Connect and those are the events put on by us at devopsy.kinsta.cloud. We hope to see you at them and will be sure to let everyone know when we do. Until then don’t reward imitators.

  • ClusterHQ and devopsy.kinsta.cloud survey show Containers poised for mass adoption

    ClusterHQ and devopsy.kinsta.cloud survey show Containers poised for mass adoption

    devopsy.kinsta.cloud and ClusterHQ, conducted a survey on Container usage that shows an overwhelming majority of users have either already using, testing or investigating Container usage. With 285 respondents representing a wide range of organizations, it shows that Containers will be part of many production environments in the very near future.

    Currently, only 38 percent of respondents reported using containers in production environments, but that number is projected to increase 69 percent over the next 12 months as organizations find new ways to address important barriers to adoption. It verified that Docker is overwhelmingly the container of choice, with 92% of respondents having used or investigated it, followed by LXC (32%) a distant second, but still far ahead of Rocket (21%). To access the complete survey and report visit https://clusterhq.com/assets/pdfs/state-of-container-usage-june-2015.pdf.

    Companies ranging in size from small organizations with 1 to 500 employees (69%), to mid-size companies with 501-2,500 personnel (12%), all the way up to large enterprises with over 2,500 employees (19%) are represented in the survey. This demonstrates that containers are being embraced by all businesses from the startup stage to Fortune 500 companies.

    Respondents came predominantly from Development, Operations and DevOps teams. QA and security teams were a smaller share. The survey revealed how container technologies are being used today, as well as research-based insights while providing clues as to where the industry is trending.

    From the ClusterHQ release on the survey:

    The survey also revealed insights into what is perceived to be the primary barriers to container adoption. Security seems to be emerging as a consistent concern throughout the DevOps community in these times of never ending breaches throughout the world:

    • Security — 61%
    • Data Management — 53%
    • Networking — 51%
    • Skills and Knowledge — 48%
    • Persistent Storage — 48%

    Data Management capabilities also emerged as essential to the success of container strategies and that the vast majority of organizations want to run databases as well as additional services in containers.

    • When asked to rate how important data management is to container strategies, 66 percent reported it as a critical or important gating factor, 29 percent ranked it as moderately important and only 5 percent reported that it carries no importance.
    • Over 70% of respondents said they would like to run a database or other stateful service in their container environments.
    • Respondents were also asked which specific features of container data management they considered to be most important, selecting the “integration of data management capabilities into existing container workflows and tools” as their first choice, with “seamless movement of data between dev, test and production environments” a close second.
    • MySQL (53%), Redis (52%), PostgreSQL (50%), and Elasticsearch (43%) were reported as the top four most frequently used stateful services.

    Containers have become known for portability and flexibility, the survey reveals that organizations are using them in different infrastructures but most frequently in on-premises data centers (57%), followed by Amazon Web Services (52%).

    So I think it is safe to say Containers are rapidly becoming one of the staples of development and are here to stay to stay in the foreseeable future.

    devopsy.kinsta.cloud along with ElasticBox are currently conducting another survey on “What is DevOps to you?” One in 50 respondents wins a $50 dollar Amazon gift card and one grand prize winner will win a new 3DR Drone. Take a few minutes to help us with this survey.

  • CA beefs up DevOps offerings with Grid-Tools acquistion

    CA beefs up DevOps offerings with Grid-Tools acquistion

    After a relatively long hiatus from the M&A scene CA seems to be back with bang. Following on the heels of its nearly half a billion buy of Rally Software, CA yesterday announced the acquisition of Grid-Tools. Grid-Tools is a test data management market leader. Prior to the acquisition they were a partner of not only CA, but HP and Oracle as well.  Post acquisition it will remain to be seen whether HP and Oracle remain important partners.

    Taken with the Rally acquisition a week ago this buy makes a strong statement that CA is doubling down on DevOps. Of course Rally literally wrote the book on Agile and with Grid-Tools leadership position in its space, CA has in one week brought in two leading companies in their space.  As with any acquisition integration is always a question. In this case it is a double helix of integration. Integrating Rally with Grid-Tools and both into the larger CA portfolio will take some work.

    Last week I spoke to James Harvey, General Manager and SVP, IT Business Management Division at CA Technologies. One of the topics we spoke about was that CA in buying Rally was not only buying some great IP and products, but also getting some top people. The Grid-Tools acquisition brings another influx of new blood to CA as well.  On top of this CA also announced the appointment of Otto Berkes as CTO.

    Taken all together we get a picture of CA on the move. They are adding new ideas, new people and new products as they seek to transform from a software provider in the mainframe space to a major player in the new application economy.

    One of the things that I think we will also see CA move into in a bigger way is SaaS and services in general. Unlike many of its competitors, CA has remained a traditional software vendor for a long time. But with the state of technology today, offering software as a service and offering consulting services around the software is more and more a requirement rather than a luxury. This may cause some angst among CA service delivery partners, but I feel it is an inevitable step in CA’s market evolution.

    Another telltale clue will be CA’s ability to retain the talent at these acquisitions. All to often brain drain occurs after acquisitions. I have not seen any announcements around management teams staying on post-closing, but CA could use the talent. They have seen some executives leave recently.

    The real winner in all of this in my opinion is DevOps. Large technology providers continue to load up on DevOps offerings in anticipation of the larger global enterprise market adopting a new way of IT that includes things like Agile, DevOps, Cloud, SaaS, etc.  It also bodes well for future acquisitions in this space by CA competitors which should help make some VCs sleep easier about their investments in startups in the space as well.

    BTW, in the interests of full disclosure CA is a sponsor/advertiser here on devopsy.kinsta.cloud, though we had no special notice or insight into any of this news.