Category: Features

  • Loggly Derived Fields Add Structure To Unstructured Logs

    Loggly Derived Fields Add Structure To Unstructured Logs

    The Gist of Loggly’s Derived Fields Gesture

    A top log management product vendor, Loggly announced an update to its tooling last month in the form of its new Derived Fields. The vendor has drilled down past the summaries in its Dynamic Field Explorer interface into Derived Fields that use metadata to structure unstructured log data.

    Where traditional log management and analysis products have typically required you to create one-off regular expressions for custom analyses—expressions that you must build anew each time you want to put log data under a microscope—Loggly now enables you to use rules rooted in regular expressions that you create once to structure unstructured data when your systems first enter logs into the tool. You can look at resulting Derived Fields instantly, every time you need to do log analysis, according to Hector Angulo, Head of Products, Loggly.

    The necessity for the Derived Fields capability arises from the fact that logs that escape structured creation contain so much untapped value. Until now, Loggly’s approach has been to automatically apply structure to common log types. “But we find that more than one-third of customer logs are still not structured. Even worse, many of these logs were created by developers for their own use, without the expectation that others would need to rely on them for critical troubleshooting. As such, it can be really hard for everyone but the original developer to decipher what specific logs mean,” says Angulo. Derived Fields attempt to retrieve 100-percent of that value from the log data by making analysis possible for any team member.

    How Loggly Dogs Data Using Derived Fields

    Loggly absorbs data from common log types such as Apache or JSON. By adding metadata that describes unstructured log data and then “injecting” context and structure into logs or parts of a log, Loggly’s Derived Fields reclaim obscure developer logs. Fields that uniformly describe the same kinds of data elements across logs enable users to compare data within logs to see what is happening across a DevOps environment.

    Staff members who can create custom parsing rules based on regular expressions can set up the rules the DevOps teams will need at the start. Then, unless you come up with a new rule you want to add, your team members won’t have to create regular expressions again, and certainly not in order to search log data on the other end of that pipe.

    Using Derived Fields

    Using Loggly’s Derived Fields, you can drill down on a specific value in a field. Click on the field name and you can inspect all log events that have the same type of value. A summary chart above the individual event log will automatically refresh to summarize the events of the data from the given value, says Angulo.

    You can easily see other log events that share similar data or characteristics in order to arrive at insights about what is going wrong, or right with the software.

    How Derived Fields Help DevOps

    “Rather than starting with an empty search box, Loggly starts off with bird’s-eye-view summaries using Dynamic Field Explorer,” says Angulo. From there, you drill down to fine grain details.

    The time that Loggly’s Derived Fields save, time that it would normally take to create one-off queries for every analysis, is critical if you’re trying to solve a problem that is preventing end users from completing tasks and generating revenue for the business, says Angulo.

    According to Angulo, Derived Fields specifically help DevOps teams to:

    • Resolve issues faster because it is easier to spot the data that matters.

    • Perform advanced analytics even with legacy applications that send out unstructured, text-based logs that you cannot update or don’t have the bandwidth to update.

    • Extend advanced log analysis to more team members. You don’t have to be a regex wizard to gain insight from unstructured logs.

    • Finally, the intuitive, navigable summaries generated in Field Explorer equate to less training time, less time with reference guides, and more time on data analysis and problem solving.

    A Cautionary Note

    As with any DevOps tool update, the proof lies in how Derived Fields work in your development process. Loggly touts 5K customers using its existing product. I’m sure they’re not trying to chase anyone away.

    Are you using this tool? Do you have other input on this topic? See that empty comments field below?

  • Meeting the Relentless Mobile App Demand of the Enterprise

    Meeting the Relentless Mobile App Demand of the Enterprise

    Talk to any CIO today and one of the most pressing challenges they face is building mobile apps that enterprises want to use as fast as they need them. Most enterprises today have huge mobile app backlogs with no sign of it getting any better.

    According to Gartner, the demand for enterprise mobile apps will be a $40 billion market by next year. And, according to its latest enterprise application trend findings, by the time 2017 comes to an end, market demand for mobile app dev services will grow five times faster, or more, than internal IT organizations’ ability to meet that demand. Gartner forecasts mobile phone sales will reach 2.1 billion units by 2019.

    “Organizations increasingly find it difficult to be proactive against competitive pressures, which is resulting in their mobile apps becoming tactical, rather than strategic,” said Gartner analyst Adrian Leow. “We’re seeing demand for mobile apps outstrip available development capacity, making quick creation of apps even more challenging. Mobile strategists must use tools and techniques that match the increase in mobile app needs within their organizations,” Leow said.

    Interestingly, according to Gartner, employees today use about three different devices daily. Gartner expects that to hit five or six soon. With many firms embracing BYOD, mobile development teams will be pressured to build more apps under more pressure for more form factors than ever before. And they are already pressured. Consider this: A 2014 Gartner survey on mobile app development found that the majority of organizations have developed and released fewer than 10 apps, with a significant number of respondents not having released any mobile apps.

    In its statement, Gartner detailed four practices it feels are necessary to meet mobile enterprise mobile app demand. They’re a good start, but not enough. I share Gartner’s practices in the next paragraph. The practices I also think are necessary to meet enterprise mobile app demand will be included in a follow-up post next week:

     

    1) Prioritize app development

    Mobile development teams are overstretched and have difficulty effectively delivering the growing number of mobile apps in their queues. The result is apps being built on a first-come, first-served basis, with the line of business making the most noise having its needs met first. This lack of value-driven prioritization leads to inefficient use of IT resources and a degradation in the quality of apps delivered. According to Gartner analysts, mobile development teams need to formulate a process of mobile app prioritization that involves understanding the needs of business stakeholders. This will be a key factor in defining common criteria for evaluating mobile app projects.

    2) Adopt a bimodal IT approach

    Integration is often the largest part of the effort of delivering an enterprise mobile app, with many app development teams underestimating the time and resources required for integration during the planning stage of the traditional waterfall methodology they are following. Gartner believes organizations need to replace this traditional IT development approach with a bimodal strategic approach that supports innovation and agility to deliver apps more efficiently and quickly. Bimodal approaches consist of two models: Mode 1 drives the creation of stable infrastructure and APIs to allow apps to retrieve and deliver data to back-end systems without impacting those enterprise applications, while Mode 2 uses high-productivity, agile approaches to quickly deliver front-end app features required by the business.

    3) Use rapid mobile app development (RMAD) tools

    Using development tools that can produce apps more rapidly is crucial for enterprises to help bridge the gap between mobile app demand and supply. Significant innovation is driving this market and replacing traditional coding approaches, such as native development tools, with more effective RMAD tools. There are many approaches to RMAD, including drag-and-drop codeless tools, code generation and orchestration, model-driven development, virtualization, forms construction, and others. These approaches are allowing those with no programming skills or coding ability, such as people in business roles, to rapidly assemble mobile app prototypes and continuously iterate on these designs.

    4) Adopt a mixed-sourcing approach

    Organizations want to have full control over their mobile app development initiatives, however, maintaining a pure in-house development environment is difficult to achieve given mobile is a relatively new competency to many developers. It entails many complexities and specific activities, such as UX design and psychology or cellular coverage testing, which may be more efficiently handled by an outsourced third party experienced in mobile app development. Gartner believes organizations will improve their in-house mobile development skills over time, but currently only 26 percent of organizations are adopting an in-house-only development approach, while 55 percent are successfully delivering apps using mixed sourcing.

  • AppFormix promises to help you manage your cloud infrastructure more efficiently

    AppFormix promises to help you manage your cloud infrastructure more efficiently

    Application Performance Management (APM) tools are great for…well, for managing application performance. AppFormix believes, however, that APM only takes you so far. You also need to manage infrastructure performance.

    The theory behind APM is simple enough: proactively monitor applications to detect and resolve issues in real-time without undue impact on application performance. What if the issues affecting application performance don’t have anything to do with the application itself, though? There are multiple components involved in developing, deploying, and running an application. One very important element of app performance is the infrastructure hosting and delivering that app. AppFormix wants to help organizations bring that same sort of APM visibility and efficiency to proactively addressing issues with the underlying infrastructure.

    In a press release announcing its exit from stealth mode and availability of AppFormix in beta, the company said, “Applications can only perform as well as the infrastructure they run on. Truly reliable performance can only occur when cloud infrastructure is more responsive to the needs of developers and their applications. AppFormix software automatically detects and eliminates resource contention among applications on shared infrastructure. Resource bottlenecks are always moving, and AppFormix is focusing on enabling developers, operations and DevOps teams to use the same toolset to pinpoint them in real-time and establish policies for preventing problems in the future.”

    In the world of DevOps and open source it’s crucial for tools and platforms to play nicely together. It seems that AppFormix delivers on that front. The company claims that AppFormix integrates with OpenStack, Kubernetes, Mesos and other platforms to enable organizations to effectively manage the physical infrastructure while also providing visibility and management for the virtual environment and container technologies.

    “For example, let’s say your application is a flashy, new (and expensive) sports car. Would you drive it on a dirt road? A rickety bridge? A street cratered with potholes? Of course not. But unfortunately cloud infrastructure today IS that dirt road, it IS that rickety bridge, and it IS that street cratered with potholes,” explains Sean Dunnigan in an AppFormix blog post. “If your enterprise does not invest in monitoring and controlling cloud infrastructure, your applications will be in for a bumpy ride. Enterprise cloud infrastructure needs monitoring and control to clearly eliminate bottlenecks and contention to ensure applications have the best infrastructure to “drive” on.”

    What’s interesting about DevOps and the various tools and platforms that have evolved to facilitate and support DevOps is how the line in the sand just keeps getting moved. First application development was the bottleneck so there was Agile. Then infrastructure was the bottleneck so we got DevOps. Then various integration, testing, deployment, and performance automation tools have sprung up to deal with new bottlenecks as they’re discovered. If AppFormix works as advertised, organizations can monitor and deal with infrastructure issues more proactively and move that line in the sand to the next bottleneck.

    AppFormix is available for both Linux and Windows operating systems and is currently available in beta. It is slated for general release in the third quarter of this year.

  • Security at the Speed of Innovation

    Security at the Speed of Innovation

    With the advent of the cloud and platform as a service (PaaS) offerings, developers are innovating faster than ever.  But with this rapid pace comes risk. Companies quickly implement new apps to meet their business demands, but the increasing complexity of the infrastructure being used – both in the cloud, on premise, or a hybrid combination – makes it difficult to ensure vulnerabilities are not introduced or vital corporate information is not exposed. In the quest to ensure that policy and governance are in place and security risks are negated, IT often brings innovation to a screeching halt.

    Is there a happy medium that enables developers to continue accelerating innovation, but makes IT confident there’s adequate security? In this article, we’ll look at the importance of governance and policy, and outline the five fundamental security requirements that will help enterprises bridge that chasm that currently separates development and IT.

    Policy Debt – The Downside of Faster Innovation

    Security flaws are not new. Enterprises have faced serious security problems for decades. As today’s computing landscape becomes increasingly diverse and complex with increasing use of the cloud, new vulnerabilities are introduced, which exacerbate problems with existing security methods, such as simple usernames and passwords and an over-reliance on network perimeter security models.

    The rapid introduction of new developer technologies far outpaces an enterprise’s ability to vet them. As a result, enterprise IT faces a tradeoff: rapidly adopt new technologies to satiate business demands thereby accepting more risk, or slow down new technology adoption with the hope of mitigating risk. Tension between enterprise IT and the rest of the business is the inevitable outcome. More importantly, because new apps have so many dependencies, as soon as one is put into production, an enterprise almost immediately incurs policy debt.

    Policy should enable enterprises to track these dependencies, but in today’s IT environments, each piece of infrastructure or cloud resource has its own unique policy model, operational mode and lifecycle.  As a result, enterprises end up with a layered cake of dependencies, which is difficult to keep track of and ensure no security holes are left unpatched.

    Most of today’s security technologies – like gateways and firewalls – are either point-based or palliative solutions. They treat symptoms rather than root causes. And, they only work for traffic that’s routed through them, which precludes most of the server-to-server interactions that happen within the datacenter. Reliance on gateways is akin to locking the deadbolt on the front door of your house but leaving the back door open.

    These simply are not enough to address the proliferation of attacks that have paralyzed companies and exposed customer and consumer data. Consider the three major security Linux exploits – Ghost, Shellshock and Heartbleed – that came to light in the past year.  To patch their systems against these problems, companies needed to find the vulnerabilities and reset servers to activate the fix, which resulted in a cascading failure of servers, downtime and a host of other performance-related issues – simply because there’s no centralized way to apply policy and determine whether a resource in use is vulnerable.

    The Fundamental Five Security Requirements in the Brave New IT World

    To fully protect their increasingly complex IT environments, there are five fundamental security requirements no enterprise should be without:

    1. Resource Naming and Identity – To secure access of a workload or process, it needs to be named so that it can referenced as logic is applied. There is no notion of identity for the applications running today. They’re simply workloads running on a CPU.  If enterprises want to apply policy, they will need an overlay operating system that gives identity to that workload, so it can be organized into a manageable, policy-driven hierarchy.  This type of naming scheme is being done for Internet domains, but there is nothing comparable for the data center that enables IT to find, maintain and operate workloads residing there, regardless of where they are physically run.
    2. Chain of Trust – In today’s data center topologies, no actual proof is needed to ensure that a holder of a token is exactly who it claims to be.  To guarantee a high level of proof of identity and actual trust of components, enterprises require a central signing authority that issues tokens to all clients and internal components. This ensures that the management backplane is resilient to token and credential theft, and the system offers a high degree of trust.
    3. Context Aware Policy – Most systems rely solely on role membership to make authorization decisions, such as  “who” can do “what” to “what.” But enterprises need to go further than that, with the use of a dynamic scripting language for authorization decisions. Every authorization decision will require information over and above simple role membership (date and time, authentication strength, targeted resource and more). The result is a system that adapts more easily to enterprise authorization requirements.
    4. Control of the Network – The network is a vital part of any enterprise system, and controlling access to network nodes is key for enterprise IT governance. Today, network access control is a hodge-podge combination of network perimeters, firewalls, VLANs, VXLans, proxies and security appliances. Workloads exist in network segments and workload connectivity is a function of network segment configuration. Over time, these configurations become rigid, brittle and difficult to maintain. To prevent this, enterprises need to control the network within the cluster so that any workload running must be given explicit access to the network and other workloads (via policy) in real time and regardless of physical properties of the infrastructure.
    5. Ephemeral Service Credentials – Applications and services require connectivity and sometimes credentials to talk to one another. Once an application gets a credential for a service, the application becomes responsible for safeguarding that credential. However, credentials sometimes leak — they can appear in log files or configuration files, and can even be scraped from memory. What enterprises need is a new approach to service access that binds a credential to an individual network path. This ensures that even if a credential were to leak, it couldn’t be used from another location on the network. Moreover, with this method credentials live only as long as an individual workload in the system, rotating every time the application stops and starts again. By taking this approach, the burden on applications for handling credentials is reduced, strains of NetOps and network perimeter security models at scale decreases, and weak links in the trust chain are removed. The result is a more secure system that you can trust without changing your existing investments.

    About the Author/Derek Collison

    derek-collison

    Derek Collison is founder and CEO of Apcera. An industry veteran and pioneer in large-scale distributed systems and enterprise computing, Derek has held executive positions at VMware, Google and TIBCO Software.  As CTO and chief architect of cloud application platforms at VMware, he co-founded the cloud computing group and designed and architected Cloud Foundry,the industry’s first open PaaS. During his time at Google, he co-founded the AJAX APIs group.

  • What CIOs need to know about building deployment quality

    What CIOs need to know about building deployment quality

    Application Release Automation, or ARA, is the process of packaging and deploying applications (or updates to applications) in an automated, repeatable and consistent way.

    In today’s market landscape software has become a major differentiator for many businesses, across all industries and verticals. In a world of apps, Internet of Things and customers’ expectations to be always connected, – just about every company is now becoming a software company. Software development is now critical to the success of your product, and its delivery process needs to be fine-tuned and streamlined to ensure that you get quality software in the hands of your end users as quickly as possible.

    To understand how ARA can help you achieve higher quality software releases (which contribute to your bottom line), you must first understand the challenges you might face if your business is still using manual deployments, or other archaic methods. If that’s your case, though, you’re not alone: a survey we ran last year found that over 75 percent of deployments are still done manually, despite the many problems with this model, which is extremely brittle and error prone. This creates not only many failed deployments, but loss of hundreds of men hours trying to troubleshoot those failures. This is certainly painful in the mission critical production environment, but carries great cost long before we reach production. Even in the lower environments (such as testing or pre-production), 66 percent of respondents report its very time consuming just to troubleshoot why the failure occurred. As we promote code to be deployed in production- the stakes are higher. Costs of failed deployments, delayed releases and loss of men hours are exponentially aggravated when you add possible fines on top of that, cost of SLAs violations, customer churn, and loss of business. There’s no question the implications of failed deployments put a major dent in your bottom line, and with some companies – failed deployments have literally put them out of business.

    A prime example of how a failed release can have huge impacts on a business is the case of Knight Capital. Knight Capital WAS a financial firm. In August of 2012, they manually pushed out a new release to their software when the markets were down over the weekend. Monday morning came and when the market opened, their new software kicked in. The results were disastrous. They accumulated (extremely quickly and erroneously) a $9 billion [H1] position in the market – represented by the movement of 397 million stocks in just 45 minutes. Two hours later, when Knight was still chasing the culprit in their release process and trying to rollback to a previous version of the software, the New York Stock Exchange said, “We’re done waiting for you,” cut their hardline to the market and Knight couldn’t make any trades.

    The effects were disastrous and swift. Knight Capital endured a pre-tax loss of $440 million. Within weeks, Knight Capital was sold for pennies on the dollar – a failed release literally killed the company. While this is certainly a worst-case scenario, it is a great example of how it is necessary to understand that once you start talking about production environments, there is a lot of regulatory and best practices that have to be followed or big problems can occur.

    Why are manual deployments so problematic?

    First of all, manual deployments are error prone because each deployment has to be done by an actual human. Even the most veteran of developers or ops engineers make mistakes, and when you start talking in the hundreds (or thousands) of deployments, across complex stacks and configurations, an error is almost inevitable. While no system can fully-eliminate the potential for an issue, you can imagine that in a deployment process where many of the steps are automated – and therefore consistent across releases – your chances of an error are reduced dramatically.

    With manual deployments, it’s also difficult to achieve true, fine-grained, visibility and auditability into the entire deployment process of all the application’s components and their corresponding infrastructure or configuration. Once a deployment is pushed live, the only person who really knows how, exactly, the update was promoted from Testing to Production is the individual (or individuals) who performed the release. And as good as they might be in keeping notes, they’ll never be as comprehensive, or bulletproof, as an automated log that track every single component in the multi-stages deployment process.

    Manual deployments also are not adept at negotiating what is called the “Delivery Gap.” Essentially the delivery gap is the chasm that exists between three different factions of the software team. On one side there is the development team, which has a bunch of tools and practices they like to use. On the other side is Operations, which has their own set of tools and methods/requirements. Then, finally, there is the infrastructure, which spans across both Development and Operations and places requirements on both parties. So you have essentially three different players, using different tools, with difference practices and requirements, and negotiating between them is a tricky and difficult process. Ensuring there’s no configuration drift between infrastructure or app components across the different team, and ensuring consistency in deployment processes has proven difficult for humans to perform, particularly as each process includes hundreds – if not more – of artifacts, configuration files, dependencies and deployment requirements. For an automated process, however, consistency and repeatability are the default state.

    So now that we’ve established the pitfalls of manual deployment practices, let’s talk about how Application Release Automation can solve some of these issues and support higher quality software releases.

    We’ll start with the aforementioned “delivery gap.” Application Release Automation is a DevOps solution that bridges the gap between the Development teams and Operations teams. It does so by creating a solution that encompasses Continuous Integration, Configuration Management and Deployment practices that respect infrastructure, as well as operation’s needs and regulatory requirements. It achieves this because you can build these considerations into the automated process, which is recorded, logged and tracked by default. Rather than each deployment being a unique ‘snoflake’, software deployments become routine and predictable. It’s not on one person to mentally “flip the switch” and jump back and forth between groups to make sure everyone are satisfied. Rather, it is an automated process that takes everyone’s interests and requirements into account, and then makes sure everything fits within the infrastructure and configuration requirements.

    Furthermore, ARA is a “model-driven” approach that allows you to reuse existing templates, configurations and processes over and over to make your deployments consistent, and require minimal overhead for the initial set up of the process. This means you can deploy any version to any environment quickly, with push-button deployments. This not only increases the speed of deploying across different environments throughout your process, up until the final release to Production, but also allows for repeatability in a way manual deployments simply can’t. This is especially important when it comes to testing. Imagine if the framework of every update you deployed was identical – how much easier would that make testing? And how much easier would your tests be if they were all ran continuously and automatically? That is what ARA can offer.

    Additionally, with consistency, your deployments are very predictable. You know what the run times will be, allowing you to plan your development processes more accurately and efficiently. This means you can allocate time and resources in a way that maximizes your output – which allows your team members to spend more time on their core competencies and improving your product, versus having to manage the deployment process or the infrastructure.

    Along the same line, one of the key tenets of ARA is packaging. When you manually deploy updates, bits and pieces that comprise your application are being deployed (“moving”) at different times, creating a “noisy” process, with lots of dependencies, that’s difficult to manage. With ARA, everything is wrapped up in a tidy “package.” This effectively creates a “bill of materials” for your release and all dependencies and related configurations, which allows you to easily indicate what components of the application need to be deployed where, and in what order.

    Application Release Automation also solves the issue of having such a critical process to the company be dependent on what is often just one person – a “star student” in your team who “holds the keys” to the project and only he has the tribal knowledge and expertise to perform or debug a deployment. With ARA, there is an implicit transparency to the project that gives any team member the ability to access the system and deploy the software (pending the right security permissions, of course).

    Lastly, with ARA, you have complete visibility of the process from start to finish. If something goes awry, you have a much better view of where the error originated from, making recovering much faster and easier, and the damage much less significant.

    Ultimately, a successful ARA strategy eliminates the need to build and maintain custom scripts for application deployments, while simultaneously reducing configuration errors and downtime. It allows strategic allocation of resources, giving users the most “bang for their buck” from their developers and other IT professionals. Because of all these factors, Application Release Automation is a hugely effective strategy for increasing both the quality and speed of your deployments.

    About the Author/Anders Wallgren

    leadership-anders-wallgrenAnders Wallgren is Chief Technology Officer of Electric Cloud. Anders brings with him more than 15 years of in-depth experience designing and building commercial software. Prior to joining Electric Cloud, Anders held executive positions at Aceva, Archistra, and Impresse. Anders also held management positions at Macromedia (MACR), Common Ground Software and Verity (VRTY), where he played critical technical leadership roles in delivering award winning technologies such as Macromedia’s Director 7 and various Shockwave products.  Anders holds a B.SC from MIT.  Connect with Anders on LinkedIn or Twitter.

  • Bonitasoft makes business process management more agile with open source

    Bonitasoft makes business process management more agile with open source

    Organizations embrace DevOps for a variety of reasons, but one of the core value propositions is speed. DevOps enables business to build, test, deploy and update applications more quickly than without DevOps. With so many quickly-moving parts, though, organizations also need tools to help keep track of it all like a business process management platform.

    Bonitasoft developed its business process management platform—Bonita BPM 7—to facilitate the creation of engaging, process-based applications. It was also important, however, that the applications be able to adapt in real-time to changing business requirements. The latest release is an open source version that represents a strategic shift for Bonitasoft—a somewhat inevitable evolution to leverage the same practices and principles in designing and maintaining the platform as the platform is intended to manage.

    “We’ve embarked on a new mission to create solutions that empower developers to build applications that support continuous change,” Bonitasoft CEO and co-founder Miguel Valdes Faura said in a press release statement. “To win in today’s competitive climate, you need to be able to adapt to change quickly and continually improve your business processes and the applications that support them. Bonita BPM 7 is the first solution leveraging the power of open source and BPM process-based applications that meets the demands of today’s business requirements.”

    Bonita BPM 7 is built on a popular and widely used open source BPM solution. Developers can create processes in Bonita BPM 7 using the BPMN 2.0 standard, and can seamlessly connect with existing third-party systems such as CRM and ERP systems. Bonita BPM 7 builds on the open source foundation, though, with more extensible frameworks, and a powerful connector builder tool to enable developers to freely code their own graphical components and REST APIs.

    The “secret sauce” of BPM 7 is the way Bonitasoft segregates business logic from the data and user interfaces. The separation makes it easier to introduce changes in real-time. Developers can perform maintenance or push updates to the user interface independently of the business workflow and without taking the application offline.

    According to Bonitasoft, the key benefits of Bonita BPM 7 include the following:

    • Speed – Developers can build applications faster, improving developer productivity
    • Freedom – Developers can easily build what business really wants, and companies can maintain their applications easier and more affordably with live updates
    • Adoption – Development teams can empower their users with more accessible, engaging and usable applications, boosting competitive advantage

    “Bonita BPM 7 represents a real convergence between the world of the ‘BPM app’ and traditional enterprise software,” Valdes Faura said. “It gives developers the freedom to easily code and extend the system whenever they hit the limit with its native features. Plus, the platform is built for change, so developers and business users can apply changes, updates and improvements over time – creating what we call ‘living applications’ that live and breathe and grow along with your business.”

    As developers develop faster and DevOps enables organizations to push and update applications more rapidly the need for tools and platforms to monitor and manage things grows. By leveraging open source software Bonita BPM 7 follows a successful strategy already employed by companies like Github and CloudBees. If you’re looking for a business process management platform you should check out Bonita BPM 7.

  • Say hello to Container Journal

    Say hello to Container Journal

    Today we launched a sister site to devopsy.kinsta.cloud – Container Journal. The url for the site is http://www.containerjournal.com. The site is dedicated to spotlighting everything about containers and computing (as opposed to containers like in the Container Store). This includes not only the containers themselves, but everything that goes along with it.  Topics wil include container management, data management for containers, container security, networking for containers – in short the entire container ecosystem.

    Right now most of the content on Container Journal was container related content that was originally on devopsy.kinsta.cloud. However, over time Container Journal will have more and more of its own original content that will not appear here devopsy.kinsta.cloud. So you will need to check Container Journal to stay up on the latest container related content.  A good way of doing that is to sign up for the Container Journal newsletter.

    In addition to articles Container Journal will feature webinars on container related topics, as well as other special features including ebooks and surveys. Many of the outstanding authors who contribute to devopsy.kinsta.cloud will also be writing for Container Journal as well.

    We are looking for good container related content though. If you would like to contribute to Container Journal, write me at editor@devops.com with your request.  We are also seeking sponsors, partners and advertisers for Container Journal as well.  In a relatively short time, we think Container Journal will be largest media site with a dedicated collection of container related content.  This is your chance to be part of it. Sponsor info can be had at sponsor@devops.com.

    Also be sure to check out the Daily Poll on Container Journal. We will be asking some great questions with rapid feedback on what others are saying.

    Like any new venture, I am sure there will be growing pains with Container Journal. Please keep me posted if you notice anything.

  • Top 5 Anti-ESB Arguments for DevOps Teams.

    Top 5 Anti-ESB Arguments for DevOps Teams.

    Unix and Mac. Developers are always in combat. My last verbal combat was a “discussions” around ESB and Microservices. They are fun because both supporters tend to have very strong opinions about what they think is best and both want to fight each other. I recently got involved in one of those discussion about ESB vs. Microservices and the ESB guy throw lots of arguments at me. “ESB is magic” got almost burnt into my mind until I started to investigate a bit: “How to fight ESB discussions in combat?”. Here are my top 5 findings that may help in your next verbal ESB combat situation.

    (more…)

  • “Show Me The Money!” – Delivering DevOps Value

    “Show Me The Money!” – Delivering DevOps Value

    HM Heath Solutions delivers new business applications in the healthcare industry to 35 million customers.  In order to embark on their DevOps journey to improve software delivery, Valerie Scott, their Manager of Shared Services Division, had to show senior management an ROI on a successful project, before they would invest fully. On June 2, Val Scott along with Rick Slade of IBM joined Alan Shimel of devopsy.kinsta.cloud in a webcast to discuss this interesting client case study.  During their discussion, they illustrated in vivid detail how HM Health Solutions showed success in DevOps to their senior executives, for them to buy in and sponsor the project.

    Val and Rick’s webinar parallels many similar discussions I’ve had with senior executives.  To net it out, the bottom line is, as it was so clearly and unequivocally articulated in this amusing clip from the movie Jerry Maguire: “Show Me The Money!”

    cuba gooding jr show me the money jerry maguire tom cruise show me the money jerry maguire
    When I meet with senior LOB, Finance or IT executives — they shout a similar refrain:

    “All I want to do is buy a business outcome.  I want to invest in an IT project, and have it pay back.  Unfortunately for many application development (or other types of enterprise IT) projects, that pay back is illusory, and ROI difficult to measure.”

    — Jane or John Executive, representing nearly every IT executive or CFO I have ever met

    Unfortunately, many struggle to quantify, monetize and demonstrate the financial return on investing in IT projects.  Yet as described in this blog, it is the primary responsibility and outcome of management; leading the economic performance of their department or unit.  Show me the money!  Fortunately, many clients experience positive returns, both operationally and economically.  Ten (with links to more) client case studies with returns are highlighted in this blog, and summarized on this page.

    As you undoubtedly have experienced yourself, senior executives respond to clear business value and benefits articulated as financial returns, as ROI.  But how do you do that for DevOps, a set of technical practices and associated culture change?  As Val and Rick described during their informative webcast, comparing productivity, time-to-market, speed of delivery, and quality, both before and after a DevOps pilot, are crucial.  These operational metrics will be improved by adopting DevOps.  However, to win the hearts and minds of senior executives, you have to monetize the results, in other words – show them the money!  Technical techniques and practices such as those Val and Rick described to Alan, shifting left, test driven development, and automating application build, deployment, and test are absolutely necessary, but they are insufficient to win the argument with senior executives.  The gains they produce are necessary, and impressive.  The operational results have been stellar thus far at HM Health Solutions, per Val:

    • a 67% reduction in resource demands on the release team & process,
    • a 75% reduction in relative hours to repair defects per environment,
    • an 82% reduction in application deployment time.

    Yet as impressive as these operational results are, they are insufficient.  As Val described, arguments about business value, technical value, or improvements to developer or operations staff productivity, alone did not persuade the management.  The magic word is an economic and financial one: “investment”.  Making a strategic investment to improve delivery speed and quality of business applications was the key to winning the hearts and minds of the senior executives.

    In addition to the technical practices described above, Alan asked Val to describe the tools HM Health Solutions adopted.  A continuous delivery solution with application release automation software from IBM UrbanCode was implemented, including application build, deploy, and release.

    As a way of summarizing the webcast for the audience, Alan asked Rick and Val for their two key takeaways; the two most important messages and things to remember.  Rick’s:

    1. Knowing which metrics are critical to your organization.  There are many benefits to adopting DevOps, and many potential hard numbers that are straightforward to capture and measure.  Deciding which metrics have the most impact and are most persuasive to your stakeholders is critical to making the case to invest in DevOps.
    2. Implementing tools and automation: automated testing, and linking that to build and deployment processes and automation.

    Val’s:  Rick’s two takeaways of course!   And one more…

    1. DevOps is new in the industry, and is not yet well understood or common practice in enterprise IT or among its leaders.  Understand your audience, and become good at explaining it in straightforward and clear business and financial terms to senior executives.  Especially persuasive are other client proof points, and the results of pilots in your own enterprise IT environment.  Make sure pilot results show that the solution works and delivers timely business value, and that the related facts and metrics clearly quantify the results.

    Read this blog to know more and Check out other customer proof points/ case studies

    This was a very informative, fast paced, and information rich webcast.  I hope that you find the replay useful in continuing your DevOps adoption journey.

    If you’d like to explore more about management responsibilities and know-how for establishing an ROI for DevOps and app release & deployment automation, see this ROI web page, and read this ROI blog for additional resources on method, approach, making the case, and calculating the ROI.  And please don’t hesitate to reach out to me on twitter: @paspung.

    I look forward to hearing your success stories in making the ROI case to senior executives, and delivering DevOps value to your organization!

    peter signature, small

    Peter Spung, DevOps Deploy and UrbanCode Integration Executuve, IBM Cloud, @paspung

  • Apply DevOps automation to APIs with Akana

    Apply DevOps automation to APIs with Akana

    One of the core values of DevOps is automation. The ability to automate routine tasks and have triggers that automatically initiate other tasks takes care of all of the routine functions so developers and IT personnel can focus on bigger issues. One thing that has also emerged as driving force for DevOps—and IT in general—is APIs. Organizations have different platforms and tools from different vendors and they need everything to integrate smoothly together. The APIs enable that synchronicity but add another layer of complexity to develop and manage the APIs as well. That’s where Akana comes in.

    Akana enables organizatiions to quickly deliver scalable applications, connect and integrate applications, and share data as APIs. The Akana API Management Platform was created to give developers and IT personnel the tools necessary to effectively develop and manage APIs. Akana recently introduced new capabilities in its API Management Platform to streamline API management and reduce the time required to update APIs.

    One problem organizations face is that DevOps disrupts the traditional workflow and creates new bottlenecks. DevOps is sort of a natural evolution of Agile development—taking the principles of Agile beyond developers to the IT infrastructure and the company as a whole so that everyone can keep up with the faster pace of development. The rapid deployment of apps, however, can have a cascade effect that impacts the API lifecycle.

    As new apps are deployed the API definitions can change. Those changes have to be propagated to the API portal. The API owner has to update associated documentation. In most cases this process is a tedious manual exercise. The new Akana API Management Platform seeks to change that by bringing DevOps-style automation to the API lifecycle management process.

    The new API Management Platform integrates with continuous integration platforms like Jenkins and TeamCity. It has provisions for tracking necessary approvals to push updates to the API portal or API gateway. It also includes support for standard API descriptor document types like Swagger, RAML and WADL.

    “APIs have fast become the de-facto standard for digital enterprises to connect applications and services with digital end-points like mobile apps and internet-of-things,” said Brent Carlson, Senior Vice President, Technology, at Akana. “With this new capability, enterprises can deliver continuous innovation with speed and agility, ensuring that new updates and capabilities are automatically, efficiently and securely delivered to their developers and partners, in a timely fashion and without manual intervention.”

    No matter how streamlined you get you’ll eventually hit a bottleneck. As more of the development and deployment process gets automated that bottleneck gets moved farther down the chain, but then new platforms and tools emerge to address evolving issues and fix the new bottlenecks. For some organizations that have already embraced DevOps APIs may be the new bottleneck, but a tool like the Akana API Management Platform may alleviate that problem.

    It will be interesting to see where the next bottleneck strikes. At some point as DevOps evolves and every element is streamlined and automated the only bottlenecks will be organic—meaning the human beings involved in the process.