Skip to main content

Cargo Cults: Agile Development As Social Subversion

This morning my newsfeed came up with an interesting read from Gizmodo, an article interpreting cybersecurity as a war against haunted objects. The idea of securing the "internet of things" as an exorcism is rich, nuanced and perhaps even poetic. I'd encourage you to read it, as it is unusual to consider technology through a spiritual lens. While reading the article, I was reminded of another lens through which I view software development, the cargo cult.

These spiritual movements originate during and shortly after World War II, in Melanesia. In their initial contact with western technology, the first people of that region saw spiritual significance and, through imitation, sought to gain the material wealth and social place possessed by occupiers. Their rituals sometimes involved building (non-functioning) radios, airports and vehicles from wood. They believed such tokens would enable their ancestors to send cargo (material goods) to them from the afterlife. I think one of the most interesting things about cargo cults is that, at a deeper level, they subvert social order imposed from the outside with an emergent order based on the first peoples' traditions and values.

On a superficial level, it's not uncommon to invoke the concept of a cargo cult when discussing agile software development. Many developers and especially project managers obtain certificates as scrum masters. Through the rituals of an agile methodology, they expect to produce high quality software with efficiency and flexibility. Parallels can be easily drawn with cargo cults: agile practitioners can indeed fail to grasp the underlying mechanisms and invoke ritual motions devoid of their original purpose. This theme has been addressed by James ShoreJoel Kuiper, CIO magazine, Scrum Alliance, and that's just part of the first page of Google results.

My point in this post has to do with a deeper function of cargo cults. As mentioned earlier, cargo cults function as a force of social subversion, one in which the occupied group attempts to recast social order imposed by colonial occupiers. Often the social order in a software organization cannot be questioned directly, especially not by low-level employees. Without a direct vehicle for addressing culture, social reordering seeps into other processes, subverting a dominant social order enforced by management in favor of an emergent order controlled by developers.

Agile practices are a natural repository for this seepage. Through scrum meetings, sprint planning, retrospectives, planning poker and other agile rituals, teams involved in agile processes can optimize the social order rather than value to the business. For instance, engineers can challenge senior management by redirecting negative attention about lack of progress onto agile rituals instead of directly addressing core challenges. Agile development rituals can mask technical debt, poor planning and incompetent engineering.

Agile and lean toolsets can efficiently regulate work queues, optimize throughput and provide flexibility to project owners to address changing business conditions. These practices are ineffective when team members use them to challenge the dominant social order on the team. Difficulties implementing agile practices can be symptomatic of a larger cultural problem, and not one that should be shrouded in ritual practices.

Comments

Popular posts from this blog

ReactJS, NPM and Maven

I'm just starting to get into working with ReactJS, Facebook's open source rendering framework. My project uses SpringBoot for annotation-driven dependency injection and MVC. I thought it would be great if I could use a bit of ReactJS to enhance the application. If you're looking for a basic conceptual intro, I recommend ReactJS for Stupid People and of course the official documentation  is quite good. In full disclosure, I still have no idea how to do "flux" yet. As an experienced Java backend developer, I'm pretty decent at hacking Maven builds - which is precisely what this blog post is going to be about. First, a word about how React likes to be built. Like many front-end tools, there is a toolkit for the node package manager (NPM). From the command prompt, one might run npm install -g react-tools  which installs the jsx command. The  jsx  command provides the ability to transform JSX syntax into ordinary JavaScript, which is precisely what I want. O

Solved: Unable to Locate Spring Namespace Handler

I attempted to run a Spring WebMVC application, and when starting up the application complained that it didn't know how to handle the MVC namespace in my XML configuration. The project runs JDK 7 and Spring 4.0.6 using Maven as the build system. The following is my XML configuration file: <?xml version="1.0" encoding="UTF-8"?> <beans xmlns="http://www.springframework.org/schema/beans"        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"        xmlns:mvc="http://www.springframework.org/schema/mvc"        xsi:schemaLocation="         http://www.springframework.org/schema/beans         http://www.springframework.org/schema/beans/spring-beans.xsd         http://www.springframework.org/schema/mvc         http://www.springframework.org/schema/mvc/spring-mvc.xsd">          <mvc:annotation-driven/>      </beans> I have a few more beans than this, but their details aren't especially relevant

Spark Cassandra Connector Tip

We're using Databricks as our provider for Spark execution, and we've been struggling to get the Spark Cassandra connector to work outside of the local development environment. The connector was attempting to connect to 127.0.0.1 even though we were passing the new host information into the getOrCreate(..) call. After working with Ganesh at Databricks support, we figured it out. The realization is that in Databricks, calls to getOrCreate() from a fat jar don't create a new SparkContext object. Thus, the configuration passed in gets ignored. If you want to update the Cassandra host information for the connector, you must update it after  the call to getOrCreate() instead. Add the configuration directly to the context and you'll be good to go!