Catenary

Entries from February 2009

More on measurement

February 26, 2009 · 2 Comments

Related to yesterday’s post and to an entry I wrote two years ago on measurement, I just found an old (2003) post from Martin Fowler on why we can’t measure productivity in software development. He’s much clearer than I am, and his article is well worth reading. His conclusion:

I can see why measuring productivity is so seductive. If we could do it we could assess software much more easily and objectively than we can now. But false measures only make things worse. This is somewhere I think we have to admit to our ignorance.

(Thanks to Jon / Greg for sending it my way)


Categories: Academia · Software development

Experimentation and argumentation

February 25, 2009 · 4 Comments

Just a reflection spawned from a recent post by Greg Wilson and a later discussion at the lab (I had to leave early, so I don’t know how it ended):

In a research discipline with few or no mature constructs, such as ours, experimentation is little more than disguised, expensive, and poorly grounded argumentation. It is misleading: it proves nothing, it can be made to support almost anything, and it has an aura of “truth” disproportionate to the weakness of its real validity.

It is best to develop constructs and their underlying theories through argumentation enriched by qualitative observations, and to proceed to experimentation only when the constructs seem sound.

I realize that a great part of the appeal of experimentation is psychological. It is comforting to hear that someone ran an experiment and “demonstrated” this or that. But these demonstrations are flimsy, and will be superseded and forgotten once we develop a better understanding of the relevant constructs and theories.

Categories: Academia

Happy birthday, Darwin (except in the US)

February 12, 2009 · 9 Comments

A friend of mine just tipped me to this: Google Canada has a nice celebratory image to commemorate Darwin’s 200th birthday, as does Google France, Google Germany, Google Mexico, Google China, and any Google I can think of — except Google.com. I guess this is so to avoid offending susceptibilities.

Update: Or am I going insane? Greg and Yoni report that they get the same image commemoration at google.ca and at google.com. Yet I still get the basic Google image at google.com. Any other reports?

Categories: Off Topic

Not crazy about Wordle

February 11, 2009 · 12 Comments

You’re probably familiar with Wordle. It’s a neat application that picks up the most common words in a text and arranges them in a pretty word cloud. As a toy, it’s quite fun.

But there’s an idea seeping in among the blogs I read, suggesting that Wordle clouds are actually useful as a communication tool. For instance, here is a flyer produced for a talk by Deepak Singh. He liked it a lot:

They used my delicious feed to build a tag cloud using Wordle. The results are wonderful and give you a better insight into things that I get interested about that I could have told you in 5 minutes myself.

Michael Nielsen liked it too, wondering “if only we could replace all speaker bios this way…”

I, however, thought it shows much of what is wrong with our ultra-caffeinated Web 2.0. Looking at the flyer, I can guess that Deepak is interested in a number of topics: the semantic web, bioinformatics, programming, science, etc. And yet I can’t guess, at all, what are his opinions on any of these topics, nor how he relates them. What does he think of the state of the art of bioinformatics? Is he particularly interested in applying cloud computing to healthcare systems? I have no idea. It’s as if the word cloud processed Deepak’s ideas to take out all of their nutritional value and gave me just the pure sugar: exciting, yummy, and devoid of nourishment. Oddly, the title of his talk (“Science Big. Science Connected”) fits the flyer; I picture myself reading it as a caveman or as an ape, jumping all over at the sight of big, pretty, meaningless words, basking at the glory of scientific progress.

More recently, some students at my Department have been producing Wordle clouds of their Masters’ Theses. Here’s Christian Muise’s, and here’s Neil Ernst’s, for instance. The result is just as problematic; I guess Christian studies something to do with implicants and Neil built something called “Jambalaya”, but I can’t go any further.

To compare, here are two summarizations of my Masters’ work. The first is a Wordle cloud of my 2005 thesis, the second is the abstract of the paper that goes along with it:

mscthesiswordle

Anchoring and adjustment is a form of cognitive bias that affects judgments under uncertainty. If given an initial answer, the respondent seems to use this as an ‘anchor’, adjusting it to reach a more plausible answer, even if the anchor is obviously incorrect. The adjustment is frequently insufficient and so the final answer is biased. In this paper, we report a study to investigate the effects of this phenomenon on software estimation processes. The results show that anchoring and adjustment does occur in software estimation, and can significantly change the resulting estimates, no matter what estimation technique is used. The results also suggest that, considering the magnitude of this bias, software estimators tend to be too confident of their own estimations.

And a second comparison (which is a blatant plug to my recent work with Gina Venolia, to be presented at ICSE this May). Here is the Wordle cloud of “The Secret Life of Bugs”, and the abstract of the corresponding paper:

secretwordle

Every bug has a story behind it. The people that discover and resolve it need to coordinate, to get information from documents, tools, or other people, and to navigate through issues of accountability, ownership, and organizational structure. This paper reports on a field study of coordination activities around bug fixing that used a combination of case study research and a survey of software professionals. Results show that the histories of even simple bugs are strongly dependent on social, organizational, and technical knowledge that cannot be solely extracted through automation of electronic repositories, and that such automation provides incomplete and often erroneous accounts of coordination. The paper uses rich bug histories and survey results to identify common bug fixing coordination patterns and to provide implications for tool designers and researchers of coordination in software development.

In both cases, the second version actually gives you some information beyond “estimation stuff” or “bugs stuff”; it’s not the full story but perhaps it’s enough to tell you whether you should read it or not.

There are some cases where playing around with Wordle may be a bit illuminating. I once heard that the most common words in Bernal Diaz del Castillo’s The Truthful History of the Conquest of New Spain were God, blood, and gold. This is probably false, though it is still a pretty good symbolic summary of the Conquest. But in general we shouldn’t fool ourselves thinking that disconnected pretty words are a good substitute for actual sentences and ideas.

Categories: Academia · Information visualization

Light bulb ad

February 3, 2009 · 1 Comment

I loved this ad by the World Wildlife Fund for its simplicity.

(via Jon Pipitone, who has also posted some related thoughts on why consumer choice is only a small part of the equation when it comes to addressing climate change.)

Categories: Activism

York strike

February 2, 2009 · Leave a Comment

Very good post on the Torontoist blog analyzing the idiocy of York University’s recent lose-lose three-month strike.

Categories: Academia · Toronto