Showing posts with label visualization. Show all posts
Showing posts with label visualization. Show all posts

Thursday, April 01, 2010

Beautiful Bracketology

Leonardo Aranda's Bracketology - NCAA 1985 - 2009 is a beautiful rendition of the results of the NCAA March Madness men's basketball tournament for the 25+ years of the 64 team format.



I myself have compiled compiled these statistics over the years (2009, 2009, 2008, 2007, 2007, 2006, 2006) in an attempt to win the NCAA March madness bracket pools in which I have participated and just for the fun of studying the statistics. But I am green with envy as well as another appropriate color with admiration when someone takes data that I have kicked around for years and makes a striking visualization from it.

Again I am Salieri* to some Mozart. I recognize genius and beauty, but I can only produce mediocrity. (*the Amadeus movie version of this story, not the real one)

(via Castro's Favorite Color)

Monday, January 11, 2010

Aspiring to Tuftian perfection - presenting data

Often financial, scientific or engineering analysis takes large amounts of data and numbers and crunches them down to a single number or decision. I know it felt that way when I was researching and writing my thesis. Much like 42 being the answer to "Life, the Universe and Everything", it doesn't seem fair to take all of the data and turn it into one number or decision. Being intellectually honest and the presentation of the data have a lot of influence on the final outcome.

That intellectual honesty and the importance of good data representation and presentation are the lifework of Edward Tufte. I have just finished reading Beautiful Evidence and Visual Explanations which are his third and fourth books on the topic of data presentation. I am going backwards in the series because that's what's available to me and because I needed to answer a question about presenting some data of my own, while keeping my intellectual integrity at the same time.

Edward Tufte describes his books in the introduction to Visual Explanations. He says that The Visual Display of Quantitative Information is about pictures of numbers, Envisioning Information is about pictures of nouns, and Visual Explanations is about pictures of verbs. Beautiful Evidence seems to be about the best examples of these pictures, where well presented data helps in decision making. He also has counter examples where poorly presented data hinders decision making. In the two books I have just read he takes especial umbrage with the presentation of the data for the Columbia and Challenger shuttle disasters. His opinion is that the data presentations failed to stop and potentially caused the disasters. He also hates Powerpoint. He has been quoted as saying "Power corrupts, PowerPoint corrupts absolutely"

In Visual Explanations, in his review of the reason for the Challenger disaster he notes how the data about O-rings should have actually resulted in a recommendation not to fly but the presentations did not get the message across. The flight day had temperatures and conditions that were far outside of any of the past experience in flight or testing that the O-ring testing and usage had, yet the data presented didn't clearly indicate that. He proposes the unclear presentation as a reflection of unclear thinking and suggests this is the cause of the disaster. There is some disagreement with Tufte's analysis of the presentation flaws leading to the bad decision to launch in cold weather.

In this book, Tufte also uses the famous origins of epidemiology story of John Snow discovering that the Broad Street well was the source of an 1854 cholera outbreak in London. Tufte cites the discovery of the pump well that caused cholera epidemic as good presentation of data but he cautions that if the data were presented in a different form it might give different conclusions. Tufte lauds the fact that Dr. Snow checked his conclusions by looking at anomalous data and finding the reasons for them to see if his hypothesis was supported.

In Beautiful Evidence, Tufte reviews the Columbia Space Shuttle disaster. When the Columbia Space Shuttle was in orbit after it appeared that the wing had been struck by debris during launch, the team on the ground had 12 days to determine if the debris that hit the wing was an issue. Once again the team could not present the information in a manner to convince people that the impact under discussion was probably far larger than any from data they had from previous testing. Tufte is extremely critical in these examples because he feels that the bad presentation was a sign of unclear thinking and was in the direct causal chain that led to the disaster.

Of course there are those who decry my "What would Tufte say?" enthusiasm as I critically analyze every chart in every presentation that I make. I wholehearted recommend reading all of his work, and I realize that Tufte's design of presentation criteria are excellent but perhaps a little perfectionist. Not every presentation I make is life or death, in fact none are. So perhaps I can get away with a "good enough" approach in which I try to keep some of his principles in mind when I must present data and still conform to a corporate fashion for PowerPoint or Excel charts of a certain type. The alternative is to despair of ever producing Tuftian presentations with a clarity of thought that only a few transcendent individuals possess. Like Salieri as portrayed in the fictional Amadeus, I can recognize his genius but can only produce mediocrity myself.

Thursday, September 13, 2007

Music and Music Visualization for the Masses - Classical style

I just finished reading Cryptonomicon by Neal Stephenson again. In one scene one of the many main characters, Lawrence Waterhouse, who loves math and organs, wants to take a crack at fixing the organ in the church to which his (hopefully) future wife belongs. They won't let him near the thing until he jumps up and starts playing Toccata and Fugue in D minor. He is such a genius that he transposes to C sharp minor on the fly, because that will sound better on that organ. Musicians will cower and whimper at the scariness of someone actually being able to do that. The author's description of the performance is humorous in itself, especially the part where Lawrence kicks off his shoes and starts playing pedal tones and low notes to shake the whole church. He pretty much blows the mind of the pastor, music director, and future fiance, and blows his own mind as he figures out a math problem that has been plaguing him and runs out of the church.

Unfortunately Catholic churches these days seem enamored of the piano and don't play even the electric organs they have anymore, let alone the real pipe organs in some of the older churches. I miss that "God has entered the room" sensation described above that you get when a good organist is playing a good organ and really pumping out the low notes. Almost any Bach organ piece is sufficient for that effect.

Thus, I was inspired to go search the web for some free performances of Toccata and Fugue in D minor, and was looking for a site that I remembered with videos for visualization of the notes of the music as they were played. The site is the Music Animation Machine and one of the most popular animations is in fact for Toccata and Fugue in D minor. See it embedded below, just click:



There is a ton of other great stuff at the site, the page with the list of music with videos is here. As regards Bach, I would say that I am more a fan of the fugues than I am of the toccatas, I suspect it is the rigor and repeats with variations in the fugues that I like so much. My favorite is the Little Fugue in G minor. Unfortunately the visualization (youtube link) is a midi piano and it really sounds best on the organ. A good version on the organ can be (paradoxically) found at the PianoSociety webpage (link to mp3, BWV 578 - Fugue in G minor ("Little Fugue")).

You could and should spend many days searching and listening to all the great free stuff at the Piano Society. Some of my favorites from the Piano Society are ...
  • Debussy Clair de Lune, (mp3 link Clair de lune). My mom wants me to finally learn this and play it for her at the nursing home someday. The Music Animation Machine visualization (youtube link) will blow your mind with all of those notes.
  • Mozart Piano Concerto No. 20 in D Minor, KV 466, Romanza (mp3 link Romanza). Possibly his most famous tune, made famous again in the movie Amadeus.
All of it is nice music to listen to while working or reading or even when doing nothing but listening.