Just finished this delightful little book, Rapture for the Geeks, by Dooling (see MacLeod’s Fall Revolution series for the origin of the expression of his title).  A fun little book, and a bit different from what I was expecting.  It is about the singularity, of course, but it also channels parts of the Jargon file / Hacker’s Dictionary, Raymond’s Art of Unix Programming and other works of Unix and Open Source advocacy, with a dash of the Science v. Religion discourse of the likes of Dennett, Hitchins and Dawkins.

I quite enjoyed the book, though there is nothing really new here in terms of an original contribution to the topics by Dooling.  Those unfamiliar with the concept of the technological singularity, though, will find a lot of good references and ideas to follow up from here.  Dooling  collects quotes and excepts from all of the great original thinkers, from Turing through Kurzweil.  I was right with him till probably the last chapter where, to my mind, he looses the courage of his convictions on the value of religion regarding its moral and philosophical contributions.  He seems early on to be right with the scientists when talking about minds, brains and the “soul”.  So found his wishy-washiness in the end a bit perplexing.

But as I said there is a lot of fun to be had.  I haven’t mentioned my admiration of the poetry of Emily Dickenson yet in this blog.  For some reason, she appears to appeal enormously to those of the geeky mindset, especially her poem about the Mind/Brain.  Dooling presents a Python program version of Emily’s famous poem (again not his work, but that of Martelli and Ravenscroft of the Python Cookbook fame, and Google and, BTW, who are working with Guido, the inventor of Python, at Google on the Python language and other projects).  It is an example of the pure poetry of programming in general, and the Python programming language in particular.

Just finished Stephenson’s Anathem this week.  Initial impressions: I definitely liked it a lot, though it may not end up being my favourite Stephenson (still probably Cryptonomicon followed by the Baroque trilogy).  It is a fun easter-egg hunt of the major philosophical and intellectual milestones  of western civilization.

1. What other modern  writer (SF or otherwise) can you think of who could turn such a description into an engaging work of fiction?
2. I probably didn’t recognize half as many references as I would like to believe I would have (or want to admit not to spotting).

I’m sure the prime audience for Stephenson is heavily skewed to computer & tech geeks, all of who probably saw the Turing test, Penrose tiles and Godel “parallels”  (among many others) as well.  I won’t give away any spoilers, because the twist/reveal comes about 3/4 of the way into the book that finally puts this weird game into some kind of understandable perspective.  Oh and as an academic, I found the concept of the cross between a University and a Monastary in the Concents quite fascinating.

Capsule review: Will definitely be a must read for any Stephenson fan, and probably any fan of SF will  greatly enjoy if they (as usual for Stephenson) have a large appetite for chunky, complex novels.  Those  not usually interested in the genre, should probably read Cryptonomicon  first to determine your taste for Stephenson before plowing into Anathem.

Just a snippet from a  grant we are submitting for a new cluster computing instrument for TAMUC, that I was a bit proud of writing.  Perhaps undergraduate and graduate students might get a better feel for some of the current and near term work you might be involved with me and the sciences at TAMUC from this description.

We have historically divided the scientific endeavor into three fundamental domains: the physical sciences, focusing on nonliving matter (physics, chemistry); the life sciences, focusing on living matter (biology, genetics); and the social sciences, focusing on humans and their societies (psychology, cognitive science). With the creation of computers, it can be argued that a fourth fundamental domain of science has been created that focuses on computation (Rosenbloom, 2004). Whether or not one agrees that computation is a new fourth fundamental domain of science, computational modeling and scientific computing has added a new fundamental tool to the scientific toolkit, augmenting the traditional tools of analytical methods (mathematical descriptions), and experimentation. High performance scientific computing allows for large-scale computational models, which fit a point midway between analytical methods and experimentation. Large-scale computational models allow scientists to explore problems much to complex to be described purely analytically, for real world complex dynamical systems. But they also allow for a type of virtual experimentation of sufficiently complex problems, but without the danger or expense that might be needed to conduct such experiments in the real world.

The intersection of computer modeling with the traditional sciences has opened up a whole new research methodology. Increasingly, it is the intersection between traditional sciences, along with computational modeling, that are driving important scientific discoveries. For example, computation along with biology and chemistry drive much of molecular biology and genetic sequencing research, providing fundamental insights into disease processes and health issues. In our proposal, you will see many other examples of these types of synergies being performed at Texas A&M University – Commerce (TAMUC), and how computational methodologies are crucial to their success. Because of these increasingly important synergies, there is a great demand for trained and knowledgeable professionals with backgrounds both in a fundamental scientific domain, as well as experience with high performance computing and computational modeling. At TAMUC we are participating in and helping to drive this paradigm shift, and are heavily involved in the training, education and implementation of these computational methods for attacking fundamental scientific questions. As with many such organizations, our research efforts started out by building computational infrastructures in isolation. We have realized, however, that a critical mass now exists on our campus of research in this area, as well as an increasing demand from industry and technology firms in our region for trained researchers in these methods. The acquisition of a high-performance cluster computing infrastructure will serve as a focal point for uniting these efforts on campus and in our region, and developing a focused training and research group agenda in the computational sciences.

In this blog I have talked quite a bit about two of my current favorite SF authors, Charlie Stross and Vernor Vinge, but I don’t think I’ve mentioned Neil Stephenson. Possibly because he’s been a bit quiet lately. Of course, when you churn out books that are 1000+ pages in length (including all 3 books of his Baroque trilogy), I suppose we can’t expect new works from him yearly. (Heck you will probably have to wait a whole lifetime before I produce 1000+ published pages).

Anyway, if you haven’t read any Stephenson yet, get ye to a bookstore (your geek status is officially suspended till you complete this requirement). And his next novel, Anathem, coming out this September, looks not to disappoint.

I have become more and more convinced that trying to teach beginning programming using a production language like C++ or even Java is really just a horrible horrible mistake. I am just wrapping up teaching our Programming II course this summer. We use C++ for our intro courses (as do many other institutions), and continue on with it for the core courses of our undergraduate curriculum. My experience this summer has been the same as in the past. We spend so much time on the minutia of the syntactic complexities of the C++ language that there is no time for any of the big picture. And worse, many students just see this seemingly impenetrable mass of complexity and it often just stops them cold. C and C++ are powerful languages, and they must, in my opinion, be learned at some point as part of a complete CS education, but…

So I recently saw this free creative commons published book How to Think Like a Computer Scientist. What first brought it to my attention was that I saw MIT was actually using it as part of their intro to programming course, and it showed up on their most recent OCW course curriculum. Now I am a big fan of the Python programming language, as those around me will tell you, so I may have some bias. But seeing how it is being used and praised in all kinds of cutting-edge domains, like not only this MIT OCW course, but for example Google uses it heavily, and it is really beginning to take off among researchers and scientists in the scientific computing community, replacing Perl in many cases, I would venture to say that I am not the only one that sees the power and advantages of Python.

So, a) I really do need to renew my own effort to see if we can get our department to rethink some of its choices of the undergraduate curriculum; b) in the meantime, any undergraduates that might stumble upon this who are about to take or have just taken our intro programming courses, I would recommend that looking at this book might help you to get a better understanding of programming, and maybe see some of the big picture issues that we might not get to you clearly in the current courses, and c) the book also works great as just a Python tutorial. I have been recommending this book as well to my graduate students who will be taking my AI: Collective Intelligence course this fall, as a good tutorial for learning the Python language.

Not my title, but that of an article in most recent Chronicle of Higher Education here.

As an educator and scientist in higher education I see what the author is talking about first hand all the time. I have little luck in convincing the American undergraduates I work with of the joys and benefits of pursuing higher education in the scientific and technical fields, while our graduate programs are brimming with foreign nationals. As the author says, I have nothing but admiration and respect for our graduate CS students, and greatly admire many of them in their determination and effort. My beef is with the American students, products of our American educational system. Will all of those undergraduates really find themselves as satisfied and fulfilled as their counterparts a few grades above them in the years to come? Some additional points to add, in no particular order:

• Self-esteem and all, as the author points out is greatly overrated. Self-confidence without a basis of real achievement and struggle is hollow at best, and will lead to a similarly hallow life.
• And conversely, there is nothing quite like the feeling of perspective one gets looking back on a long journey of constant (slow, steady, sometimes yes even agonizing) progress and accomplishment towards a difficult goal. The authors term is “arduous intellectual ascent”. It is not always arduous, there are many small joys and wonders on the slow long journey, mostly sufficient to counter the setbacks, dead-ends, frustrations and wanderings that will inevitably occur.
• I don’t know how to begin to (re)emphasize this type of personal and intellectual achievement and self-discipline as cultural ideals. But I know it is essential that we recapture it somehow as a cultural imperative and core educational perspective
• I knew the thrust of this topic was triggering some association, and now I just recalled that Covey’s 7 Habits of Highly Effective People makes some similar points, much better than I argue here, along the same lines in his introductory chapters. I’ll have to dig that up and reread to refresh myself on some of his points, but check it out, I highly recommend the book.

I have recently been exploring social networking sites and collective intelligence algorithms. I suppose I am of the generation that just missed out on the Facebook/MySpace phenomenon. But I have always found recommendation engines from places like Amazon and Netflix quite useful. They provide an indirect type of socially augmented intelligence by using algorithms to find people with similar tastes, and then rate or recommend items indirectly based on their recommendations and their similarity to your own tastes. Newer sites like del.icio.us and last.fm take this to an explicit next step. These types of social networking sites allow you to actively find not only items that interest you (web sites and music respectively), but also people with similar interests and tastes to form explicit and ad-hoc social networks. See the new items on my side bar which should follow my del.icio.us bookmarks and last.fm music interests and activity from these sites.

One of the themes of this blog is Metacortices, the idea that the collective cognition of many people can be harnessed to perform more intelligent behaviors than would be possible from any of the individuals. Social networks, as I am describing them, do fit this definition to a degree, though the intelligent behavior being generated is really one that benefits the individuals by helping them make better choices, and find more interesting stuff. Though, look at collective intelligence and social games research for examples where people are designing systems based on playing games that do appear to create behavior that is more intelligent than any of the individual participants might do on their own.

A related concept that comes to mind looking at my del.icio.us and last.fm logs is the lifelog (also known as lifestream or total history). This is more in the realm of building an Exocortex, the idea of a constantly created log or memory of activities, thoughts, findings, etc. The basic idea of a lifelog is a technologically enhanced long-term episodic memory. Episodic memory is a type of long-term memory recognized by psychologists and cognitive scientists. It is the type of memory that allows us to store and recall episodes in our life, like our last birthday party, or what we ate for lunch yesterday. A lifelog would consist of a technologically enhanced person with devices that capture all video, images, audio and other type of sensory inputs, and stores and processes these logs in ways that make them searchable. Imagine a camera in your glasses taking video at 10 frames per second, being automatically meta-tagged with gps location information of where the photos occurred, and associated through temporal tags with other streams, such as audio or other, possibly uploading them to a Flickr stream, with auto-generated tags, etc.. The link given previously of Stross’s ideas on this subject propose a rapidly approaching capability to log and process this level of data for individual people because of increasing computing storage and processing power and mobility.

A lot of this interest was because of a new book I have been reading Collective Intelligence by Tobey Segaran. I think this is a wonderful book, almost on the level of Norvig’s Paradigms of Artificial Intelligence Programming: Case Studies in Common Lisp, in terms of giving concrete and hands-on views of the important algorithms and methods behind these intelligent systems. My graduate AI course this fall of 2008 will be using this book as our text and will concentrate on machine intelligence and collective intelligence methods.

(Yes that title is a Benigni reference. The gist of this post got me to thinking about Benigni’s and other’s movies that present an unshakable core of optimism in the face of unspeakable tragedy.)

As those who know me well would tell you, at my core I have a bit of an optimistic streak concerning our future as human beings, as a race, as a society. Some might look around and see all the potentials for disaster and collapse (see some of my previous posts on the Unabomber and Jared Diamond). But I can’t help but look at the other side of the coin. I don’t think I am naive, or unaware of the very real problems that face us as a race, I try not to be an unabashed technophile. I suppose the general outlook does somewhat go hand in hand with being a geek and a technophile, how can you not be excited (but frightened as well) by the things being unleashed around us, by us; by the very interesting times we are living in!

Case in point. I can’t believe I haven’t mentioned the Grand Challenges of Engineering yet. I have even used these as a theme for a talk I gave this spring for our TAMUC college days to prospective students. If you want an example of something that gets me out of bed in the morning, something that really excites me, look through this list of items. The list was developed by some of the top minds of our days in the engineering and scientific field. Minds like Larry Page, one of the founders of Google and Ray Kurzweil, inventor and technologist (and a scarily unabashed technophile if there ever was one).

I’ll just point out to student who might be reading, most all of my research being done here at TAMUC, by me and my research group and colleagues, falls within one or the other of the areas given in this article. Much of my main research touches on reverse engineering the brain, trying to build smarter artificial systems by studying and emulating neural processes. We have recently become more involved in virtual environments for training. And I have always had a strong interest and involvement in computational modeling and scientific computing, which is the heart of the types of new tools we are building for cutting-edge science of the 21st century. So again to any of you student, if you are interested in learning more or even working on some of the Grand Challenges mentioned in the article, you might want to stop by and talk with me sometime.

Back from China

Went to China at the start of the Summer to visit with Shulan’s family in Nanjing, and also took a trip to Beijing for a bit of sight seeing. This was just after the major earthquake in Chungdu, so as you see it has been some time since I got back, but wanted to post a few notes about the trip.

First some pictures. A lot of these are from our trip up to Beijing to do some sightseeing. We took an overnight sleeper train up north to get there, which was fun, haven’t done that since I was a child. But I’m sure the enjoyment factor would fade quickly after the novelty factor wears off. We got to see some of the Olympic buildings constructed for this summer, including the new main stadium known locally as the Bird’s Nest. We went and saw many of the historical sights while in Beijing, including the Forbidden City, the Great Wall and the Ming Tombs, and of course since I was with Shulan sampled many of the authentic cuisines of Beijing, searching out the locals favorite restaurants and foods.

As you can imagine I was following the events of the earthquake quite closely. There was an amazing outpouring from the Chinese people while we were there. And the openness and effectiveness of the organized government response was equally impressive. Hopefully their openness signals some permanent future trends, and will not revert to old ways say after the Olympics. I know for example the criticisms by especially the parents of possible irregularities in construction techniques, especially for school and other public buildings, are beginning to be discouraged and quieted more and more by the Chinese officials. We will see if they can close the barn door after letting the horses of progress out this time.

Some of my favorite coverage of the Chengdu Earthquake came from NPR. I am a listener and supporter of public radio, and they happened to have some of their radio reporters in Chengdu for a feature on China focusing on Schizuan providence when the earthquake struck.

Rest in Peace Pappert.

Pappert: 1990-2008

She was a good cat.