To follow this blog by email, give your address here...

Sunday, June 05, 2016

The film “Machine of Human Dreams” – some comments by the human dreamer

In which the primary subject of a recent documentary film rambles on a bit about the events the documentary covers, and some things that it leaves out...

These are amazing times for those of us who are passionate about AI and robotics. Finally, at ever so long last, the ideas and visions we've been talking about and working toward for decades, are getting embraced by the mainstream! Concepts that would get you laughed out of university departments or corporate research labs just 10 or 15 years ago, are now being adopted as research priorities by governments and major corporations. Believing that AIs with general intelligence at the human level and beyond may well get created during our lifetimes, no longer makes you a certifiable member of the lunatic fringe!

One practical consequence of this shift in the zeitgeist is that funding for advanced AI R&D is now less difficult to come by. It's still not easy – funding is always competitive, and the dynamics of various funding sources remains complex. But things are much better than they were a decade or two ago, and this shows not only in big-time funding events like Google buying Deep Mind for a half billion dollars or Elon Musk and friends soft-committing $1B to OpenAI, but also in smaller ways like the OpenCog project I lead getting more donations and corporate backing. After a number of years of slow progress throttled by resource limitations, we are starting to move faster.

Another consequence of the increasing enthusiasm for AI is growing media attention. The number of calls and emails I get from journalists these days is remarkable. And this summer the second documentary film about my AI and robotics work is coming out – “Machine of Human Dreams”, by Roy Cohen and Roast Beef Productions.

The first film made about my work was Raj Dye's avant-garde documentary “Singularity or Bust”, which covered my collaboration with Hugo de Garis in China in 2009 (and is available for free now on YouTube). Raj's film won Best Documentary at the LA Film Festival of Hollywood, and I like it very much. The style is a bit home-movie-ish at times, but it works; the editing and direction are very thoughtful, and a certain slice of my life and work is captured with artistry and accuracy.

Machine of Human Dreams covers bits and pieces of my AI and robotics work in Hong Kong and Addis Ababa during the period 2013-2015. It also covers portions of my earlier life and career.

Not too surprisingly, I definitely recommend you to watch the film. I particularly like the parts of the movie covering my team's recent work in Hong Kong and Addis – I think these are excitingly shot and directed, and they show aspects of our recent robotics tinkering that there's no other way to get a visual look at. 

The footage of RoboSapien robots (that Ruiting and I brought from Hong Kong in our suitcases) dancing in the rugged streets of Addis Ababa packs a sociopolitical wallop along with the techno-pizazz … and David Hanson's Sophia robot, showcased near the end of the film, is just so frickin' beautiful and evocative.... 

The various futuristic discourses and diatribes the film captures me giving are mostly well selected, and get across my broad high-level vision for AGI fairly nicely. There's not much footage of me explaining the meat of my AI work, but then there are numerous YouTube videos of me giving such explanations already available, so anyone who cares can find such material.

Trying to cover so much stuff in just an hour or so, it's inevitable that the film leaves a bunch of important things out … and I have to admit that some of the choices Roy made regarding what to include and what (and who) to omit, were pretty different than the choices I would have made given all the footage he gathered of myself, my team, and my friends and family.  With this in mind, I have written this probably over-long blog post in order to comment on the events the film covers, and also to highlight some of the things the film leaves out, which I think are nonetheless fairly critical to understanding the events and individuals that the film presents.

So – my hope is that, for someone who has seen the film, this post will fill in some of the “missing links” and make the whole story clearer.  

If you haven't seen the film, there is probably still some useful and entertaining info in this post; but the choice of specific topics to discuss here is heavily driven by the various scenes shown in Machine of Human Dreams, so it will definitely make more sense if you've seen the movie. 

Also, I suppose that alongside their potential interest to AGI geeks, my comments here may also be of interest to anyone curious about the general nature of the complex relationship between documentary films and actual reality....

The Film Originates...

I first met Roy Cohen at the Global Future 2045 conference in New York in 2013, where David Hanson was planning to demonstrate one of his robots. The robot demo at the conference wound up not coming together for various logistical reasons, but David was there at the conference, and was there afterwards as well holed up in a hotel room getting his Philip K. Dick robot ready for a TV interview. Roy was trying to track down David, but David was busy fixing up his robot. But I had a little more free time. 

Roy seemed like a smart guy – he had a neuroscience background and a broad understanding of technology, and he was getting into film-making. He wanted to do a documentary project. I suggested he should make a documentary on the collaboration David Hanson and I were starting, aimed at applying my open-source OpenCog AGI software to control David's amazing humanoid robots.

We talked more and the concept grew on Roy. He scrabbled together some funding from Israel to do some preliminary shooting. He came to Hong Kong and got some footage of our robot lab; and he came to Ethiopia to film the team at iCog Labs, the AI/robotics development firm I co-founded there, that collaborates with OpenCog and Hanson Robotics. The preliminary footage he shot enabled him to gather enough funds to complete the film.

I liked the idea of Roy being a sort of “embedded video-journalist” in our project, popping up every now and then to gather footage of what our team was doing. Though him not being based in Hong Kong or Addis Ababa wasn't ideal – he didn't visit that often, and predictably enough, it seemed that the most interesting stuff happened when he wasn't around.

Production Progresses, and the Concept Drifts

As Roy's film project progressed, I noticed in our intermittent conversations that his vision of the movie was drifting a bit from what we had originally discussed. I had wanted him to focus on the progress of the technology, and on the international team making the progress happen. But he was gravitating more toward focusing on ME as a person – on making it more of a biographical film. This didn't interest me nearly so much, mostly because I was more interested to tell the world about our AGI work than about myself. 

But in any case, I liked Roy and was happy to support his project even as his vision drifted from what we'd originally discussed. He started asking me for access to various people in my family and from earlier parts of my career, and I sent emails putting him in touch. He ended up interviewing a sort of quasi-random sample of people from my past and present, including my mom and dad and kids, and my first wife (but not my second), and a couple of my AI collaborators from the late 1990s. There were also quite a few people I told him it was important for him to interview – if he was going to do the “dig into Ben's past life and work” thing – but he didn't, probably mostly for cost reasons (e.g. he ended up interviewing a bunch of people who lived near New York, and omitting folks who lived in other areas).

As 2015 advanced Roy seemed very eager to finish the film and get it launched. I tried to convince him to take a slightly slower pace, and keep filming through 2016. It seemed to me that in 2016 we were likely to get OpenCog to control David Hanson's robots in a really interesting way, and that this would make a great ending for his film. But he didn't want to wait – I suppose understandably, because after all his funds were limited, and the timing of research is hard to predict. What if he waited through 2016 and then the OpenCog-controlled Hanson robot got deferred till 2017?

Choices, choices, choices...

I didn't see any rough cuts of the film while it was in progress (except one very crude, early trailer) and I had a lot of other things going on in my life, so I didn't think about it often. Then in early 2016 I saw that the film was to be shown at the Sheffield Documentary Festival; and Roy sent me a DVD.

I liked a lot of what I saw. On the other hand, out of all the footage he'd gathered, many of the choices he'd made were not what I had expected.

Overall, I felt upon first viewing, his film portrayed me as a charismatic, utopian, somewhat don-Quixote-ish character, tirelessly pursuing a wild-eyed dream of benevolent superhuman AI, persistently and enthusiastically ignoring the world's repeated pushbacks. 

The Ben in the film keeps moving to some new location, launching a new AI project and not quite getting to the finish line, then moving somewhere new and trying again: New York, Hong Kong, Ethiopia....  He makes a few personal and business messes due to caring more about his AI dream than anything else. But ever optimistic, enthusiastic and visionary, he keeps on pushing. And finally, by the end of the movie, he has found a powerful, equally starry-eyed and brilliant collaborator in roboticist David Hanson. Together, they will keep on pushing – and maybe they'll even get there eventually!

This Ben-character in Machine of Human Dreams certainly has a lot truth about him....  And it's certainly understandable that, to make an hour-long movie about a 49 year old person's life and work, a lot of simplifications and short-cuts will be needed. Nevertheless, given that the guy in the film is a bunch of samples of ME, I couldn't help, when I viewed the film, reflecting on everything that was left out, and the patterns of inclusions and omissions.

Overall, I can't really judge the quality of Machine of Human Dreams as a film in any objective way, I'm obviously too close to it. What I do feel impelled to do, though – and will do in the rest of this post – is step through the key episodes that the movie covers, and explain briefly what elements and aspects of the real-life versions of these episodes the film leaves out (for reasons of time limitation and choice of emphasis).

The film is not entirely chronological, but in my remarks here I'm going to proceed mostly in chronological order. The film starts with a sort of wild ride through my current work in Hong Kong and various interviews with people who are working with me here. This part is evocative, and shows some intriguing stuff. Then after that the film gets semi-chronological and quasi-autobiographical, beginning with my childhood.

AGI as a Crazy Hippie Dream

I gave Roy access to my mom for the movie, and he used a nice chunk of the interview footage he gathered with her. Watching this part was rather moving for me; my mom is a truly good-hearted, sincere and compassionate human being, as well as extremely competent and intelligent and hard-working. Hearing her recount bits and pieces about my early childhood on film was cool! Indeed it was my mom, in my first 4 years before I started school, who got me started on science and math and philosophy and creative imaginative thinking generally.

One key omission in the film pops up here: my other parent. While the interview footage Roy gathered from my father Ted Goertzel didn't make it into the film, Ted was also extremely important to me in my formative years. Ted was a sociology prof at U. of Oregon and then (for about 40 years, until he recently retired) at Rutgers University, and it was he who got me started on critical and analytical thinking. Ted has also followed my research career quite closely, including co-authoring and co-editing with me various books and papers on the future and social implications of AGI.

After my birth and infancy in Brazil, I lived from age 1.5 to ago 7 in Eugene Oregon. This was the late 1960s and early 1970s and the place was rather wild and full of hippies at the time. Ever since I have considered myself some sort of quasi-hippie – though obviously I'm too geeky, too hard-working and have too much of a hard-edged punk-rock/New-Yorker aesthetic to really be a hippie in the classic sense. The part of Machine of Human Dreams dealing with my childhood makes much of the roots of my AGI aspirations in the dreamy-eyed utopian idealism of the 60s/70s era. This is fair enough. Changing the world was what the adults around me were all about in Eugene back then; and I absorbed from my parents and their friends the idea that utterly changing the world was a reasonable thing to do and probably the most valuable way to spend one's life. Until my mid-teens I was fairly optimistic about radically improving the world via education and social reform; but at a certain point I shifted my views and became convinced that extreme technological advance was the best path toward tremendous positive transformation.

The film symbolizes the 60s/70s era culture by showing a bunch of freaks banging on drums in a field somewhere or other. I don't remember ever seeing anything quite like that. I do remember a near-constant stream of funky bearded guys in torn jeans and long-haired women in loose dresses and beads, singing folk music and strumming guitars and smoking weed … and lots and lots of political demonstrations, holding up signs and chanting and so forth. That was a time when folks in the counterculture believed anything was possible. I still feel that way.

Thinking About Thinking Machines

After my childhood, the movie briefly treats my undergraduate career, interviewing two people who knew me in college: my girlfriend (later first wife) Gwen, and my old friend Ken Silverman (who later worked with me at Webmind).

Ken recounts how, back when we were 15-17 years old and in our first couple years at Simon's Rock Early College, we used to sit around for hours and scheme about creating thinking machines. Well yes we did. Many of the theory-of-mind ideas I later published in “The Hidden Pattern” were already in my head back then. And Ken had lots of his own interesting ideas too, though he always tended to come back to hardware-focused solutions to AI problems, whereas I was focused more on the philosophical or mathematical aspects.

An understandable omission here is: The other good friends I also mused about AI with back then. For example: my college friend Mike Duncan who is still a close friend and who, unlike Ken, is still collaborating with me on AI at this moment, working on applications of OpenCog to analyzing genomics data, and on designing an OpenCog-friendly motivational and emotional system for David Hanson's robots. 

Ken's view is valid and interesting, but Mike's view would have been interesting to show too, especially because I haven't worked with Ken since 2001, whereas Mike has seen the details of my AI thinking and practical work all the way from 1984 through 2016. But Roy didn't happen to interview Mike just because the logistics didn't work out – while Ken lives in New York, Mike lives in Florida and Roy didn't have budget to haul a crew down there just to talk to him.

The movie skips everything I did between 1985 and 1997 – i.e. my grad school at NYU and Temple University, and then my whole academic career, in which I was a professor in departments of mathematics, computer science and psychology in the US, New Zealand and Australia. This was the time period in which I turned my vague college inklings about AI and cognitive science into more fleshed-out conceptual/mathematical theories (though still with many ambiguities and not nearly enough details to guide software implementation in detail). I also made some valuable collaborators in this period, e.g. Dr. Matt Ikle' whom I met in 1993 when we were colleagues in the math department at the University of Nevada Las Vegas, and who later became a co-creator of OpenCog's probabilistic logic and attention allocation subsystems.

The Webmind Experience – and my path toward practicality

The film gives a fair bit of airtime to Webmind Inc., a company I co-founded with 4 others in 1997 and that grew to around 130 total employees before it crashed and burned (alongside a lot of other cool dot-com era companies) in early 2001. It features a fair bit of Lisa Pazer, who was a Webmind co-founder and Webmind's first CEO. Her family also invested some seed money in Webmind in the very early stages; and as the film alludes, we were briefly romantically involved prior to co-founding Webmind (though that aspect of our relationship never went that far and ended before the company was started).

Right after Webmind tanked in 2001, I wrote an essay called “Waking Up from the Economy of Dreams” about the experience. While that piece of writing feels naïve and off-target to me now in some ways, it does effectively summarize my state of mind and attitude on the topic at the time. In hindsight, knowing what I do now about practical software projects and the tech business, all of us in the Webmind leadership – including me, Lisa, Ken Silverman, our second CEO Andy Siciliano, my long-time AI collaborator Cassio Pennachin (who first worked with me at Webmind, and is still working with me today) – were incredibly naïve. Ken and Cassio and I were naïve about how to manage and plan a project of the complexity of the Webmind AI engine; Lisa and Andy were naïve about how to run a technology R&D company of this complexity … we were all smart and ambitious and sincerely trying to do great things, but none of us really knew what we were doing in the context in which we were trying to operate.

Certainly, as Lisa alludes in her interview in the film, I was quite unrealistic at that stage of my life in terms of project planning – I was way overoptimistic in terms of how much work it takes to turn conceptual/mathematical designs into working large-scale software systems. And the business side of the company was not blessed with any particular skill at realism either. Nevertheless, at certain points the company did come pretty close to a successful exit via acquisition. There are some not-that-different parallel universes in which we sold that company at the right time, and made ourselves wealthy and came out of the experience looking like business wizards.

After Webmind shut its doors, I turned largely back to theory, and started thinking hard about how to incorporate everything I'd learned from the 3 years of science and engineering we'd done at Webmind, in a new AGI software design. My main goal was to encompass all the key ideas and structures in the Webmind design in an alternative design that would be much smaller and simpler. Webmind had been a wild grab-bag of different AI algorithms, all acting on the same “weighted labeled hypergraph” knowledge store. My new objective was to reduce the set of AI algorithms to a much smaller set, and to engineer these algorithms so that they would work very closely together. I still thought one needed an integrative, multi-algorithm approach to capture the richness and diversity of human intelligence, but I realized one had to be less willy-nilly about it, and carefully sculpt a set of algorithms intended to help each other out of their ruts. Eventually I came to call this principle “cognitive synergy” and I formulated it in a mathematical way.

Out of this phase of theory work came the AGI design I called the “Novamente Cognition Engine”, which eventually (in 2008) got open-sourced and morphed into OpenCog, and into the AGI design described in my 2014 books Engineering General Intelligence (co-authored with Cassio Pennachin and Nil Geisweiller).

One major part of my professional life that the film omits is my career in narrow-AI consulting and application development. In parallel with trying to work out a better thinking machine design, in the period 2001-2011 I also worked on a wide variety of practical AI consulting projects. I was based in Washington DC most of this time, and worked on bioinformatics for the NIH and CDC, and also (indirectly via various other entities) for INSCOM (Army intelligence), NSA and the Air Force. Some of the military/intelligence oriented work was interesting and potentially important, e.g. we used some tools from OpenCog to create software predicting which Army staff are most likely to commit suicide.

My bioinformatics consulting work over the years has largely been tied in with another, perhaps more critical aspect of my life that the film passes over -- my work on the application of AI to biology, and in particular to understanding the genomics of longevity. Alongside questing to build thinking machine, I have also spent a fair number of mind-cycles thinking about how to use AI technology to help cure aging and radically prolong human life. Some of my investigations in this area have been fairly successful, including new discoveries into the genetic roots of Chronic Fatigue Syndrome, Alzheimers and Parkinsons. I also helped Genescient Inc. understand why their super-long-lived flies live so long, and design some valuable nutraceuticals based on my AI analytics results.

This applied-AI aspect of my career is not that sexy or exciting for the most part (though, OK, the use of AI-driven bioinformatics to push toward a cure of aging and a path to superlongevity is arguably not all THAT boring!). On the other hand, the film generally gives the impression that I keep struggling and failing at everything in spite of my big ambitions and vision and immense knowledge, etc. It is certainly true that I have failed to create human-level AGI so far. But in my consulting work I have succeeded at some simpler (but not that simple) things, which have in some cases been highly rewarding and useful in themselves.

At the start of Webmind I was writing a lot of software code, but gradually as my career progressed I drifted into a pattern of coding only occasionally, and doing more theoretical and management work. The core of OpenCog, back when it was the Novamente Cognition Engine, was originally written by Andre' Senna and Thiago Maia in Brazil, working closely with Cassio Pennachin. Since the creation of OpenCog in 2008, the two most important contributors have been Dr. Linas Vepstas (based in Austin) and Dr. Nil Geisweiller (based in France and Bulgaria). Those guys have worked wonders. Nil is probably the only guy on the planet to fully understand my AGI design on the philosophical and mathematical level, and ALSO know the OpenCog codebase very well on a software level. Linas brings tremendous practical experience and software chops as well as deep mathematical and AI insight. Roy interviewed both of them for the film but ended up not using the footage – understandable perhaps given the time constraints of the movie, but still a bit distressing to me since these two extraordinarily brilliant and dedicated guys are really the ones most responsible for making the actual OpenCog system work.

My Hong Kong AI Adventures

In 2011 I relocated from DC to Hong Kong. I had been sick of DC on the personal level for a long time, but had been “stuck” there due to having a (roughly) 50-50 custody sharing arrangement with my ex-wife, Gwen, for our 3 kids. But by 2011 our youngest, Scheherazade, was about to do a junior year of high school overseas, so it seemed the right time to shift somewhere more interesting.

Machine of Human Dreams interviews Gwen a fair bit, and even has her appearing to say (via splicing together of utterances she made in different contexts while being interviewed) that she filed for divorce from me because I was so obsessed with AGI and my work that I couldn't pay enough attention to other people. Well, OK, whatever – I mean, the actual story of our divorce was definitely a lot more complex and nasty than that and didn't have much to do with AGI, but whatever. In this particular case the simplifications of the movie are probably in everybody's best interest….

In terms of omissions, it felt a bit odd to me on a personal level that he included Gwen in the movie but barely mentioned our 3 kids, e.g. our oldest son Zarathustra who is now getting his MS in computer science and moving toward a career in AI himself. But even more so, it felt odd that my long-ago first wife Gwen was included but he omitted my second wife Izabela Lyon Freire and – yeesh! – my actual wife Ruiting, to whom I've been happily married for 6 years now.  Both Ruiting and Izabela are excellent AI researchers with significant contributions to OpenCog. Izabela helped design OpenCog's PLN probabilistic reasoning engine.  Ruiting helped create OpenCog's natural language processing and dialogue subsystems.

Overall, through the years, my AGI obsession has drawn me to brilliant, active-minded women who are fascinated by AGI and other scientific and intellectual topics -- though it's true that Gwen's interest in these topics diminished as our marriage went on, and she got more focused on religion and nutrition, which interest me less.  And whatever difficulties I've had with love relationships have had little directly to do with my AGI obsession and more to do with other personality factors.

Roy skipped interviewing Izabela for the film because he didn't want to travel to Brazil; Gwen, being in the DC area, was more convenient. He did interview Ruiting fairly extensively, but in the final film she just shows up for a few seconds, jokingly noting that she doesn't want to move to Ethiopia (though the truth is, while she prefers living the developed world, she is willing to relocate with me to Ethiopia for a while if that turns out to be the best thing for our AGI work).

As an aside, Raj Dye's film Singularity or Bust has some sweet footage of Ruiting and me interacting with a Nao robot, back before we got romantically involved --you can clearly see the early sparks of our relationship there, which is pretty cool from my point of view...

The budding love relationship with Ruiting – who lived in Xiamen at the time – was part of the reason I relocated to Hong Kong. Another part was that Cassio and I secured funding to start a machine learning based investment management company, Aidyia Limited – which finally started trading a small fund in early 2016. And finally, Gino Yu and I got some Hong Kong government research funding for an OpenCog project at Hong Kong Poly U, where Gino is a professor.

The film omits mention of Aidyia, but a long middle segment of the film focuses on some robotics prototyping work we were doing at the Poly U OpenCog Lab in 2014-2015. This part of the film captures some cool robot-lab work and social dynamics, yet also feels to me like one of the more oddly focused segments. While Roy was at Poly U filming, the OpenCog team there was preparing to show some small robots to some officials from the grant funding agency that was funding the project, and there was some nervousness about putting on a good show. Roy liked this energy and nervousness, and for a while he was considering to focus his whole film mainly on our push to make a good demonstration for the funding agency officials.

I argued with Roy long and hard about this, at the time – making the points that: a) this demonstration had no particularly profound meaning, as it pertained to a robotics prototyping project that was valuable but not really core to the OpenCog AGI initiative; b) the people involved in the robotics prototyping work at Poly U were not really the key players in the OpenCog project anyway. Eventually I did convince him that focusing on this funding agency demo would result in a very boring film – I dragged him (metaphorically) kicking and screaming to Hanson Robotics and convinced him to end the film with David's gorgeous robots.

Still, though, I seem not to have fully convinced him – because that funding agency demo still absorbs a chunk of the film that is quite disproportionate to its actual importance. Also, the film omits the outcome of the demo, probably because it was boring … in the end, the demo we gave to the officials was underwhelming but adequate, and after a bureacratic delay of a couple months we were given a passing grade and the research (and research funding) continued.

The film then shows a few staff leaving the project after the underwhelming demo, hinting not too subtly at a potential causal connection between that demo and any staff departures; but in fact no such causal connection existed. Staff turnover was very high on our Hong Kong Poly U OpenCog project, mostly because the grant funding we had didn't allow us to pay market salaries. And the researcher who the film shows quitting OpenCog and leaving Hong Kong, Aaron Nitzkin, is a great guy and a deep cognitive theorist, but actually contributed fairly little to OpenCog due to his lack of professional programming skills.

This brings us to a big omission in this section of the film -- its failure to note the deepest OpenCog work was being done all through that time period by Linas and Nil in the US and Europe, far away from and almost completely ignorant of the Hong Kong team's robot prototype demos.

Also, as a minor point, the film shows OpenCog software and robotics developer Mandeep Bhatia musing about potentially moving back to India; but while Mandeep likes to think about this periodically, in fact he's still here in Hong Kong, now working with me and the rest of the team on making OpenCog control Hanson robots.

One thing the film does depict very accurately is that I have had a fascinating and fantastic time doing AI and robotics development here in Hong Kong. With David Hanson's amazing robot heads, Mark Tilden's walking robot bodies (briefly discussed at the start of the film) and OpenCog intelligence, we have the potential to make the smart, emotional, physically able humanoid robots everyone expects from science fiction. Ultimately AGI will transcend the human form and the human mind. But as we walk along that path, robots with humanoid form will have an important role to play in shaping the emergence of AGI cognition, emotion and values, and in helping human society come to grips with the onset of ever more advanced AGI. Despite some peculiarities of focus, I think the Hong Kong footage in Machine of Human Dreams does get across some of these themes in a striking and visual way.

iCog Labs and the Ethiopian Singularity

The film briefly shows me in Ethiopia discussing AI at a university there, and demo-ing robots out in the street with a team of young Ethiopian programmers. The robots in the streets of Addis look splendidly incongruous; and Ethiopian writer and tech project manager Hruy Tsegaye gives a beautiful speech about the power of advanced tech to advance Africa.

The vague impression given in the movie is that, after things got tough in Hong Kong, I started roaming far and wide in search of somewhere new to go and push forward with AGI – and I was so adventurous and maybe desperate that I looked as far as wildest Africa! This is indeed poetically true, in that I am very interested in the notion of building a large AGI team in Ethiopia where the costs are low, the people are lovely and the food is delicions. On the other hand, the dynamics of my involvement with Ethiopia has been a bit different than the film suggests.

I co-founded iCog Labs – Ethiopia's first AI/robotics firm -- in 2013 together with Ethiopian roboticist Getnet Aseffa Gezaw and American investor Sander Olsen. The idea for iCog originated when I visited Getnet in Addis Ababa in 2012, after getting to know him via the Internet in 2011. OpenCog and Hanson Robotics have been outsourcing work to iCog since 2013, and iCog has also been helping me with various AI consulting projects. I have consistently been impressed with the intelligence and ambition of the young computer scientists and programmers of Ethiopia. I have a few times considered relocating to Addis to work full-time on growing iCog into the world's greatest AGI, robotics and bioinformatics research center -- but at the moment I have a lot of interesting stuff going on here in Hong Kong, so I'm just visiting iCog as often as I can find room for.

Dr. Hanson's Robo-Dreams

One of my bigger successes here in Hong Kong has been to facilitate my good friend Dr. David Hanson moving his company here! David was coming to Hong Kong periodically before I moved here, because he was getting some robots made across the border in Shenzhen. On one of his visits, I introduced him to some of my tech-scene contacts here, and these contacts ended up garnering him investment money for his company Hanson Robotics – which ultimately ended up in him and his family moving out here to start a new branch of the firm, Hanson Robotics Hong Kong.

Working with David has been an intriguing, exhilarating, and sometimes exhausting experience. While his focus is mainly on emotional and social robotics, he fully gets my AGI vision and my intended route toward it with OpenCog. He has been both a good friend and an able collaborator … the end bit of Machine of Human Dreams quite accurately depicts what I'm doing with Hanson Robotics these days (well, as of 2015 anyway). The footage Roy got of the first version of David's “Sophia” robot is strikingly beautiful. The new version of Sophia is even better.

Since the time Roy wrapped up shooting Machine of Human Dreams we already have made great progress connecting OpenCog to the Hanson robots, and at time of writing, it seems it should be a small integer number of months before we have the first fully OpenCog-controlled Hanson robot head. Over the next few years, I think the Hanson robots can be both an outstanding showcase for OpenCog AGI, and a practically valuable medium for supplying OpenCog systems with the perception, action and social/emotional interaction they need to learn and grow.

Intelligent Networks Spawning Intelligent Networks ...

One thing that my work with David Hanson and his team – with their background in art and theater – has given me a stronger sense for, is the powerful urge the human mind has to perceive and create narrative structures. At some deep level, our hearts, minds and brains really want to view things in “Hero's Journey” type terms – in terms of stories with a beginning, middle and end … in terms of individual protagonists meeting obstacles and overcoming them and growing in the process, and so forth. We often get ourselves into trouble by unconsciously imposing this structure in cases where it doesn't really exist, or plays at most a minor role.

The great biologist Michael Rose, whom I worked with at Genescient Corp. for a few years (mostly at a distance, but occasionally face to face), often railed against this tendency as it manifested itself in biologists. Biological systems, as he understands them, are highly complex networks with subtle nonlinear self-organizing dynamics. Most meaningful biological effects emerge from rich networks of causation spanning numerous biological systems on multiple levels – many genes and proteins, many kinds of molecules, many kinds of cells, many organs.... Many biologists want to explain a disease or some other phenomenon via finding a single gene or a single biological process that is The Answer, or a single dynamic with a beginning, middle and end. But in reality, Michael emphasizes, biology doesn't work that way. There is no narrative. There are just mind-numbingly complex networks, out of whose distributed multilevel dynamics complex effects emerge.

I think Rose's complaint is also at the root of my complex, perplexed feelings toward the many simplifications made in Machine of Human Dreams. I have some difficulties with the tendency to simplify things into a templated, stereotyped narrative structure, even when this structure captures only a small part of the actual dynamics one cares about.

In its quest for clearly comprehensible drama and narrative simplification, one important thing the film de-emphasizes is that I've been supported in my passionate transcontinental quest for AGI by a rich and diverse network of friends, family and collaborators. The film sidesteps this aspect by focusing mostly on people from various stages of my life with whom I worked temporarily and stopped, and bypassing the other people from the same stages of my life with whom I've had strong, ongoing relationships. In this way, the film makes it look like I've been far more of a wandering loner than has been the case, and plays down the self-organizing social graph that has helped hugely in propelling my work forward. This makes ME seem like a more of a lone wolf and less of a human-network-aggregator than I actually am; and it makes the quest for building AGI seem like much less of a team effort than it really is.

What I'm doing with my life is not pushing to build a thinking machine all on my own – what I'm doing is serving as the seed about which a network of other brilliant people can crystallize, and providing a core of ideas to guide their work. This may seem like a fine distinction, but it's actually a very important one.

I remember one moment in my apartment in Hong Kong, when Roy was there filming along with a colleague from Roast Beef (whose name I've forgotten). His colleague said to me, while interviewing me, something like “You've moved around a lot. When you run into a dead end somewhere, you just cut your ties and move on, huh?” --- I looked at him bemused. What I said is something like, “No, not at all. When I get frustrated and want more opportunities, I do tend to move on to new places – but I never cut my ties. I've kept so many of the friends and colleagues I've had over the years all over the world. I'm actually really good at keeping touch with old friends and colleagues via the wonders of the Internet. And if you look at my colleagues now, there are people I've been working with since the 80s and 90s from all over the globe, flying in here to Hong Kong to collaborate. A bunch have even gone to Ethiopia with me to work with the guys there. The network of people collaborating on this stuff is not tied to any one physical location. However, I've often found that funding sources are obsessed with you being in a certain physical location....” – And then Roy's colleague quickly changed the subject, and the interview ended shortly after. My answer wasn't what he wanted to hear. He had already put me in the box of “Mr. Cuts His Ties and Moves On” because he was thinking of the narrative of the film that way. I got the feeling that -- unlike Roy -- this colleague wasn't really concerned about the actual human being or the actual science and engineering project that the film was supposed to be reporting on – he was more interested in coaxing me to say stuff that would fit into the narrative structure in his own head.

Similarly, as Ruiting recalls, when she was being interviewed for the film, they probed her with questions oriented toward finding controversy ...  like “Does Ben care more about his AGI work than he does about you? Does he prioritize his work over your relationship?” She answered that one something like “Sometimes, maybe” – which was both honest and sufficiently boring that it didn't make it into the film. But if they'd chosen to poke in different directions, they would have found Ruiting had a lot of interesting things to say on other relevant topics. 

For instance, when she started working on OpenCog-based natural language dialogue, she thought it would be a relatively easy problem, because OpenCog had a semi-magic logical inference engine that would just solve everything. Indeed, if your inference engine is good enough, then you can just pose every aspect of natural language dialogue as an inference problem, and you're done! But over years of thinking about it and working on it, she came to grips more thoroughly with the nature of the problem – which is that, in order to perform usefully fast on linguistic problems, the inference engine needs to be guided by linguistic knowledge … but the linguistic knowledge can only be gathered by inference … so you actually have a “chicken or egg” problem … you have a complex cognitive system in which each part requires the others in order to function. 

How Ruiting's thinking about AGI and language processing has matured over the 6 years we've worked together would be a challenge to portray in a film – however, even a slight hint in this direction would have been interesting to show I think. As it is, the film doesn't even hint that this sort of aspect exists in my life – the fact that I'm joyfully married to a lovely young woman who is working and thinking together with me about AGI is utterly bypassed.

This hits on a larger point: It occurs to me that, if one looks at Machine of Human Dreams as a portrayal of my own personal journey through AGI development from a classic-narrative “Hero's Quest” type perspective, one major thing missing is any substantial depiction of the growth and transformation the “hero” goes through as a result of his trials and tribulations. The film gets across that I'm a dude who holds AGI as a Grand Goal and keeps on trying, and whose frustrations never last too long – when I hit an obstacle or setback I do sometimes get pissed off or even temporarily depressed, but ultimately I just ram into it again or look for some other way around, because I can see so damn clearly in my mind what's on the other side! But the film just shows me keeping on going, and doesn't really show how I've grown and adapted as result of keeping on going for 49 years. Compared to the real Ben Goertzel, the Ben G character in Machine of Human Dreams is a lot more Energizer Bunny like – he keeps on going and going admirably, but he never really changes.

In fact I've changed a lot in my life, in various phases, in multiple ways that are relevant to my AGI work. In the Webmind era I was fantastically unrealistic in my project planning and time estimates. I'm still a bit on the optimistic side, to be sure; but I'm now more within the scope of ordinary optimistic project leaders – there's a world of difference. I have undertaken great efforts to rid my mind of delusions insofar as possible, to really see what is feasible versus what I'd like to be feasible, to clearly distinguish intuition from solid knowledge and research projects from engineering projects. Again I have not become a hard-nosed pragmatist but I've become way way better at distinguishing how the world is from how I'd like it to be – while still pushing to make it become more the way I'd like it to be! Much of this learning has occurred as a result of doing various practical, applied narrow-AI consulting projects, a side of my life that is far more boring than the quest for superhuman AGI ... but yet if I do succeed at building superhuman AGI, this will partly be due to the modicum of discipline I learned from spending a bunch of time delivering real stuff for customers, sometimes successfully and sometimes not.

On a more personal side, I've gradually had to learn to stress out less about the frustration of my grand cosmic goals being so slow to achieve; and of spending so much of my time on stuff that I enjoy only moderately and that works only indirectly toward my grand goals (e.g. managing people, doing consulting projects, going around seeking funding,...). At times this has really made me feel like shit; but eventually, through various sorts of efforts and relaxations, I've untied a lot of knots in my mind and become OK with everything. These days I feel a deep inner contentment, even while working like hell toward difficult goals in chaotic situations – a feeling that visited me only much more intermittently in previous parts of my life. Most likely some of the crappy decisions I made in earlier phases of my life were rooted in a deep inner discontent, which plays a much lesser role in my psyche these days.

The film's portrayal of me as an obsessed AGI zealot is certainly accurate; but my own individual growth and transformations, which have impacted the flow of my AGI work in huge ways, have been driven as much by my various non-AGI passions and occupations – for instance, my explorations with psychedelics, and my research into psi phenomena, both of which are left out of Machine of Human Dreams for understandable reasons (all that is fascinating and important stuff, but would be distracting and hard to capture usefully in a brief way). As it happens, the three people who could have infused the film with some insight into the diverse factors driving my evolution as a human being and scientist – my wife Ruiting, my oldest son Zar, and my ex-wife Izabela – were omitted from the film, although Roy did interview Ruiting and Zar fairly extensively.

I can't especially fault Roy Cohen for not coming to grips with the depths of Ben Goertzel's psyche … I'm a complex, unique sort of weirdo, and Roy and I never had the kinds of conversations that would have enabled him to really understand me well. Roy and his colleagues always stayed pretty close to the surface in their interview questions; and I never tried to push them into grokking my individual character more thoroughly, mostly because I wanted their film to focus on OpenCog and the quest for superhuman AGI rather than me as a person. But of course, if you really want to dig deep deep deep into things, the motivations and networks inside my human mind and the motivations and networks in the AGI and OpenCog communities and the motivations and networks inside the still-incipient OpenCog AGI minds are all dynamically interpenetrating and growing in a coupled way. This shit is bloody complicated!

Conveying the complex social-dynamical phenomena via which networks of intelligent people are coming together to create networks of intelligent processing inside AGI systems … together with the inner growth and transformations of the people trying to crystallize such networks around breakthrough ideas – sure, this would be a big challenge from a film-making perspective, and I can see why Roy and his colleagues found it convenient to fall back on more of a standard narrative structure....

Net net, while it omits various relevant aspects of the underlying reality, still, the story Roy tells is pretty good. I do feel there's an even more fascinating kind of story lurking beneath. But I suppose that's usually the case...

Meanwhile, a film by nature is frozen in time, whereas reality moves on. Just in the last week -- i.e. 8 months or so after Roy finished shooting Machine of Human Dreams -- we've gotten OpenCog fully hooked up to the gorgeous Hanson robots, controlling their verbal and nonverbal behavior. Now it's down to making the robot smarter and smarter.

We're doing a low-cost-robot soccer contest in Ethiopia later this year and my hope is to have one of the Hanson robots give the speech at the opening ceremony, maybe with a funky African-style braided wig. Lots of high Ethiopian government folks will be there, I'm sure their jaws will drop. And we're still jamming with Mark Tilden, moving forward on plans for a humanoid walking body to go along with the Hanson heads and OpenCog mind.

And behind the scenes the AI keeps progressing. Nil (French, living in Bulgaria) and Eddie (from Vermont, but was just here in Hong Kong for a couple weeks) and Misgana (moved from the Ethiopia office to Hong Kong some time ago) have gotten OpenCog's probabilistic inference engine (first described in a 2006 book by me, my old Las Vegas + New York collaborator Matt Ikle', my ex-wife Izabela and my Finnish transhumanist friend Ari Heljakka) to do some cool inferences about the biology of longevity, as well as about what people say to the robot. The non-linear-dynamical attention allocation math that Matt and I worked out over a decade ago is actually finally working now, thanks to some work by Misgana and with some help from Roman, a German intern who also wrote a Lojban interface to OpenCog (Lojban is a speakable form of predicate logic, around for more than half a century spoken by a small community of awesome geeks on the Internet).

Overall – the international network of human minds is gradually bringing to life a plausible approximation of the cognitive network that Nil, Cassio and I described in Engineering General Intelligence in 2014. This emerging mind network is starting to display itself via the emoting faces of David Hanson's beautiful robots but also in other ways, such as finding patterns in complex networks of genomic data.

A new form of life is unfolding, little by little. Very fast on the historical scale, sometimes painstakingly slowly on the time-scale of daily endeavor. Machine of Human Dreams depicts a few interesting fragments of the process, captured during a brief slice of time. The AI work will progress a bunch further inbetween me writing these words and you reading them. 

Us personalities involved in building AGI and our individual narratives and stories are often colorful and interesting, but from a bigger view, we're kinda like the funky flashes of fire coming out of the bottom of a rocket as it blasts into space. Yes, the dancing yellow flames from the rocket are fascinating, and you can stare at them a while and get lost. But the flames on a campfire are fascinating also. The unique thing about the rocket is that it's going into space. The unique thing about the story Roy Cohen captured is that this is a group of people building a mind beyond the human. Even though I'm working toward this goal every day, and the step by step work can be difficult and tedious, it still blows my mind to think about what we're doing and its ultimate implications.


Bill Lauritzen said...

Very nice and inspirational post, Ben. I have not seen the movie yet, but I still learned a lot.


Awesome Ben! Very inspiring indeed. Hopefully, OpenCog will one day be able to appreciate the 'hero's journey '.


Awesome Ben! Very inspiring indeed. Hopefully, OpenCog will one day be able to appreciate the 'hero's journey '.

Mentifex said...

This is a great post, Ben. I have long called you the Albert Einstein of artificial intelligence. Meanwhile, you can see me two weeks ago attending the White-House-sponsored Artificial Intelligence: Law and Policy workshop, waving the New York Times and asking White House Deputy Technology Officer Ed Felten to point out out to me where John Markoff of the New York Times was sititng up in the audience. Then you see me walking off camera to approach John Markoff and infect his febrile mind with memes of Mentifex AI Technology.

Mentifex said...

Sorry Ben, I posted the wrong link. Artificial Intelligence: Law and Policy Workshop is the correct link to the first of four AI workshops being co-sponsored by the White House in 2016. Since it was held here in Seattle WA USA at my alma mater University of Washington, I just _had_ to attend. I figure that AI and AGI (coined by you :-) must be getting pretty important if the American White House is starting to convene AI Workshops -- kind of like your AGI or Singularity Summits that you have been organizing already for years now.

Meseret Dastaw said...

Interesting awesome jobs, dont forget to keep doing so - u already are the n^th among people who's been changing the world!!