More Wonder in Wonderland

We returned to Wonderland, and things have indeed changed since our 2005 trip; there is now a water park -- the perfect place to cool off and listen to bhangra.

Ameen modelling Jalandhar's latest swim wear fashion...

And the kids 5 minutes after returning home...

The Progress of Safety - Indian Style

So for any of you who may have recollections of 70s travel on India's famed GT road, things are much different, generally for the better. My childhood trips to India virtually always involved an accident of some form or another. Once my father, grandfather and I got ran off the road by a bus overtaking another -- our motorcycle went down, and we all suffered some serious breakage. I can't recall a single trip to India during that period where at least someone we knew was not in a serious accident.

Now things are very different. The road from Delhi to Amritsar in general segregates traffic moving to Delhi, from that moving away from Delhi. I'm no traffic engineer, but in general, this seems a good thing. In addition, the moon crater size pot holes, while by no means an endangered species, generally have dwindled on main thoroughfares. Things get even more amazing -- many cities now have very strict helmet and seat belt laws. When you look out onto the streets, it really looks like the laws are being enforced, and folks are following them. But on closer inspection, I realize this is not quite the case.

Upon entering a taxi, virtually every one of them tells you to put on your seat belt. So I reach for my belt, and realize there is no buckle on the end -- its been cut off. The driver usually smiles and says something like, "just lay it across your lap, so the police won't notice." I was wandering the bazaar and noticed a man selling helmets - they looked like hard baseball caps. He had a pair of scissors and was busy cutting off the straps. I asked him what good a helmet was with no straps -- he looked at me like I was completely daft, "so the police don't bother you, obviously."

I also realize that woman don't wear helmets. So I ask my driver why that's the case -- he says, "oh the ladies were furious that their hair was being messed up. Woman have many rights you know. Men in the goverment also realized that so much of life's beauty is gone if one can no longer see woman and their long flowing hair on the back of a motorcycle." All I could think was, ok, here's a country with an out of control infanticide rate driving a major gender imbalance, and the government decides to start favoring women by allowing them the option to die in statistically larger numbers. After thinking about it for a while, I realize I'm wrong -- after all, the straps are cut off the mens helmets, and there is no functioning Snell helmet approval organization, so virtually anyone can manufacture helmets; they can even make them out of tupperware if they want to.

The best part, of course, is that if you have 500 rupees on you, you can totally ignore the laws, since a little palm grease goes a long way. And I must say, all cynicism aside, it really is liberating knowing that virtually every law out there is easily skirted, leaving one completely free to do what they want. Our kids love romping around seat belt free in the car. And in general I let them, not just since the belts are broken, but back in 70s America, that's how I grew up.

A Trip to Manikaran Sahib

We recently returned from a few days up in the mountains with my cousin and family. We went to Manikaran Sahib, a Gurdwara that is located in the Parvati valley near Kulu and Manali in Himachal Pradesh.

The ride up was pretty twisty and turny. We had multiple vomit related pit stops. We've driven around the Cascades quite a bit without incident, but apparently the Himalayan mountain roads were too much for Nayan's stomach. Nonetheless, the drive was just spectacular. One of the things that is so different here, is that people, lots of people, actually live way up the mountain sides. Often there are no roads, just little trails; folks hike up many thousands of vertical feet to get to their houses. There's also an interesting network of rather sketchy cables and baskets to help people and goods traverse major valleys. Pictured below is me standing on one of many jerry rigged rafts that folks use to cross rivers.

The Gurdwara is built around natural hot springs; there are multiple baths where you can soak. The Gurdwara itself has a very universalist bent -- virtually every religious prophet is pictured throughout the Gurdwara; each time I went into the hot spring I had a different experience -- once with a group of Hindu priests, again w/ a number of Buddhist monks, more with Sikh pilgrims.
Here are a few snippets from SikhWiki.org on the history of the site: Guru Nanak Dev ji was with his Sikhs in the Himalaya mountains of India. His sikhs were hungry and there was no food. Guru Nanak sent his good friend Bhai Mardana to collect food for langar (the community kitchen). Many people donated rice and flour(atta)to make parsadas(bread). The one problem was that there was no fire to cook the food. Guru Nanak than lifted a rock and a hot spring appeared. The sikhs were able to make rice and beans.

Legend has it that once Lord Shiva and his divine consort Parvati were wandering in this sublime environment. Shiva liked the place and started meditating. Meanwhile, Parvati started taking a bath in the blue waters. While she was playing in the water she lost her earring. Shiva was enraged when he could not get back the earring, he started doing Tandav, the dance of destruction. The atmosphere got tense and Shiva threatened the serpent, the probable thief. The serpent fished the jewel out from the waters. Thus the river came to be known as Parvati and the place was called Mani(ring)Karan(ear).

A Delightful Delhi Day

We had a blast cruising around Delhi today. Since we're all jet lagged, we experienced the very unusual act of getting the Dhillon family out and about at a crisp 7:30 AM. This is the first time in my life I have actually enjoyed Delhi. Perhaps its the stunning Le Meridien hotel that is coloring my take, but I could swear this city is so much cleaner and greener than I remember it. We especially enjoyed Humayun's Tomb -- mostly, the first, more minor tomb pictured here. Something about the lines and rawness of its shape; I also love how nothing is cordoned off or protected by railings -- we happily climbed up and around and all over the structures.

Love, Escalators, and Fishing Nets

So we got out off the plane @ the airport yesterday, and I was totally shocked. For the 36 years of my life, and the many many times I have been to the Delhi airport, I have not once seen the escalator working. In 96, when I flew in from Boston, I saw a college girl fall on her knees before the escalator and start crying tears of joy, "oh my broken India! I have missed you so much." While riding down the escalator I contemplate the thrill of progress reaching even the arcane corners of government. Upon stepping off the escalator, I look up and smile, realizing the girl's broken love is still there to welcome her. Right above the customs agents that stamp your passport is a massive gaping hole in the ceiling where you can see piping and ducting exposed through shattered pieces of grease stained 70s ceiling tiles. Below the 30 foot round hole hangs a massive fishing net; it is tied with twine to rusty bent electrical poles sticking down from the ceiling at various angles. The net keeps new arrivals and customs agents safe from falling debris.

Family Photos from the Christmas Season

Illiterate Iraqi Men in Ballard

I just got back from a work out. While working out, the following conversation occurred between the following people:

• Large white rather awkward 50 year old man w/ beard, I'll refer to him as LWAYOMB for short.
• Typical white normal middle aged Seattle-ite woman, I'll refer to her as SeattleWoman
• And me.

I'm working out on a machine, about 10 feet away LWAYOMB says to SeattleWoman, "excuse me, excuse me, miss, uh hum, do you know if we are supposed to clean up after we use the machines. I mean, uh hum, today is my first day and I, uh hum, am not sure."

SeattleWoman: "well yes technically you are, but I'd say about 40% of the people don't and about 60% do."

LWAYOMB: "oh, uh hum, yes, I see. Well you know, I see that man over there, uh hum, he didn't clean off his machines, and, uh hum, perhaps he can't read English."

SeattleWoman: "well you know some people do, and some don't."

LWAYOMB: "yes well he looks like an Iraqi, so you know, perhaps he can't read. You know, these Iraqi's don't read English very well."

SeattleWoman kind of drifts away passively.

So at this point I'm really annoyed. I walk over and say to LWAYOMB, "Sir, I speak English just fine. You really shouldn't assume that a man merely due to his skin color is illiterate. Also, I'm not from Iraq, but if I were, why would that matter? You could simply have asked me to wipe off the machines instead of proceeding with this elaborate passive aggressive dialog."

LWAYOMB huffs and says, "oh well yeah, uh hum, I've tried that before, uh hum and it didn't get me anywhere." LWAYOMB getting red and flustered, repeats over and over again, "can you read, I mean, can you read. Can't you read?"

I shake my head and go back to working out. Later, after LWAYOMB leaves, SeattleWoman says to me, "I'm really sorry about that. I thought he was asking a straightforward question, and I was trying to say, yeah some people do wipe down the machines, some don't, it's not really a big deal either way. But after he started on the racist angle, I was shocked and sort of speechless."

I said, "yeah that was pretty bizarre. I've spent my entire life in the states, and I must say, that was the first clearly racist incident I've ever encountered directed at me. And of all places, this is Seattle, where on earth is this guy from?"

So, to all my friends over the years who have argued to prove the point to me that racism is alive and well even in lefty Seattle, perhaps you are right. But I must say, while its certainly annoying, this man is clearly in the minority, and his behavior is not socially acceptable. Afterward, when I was checking out, I chatted w/ the receptionist about the incident. Coincidentally, the man walked by at the same time. She was apologetic, clearly bothered, and said she'd chat w/ him.

Remembering Paul Yeskel: 1951--2007

One of my good and very inspiring friends recently lost a dear friend of his. He sent me the eulogy he made to his friend. I found it so moving I asked him if I could post it here; to my request, John said, "Please post away. My prayer is that everyone who gets this email will forward it." Please have a read and realize that life is precious, and there truly are amazing people who make this world a better place.

John Silliman Dodge
From Radio & Records Jan 18, 2008

I recall a scene in Tom Sawyer where Tom and Huck have staged their own deaths. The whole town is packed into the church and there’s much sobbing and lamentation. The two boys, hiding upstairs in the organ loft, are having the experience many of us fantasize about: attending our own funeral and seeing just how many people loved us and how upset they are that we’re gone.

On the afternoon of December 27, 2007 at a chapel in New Jersey, I spoke by thought to my dearest friend, Paul Yeskel who died suddenly and unexpectedly four days before. “Pauley, wherever you are I hope you can see this room filled with people all here to honor you, to declare how much they loved you and how much richer you made their lives.” We don’t know why he went to sleep the evening of December 22 and simply never woke up, but when the news finally comes, it won’t matter how it happened. Paul is gone and his wife, his daughters, his brother and sister, his world family will never be the same.

Let me tell you a few things about this wonderful man I knew for 35 years. He was born in Elizabeth, New Jersey and came of age during the golden age of New York Top 40 AM radio. Cousin Brucie, Murray the K, Dan Ingram and the rest were like family members to him. The summer of ‘69 before his first year of college, Paul went to Woodstock. And if that didn't clinch his career path, I don’t know what did.

He started in radio but soon moved over to records. Promotion was Paul’s special calling and his effectiveness was demonstrated by the gold records which covered his office walls. There were stints with Ariola, ATCO (where he was instrumental in signing my band, Cooper-Dodge), and Arista Records. Then came his marketing and promotion firm, Aim Strategies. Many firsts there, including the first company to promote the (then) new Triple A format, first company to develop radio play and retail sales tracking software, first company to focus on the current side of Classic Rock with the website www.classicsdujour.com. Besides the amazing set of rock-hall-of-fame pictures that rolls when you visit www.aimstrategies.com, I like this quote best:

“We have had the privilege to work with artists like The Beatles (Love), Led Zeppelin, The Rolling Stones, Bob Seger, The Who, Fleetwood Mac, Eric Clapton, Neil Young, Heart, Styx, Lynyrd Skynyrd, Def Leppard, Bon Jovi, Queen, CSNY, John Fogerty, Peter Frampton, Steely Dan, George Harrison, Ringo Starr, Journey, Kiss, John Mellencamp, Sammy Hager, REO Speedwagon, ZZ Top and The Allman Brothers. I get paid for this. Life is good.”

Family was important to Paul. He married the girl of his dreams and together they produced two beautiful daughters. His fine family was a great source of emotional support when in 1998 Paul developed a rare and potentially fatal kidney disease. Younger brother David Yeskel (also a successful record exec) was to be the designated organ donor, but when Paul’s system started to crash in 2004 and they began the pre-transplant process, Dave’s candidacy was suddenly ruled out due to a family history of diabetes. Without a feasible Plan B, Paul was seriously worried. He knew that people died waiting for kidneys which came too late.

He shared these mounting concerns with me over dinner at The Learning Conclave conference in Minneapolis in July 2004. At one point I asked Paul, What’s your blood type? A-positive he says. Really, so is mine. I should just give you one of my kidneys. To which he responds, Don’t **** with me! But less than five months later at the Robert Wood Johnson Hospital in New Brunswick, New Jersey, that’s just what happened. After that life-altering experience, we called ourselves The Kidney Brothers. We nicknamed our co-project Billy, as in Billy the Kidney. Of all my life’s so-called achievements, that’s the one of which I am most humble and proud.

The next summer, the Conclave invited us back to tell our story. To a packed auditorium session, Paul described the major rejection episode he experienced immediately after the kidney transplant. In typical fashion, he made serious things light and funny. The crowd cracked up when Paul said, “But hey, I’m in record promotion. I can handle rejection.” He soon became active in the cause of organ donation. If youbd like to learn more about the organization he was involved with, visit the New Jersey Organ and Tissue Sharing Network at www.sharenj.org.

Now our business is going through a fundamental revolution. But however things work out, the basics won’t change. We still need people with big hearts and big ideas to lead us into the future. We need honest people to offset the dishonest, visionaries to counterbalance the myopic, positivity to counteract the gloom and doomers. Paul was this kind of man. The kind of guy who puts a sign on his desk that says, “Obstacles are what you see when you take your eyes off your goal.”

So if imitation is the most sincere form of flattery, let us flatter Paul by imitating the better aspects of his character. He was honest to a fault, candid even in difficult situations. He was generous and genuinely caring. He was in touch with his feelings and their expression. He was one of a kind, a big, beautiful man whose warm spirit enriched the lives of everyone he touched. I’m not being sentimental here. He was the kind of guy you'd give your kidney to.

I’ll close with lines from an old Eagles song, the band that Paul Yeskel first booked in college back in 1972 and last promoted with Long Road Out of Eden in 2007:

“My man’s got it made, he’s gone far beyond the pain. And we who must remain go on living just the same. We who must remain go on laughing just the same.”

So long, Paul. We’ll miss you. In you, the world lost one of the good guys.

Uranium Ore to G-Strings: Recommendations Gone Bad

Amazon's recommendation engine, I believe, relies heavily on collaborative filtering. The theory behind collaborative filtering reads something like: I will tend to like things that people like me like, where "people like me" is defined to be: people that perform similar actions, like buy the books I buy, or rate movies they way I do. Now, take a moment to go the Amazon page for the Uranium Ore product located at:

http://www.amazon.com/Uranium-Ore/dp/B000796XXM

and check out the "Customers that bought this item also bought ..." section. So after laughing for about 5 minutes, I started to think of why this might happen.

Here's a theory I had: there exists a group of users that like to spoof Amazon's engine for laughs. So they go out and provide a bunch of recommendations on goofy products, like those appearing as a recommendation for Uranium Ore. Then, they comb Amazon for products that don't have a lot of purchase transactions. Since Amazon's recommendation engine relies more heavily on purchase data to determine similar users to then pivot into recommendations, in the absence of this data, I reasoned, it probably relies more heavily on user provided ratings. So, without having to spend any money, the spoofers can simply rate the product well, and voila, out pop the G-String recommendations.

Well I don't think this explanation cuts it. I went through and followed recommendations made by a bunch of users w/ comments like: This is the best strawberry jam I've ever tasted. It works well with toast AND English muffins, and these users certainly did not make recommendations of the G-String kind. So, what gives?

Thanksgiving at Fox Farm in Plain

We've been having a fun Thanksgiving up here at Fox Farm in Plain, Washington. Fox farm is an old, well, fox farm, as in raising foxes for furs. The fox raising has long since stopped, and now its mostly a piece of land owned by a playful family that rents out a little cabin. The land is about 15 acres set in a beautiful valley near Lake Wenatchee in the Cascade mountains. The kids have been having a blast; the farm has chickens, goats and horses among other critters. The father of the family works up at Stevens Pass and collects all kinds of contraptions on the property, like old ski lifts, World War I vehicles, really old snow CATs, and more. Its pretty interesting just wandering the farm and running across things. We've also been enjoying having a nice campfire at night. Even in 20 degree weather, there's nothing like a campfire to stay cozy.

Nayan's Birthday Party

We had a blast the other day celebrating Nayan's 6th birthday. We went down to Sunset Bowl in Ballard. The kids had a hoot. The older kids were seeking order and civility in the bowling process. The younger kids just wanted to grab a ball and throw it down the lane. The younger kids eventually won out, so we settled for pure chaos with the names of random party goers appearing on the who's-to-bowl-next bowling monitors. After some initial discomfort with the anarchy, everyone had a great time, including the birthday boy.

Slurpies at the Science Center

We were at the science center the other day and I had a dying urge for a slurpy. Here's a quick clip of the kids savoring theirs. My appologies for the gunfire audio, but Blogger's video upload is a bit buggy.

The Rise of Khalsa - Punjabi Animation

Its been 14 years since I had my original epiphany on how the web would change the world, and I must say, I'm continually surprised at how rapidly things can change on the Internet. It was a little over a year ago when I wrote about the difficulties of finding kids content in Hindi. Today I did a YouTube search for Hindi cartoons and found a bunch of good content. I thought certainly there couldn't be much Punjabi content, but then my Punjabi cartoons query revealed a bunch as well.

So while searching, I ran across this animation called The Rise of Khalsa in Punjabi. Someone posted it on YouTube in 7 parts. You can also purchase the DVD HERE. The YouTube link to the first part is HERE. I have so far watched the first 3 parts, and it seems to be fairly well done. The video depicts Banda Singh Bahadur's rise and conquest of Punjab by the Khalsa army starting in the early 1700s; the Sikh victories contributed to the ultimate fall of the Mughal raj.

There are some violent images, so be aware if watching it with your kids. Unfortunately, there are no English subtitles in the YouTube video.

Lord of the Flies: Hard Lessons for a 5 Year Old

I posted HERE about Nayan's decision to wear a patka and be a proper Sikh. Well it seems he's changed his mind. For 4 weeks Nayan was perpetually taunted and called "weirdo", "freak" and repeatedly ordered to "take it off" by other kids. He was very surprised. He honestly expected other kids to be as excited as he was in his religious adherence. What particularly frustrated him, was that whenever a child asked him "why he had that thing on his head" - and he tried to explain it, they ran off laughing.

We had no idea he was being harassed until last week. He was afraid to say anything since the school authorities had lectured the kids not to "tattle." Ameen went in to speak with his teacher upon finding out. The teacher, to her credit, took action to separate some of the harassing kids. But I believe it was all too late. These things can be pretty viral in their propagation. The damage was already done.

Nayan learned a hard first life lesson: fitting in is really important, and in the all white school of North Beach Elementary, he already stands out. With all the pierced, tattooed, pink haired "open mindedness" of left wing Seattle - one would think this wouldn't happen. Well it seems many humans, even as young as 5, simply are obsessed with something as harmless as a head scarf. It saddened me to see him so excited with his new haircut and eagerness to be accepted, but alas, at least his heart was in the right place. He was very logical about it, he said, "Papa, perhaps I can try again when I'm older, and better at explaining Sikhism."

Saturday Morning Soccer in Ballard

We don't yet have a mini van, but we do spend Saturday mornings at Nayan's soccer matches. I can see why this is THE world sport; the game seems to come very naturally to kids, and unlike T-ball, they really get into it. A quick video of the kids playing afterward is shown below (the gunfire audio is courtesy of Google's new video uploading software, the original is HERE):

Seth Falcon joins Hypertext Solutions

Some folks have been asking what type of individuals we are looking for here at Hypertext Solutions. In general, we are looking for star contributors in multiple areas including but not limited to the areas of: text analysis, natural language processing, distributed programming, information retrieval, and data mining. I thought it might be helpful to chat with one of our new hires and ask him why he joined us.

Seth Falcon began working for Hypertext Solutions last week. In addition to being a key individual contributor to the well known open source Bioconductor project, Seth helped lead the overall development efforts for the project and was responsible for orchestrating the efforts of over a hundred contributors scattered world wide. Seth is a known contributor to R, a widely used statistical programming language. Seth brings with him a wealth of statistical and programming knowledge which will help us as we develop beyond our core areas of unstructured and structured text handling.

I asked Seth a couple questions when he first started last week; I have shared these below:

Seth, you obviously were working on very intriguing and influential work. You could have gone anywhere, both to large companies as well as myriad startups. What was it about Hypertext Solutions that really stood out for you as the place to join?

There were a number of factors that made Hypertext Solutions the most intriguing choice for me.  First of all, a small start-up was appealing because I want the excitement of building The Next Big Thing  along with the responsibility of helping to evolve the development culture.  Another factor is the problem domain.  The search space is a rapidly growing domain rife with interesting problems.  So not only did Hypertext provide the start-up environment I was looking for, but it gave me an opportunity to work with cutting edge technologies in a domain that I find interesting and challenging.

So, how do you like it so far?

A few days before I started, I received a "book bomb" from the company (don't worry, just a bunch of books, absolutely no explosives) consisting of a number of technical and fiction titles.  I thought this was a great way to start communicating the company's vision to new hires.    Today is day three.  I continue to be impressed by the technologies that we are working on and am enjoying getting to know my colleagues. I'm really excited about ramping up and starting to contribute to our products.

More about Seth can be found on his blog at: User Primary.

First Day of School

The other day was Nayan's first day of kindergarten. This was a bitter sweet moment for me. While I'm overjoyed Nayan is growing up to be a mature, articulate, and thoughtful young boy, its sad, in a way, to know he's growing up. I recall distinctly when I was 17, waving goodbye to all of my family and friends, as I boarded an airplane to head off to Chicago and my new college life; my family and friends were so emotional -- sad, and crying. In me, there was no sadness; I had to pinch myself to stop from smiling; I was thrilled at arriving in my new life and leaving my small town world behind. Without a doubt, when that day comes with Nayan waving goodbye to me, I'll be a real emotional mess.

Despite the teachers rounding us parents up and taking us to the "cry" room - no one was outwardly sad, most of the moms were just grinning looking forward to their precious hours of freedom. There were, however, many practical concerns. Nayan has never been away from home for such a long duration. Simply getting him to eat his lunch is a whirlwind of a challenge. Well he learned quickly. After 3 days of stubbornly refusing to eat anything but the cookies in his lunch, he ultimately caught on.

I was also concerned about Nayan getting picked on for his patka. Nayan has recently decided he will be a proper Sikh and never cut his hair. As others, Ameen and I were quite surprised by his decision, and powerful will. Nayan has virtually no role models here in the states who have kept their hair, but his dearest cousins in India all have their hair kept. Ameen, after many failed trips to the barber, ultimately relented. So it turns out no one teased him, as Ameen was certain would be the case. Our neighborhood is really full of such open minded and caring people. Thank God we don't live in France, where Nayan would have been ejected from the school system for simply following his faith.

KDD 2007 Videos Available

The KDD folks have made select talks and interviews from KDD 2007 available online. If you were unfortunate, like me, and unable to attend, you can view the videos HERE.

I recommend Calculating Latent Demand in the Long Tail by Chris Anderson of Wired Magazine.

The Rock Star Treasure Hunt

I've been interviewing a lot of people lately. Trying to find truly great employees is such an interesting process. I find it difficult to really put my finger on what predicts a future epic employee. I've interviewed a large number of people over many years. I've also hired a good number, and then gone on to see how they performed.

Over the years I have constructed a mathematical model to try to help me gauge different attributes of engineers and ultimately score them. Its not a terribly fancy model, but I do have a number of attributes I rank a candidate on after an interview; these scores are then combined to give me a final candidate score. In many ways, this is a ridiculous thing to do -- try and distill a human being down to a simple number between 0 and 1. What I find, is that I am constantly playing with the model to see which attributes really matter and in what relative weight to one another. I often go back and forth with numbers until I can align them w/ my intuition; I realize this is a silly game, but I find the process helps me think through the many issues and realize ultimately what is important. So I put the scores of the absolute best people I have worked with, and the worst, along with the scores I think I would have given them after interviewing them; this helps give me a little perspective. Some really key lessons stand out for me.

1. Programming problems and puzzles only take you so far. I like to ask a lot of tough questions, but the one lesson that sticks out in my head, is of the hundreds of people I have interviewed over the years, the one person who stood out as the uncontested best at answering my technical questions, turned out to be the absolute worst employee. As a candidate, I recall being utterly impressed by this persons answers. I kept drilling him from all angles, and then said, ok, these answers are simply great and I have to hire the candidate. I did, and then I realized what a mistake it was. It turns out, this person was a complete Bartelby the Scrivener, cleverly refusing to do any work. He simply would not do anything, other than reinstall various operating systems on his machine, and answer other people's questions. It turns out, he was really quite good at answering peoples questions, but a "mere" oracle was not what we needed.

2. Sort of the opposite of my first lesson, is that someone who my instincts tell me is worth hiring, but I may still be hesitant on, may still be great. I barely hired at least one of my greatest all time hires.

3. Motivation is a hard thing to gauge, but an essential part of any great contributor. People that have something to prove, can be incredibly motivated. For example, I once hired someone who had never programmed anything more than some toy applications based on a reading of "Java in 21 days." I knew I was gambling, but I was just so impressed with how much this person knew about something he knew nothing about only 3 weeks prior. Obviously he had many other great technical attributes, a strong math and physics background, etc. In any event, he was able to rewrite 6 months of work from a 15 year veteran in 5 long days and have the system really shining within a few short weeks. A few months later he was the star programmer amongst a strong team of 10.

Okay, I'll end this post, as I'm not sure what my conclusions are, other than, its not a straightforward thing to hire the best of the best.

Out of the dark - Hypertext Solutions buys InFact

Well for those of you who have wondered what my top secret quest for the past few months has been about, you can now, finally, read all about it HERE. It has been an extremely interesting time in my professional career leading the effort to make this deal happen. I have indeed learned a great deal about many things non-technical. I have met an amazingly talented bunch of people who have helped guide me through this amorphous and somewhat enigmatic process.

More than anything, I'm simply thrilled to join Hypertext Solutions (note: the name is just a placeholder, we're still in stealth mode) where I can focus on taking the work that has consumed the last 6 years of my life out to massive success. I'm so happy to be back in the start up world, and especially, a well funded one with a powerful and disruptive strategy.

Finally, for those of you who are interested in perfecting and building upon the world's best NLP based text analysis and search platform, send me your resume! I'd love to talk to you.

And now, here is a snippet from the press release:

SEATTLE--(BUSINESS WIRE)--Insightful Corporation (NASDAQ: IFUL), announced today the sale of its InFact search technology and associated intellectual property rights to Hypertext Solutions Inc. for $3.65 million in cash. Hypertext is a Seattle-based startup company focused on making information on the web more “intelligent.” The transaction closed today.

“Our move to sell the InFact technology enables us to focus on accelerating the growth of our S-PLUS product line and our Data Analysis business, which grew 14% during the first half of 2007 as compared to the first half of 2006,” said Jeff Coombs, President and CEO of Insightful Corporation. “We believe we are well positioned to drive additional growth in the predictive analytics space, and are currently investing heavily to deliver an increasingly enterprise-scalable platform and a series of high-value solutions targeted at the life science and financial services industries.”

Google Scalability Conference Talks

Greg Linden has an excellent summary of the Google Scalability Conference with a number of links to the talks. I've seen a few, and highly recommend the first keynote titled MapReduce, BigTable, and Other Distributed System Abstractions for Handling Large Datasets by Jeff Dean. Greg's full post is available HERE. Kyle Cordes also does a good job of summarizing YouTube's scaling experiences HERE. You can see the full YouTube scaling talk HERE.

Human Computation by Luis Von Ahn

I absolutely love StumpleUpon's video recommendation plugin. I now get great video's to watch highly tailored to my taste. Here is a lecture I ran into by Luis Von Ahn, a CS professor at CMU, lecturing on his approach to developing clever and addictive games to leverage human computational power to solve important problems. For example, one of the games allows him to build a database of metatags for images on the web. He argues he can metatag effectively all image content in Google's image search with his user population in a very short period of time. This lecture left me thinking social networking sites are significantly under utilizing their user populations.

How not to find great employees

If you're in a startup and are trying to attract great employees, whatever you do, do NOT post a job ad that looks like this:

CompanyX is a tiny technology startup in Seattle. We are working on some amazingly cool technology, and we face the ongoing challenge of matching people with other people (contextually and behaviorally) and scaling a complex Web application.

We're looking for scary smart people who are willing and excited to jump into a startup, work hard, have fun, make their mark, and work for part equity and part cash. We want to make a lot of money, but you should know this is not your Mommy's station wagon rolling down the freeway at 60mph. This is a pimped out Hummer on extremely rough terrain with life-threatening hazards around every corner. And we're going too fast. If that actually sounds FUN to you, then give us a yell and tell us exactly why we should have a conversation.

Trail Critters and Other Biking War Stories

So after non stop mountain biking for the past week up here at Whistler, I can say with confidence, bears rule the land. A few days back, I was flying through the woods on a cross country ride; I was descending some tight technical single track and ready to shoot out onto a gravel road when I noticed a rather large black bear mulling around in the trail exit onto the road. I stopped as fast as I could, smiled and waved at the bear, and proceeded to back out slowly. He watched me until I was almost out of sight. I then turned my back to him and zipped away -- heart racing of course.

Yesterday, there was a big fella grazing just a hundred yards or so at the top of the lift. I also met a French guy who told me all about his best friends grizzly encounter that had recently happened. Apparently his friend and another friend were mountain biking not too far from here, and a grizzly attacked the other friend. The Frenchman's friend charged the bear to save the other guy, and smacked the bear with his bike. The bear was pushing toward him while he was holding it back with his bike. He then tried to break the bears nose by punching it - to no avail of course. The bear then swiped him with his paw, and apparently ripped deep into his jaw bone. He then passed out, and awoke over half an hour later. Apparently the grizzly left him after determining he was dead, or unworthy. He escaped with only 256 stitches.

This is what riders up here do whenever talk of the furry ones comes up - we all have our war stories. Today, there is a section right above lower Whistler downhill, where you turn a tight corner and launch in the air and down fast into a long open descent. As I was rounding the corner just a moment before committing, I noticed a huge black bear grazing only a few feet from the trail at the bottom. Fortunately I slammed on my brakes and was able to back track out. Another instant and I would have had to race by him praying all the way that I wouldn't blow out a tire or that he wouldn't give chase.

Another rider up here had a mountain lion incident on Tuesday by the mini-disc golf course - he got confronted, and the lion kept pushing toward him. Finally he hopped on his bike and tried to out run the lion. Fortunately for him, he was a downhill racer so he was pretty quick. Apparently the lion chased him for quite a while. The lion story brought me back to my own lion encounter, but I'll save that for another time.

Once this sort of stuff creeps into your mind, its very hard to get rid of the thoughts. The past few days, I've been scanning for critters like mad. Its actually an annoying distraction when there's enough obstacles immediately in your path to pay attention to. Today I was dropping off a steep ladder when I got completely spooked by what turned out to be a life threatening squirrel. Ridiculously, I did end up with quite a crash - fortunately for my ego, it was a tough and terribly slippery spot. Well at least I got to test out my helmet and armor. In any event, I've had enough furry encounters in the past week to last me the year.

The Continued Adventures of Mateo: Fidel Oaxaca

My good friend Matt, now known as Mateo, dropped his life as a Seattle software geek, packed up his trailer, and drove down to the lovely beaches of Zipolite, Oaxaca. He has set up a new life down there. Occasionally I post some of his letters, with his permission of course, to remind us all that there is a world out there away from mortgages and 9 to 5 gigs. Here are some snippets from the latest:

Hey man. Thanks so much for getting back, I really appreciate it. [...] I'm now working with two other Mexican guys starting yet another Mexican non-profit to apply for world bank money to do a deforestation project. This is more Manolo's baby, he worked at the world bank for a number of years and his program was canceled by Wolfowitz. Needless to say he is quite pleased that W got the boot. Anyway he has retained a ton of contacts; I'm helping him prepare English applications and he is helping me find international money for things I'm interested in. The coolest thing, is learning from him.

In Mexico you can't do anything without the support of a local heavyweight. The local heavyweight can be a business leader, a member of an old family, a particularly good fisherman, or even somebody who tells good jokes. It has nothing to do with money or explicit power, it has to do with their personal power, their charm, their charisma, who knows what... Some people have this power [and] people follow them[;] they just know how to talk to all different kinds of people. With them you have a project. Without them you don't, they just take your money and nod. Usually if you go to a small town there are one or two guys who are heavyweights and you will quickly learn who. But one in a hundred, you can take the guy anywhere and plop him down and hell if he can't get everyone behind him in 30 minutes... no matter if they have never seen or heard of him.

Manolo is one of those. He looks like Fidel Castro at 50 with [a] gray beard, rides an old horse everywhere, and is shitfaced by 10:30 every day, but he's an incredible community leader. We went for a business meeting last week in the early morning sober hours. We were all in our bathing suits. We drank cheap Nescafe and he smoked cigars that he rolled from a single tobacco leaf at the table. He gave me the names of about 30 different international organizations that fund the work I'm interested in with tips for writing proposals and the names of his personal contacts. Then Filemon came by to borrow his gun to kill his cat, which had developed a [terribly] incurable disease. Manolo produced a small firearm and dispatched the poor cat, after which he announced he needed to take a ceremonial bath to cleanse himself of the bad vibes from killing an innocent animal. But no matter; we would resume the meeting with Alexis and I at the table and him out on the patio naked in a tub of water under the [bougainvillea] and next to his horse, who lives with him in his house. His house is the most amazing place I've seen, a sprawling decaying concrete estate with 180 degree views of the coast that he built himself over the last 20 years.

[...]

Nothing new here really. Things have quieted down a lot, we are waiting for the rain to start. Best to Ameen and the kids. take care, hasta la proxima,

Matt

Book Review: Come Back to Afghanistan by Said Hyder Akbar

I just completed an amazing book called Come Back to Afghanistan by Said Hyder Akbar, a 17 year old teenager from California. For anyone interested in the current state of Afghanistan, I highly recommend this book.

Books like this, i.e. personal accounts of a foreign and politically relevant land, are typically written by seasoned news reporter type folks, or other adults who already have a solid world view. Witnessing Hyder, a youthful teen, struggle to make sense of this world, often through colorful pop culture references, is so unique. In addition, I've always been fascinated by the recent history of Afghanistan. I was similarly glued to Soldiers of God, by Robert Kaplan, a detailed account of his experiences with the Soviet fighting Mujahideen. Perhaps it is the vivid descriptions of these rugged mountain war zones, places like the Khyber Pass or the Hindu Kush, that get to me. I'm also always interested in understanding the forces of tribalism, especially in South Asia.

Anyway, back to the book, not sure exactly how it happened, but somehow Hyder was given a microphone and recorder by Susan Burton who ultimately produced a show for This American Life, the NPR radio show hosted by Ira Glass. You can listen to the complete This American Life episode HERE. This show kicked off much of what appears in more vivid detail in the book. You can also buy the book on Amazon HERE.

Here's a snippet from a Publisher's Weekly review on Come Back to Afghanistan:

Akbar's refreshingly unsentimental reminiscences of visiting his father's homeland as a teen make for an intriguing portrait of Afghanistan at a time of significant transition. On 9/11, Akbar, who was born in Peshawar in 1984 but grew up in the U.S., was living near Oakland, Calif., where his father ran a clothing store. After the attack, the elder Akbar, a descendant of an Afghan political family, returned to his country to take a job as President Hamid Karzai's chief spokesman and, later, as governor of Kunar, a rural province. The author visited his father for three successive summers, and the result is this account, a closeup view of the creation of the country's post-Taliban democratic government, told from a perspective that's impressively both insider and objective. Akbar reports on chats with cabinet ministers and warlords, and sketches the lay of the land, visiting both sumptuous Kabul palaces as well as bombed-out villages. His youth and curiosity send him on some dangerous adventures (he retraces a mountain route between Afghanistan and Pakistan used by fleeing members of al-Qaeda and the Taliban), and that youthful flavor also infuses the writing with a hip stream-of-consciousness that is by turns funny, insightful and, occasionally, breathtaking.

All in all, I give this book 4 out of 4 stars.

Big Whistler Air

Here's a great video of riders getting some big air. By the way, that reminds me, there's a popular trail up here called Dirt Merchant - there's a lovely spot where you launch over a creek that flows between the launch and landing. Its such a great feeling - a middle aged guy like me can feel like Evil Kenievel for a wonderful few moments. But I digress, back to these far more talented kids, enjoy:

Whistler Fun and Lots of Sun

We got up to Whistler yesterday morning and have been having a blast ever since. Yesterday I had a great time riding a bunch of cross country trails all around the Lost Lake area. There are some really fantastic trails that I've never found before. Lots of great wooden planks and roller coaster fun on Rhinoceros Furniture - my these Canadians sure know how to make some unbelievable trails. Poor Maya didn't make it out of the house today; alas her paws are really sore from our heavy riding yesterday; I really want to find some good running shoes for her.

Today was a hoot doing some downhill riding. I ran into an old friend randomly who I haven't seen in 15 years. We had a blast riding together. And the weather has been just stunning - perfectly sunny and around 75 degrees.

Google Keeps Tweaking Its Search Engine

A recent NY Times article that is lighting up the search blogosphere called Google Keeps Tweaking Its Search Engine by Saul Hansell provides some insights on how the Google ranking system works. For anyone that has ever spent some time tweaking ranking metrics, this is an article worth checking out. Here are some snippets:

“Someone brings a query that is broken to Amit, and he treasures it and cherishes it and tries to figure out how to fix the algorithm,” says Matt Cutts, one of Mr. Singhal’s officemates and the head of Google’s efforts to fight Web spam, the term for advertising-filled pages that somehow keep maneuvering to the top of search listings.

Some complaints involve simple flaws that need to be fixed right away. Recently, a search for “French Revolution” returned too many sites about the recent French presidential election campaign — in which candidates opined on various policy revolutions — rather than the ouster of King Louis XVI. A search-engine tweak gave more weight to pages with phrases like “French Revolution” rather than pages that simply had both words.

At other times, complaints highlight more complex problems.

...

Mr. Singhal introduced the freshness problem, explaining that simply changing formulas to display more new pages results in lower-quality searches much of the time. He then unveiled his team’s solution: a mathematical model that tries to determine when users want new information and when they don’t. (And yes, like all Google initiatives, it had a name: QDF, for “query deserves freshness.”)

...

THE QDF solution revolves around determining whether a topic is “hot.” If news sites or blog posts are actively writing about a topic, the model figures that it is one for which users are more likely to want current information. The model also examines Google’s own stream of billions of search queries, which Mr. Singhal believes is an even better monitor of global enthusiasm about a particular subject.

As an example, he points out what happens when cities suffer power failures. “When there is a blackout in New York, the first articles appear in 15 minutes; we get queries in two seconds,” he says.

Mr. Singhal says he tested QDF for a simple application: deciding whether to include a few news headlines among regular results when people do searches for topics with high QDF scores. Although Google already has a different system for including headlines on some search pages, QDF offered more sophisticated results, putting the headlines at the top of the page for some queries, and putting them in the middle or at the bottom for others.