Washington Post Puts Microsoft on Page A1 – For Good Research!

Posted on August 3, 2008 by lewisshepherd

Stop the presses! Microsoft Research is getting national front page coverage!

The work of Eric Horvitz and Jure Leskovec got top coverage in major newspapers and news sites today.  With that fame, Eric will probably never again be willing to just while away a Friday afternoon with our Microsoft Institute folks, brainstorming some outside-the-box ideas for future work, as he did this week with us in Redmond’s Building 99.

Right after that meeting, I bugged out of Redmond for a red-eye to the east coast.  Back home in DC this morning (Saturday), I opened my Washington Post to find on page A1, “Instant-Messagers Really Are About Six Degrees from Kevin Bacon: Big Microsoft Study Supports Small World Theory.”

Continue reading →

Filed under: Microsoft, R&D, Society, Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 2 Comments »

How to Keep Up with the Semantic Space

Posted on July 25, 2008 by lewisshepherd

Fact: Reshma Sohoni, chief executive of Seedcamp (the VC accelerator focusing on European tech startups) said in an interview this week that “In the past few months, we’ve seen a lot more developments around the semantic web,” and talked about the coming value of semantic web services.  

Analysis:  There’s never-ending buzz about the semantic space. Just this week John Conroy writing at the Content Matters blog had a long and interesting piece examining “three ingredients needed to enable and popularize the semantic Web,” with the aim of answering “if we really are on the cusp of a content revolution.”

Also, I admit it, I can’t stop playing with the semantic-space startups, whether it’s Sensebot or the newly launched Evri, or Powerset (just acquired by Microsoft, as I wrote about previously).

Continue reading →

Filed under: Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 8 Comments »

So Long, Long Tail?

Posted on July 2, 2008 by lewisshepherd

I’ve been known to disagree with Harvard eggheads before 🙂 

 

Chris Anderson's Long TailAnd now, perhaps, another opportunity. A new Harvard Business Review article (“Should You Invest in the Long Tail?” by HBS Professor Anita Elberse) throws water on Chris Anderson’s paradigm, arguing that “hit products” are still more valuable than the conglomerated also-rans in the tail; her research is mostly in retail products. Chris has responded on his blog, sparking many comments and debate, and today the Wall Street Journal covered the back-and-forth debate.

I’m interested in the debate mostly because of the interest in the Long Tail way of thinking in some circles of the intelligence community.  I’ve written about the approach and its relevance to some intelligence issues (see “Tradecraft in the Long Tail” and “IARPA and the Virtual Long Tail“).

I’m just not certain that even a total debunking of the retail-oriented paradigm would undercut its value as applied to intelligence analysis. 

For intelligence analysts, obscure “facts” and patterns hidden snugly within the low-scale noise are all important – whether or not they gain numerative bulk in any accumulative way.  The paradoxical “unknown unknowns” are what’s being sought by dogged collection and analysis, and I’m not sure that’s analogous to Elberse’s acknowledged findings. 

Your thoughts welcome, here or by email back to me.

 
Email this post to a friend

AddThis Social Bookmark Button
 

Filed under: Government, Intelligence, Society, Technology | Tagged: , , , , , , , , , , , , , , , | 5 Comments »

Semantic Reality (Microsoft Acquires Powerset)

Posted on July 1, 2008 by lewisshepherd

Fact: At last, the public announcement this afternoon of one of the most-rumored secrets in tech: Microsoft is acquiring Powerset, taking us one major step forward in semantic technologies. 

Analysis: There’ll be plenty of analysts looking at this, and I expect the acquisition will get a lot of buzz just as Powerset did originally when launched.  After all, Microsoft is buying a company which was called a “Google-Killer” by everyone from the New York Times to various esoteric search-technology blogs.  [Update: it’s already started on TechCrunch.]

If you haven’t used Powerset’s first announced product, semantic searching of Wikipedia, check it out on their site and you’ll begin to see why there’s been so much interest in their technical approach. I’ve known founder Barney Pell for a while now, and we’ve mused about the possibilities of adding Powerset’s strengths to Microsoft’s global scale.  The more I played with PowerLabs, before its full launch, the more I was convinced of its power.

When I was working at DIA, one of our dreams was a semantically enabled intelligence enterprise. IC analysts and advanced users within any other enterprise vertical are going to find some very interesting capabilities finally possible when Powerset technology is wedded to the FAST search software already being deployed at web scale. But that’s only the beginning.  Continue reading →

Filed under: Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 2 Comments »

“The Largest Social Network Ever Analyzed”

Posted on June 25, 2008 by lewisshepherd

FACT: According to ComScore data cited in a story in Monday’s FInancial Times, “Facebook, the fast-growing social network, has taken a significant lead over MySpace in visitor numbers for the first time… Facebook attracted more than 123 million unique visitors in May, an increase of 162 per cent over the same period last year… That compared with 114.6 million unique visitors at MySpace, Facebook’s leading rival, whose traffic grew just 5 per cent during the same period… The findings mark the first time that Facebook, launched in 2004, has taken a significant lead in unique visitors, [and] come at a time of change inside Facebook, as the one-time upstart attempts to transform itself into a leading media company.

ANALYSIS:  This week several members of the Microsoft Institute met in Redmond with a visiting friend from government, and among other talks we had a very interesting discussion with Eric Horvitz, a Microsoft Research principal researcher and manager.  Eric’s well known for his work in artificial intelligence and currently serves as president of the Association for the Advancement of Artificial Intelligence (AAAI).

We talked about one of Eric’s recent projects for quite a while: “Planetary-Scale Views on a Large Instant-Messaging Network,” a project which has been described by his co-author as “the largest social network ever analyzed.” 

Continue reading →

Filed under: Government, innovation, Intelligence, Microsoft, R&D, Society, Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 6 Comments »

Is It Even Possible to Connect the Dots?

Posted on May 25, 2008 by lewisshepherd

FACT: Among the inspired ideas of polymath Danny Hillis (pioneer of parallel computing) was establishing the Long Now Foundation, whose projects include the millennial Long-Now Clock (“the world’s slowest computer”) and the notion of “Long Bets.”  A Long Bet is an “accountable prediction,” meaning one that has a specified end-date and a testable, wagerable, proposition.  One of the early Long Bets posted wagers $2,000 that “By 2020, no one will have won a Nobel Prize for work on superstring theory, membrane theory, or some other unified theory describing all the forces of nature.”  That particular bet is one of many signs of scientific skepticism about string theory.

ANALYSIS: Even without the ease of hyperlinks, old-fashioned newspapers foster serendipitous connections between articles, particularly if you’re reading a Sunday morning paper with lots of sections. Sunday the Washington Post did me a service by placing in different sections a couple of articles which I connected, about intelligence “failures” and about stock-market prediction, leading me to some web-surfing about the questionable validity of string theory and some related observations about the difficulty of predicting human behavior.

In the Outlook section, the Post has an opinionated and thought-provoking op-ed piece by Mark Lowenthal, one of the most “intelligent” individuals in the recent history of the U.S. intelligence community (after all, he was the 1988 Jeopardy grand champion, as well as a former assistant director of CIA).

Continue reading →

Filed under: Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 6 Comments »

IARPA and the Virtual Long Tail

Posted on May 2, 2008 by lewisshepherd

FACT: This week, the Intelligence Advanced Research Projects Activity, an arm of the Director of National Intelligence (DNI), launched its new unclassified website.  What’s there is initially fairly minimal, but they’ll be adding to the public information posted there regularly.

ANALYSIS:  I spent the week in Orlando, as a Keynote speaker at the IARPA “Incisive Analysis Conference.”  I’ll be writing a little more about the conference in the near future, as I saw some great demo’s and spoke to the principal investigators on many excellent and far-sighted advanced research projects sponsored by IARPA.  It was great to be there and to see so many old friends from the intelligence community, the national labs (PNNL, Sandia, Oak Ridge, Livermore), DoD, and innovative commercial R&D outfits.  Also, as the first IARPA conference since the organization’s launch, it was an opportunity to hear new director Lisa Porter communicate her vision and principles, which she did well and I’ll discuss those soon as well.  (She also kidded me about my efforts to make her a cultural phenomenon, but I blamed it on WIRED magazine.)

Continue reading →

Filed under: Government, innovation, Intelligence, Microsoft, R&D, Technology | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 3 Comments »

Seeking Business Intelligence

Posted on February 6, 2008 by lewisshepherd

I had breakfast this morning with Gartner’s Lisa Gross and we were able to talk about her continuing work in support of my old haunts – the agencies of the Intelligence Community. She’s first-rate at understanding the IT needs of large-scale government enterprises, and has always been known as a trusted adviser for CIOs, CTOs, and senior IT executives across many federal agencies.

I was recounting to her that when I first started at Microsoft (oh these many weeks), I was ecstatic at finding on our corporate intranet seemingly total unfettered access to Gartner research reports and white papers (along with similar access to Forrester research and reports).  The mother lode! 

Continue reading →

Filed under: Government, Intelligence, Microsoft, R&D, Technology | Tagged: , , , , , , , , , , , , , | 3 Comments »

« Previous Page