Data in the Cloud from Dallas to Mars

There’s a lot going on at this week’s Microsoft Professional Developers Conference (PDC 09); it’s a traditional launchpad for cool new stuff. I thought I’d point out several of the government-relevant announcements and technology roll-outs.

I specifically want to spotlight something called Codename Dallas, and how NASA and others have begun using it. In the keynote this morning Microsoft’s Chief Software Architect Ray Ozzie told PDC attendees (and his streaming-video audience) that a landslide of new sensors and observational systems are changing the world by recording “unimaginable volumes of data… But this data does no good unless we turn the potential into the kenetic, unless we unlock it and innovate in the realm of applications and solutions that’s wrapped around that data.”

Here’s how we’re addressing that, with a bit of step-by-step context on the overall cloud-computing platform enabling it.  The steps are: 1. Azure, 2. Pinpoint, and 3. Dallas.

Continue reading

Para Bellum Web

Tim O'Reilly, Ray Ozzie

Tim O’Reilly created a bit of a stir last night in the tech world by writing a thoughtful essay entitled “The War for the Web.” He’ll be expanding on his thoughts in his keynote address today at the Web 2.0 Expo in New York. From the essay, here’s the core argument:

“[W]e’ve grown used to a world with one dominant search engine, one dominant online encyclopedia, one dominant online retailer, one dominant auction site, one dominant online classified site, and we’ve been readying ourselves for one dominant social network. But what happens when a company with one of these natural monopolies uses it to gain dominance in other, adjacent areas? I’ve been watching with a mixture of admiration and alarm as Google has taken their dominance in search and used it to take control of other, adjacent data-driven applications.

It could be that everyone will figure out how to play nicely with each other, and we’ll see a continuation of the interoperable web model we’ve enjoyed for the past two decades. But I’m betting that things are going to get ugly. We’re heading into a war for control of the web. And in the end, it’s more than that, it’s a war against the web as an interoperable platform. [emphasis added] Instead, we’re facing the prospect of Facebook as the platform, Apple as the platform, Google as the platform, Amazon as the platform, where big companies slug it out until one is king of the hill.

… P.S. One prediction: Microsoft will emerge as a champion of the open web platform, supporting interoperable web services from many independent players, much as IBM emerged as the leading enterprise backer of Linux.

Continue reading

Once you get past Filter Failure

How do intelligence analysts handle the long-discussed problem of information overload? (The same question goes for information workers and government data of any kind.)

Continue reading

The Cyber Trough of Disillusionment

I’ll call the moment: the cyber security field is now past its giddy buzzword peak.

Gartner is well known for preparing “hype cycle” analysis of technology sectors, as in their recent publication of the 2009 “Hype Cycle for Social Software.” That report got a lot of attention on Twitter and in blogs, naturally; social medians are nothing if not self-reflective regarding their community. I thought an interesting take was by an IBM developer, who compared the 2008 version against the new one, measuring the changes in predicted “time to maturity” for individual technologies, and thereby coming up with something like a measure of acceleration. By that measure, individual blogging and social search made the most rapid gains.

But I notice something missing on the full list of 79 Gartner hype cycle reports: there’s not one about “cyber security.”

Continue reading

Immersed in Augmented Reality

Here’s a quick post, about a talk I gave this week – but as an excuse to link to a much more compelling presentation given at the TED Talks recently. Yesterday I had the good fortune to deliver the “Technology Keynote” address at the annual International Field Directors and Technology Conference, in Delray Beach, Florida. The IFD&TC is a well-known group in its field – no pun – of the world’s leading academic and government researchers, conducting large-scale and longitudinal social-scientific research studies.

As an example, think of the U.S. Census – and indeed I had the opportunity to spend some time with Cheryl Landman, Chief of the U.S. Census Bureau’s Demographic Surveys Division. You know those large studies drawn from every decade’s data? She runs them. That division’s work should feature prominently (I hope) in the forthcoming U.S. government’s “Data.gov” set of services.

Continue reading

Year of Data brings together Apple iPhone, Microsoft Surface, Google Android

 

Neat video below (Stimulant’s “XRay” project), but first, why I think it’s neat:

Every year is the year of data, I believe.

Continue reading

Several new Microsoft advanced technologies

Fact: As reported in TechCrunch and other sites today, “Microsoft’s Live Labs has just released Thumbtack, a web clipping service that allows users to compile links, media, and text snippets into online storage bins for future reference. Users can also share their Thumbtack collections with their peers, allowing them to collaborate by adding new clips and notations… The service works fine on IE7 and Firefox, and isn’t OS dependent. Each of these clippings can be sorted into folders called ‘Collections’, which can be published to the web via RSS, embedded in blogs, opened to friends for collaboration, or kept private for safe keeping.”  [There’s also a good Ars Technica review of Thumbtack here.]

Continue reading

Walled-Garden Wikis and Candlepower

Fact: Last night the U.S. Joint Forces Command (JFCOM) announced it has “moved its C2Pedia Registry to the unclassified network enabling more potential users to access and edit the site, hoping it will ultimately improve the quality of data.”  C2Pedia is a MediaWiki-driven online knowledge base of information about Command and Control (C2), with specific information about more than 200 C2 systems used across the Department of Defense and the armed services.

Analysis: The profusion of wikis in official government circles is an interesting expression of the value of social media for enterprise knowledge management, but for the most part inside agency or network firewalls, denying access to the public at large and therefore incorporating only the wisdom of “the inside crowd.” The State Department’s Diplopedia sits on their intranet (ironically called “OpenNet”), as the New York Times pointed out in a story a few weeks ago (“An Internal Wiki that’s Not Classified“), implying a distinction (without a difference to my mind) between Diplopedia and the IC’s Intellipedia, which has an unclassified version as well – but it also sits on a firewalled network!

Jimmy Wales, founder of Wikipedia, testified to Congress recently about the value of wikis and social media within enterprises, and pointed out the distinction between “within-the-agency” verticalized information sharing, a la Diplopedia, and horizontal sharing across organizations as exemplified by the IC’s Intellipedia, which as I mentioned has a firewalled unclassified version as well as its classified-network versions, all accessible from any of the intelligence community’s sixteen agencies and beyond.

Continue reading

A New Prototype: Research Desktop

Fact: The international conference on Advances in Social Network Analysis and Mining (ASONAM 2009, next July in Athens, Greece) today issued its call for papers on “experimental and theoretical works on social network analysis and mining,” particularly relating to online social Web sites, email logs, phone logs and instant messaging systems “which are widely analyzed using graph theory and machine learning techniques.”  Interested authors are encouraged to submit abstracts of up to 300 words by December 10, 2008; the full papers aren’t due until January 31, 2009.  More info at www.asonam.org.

Analysis: Several Microsoft Research people are preparing papers based on their current research, and I’m considering attending myself (I’ve written before about MSR’s work in analyzing large social networks). There are three Microsoft scientists on the Committee (Dou Shen, Haizheng Zhang, and Rina Panigrahy – check out Rina’s publications on hashing and sketching algorithms).  It should be a top-notch conference, co-hosted by ACM and IEEE.

But that’s way off in the future – what if you want to look at some research stuff right now? Well, I’ve been going through the related “Socio-Digital Systems” work of MSR Cambridge (UK), and they’ve just added more information to their section here of the main MSR site.  That’s some neat stuff, more on the side of the actual social uses of digital data and the effects on our (still-human?) everyday lives.

Continue reading

Click on My Head and You’re Classified 2.0

Fact: According to the latest McKinsey Global Survey report, “Building the Web 2.0 Enterprise,” many companies find themselves actually changing organizationally, both internally and externally, as a result of adopting Web 2.0 tools and practices. 

Continue reading