Google has reintroduced their Google Desktop with a vengeance. It was evil enough the first time around, but this time it’s downright scary. My original complaint was that Google Desktop ignores basic practices amongst RSS readers for saving bandwidth on the sites it is polling. It was pinging my site every 5 minutes asking for updates without caching the results and thus was using an unreasonable proportion of my bandwidth.

Since a new version was recently released,  I decided to try it out to see if the issue had been fixed since I sent them mail. I installed Fiddler to monitor the traffic of the application and what I found out surprised me a great deal. Google Desktop not only pings sites every 5 minutes in a manner inconsiderate of their bandwidth but it also does so without the users direction. Below is a screenshot of some of the HTTP traffic generated by Google Desktop

The highlighted requests are requests to URLs of Atom & RSS feeds that were in my browser cache by Google Desktop. I did not configure the application to fetch these feeds. So not only does Google Desktop flood websites with feed requests in a manner bordering on the behavior of a malicious application, it also does this automatically without the end user explicitly subscribing to the feed.

That's messed up.


 

In the post Feeds and well-formed XML Sean Lyndersay of the IE RSS team writes

Our years of experience in with HTML in Internet Explorer have taught us the long-term pain that results from being too liberal with what you accept from others. Hence, we’ve adopted the following overriding principle for IE 7 and RSS platform in Windows Vista: 

 We will only support feeds that are well-formed XML.

This principle allows us to build a more predictable feed parser. As a platform, it's important that applications using the platform to consume feeds can rely on the fact that the platform will always be providing information in the way that the publisher intended (trying to guess what a publisher meant to do when there is an error in a feed can be tricky, at best). We also spoke to several people in the RSS and developer community at Gnomedex and at PDC, and they wholeheartedly supported this.

Hell Yeah!!!


 

November 4, 2005
@ 06:09 PM

I saw someone reference the Dave Luebbert's reasons to clone Google's API and wonder what my opinion was in response. In my post from yesterday entitled Clone the Google APIs: Kill That Noise, I gave some technical reasons why we wouldn't want to clone the Google APIs for Windows Live Search.

However, there is probably a clarification that I should have made. In certain cases, there is one thing that trumps all technical arguments against cloning an API. That is when the API has significant market share amongst developers. This is one of the reasons why even though I thought that the MetaWeblog API is a disaster, we made the call that MSN Spaces will support the MetaWeblog API. Since the MetaWeblog API is a derivative of the Blogger API, you could argue that in this case we are cloning a Google API.

To me, the difference here is the case of mindshare. The Blogger & MetaWeblog APIs are widely supported across the weblogging industry and have become de facto industry standards. I don't believe the same can be said for the Google's search API. If anything, I'd say the OpenSearch is the closest to a de facto industry standard for search APIs although [for now] it has been ignored by the big three major search players.

On a similar note, I'd probably agree that the Google Maps API is probably on its way to reaching de facto standard and Yahoo! & Microsoft should just go ahead and clone it. If I worked on the mapping API for either company, I'd probably give it six months and if adoption hadn't increased significantly would consider cloning their API.


 

Categories: Web Development

One of the most eye opening observations I heard recently was a comment by Terry Semel, CEO of Yahoo!, where he pointed out that only 5% of page views on the Web are from search yet the account for about 40% of the revenue generated on the Web. To make this even clearer, consider this recent post on Om Malik's blog entitled Bigger Than Google, MySpace is different which states

Like all community sites that rely mostly on their users to author content, MySpace has had a very difficult time trying to secure high advertising rates. Historically, advertisers have held little trust in content that is not tightly controlled editorially and, therefore, the value they are willing to attach for ads placed next to such uncontrollable content has been very low. The result is clear… MySpace ranks higher than Google in terms of pageviews, but Google will gross $6 billion in revenues this year, while MySpace will generate about $30 million. The delta, which can be measured in orders of magnitude, is almost unbelievable. I realize the comparison is not directly apples to apples, but even so!

I bring this up because this is where Murdoch’s strategic opportunity lies… in eliminating that gap. Put another way, MySpace has a multi-billion dollar opportunity to exploit, which promises to break News Corp out of the media stock depression that it and all its fellow conglomerates have been suffering. Success on this front will demonstrate that News Corp can tap into the fastest growing segment of the advertising industry in a manner that befits Google and Yahoo!

This disparity in ad revenue is quite stunning. I agree with Terry Semel and others that this represents a significant opportunity. I wonder who'll sieze it first...


 

November 4, 2005
@ 02:59 AM

For the past few years my browser home page has alternated between http://news.google.com and http://my.yahoo.com. I like Google News for the variety of news they provide but end up gravitating back to Yahoo! News because I like having my stock quotes, weather reports and favorite news all in a single dashboard.

This morning I decided to try out live.com. After laying out my page, I went to microsoftgadgets.com to see what gadgets I could use to 'pimp my home page' and I found a beauty; the Seattle Bridge Traffic Gadget . I've talked about the power of gadgets in the past but this brought home to me how powerful it is to allow people to extend their personalized portal in whatever ways they wish. Below is a screenshot of my home page.

I'm definitely toying with building my own gadgets now. Matt has a killer gadget he's been working on in his free time that I think will be much appreciated by live.com users. If I ever find some free time, I suspect the gadget I'll end up writing will be one that has to do movie listings. Perhaps a gadget that shows the box office rankings of the previous week and also upcoming listings with information on local showtimes. Or maybe an MSN Spaces photo album gadget in the same vein as the Flickr gadget. There are not enough hours in the day...


 

Categories: Windows Live

November 3, 2005
@ 07:21 PM

From the press release Microsoft Acquires FolderShare, a File-Synchronization Technology Provider we learn

REDMOND, Wash. — Nov. 3, 2005 — Microsoft Corp. today announced it has acquired FolderShare™, a leading service in the emerging space of file synchronization and remote access technology that helps customers access information across multiple devices. FolderShare customers will continue to be able to enjoy the service at http://www.foldershare.com. Financial details of the acquisition were not disclosed.

Launched in 2002 and owned and operated by Austin, Texas-based ByteTaxi Inc., the award-winning FolderShare service saves customers the hassle of sending large files via e-mail, burning them to CDs or DVDs and mailing them, or uploading them to a Web site. Instead, it allows customers to sync important information, making it well suited for personal or small-business use. The FolderShare service also enables private, remote access to customers’ own files from any Web browser.

"Our mission for Windows Live™ is to enable customers to easily find the information, pursue the interests and deepen the relationships that enrich their lives," said Blake Irving, corporate vice president of the MSN Communication Services and Member Platform group at Microsoft. "I'm thrilled with the acquisition of FolderShare and the opportunity to offer this technology with Windows Live software and services. FolderShare technology will help customers access their information anytime, anywhere and on multiple devices, unifying their overall experience."

FolderShare is an awesome product so this is definitely good news. Even better is that they are joining our group (the Communication Services Platform). Windows Live is looking better and better every day.


 

Categories: MSN

Yesterday Dave Winer wrote in a post about cloning the Google API Dave Winer wrote

Let's make the Google API an open standard. Back in 2002, Google took a bold first step to enable open architecture search engines, by creating an API that allowed developers to build applications on top of their search engine. However, there were severe limits on the capacity of these applications. So we got a good demo of what might be, now three years later, it's time for the real thing.

and earlier that
If you didn't get a chance to hear yesterday's podcast, it recommends that Microsoft clone the Google API for search, without the keys, and without the limits. When a developer's application generates a lot of traffic, buy him a plane ticket and dinner, and ask how you both can make some money off their excellent booming application of search. This is something Google can't do, because search is their cash cow. That's why Microsoft should do it. And so should Yahoo. Also, there's no doubt Google will be competing with Apple soon, so they should be also thinking about ways to devalue Google's advantage.

This doesn't seem like a great idea to me for a wide variety of reasons but first, let's start with a history lesson before I tackle this specific issue

A Trip Down Memory Lane
This history lesson used to be is in a post entitled The Tragedy of the API by Evan Williams but seems to be gone now. Anyway, back in the early days of  blogging the folks at Pyra [which eventually got bought by Google] created the Blogger API  for their service. Since Blogspot/Blogger was a popular service, a the number of applications that used the API quickly grew. At this point Dave Winer decided that since the Blogger API was so popular he should implement it in his weblogging tools but then he decided that he didn't like some aspects of it such as application keys (sound familiar?) and did without them in his version of the API. Dave Winer's version of the Blogger API became the MetaWeblog API. These APIs became de facto standards and a number of other weblogging applications implemented them.

After a while, the folks at Pyra decided that their API needed to evolve due to various flaws in its design. As Diego Doval put it in his post a review of blogging APIs, The Blogger API is a joke, and a bad one at that. This lead to the creation of the Blogger API 2.0. At this point a heated debate erupted online where Dave Winer berated the Blogger folks for deviating from an industry standard. The irony of flaming a company for coming up with a v2 of their own API seemed to be lost on many of the people who participated in the debate. Eventually the Blogger API 2.0 went nowhere. 

Today the blogging API world is a few de facto standards based on a hacky API created by a startup a few years ago, a number of site specific APIs (LiveJournal API, MovableType API, etc) and a number of inconsistently implemented versions of the Atom API.

On Cloning the Google Search API
To me the most salient point in the hijacking of the Blogger API from Pyra is that it didn't change the popularity of their service or even make Radio Userland (Dave Winer's product) catch up to them in popularity. This is important to note since this is Dave Winer's key argument for Microsoft cloning the Google API. 

Off the top of my head, here are my top three technical reasons for Microsoft to ignore the calls to clone the Google Search APIs

  1. Difference in Feature Set:  The features exposed by the API do not run the entire gamut of features that other search engines may want to expose. Thus even if you implement something that looks a lot like the Google API, you'd have to extend it to add the functionality that it doesn't provide. For example, compare the features provided by the Google API to the features provided by the Yahoo! search API. I can count about half a dozen features in the Yahoo! API that aren't in the Google API.

  2. Difference in Technology Choice: The Google API uses SOAP. This to me is a phenomenally bad technical decision because it raises the bar to performing a basic operation (data retrieval) by using a complex technology.  I much prefer Yahoo!'s approach of providing a RESTful API and MSN Windows Live Search's approach of providing RSS search feeds and a SOAP API for the folks who need such overkill.

  3. Unreasonable Demands: A number of Dave Winer's demands seem contradictory. He asks companies to not require application keys but then advises them to contact application developers who've built high traffic applications about revenue sharing. Exactly how are these applications to be identified without some sort of application ID?  As for removing the limits on the services? I guess Dave is ignoring the fact that providing services costs money, which I seem to remember is why he sold weblogs.com to Verisign for a few million dollars. I do agree that some of the limits on existing search APIs aren't terribly useful. The Google API limit of 1000 queries a day seems to guarantee that you won't be able to power a popular application with the service.
  4. Lack of Innovation: Copying Google sucks.


 

Categories: MSN | Web Development

November 2, 2005
@ 02:38 AM

The stuff I've been working on over the past couple of months is so close to shipping I can taste it. For now you'll have to whet your appetites with the information on the list of upcoming Windows Live Offerings which include

Explore and Find New Interests

Windows Live will deliver new ways for customers to discover and explore:

Social Networking. Social Networking features for Windows Live will be based on the people whom customers know rather than strangers who may visit their blog or Web site. Social Networking in Windows Live will be centered on a customer’s unified contact list, enabling the user to find and connect with people who have similar interests, but may be new to his or her social circle. Customers will be able to choose and control who has access to discover and connect with them.

Windows Live Spaces. Microsoft will continue to invest in services that help people express themselves, and find, connect and nurture deeper relationships with others around the world. MSN Spaces will transition to Windows Live Spaces as Microsoft adds new features to the service next year.

We have a bunch of great stuff coming up over the next year or so. Thanks to Mike for spotting this list. He and I worked closely on the design of Social Networking for Windows Live and it's a feature I know lots of our users will love.


 

Categories: MSN

November 1, 2005
@ 10:05 PM

Today Microsoft announced Windows Live. The official blurb is in the press release at Microsoft Previews New Windows Live and Office Live Services

SAN FRANCISCO — Nov. 1, 2005 — Microsoft Corp. today previewed two new Internet-based software services — Windows Live™ and Microsoft® Office Live — designed to deliver rich and seamless experiences to individuals and small businesses. The new offerings combine the power of software plus services and are compelling enhancements to the Microsoft Windows® and Microsoft Office products. In particular, Windows Live helps bring together all the elements of an individual’s digital world while Office Live helps small companies do business online.
...

Windows Live

Windows Live™ is a set of personal Internet services and software designed to bring together in one place all of the relationships, information and interests people care about most, with more safety and security features across their PC, devices and the Web. Microsoft demonstrated early versions of several new Windows Live offerings, some of which are accessible at http://ideas.live.com, a new Web site where people can try the latest Windows Live beta services:

Live.com serves as the personalized starting point for Windows Live services, powered by cutting-edge technologies such as RSS and Asynchronous JavaScript and XML (AJAX). Live.com offers complete choice and customization for individuals who want quick access to the people and information they care about most. Live.com, which will be a great place to experience Windows Live Search, is available for trial today.

Windows Live™ Mail is a new, global Web e-mail service, built from the ground up to be faster, safer and simpler. Existing MSN® Hotmail® users will be able to seamlessly upgrade to the new service. People can sign up for the beta waiting list at http://ideas.live.com.

Windows Live™ Messenger helps individuals deepen their connections with the people they care about through instant messaging, file and photo sharing, PC-based calling, and more. Windows Live Messenger will enter the beta stage later this year. More information is available at http://ideas.live.com.

Windows Live™ Safety Center is a Web site where users can scan for and remove viruses from their PC on demand. The service is currently in beta form, available at http://ideas.live.com.

Windows OneCare™ Live is a previously announced PC health subscription that helps protect and maintain PCs via an integrated service that includes anti-virus, firewall, PC maintenance, and data backup and restore capability. People can sign up for the beta waiting list at http://ideas.live.com.

Windows Live™ Favorites is a service that enables individuals to access their Microsoft Internet Explorer and MSN Explorer favorites from any PC that’s online. The service is currently in beta form at http://ideas.live.com.

Windows Live will be offered alongside MSN.com, a global leader in services with more than 215 million active MSN Hotmail accounts; more than 185 million MSN Messenger contacts worldwide; and over 25 million MSN Spaces created by individuals to share their photos, Web logs (blogs) and interests with friends. MSN.com will continue to deliver rich programmed content and provide access to Windows Live services.

As someone who works on MSN Windows Live products I've seen about ten hours of presentations over the past few months on what this means for us and have come up with a simple way of explaining it to the uninitiated.

From a practical perspective, when I think about Windows Live I think about three things:

  1. User-centric web applications with rich user interfaces: You can expect more applications with rich, dynamic, user interfaces such as has been shown in the Mail beta and on http://www.live.com. For the geeks out there this means that you'll be seeing a lot more AJAX applications coming out of us and a focus on software that puts the user in control of their online experience.

  2. Smart desktop applications that improve the Windows user experience:  The MSN division has slowly become Microsoft's consumer software division. From desktop search to instant messaging, a number of key applications that were once thought of as bits that ship with the operating system are now being shipped on a more frequent basis by MSN. With Windows Live, this reality is being acknowledged and embraced. Expect to see more beneficial integration between consumer applications coming from Microsoft and our web properties such as the integration between MSN Messenger & MSN Spaces.

  3. The Web as a platform:  http://msdn.microsoft.com/msn was just the beginning, expect a lot more. Coincidentally I just finished giving a presentation to a few hundred of my co-workers from across the company on MSN Windows Live services as a Web platform. This is definitely an area I will be spending a lot of my time on in the following months.

To meet this vision will require some new offerings from Microsoft and the reworking of some existing products as well. In some cases, this will simply look like a branding change while in others it will be deeper fundamental changes in how the application works. You can try out some of the Windows Live applications today at http://ideas.live.com/.

Of course, this isn't an official explanation. That is what you'll find in the press release. Instead this is my interpretation based on talking to various folks who've been working on this and the various presentations we've gotten on the topic on my team. There is going to be a lot written about Windows Live over the next couple of days and a lot of it will be inaccurate or fueled by speculation. What I've written above is as accurate a picture as I can paint based on the knowledge I have as someone who now works on this stuff.


 

Categories: MSN

Danah Boyd has an excellent post on the differences between adults and adolescents when it comes to blogging and other forms of online expression. In her post designing for life stages Danah Boyd writes

Identity formation

When youth are coming into a sense of self, they move away from the home and look to the social world to build a socio-culturally situated identity. In other words, they engage in the public in order to make sense of social boundaries/norms and to develop a sense of self in relation to the broader social context. Youth go to the public to see and be seen and they negotiate a presentation of self depending on the reactions of peers and adults. Public performance is about getting those reactions in order to make sense of the world.

A main role of things like MySpace and Facebook is to produce a public sphere in order for youth to negotiate their peers and learn about the social world. People often ask me why teens don't just go out in a physical public. Simply put, they can't. We live in a culture of fear where most parents won't allow their children to go anywhere without supervision. Youth no longer have access to the streets or even neighborhood gathering spots. They are always in controlled locations where the norms are strictly dictated by adults - this is not a public sphere in which teens can make sense of sociability. Thus, they create their own. (Note: the production of a public and its implications is the cornerstone of my dissertation.)...

Contributive Participant in Society

And then we become adults. The bulk of adult-hood is evaluated based on contribution to society, participation, what you can create and do. It's about being a good citizen, laborer, parent. It's about the act of doing things. Your identity gets wrapped up in how you contribute to society ("So, what do you do?"). We ask youth about their hobbies and friends; we ask adults about their jobs and children. When we speak, we think that we have to produce information, be relevant, be efficient, be contributive. (And people wonder why growing up sucks.)

Nowhere is this shift more apparent than blogging land. While youth are doing identity production in terms of sociability, adults are creating new tasks for themselves - documenting, informing, conversing. It's all wrapped up in being part of the conversation, not in simply figuring out who you are.

This is one of the reasons why whenever I see words like blogosphere it makes me laugh. The worlds largest blogging site is probably MySpace. I suspect that MSN Spaces is the second largest although I'd have to ping folks from work to confirm. Both sites have significant populations of young adults (aka teenagers or adolescents). However whenever someone says blogosphere they usually mean some specific subset of blogs such as technology or politics focused blogs. Although A-list bloggers like Doc Searls, Dave Winer and Robert Scoble give the impression that blogging is about amateur punditry that competes with journalism and corporate blogging, the fact is that a large segment of the blogging population are just trying to express their identity and discover themselves online.

People building social software need to understand the needs of both classes of users. In fact, it's actually more complex than that because you often also have to factor in cultural differences as well since the Web is international. If you are interested in blogging and other aspects of social software, you really should subscribe to Danah's blog.


 

Categories: Social Software