Torsten and I have started working on RSS Bandit regularly again. Last weekend I fixed a bunch of bugs including the problem that prevented IE 7 from importing OPML files from RSS Bandit. I've gotten a few emails from folks at work about that particular issue so I thought it would be good to knock that issue out early. This morning, I checked-in support for the Atom Thread Extensions which means I can now see comment counts and view comments inline on Sam Ruby's blog.

One change we're planning to make is to switch to using a full-fledged text search engine to power the search feature of RSS Bandit. Currently, we load all the text in memory and use the .NET Framework's string comparison operators to find the target text. We want to move to a model where files on disk are indexed in the background and we don't have to have stuff in memory to search it. This should significantly improve the memory consumed by RSS Bandit.

We've investigated a couple of options for our search solution. My first thought was integrating with MSN Windows Desktop Search. After exchanging some mail with various members of the team, I decided that this wouldn't meet our needs for a number of reasons

  • Users will need to have Windows Desktop Search installed so we either need to figure out how to bundle it with RSS Bandit or disable the feature if it is not installed.
  • The indexing service is file-centric. However we need to index individual RSS/Atom items within the cached RSS/Atom feeds on disk. This means we'll have to change our model to storing one file per RSS/Atom item which could lead hundreds to thousands of files per feed.
  • The biggest gotcha was that making the indexer understand the structure of RSS/Atom feeds requires writing a custom IFilter which involves gnarly C++ coding then dealing with hairy COM<->.NET interop issues. Not exactly the kind of work one wants to do in their free time.

After further investigation we've settled on Lucene.NET which doesn't have any of the aforementioned problems. However we have been dealing with some issues that could either be bugs or just a misunderstanding of how the APIs should be used. We'll keep you posted. 


 

Categories: RSS Bandit
Tracked by:
"Search Options" (Square Pegs, Round Holes) [Trackback]
"Jubilee: we make progress again" (torsten's .NET blog) [Trackback]
http://www.rendelmann.info/blog/PermaLink.aspx?guid=ad9d055d-9d49-4c18-8ef8-008a... [Pingback]
"Our Multi-Lingual World and Search Indexes" (Dare Obasanjo aka Carnage4Life) [Trackback]
http://www.25hoursaday.com/weblog/PermaLink.aspx?guid=5225b67a-c942-4fa7-8f69-ca... [Pingback]
http://216.51.149.20/emailbattles/2006/06/01/1149195009_57/ [Pingback]
http://gator393.hostgator.com/~rocata/sitemap1.html [Pingback]
http://jawf5j3.net/estate/sitemap1.html [Pingback]
http://weujmru.net/local_news/sitemap1.html [Pingback]
http://weujmru.net/general/sitemap1.html [Pingback]
http://weujmru.net/community/sitemap1.html [Pingback]
http://weujmru.net/estate/sitemap1.html [Pingback]
http://tb9wlm3.net/03/index.html [Pingback]
http://restablog.dreamhosters.com/lessons/sitemap1.html [Pingback]
http://jszsfc9.net/01/sitemap1.html [Pingback]
http://lvxjtu6.net/erotic/sitemap1.html [Pingback]
http://henres.site.io [Pingback]
http://lordless.250Free.com [Pingback]
http://tulanka.readyhosting.com/salon/sitemap1.php [Pingback]
http://fongyf6.net/amazon/sitemap1.php [Pingback]
http://restablog.dreamhosters.com/photo/sitemap1.html [Pingback]
http://biggest-hosting10.com/~rocata/leather/index.html [Pingback]
http://host239.hostmonster.com/~blogford/sitemap4.html [Pingback]
http://host239.hostmonster.com/~blogford/sitemap1.html [Pingback]
http://fastblog.sc101.info/dental/sitemap1.html [Pingback]
http://gator413.hostgator.com/~digital/dental/sitemap1.html [Pingback]
http://vahq8px.net/internet/sitemap1.html [Pingback]
http://bbgicfz.net/sitemap1.html [Pingback]
http://uz7fdb5.net/video/sitemap1.html [Pingback]
http://lt5d7yk.net/sitemap1.html [Pingback]
http://ujprjlw.net/arkansas/sitemap1.html [Pingback]
http://ujprjlw.net/colorado/sitemap1.html [Pingback]
http://box432.bluehost.com/~zbloginf/sitemap2.html [Pingback]
http://d579737.u108.floridaserver.com/sitemap2.html [Pingback]
http://gator442.hostgator.com/~hockteam/arizona/sitemap1.html [Pingback]
http://gator442.hostgator.com/~hockteam/windows/sitemap1.html [Pingback]