Receive the weekly sampler of posts and "Resource of the Week".
Subscribe »

Enter your
email address:

My Account »


Bookmark and Share

Testimonial?
If you find ResourceShelf useful, please supply a testimonial »








Home > ResourceBlog > Article

« All ResourceBlog Articles

 

Bookmark and Share   Feed

Sunday, 23rd February 2003

Word scans indicate new ways of searching the Web

Online Searching
NOTE: After You Read the Background Article, Visit This New Page from Daypop, Where You Can See Word Bursts From Weblogs.
--
"Word scans indicate new ways of searching the Web"
When Dr. John Kleinberg of Cornell Univesity talks/writes about searching, it's more than worth listening. In a recent presentation to the American Association for the Advancement of Science, Dr. Kleinberg discussed research on how "burstiness" might be a new tool for incorporation into relevancy measures. From the announcement, "[Kleinberg] devised a search algorithm that looks for "burstiness," measuring not just the number of times words appear, but the rate of increase in those numbers over time. Programs based on his algorithm can scan text that varies with time and flag the most "bursty" words. "The method is motivated by probability models used to analyze the behavior of communication networks, where burstiness occurs in the traffic due to congestion and hot spots," he explains...For searching the Web, Kleinberg suggests, such a technique could help zero in on what a searcher wants by recognizing the time context of such material as news stories. For instance, he says, a person searching for the word "sniper" today is likely to be looking for information about the recent attacks around the nation's capital -- but the same search nearly four decades ago might have come from someone interested in the Kennedy assassination." Dr. Kleinberg was a researcher on IBM's often discussed but never publicly released Clever project. Many of the underlying concepts from Clever are being utlilized by Teoma.
See Also: "Word 'Bursts' Could Help Refine Web Searches" (via Scientific American 2.19.03)
See Also: "Hypersearching the Web" (via Scientific American 6.1999)
Co-authored by Kleinberg, this is one of the better papers on web search aimed at a non-technical audience I've read. Again, many of the concepts discussed re: Clever are being used at Teoma.
See Also: "Clever New Way to Search?" (via Wired 11.27.98)

Views: 275




blog comments powered by Disqus

« All ResourceBlog Articles

 

Read about the FreePint FamilyFreePint Family

A family of resources to help information workers be more effective, raise the value of information in their organisations and contribute to success. Read more »


FeedLatest Family Articles:


Click to view the article Quilting big data threads
Thursday, 24th May 2012

Recently I have found myself cooing over visualisation maps (and heat maps) of health and well being resources. The content rich data is overlayed with mapping technologies, and some interesting themes and patterns are emerging.


Click to view the article The fallacy of information overload
Wednesday, 23rd May 2012

A lot of the talk around social media in the last year has been around information overload. Social media has provided us with new and exciting ways to create content. But it has also meant learning new ways to manage and engage with social media tools. Are we teetering on the edge of an information overload precipice?


Click to view the article Information overload: fact, fantasy or filter failure?
Wednesday, 23rd May 2012

Information overload is a figment of your imagination. Or a failure of your filter. Or a symptom of your technological submissiveness. Depends on who you ask.


Click to view the article Newsdesk: tracking millions of pieces of information a day
Tuesday, 22nd May 2012

What if you had to sort through 3.5 million articles and social media posts a day and try to pull out the most relevant items for your organisation? What if you then had to cobble it all together into something readable for your top groups and executives in your organisation?


Click to view the article Alacra Compliance adds managerial oversight
Tuesday, 22nd May 2012

Alacra Compliance saves time by aggregating information from both free and fee-based sources and enabling users to conduct an accurate federated search across these sources (coined “simultaneous search” by Alacra).


All Family Articles »
Family Articles by Category »


Tell us what you're working on,
and we'll talk to you about how FreePint can help »


FreePint Family Testimonials

"The free content from FreePint helps me to stay informed of trends. My researchers call it an "uncanny ability to find these details". ..."

More testimonials »






Subscribe

Subscribe to the ResourceShelf Newsletter and receive the weekly sampler of posts and Resource of the Week.

Find out more »

ResourceShelf sponsored by:

Article Categories

All Article Categories »

Archive

All Archives »