Mining the Web

Monday, November 23, 2009

Duplicate Detection using MD5 and Jaccard Coefficient in C#

›
Duplicate documents are significant issue in context of the Web. Detecting near duplicate documents in a large data set, like the web, is a ...
6 comments:
Thursday, October 15, 2009

Text Summarization using Vector Space Model

›
The rapid growth of World Wide Web has resulted in information overload. One cannot possibly read every news article, document, paper, etc t...
12 comments:
Saturday, October 10, 2009

Extracting sentences from a document

›
Extracting words from a document is quite common and a fairly easy task. And using variations of Regex.Split(documentText, @"\W") ...
1 comment:
Monday, September 7, 2009

Singular Value Decomposition (SVD) and Latent Semantic Indexing (LSI) in C#

›
LSI is used in a variety of information retrieval and text processing applications. It uses uses a mathematical technique called Singular V...
40 comments:
Monday, August 17, 2009

Classic Vector Space Model in C#

›
Vector Space Model (VSM) is widely used in Information Retrieval systems. The model creates a space in which both documents and queries are ...
17 comments:
Friday, July 3, 2009

Extract Hyperlinks Using WebBrowser Object in C#

›
In my previous post , I mentioned using regular expressions to extract links from a web page. While I like using regular expressions, there ...
14 comments:
Saturday, April 18, 2009

A simple web crawler

›
it is becoming difficult to write more about what I have been reading/researching related to Information Retrieval but IR continues to be my...
65 comments:
‹
›
Home
View web version

About Me

My photo
Syed Rizvi
View my complete profile
Powered by Blogger.