Mining the Web
Monday, November 23, 2009
Duplicate Detection using MD5 and Jaccard Coefficient in C#
›
Duplicate documents are significant issue in context of the Web. Detecting near duplicate documents in a large data set, like the web, is a ...
6 comments:
Thursday, October 15, 2009
Text Summarization using Vector Space Model
›
The rapid growth of World Wide Web has resulted in information overload. One cannot possibly read every news article, document, paper, etc t...
12 comments:
Saturday, October 10, 2009
Extracting sentences from a document
›
Extracting words from a document is quite common and a fairly easy task. And using variations of Regex.Split(documentText, @"\W") ...
1 comment:
Monday, September 7, 2009
Singular Value Decomposition (SVD) and Latent Semantic Indexing (LSI) in C#
›
LSI is used in a variety of information retrieval and text processing applications. It uses uses a mathematical technique called Singular V...
40 comments:
Monday, August 17, 2009
Classic Vector Space Model in C#
›
Vector Space Model (VSM) is widely used in Information Retrieval systems. The model creates a space in which both documents and queries are ...
17 comments:
Friday, July 3, 2009
Extract Hyperlinks Using WebBrowser Object in C#
›
In my previous post , I mentioned using regular expressions to extract links from a web page. While I like using regular expressions, there ...
14 comments:
Saturday, April 18, 2009
A simple web crawler
›
it is becoming difficult to write more about what I have been reading/researching related to Information Retrieval but IR continues to be my...
65 comments:
‹
›
Home
View web version