Wednesday, March 7, 2007

Web Spiders

OBS have great experience in creating web spider applications. We have just completed our last spider in about 6 hours for the site http://www.domain.com.au

Here are most popular features that common spider include:
  • Collects any information like emails, addresses, names, phones from popular sites and directories
  • Uses regular expression so easily to configure
  • Exports information to any type of DB including MS SQL, Excel, Access, MySQL etc
  • Has pretty simple user interface
  • Filters allow to define exported data
  • Based on ASP.NET and can be run on any web server

Totally we have created more than 3 spiders and many modifications for them.

No comments: