About INETDEX
INETDEX is a web indexing and discovery project.
Its purpose is to discover publicly accessible web resources, collect useful technical metadata and build an index that can be used for search and research.
The project includes the INETDEX Bot, an automated crawler that identifies itself as inetdex-bot/2.0.