SpiderFoot: Open Source Fingerprinting Tool

SpiderFoot is a free and open source fingerprinting tool for pen testers and defenders checking the posture of the sites they defend. This is an automated recon tool, available for both Windows and Linux and written in Python. 

The operation is very easy. After installing it, you start the tool and open a Web browser and browse to localhost on port 5001. Go to the Settings page and make any changes you would like, then give the scan a name and start it and sit back. The scan will run quite a while as it does a large number of checks, depending on how you configured it. If you have API keys for Honeypot Checker, Shodan or VirusTotal, it will use those to do checks against those sites for what you're scanning.

You can scan a hostname, a domain or sub-domain, an IP address or a subnet.

I'd recommend starting out small and scanning a single IP or domain until you see the length of time it will take and if you want to make any tweaks to your settings. 

SpiderFoot will report these items:

Affiliate - IP Address

Affiliate - IP Address - Subnet

Affiliate - Internet Name

Affiliate - Web Content

BGP AS Membership

BGP AS Ownership

BGP AS Peer

Blacklisted Affiliate IP Address

Blacklisted IP Address

Blacklisted IP on Owned Netblock

Blacklisted IP on Same Subnet

Co-Hosted Site

Cookies

DNS TXT Record

Defaced

Defaced Affiliate

Defaced Affiliate IP Address

Defaced Co-Hosted Site

Defaced IP Address

Device Type

Domain Name

Email Address

Email Gateway (DNS 'MX' Records)

Error Message

Externally Hosted Javascript

HTTP Headers

HTTP Status Code

Human Name

IP Address

IPv6 Address

Interesting File

Internet Name

Junk File

Linked URL - External

Linked URL - Internal

Malicious AS

Malicious Affiliate

Malicious Affiliate IP Address

Malicious Co-Hosted Site

Malicious IP Address

Malicious IP on Same Subnet

Malicious Internet Name

Name Server (DNS 'NS' Records)

Netblock Membership

Netblock Ownership

Non-Standard HTTP Header

Open TCP Port

Open TCP Port Banner

Open UDP Port

Open UDP Port Information

Operating System

Owned Netblock with Malicious IP

PasteBin Content

Physical Location

Raw DNS Records

Raw Data from RIRs

Raw File Meta Data

SSL Certificate - Issued by

SSL Certificate - Issued to

SSL Certificate - Raw Data

SSL Certificate Expired

SSL Certificate Expiring

SSL Certificate Host Mismatch

Search Engine's Web Content

Similar Domain

Social Media Presence

URL (Accepts Passwords)

URL (Accepts Uploads)

URL (AdBlocked External)

URL (AdBlocked Internal)

URL (Form)

URL (Purely Static)

URL (Uses Flash)

URL (Uses Java applet)

URL (Uses Javascript)

URL (Uses a Web Framework)

Web Content

Web Server

Web Technology

You can find out more and download SpiderFoot at http://www.spiderfoot.net/