Property

http

Property Name	Type	Description	Required
components	object<string, HttpComponent>	The web technologies (ex. jQuery) that a website uses.
dom_hash	integer
favicon	HttpFavicon	Favicon for the website. Helpful to find phishing websites, fingerprinting products or locating websites from the same vendor/ company.
headers_hash	integer	Numeric hash of the HTTP headers with the order preserved.
host	string
html	string
html_hash	integer	Numeric hash of the "http.html" property. Useful for finding other IPs with the exact same website.
location	string
redirects	array of HttpRedirect		Yes
robots	string	Contents of the robots.txt file.
robots_hash	integer	Numeric hash of the robots.txt file which can be used to find websites that have the same robots.txt.
securitytxt	string	The security.txt file is an emerging standard for knowing how to contact the website owner for security issues.
securitytxt_hash	integer
server	string	Short-hand for accessing the value from the "Server" HTTP header.
server_hash	integer
sitemap	string
sitemap_hash	integer
status	integer
title	string
title_hash	integer
waf	string	Web application firewall that is protecting this website.

HttpComponent

Property Name	Type	Description	Required
categories	array of string		Yes

HttpFavicon

Property Name	Type	Required
data	string	Yes
hash	integer	Yes
location	string	Yes

HttpRedirect

Property Name	Type	Required
data	string
host	string	Yes
location	string	Yes

↑ TopSearch Queries

SearchWebsites that have a security.txt file
http.securitytxt:contact

SearchGoogle websites as identified by the Google favicon
http.favicon.hash:708578229

SearchWebsites that are behind a Citrix NetScaler web application firewall (WAF)
http.waf:"NetScaler AppFirewall"

SearchWebsites that are using jQuery
http.component:jQuery

↑ TopExample

{
    "components": {
        "jQuery": {
            "categories": [
                "JavaScript Frameworks"
            ]
        },
        "Font Awesome": {
            "categories": [
                "Font Scripts"
            ]
        },
        "Optimizely": {
            "categories": [
                "Analytics"
            ]
        },
        "Bootstrap": {
            "categories": [
                "Web Frameworks"
            ]
        },
        "Google Tag Manager": {
            "categories": [
                "Tag Managers"
            ]
        },
        "Google Font API": {
            "categories": [
                "Font Scripts"
            ]
        }
    },
    "redirects": [
        {
            "host": "52.167.219.168",
            "data": "HTTP/1.1 302 Found\r\nServer: nginx\r\nDate: Sat, 24 Mar 2018 22:01:41 GMT\r\nContent-Type: text/html; charset=utf-8\r\nContent-Leng...",
            "location": "/"
        }
    ],
    "securitytxt": "Contact: security@gitlab.com\n\nDisclosure policy: https://about.gitlab.com/disclosure/\n\nAcknowledgements: https://about.gitlab.com/vulnerability-acknowledgements/\n",
    "title": " The only single product for the complete DevOps lifecycle - GitLab | GitLab ",
    "robots": "User-agent: *\nDisallow:\nSitemap: https://about.gitlab.com/sitemap.xml\n",
    "robots_hash": 2114941077,
    "favicon": {
        "data": "AAABAAIAEBAAAAAAIABoBAAAJgAAACAgAAAAACAAqBAAAI4EAAAoAAAAEAAAACAAAAABACAAAAAA\nAEAEAAAAAAAAAAAAAAAAAAAAAAAA////Af///wH///8B////Af///wH///8B////ASWX/RUne/MX\n////Af///wH///8B////Af///wH///8B////Af///wH///8B////Af///wH///8B////ASan/EEn\nbvThJm/05yai/EP///8B////Af///wH///8B////Af///wH///8B////Af///wH///8BJqP8Ayaj\n/I0mi/v5J1Tt/SdT7Psmi/z5JqL8j////wH///8B////Af///wH///8B////...",
        "hash": 516963061,
        "location": "https://about.gitlab.com:443/ico/favicon.ico"
    },
    "host": "about.gitlab.com",
    "html": "<!DOCTYPE html> <html class=html--no-js lang=en> <head> <meta charset=UTF-8 /> <meta content='width=device-width, initial-scale=1.0' name=viewport /> <script>document.documentElement.className = 'html--js'</script> <scrip...",
    "location": "/",
    "securitytxt_hash": -569364831,
    "server": "nginx",
    "sitemap": "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<urlset xmlns=\"http://www.sitemaps.org/schemas/sitemap/0.9\">\n  <url>\n    <loc>https://about.gitlab.com/gitlab-hosted/</loc>\n  </url>\n  <url>\n    <loc>https://about.gitlab.com/gitlab-hosted/migrate-from-gitlab-com/</loc>\n  </url>\n  <url>\n    <loc>https://about.gitlab.com/handbook/sales-qualification-questions/</loc>\n  </url>\n  <url>\n    <loc>https://about.gitlab.com/handbook/resellers/</...",
    "sitemap_hash": 493700267,
    "html_hash": -1521600445
}