Bow Tie Kreative Intel System

Files 05 to 09

The tool and source registry

268 tools, datasets and official sources across five libraries. Each entry keeps its licence or access tier, its honest limitation, and its official link. An open-source collector does not grant rights to collect from an upstream source.

Browse the registry

120 of 268 entries.

Technical and passive OSINT · Open-source components

OWASP Amass v5

Apache-2.0; components may vary

Details →

Technical and passive OSINT · Open-source components

SpiderFoot

MIT

Details →

Technical and passive OSINT · Open-source components

ProjectDiscovery Subfinder

MIT

Details →

Technical and passive OSINT · Open-source components

Findomain

GPL-3.0

Details →

Technical and passive OSINT · Open-source components

assetfinder

MIT

Details →

Technical and passive OSINT · Open-source components

Cert Spotter

MPL-2.0

Details →

Technical and passive OSINT · Open-source components

openrdap/rdap

MIT

Details →

Technical and passive OSINT · Open-source components

gau

MIT

Details →

Technical and passive OSINT · Open-source components

WappalyzerGo

MIT

Details →

Technical and passive OSINT · Open-source components

webappanalyzer fingerprints

GPL-3.0

Details →

Technical and passive OSINT · Open-source components

WhatWeb

GPL-2.0

Details →

Technical and passive OSINT · Open-source components

ExifTool

Artistic License or GPL, same terms as Perl

Details →

Technical and passive OSINT · Open-source components

Apache Tika

Apache-2.0

Details →

Technical and passive OSINT · Open-source components

oletools

BSD-style package; bundled parts vary

Details →

Technical and passive OSINT · Open-source components

FOCA

GPL-3.0

Details →

Technical and passive OSINT · Open-source components

Metagoofil maintained fork

GPL-3.0-or-later

Details →

Technical and passive OSINT · Open-source components

Gitleaks

MIT

Details →

Technical and passive OSINT · Open-source components

detect-secrets

Apache-2.0

Details →

Technical and passive OSINT · Open-source components

TruffleHog

AGPL-3.0

Details →

Technical and passive OSINT · Open-source components

OSV-Scanner

Apache-2.0

Details →

Technical and passive OSINT · Hosted free and open-data sources

crt.sh

no-key hosted CT search

Details →

Technical and passive OSINT · Hosted free and open-data sources

Censys Free

hosted account/PAT

Details →

Technical and passive OSINT · Hosted free and open-data sources

BuiltWith Free API

key, hosted free endpoint

Details →

Technical and passive OSINT · Hosted free and open-data sources

GreyNoise Community

keyless limited or free key

Details →

Technical and passive OSINT · Hosted free and open-data sources

urlscan.io Search

API key

Details →

Technical and passive OSINT · Hosted free and open-data sources

AlienVault OTX

community API

Details →

Technical and passive OSINT · Hosted free and open-data sources

Common Crawl

free CDXJ/JSON index and WARC

Details →

Technical and passive OSINT · Hosted free and open-data sources

Wayback Machine

public archive

Details →

Technical and passive OSINT · Hosted free and open-data sources

Arquivo.pt

free archive APIs, GPL-3.0 stack

Details →

Technical and passive OSINT · Hosted free and open-data sources

GitHub REST Code Search

authenticated public-code search

Details →

Technical and passive OSINT · Hosted free and open-data sources

Have I Been Pwned (HIBP) Pwned Passwords

no-key k-anonymity API/downloads

Details →

Technical and passive OSINT · Hosted free and open-data sources

NVD

free feeds/API

Details →

Technical and passive OSINT · Hosted free and open-data sources

CISA KEV

free JSON/CSV

Details →

Technical and passive OSINT · Hosted free and open-data sources

FIRST EPSS

free daily CSV/API

Details →

Technical and passive OSINT · Hosted free and open-data sources

OSV API

free

Details →

Technical and passive OSINT · Hosted free and open-data sources

GitHub Advisory Database

CC-BY-4.0 data

Details →

Technical and passive OSINT · Hosted free and open-data sources

ProjectDiscovery Chaos

account/API

Details →

Technical and passive OSINT · Hosted free and open-data sources

LeakIX API

free key advertised for researchers

Details →

PR, reputation and narrative · News, media and web mentions

GDELT

free/open-access data service; not an OSI software license for corpus

Details →

PR, reputation and narrative · News, media and web mentions

Media Cloud

account/API; official Python client Apache-2.0

Details →

PR, reputation and narrative · News, media and web mentions

Guardian Open Platform

free developer key for noncommercial use

Details →

PR, reputation and narrative · News, media and web mentions

NewsAPI

proprietary dev plan

Details →

PR, reputation and narrative · News, media and web mentions

GNews API

proprietary dev/noncommercial plan

Details →

PR, reputation and narrative · News, media and web mentions

Google Alerts

free UI/email

Details →

PR, reputation and narrative · News, media and web mentions

Talkwalker Alerts

free proprietary alert service

Details →

PR, reputation and narrative · News, media and web mentions

Google Trends

free UI/CSV/RSS; alpha API limited

Details →

PR, reputation and narrative · News, media and web mentions

Common Crawl

free corpus; downloader MIT/Apache-2.0

Details →

PR, reputation and narrative · News, media and web mentions

Wayback Machine

free public archive

Details →

PR, reputation and narrative · Social and review sources

Reddit Data API

OAuth API; free access conditional

Details →

PR, reputation and narrative · Social and review sources

Bluesky/AT Protocol Jetstream

dual MIT/Apache-2.0 code

Details →

PR, reputation and narrative · Social and review sources

Mastodon

AGPL-3.0 server; per-instance APIs

Details →

PR, reputation and narrative · Social and review sources

YouTube Data API

proprietary API with free quota

Details →

PR, reputation and narrative · Social and review sources

X API

proprietary pay-per-use

Details →

PR, reputation and narrative · Social and review sources

Meta Content Library/API

controlled research access

Details →

PR, reputation and narrative · Social and review sources

TikTok Research API

controlled nonprofit research access

Details →

PR, reputation and narrative · Social and review sources

TikTok Commercial Content API

approval-gated transparency

Details →

PR, reputation and narrative · Social and review sources

Google Places API

billing required, monthly no-charge caps

Details →

PR, reputation and narrative · Social and review sources

Trustpilot APIs

key/OAuth and contractual terms

Details →

PR, reputation and narrative · Social and review sources

Yelp Places

trial/paid proprietary API

Details →

PR, reputation and narrative · Social and review sources

BBB

manual spot-check only unless licensed/permitted

Details →

PR, reputation and narrative · Social and review sources

Glassdoor

manual citation or licensed data

Details →

PR, reputation and narrative · Social and review sources

LinkedIn

manual public business review; approved owned-asset APIs

Details →

PR, reputation and narrative · Narrative verification

Google Fact Check Tools API

proprietary API-key service

Details →

PR, reputation and narrative · Narrative verification

InVID-WeVerify/vera.ai plugin

MIT

Details →

PR, reputation and narrative · Narrative verification

Junkipedia

controlled public-interest platform

Details →

PR, reputation and narrative · Narrative verification

Hoaxy

GPL-3.0 frontend; archived 2023

Details →

PR, reputation and narrative · Ingestion and monitoring

RSSHub

AGPL-3.0

Details →

PR, reputation and narrative · Ingestion and monitoring

FreshRSS

AGPL-3.0

Details →

PR, reputation and narrative · Ingestion and monitoring

Miniflux

Apache-2.0

Details →

PR, reputation and narrative · Ingestion and monitoring

changedetection.io

Apache-2.0

Details →

PR, reputation and narrative · Ingestion and monitoring

Scrapy

BSD-3-Clause

Details →

PR, reputation and narrative · Ingestion and monitoring

Trafilatura

current Apache-2.0; older releases differ

Details →

PR, reputation and narrative · NLP, clustering and network analysis

VADER

MIT

Details →

PR, reputation and narrative · NLP, clustering and network analysis

spaCy

MIT library

Details →

PR, reputation and narrative · NLP, clustering and network analysis

Transformers

Apache-2.0 library

Details →

PR, reputation and narrative · NLP, clustering and network analysis

Sentence Transformers

Apache-2.0 library

Details →

PR, reputation and narrative · NLP, clustering and network analysis

BERTopic

MIT

Details →

PR, reputation and narrative · NLP, clustering and network analysis

KeyBERT

MIT

Details →

PR, reputation and narrative · NLP, clustering and network analysis

scikit-learn

BSD-3-Clause

Details →

PR, reputation and narrative · NLP, clustering and network analysis

NetworkX

BSD-3-Clause

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

Meta Ad Library UI

free proprietary UI; low–medium

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

Meta Ad Library API

gated proprietary Graph API; high within scope

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

Google Ads Transparency Center UI

free proprietary UI; low–medium

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

Google ATC bulk data

official JSON shards/BigQuery; high

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

Google Ads API

owned/authorized accounts; high

Details →

Marketing, demand and conversion · Ad transparency and creative intelligence

TikTok Creative Center

free proprietary UI; low

Details →

Marketing, demand and conversion · Search demand and owned performance

Google Trends UI/CSV/Trending RSS

free proprietary; medium

Details →

Marketing, demand and conversion · Search demand and owned performance

Google Trends API alpha

application-only alpha; high if admitted

Details →

Marketing, demand and conversion · Search demand and owned performance

Google Trends BigQuery

official public dataset; high

Details →

Marketing, demand and conversion · Search demand and owned performance

Google Keyword Planner UI

no separate subscription but Ads account setup/billing required; medium

Details →

Marketing, demand and conversion · Search demand and owned performance

Keyword Planning API

Google Ads API; high after approval

Details →

Marketing, demand and conversion · Search demand and owned performance

Google Search Console API

verified property; high

Details →

Marketing, demand and conversion · Search demand and owned performance

Search Console BigQuery export

verified property; very high

Details →

Marketing, demand and conversion · Search demand and owned performance

Search Console GenAI Performance

global UI rollout 2026-08-31; low

Details →

Marketing, demand and conversion · Search demand and owned performance

Bing Webmaster Tools API

free verified-site REST/JSON; high

Details →

Marketing, demand and conversion · Search demand and owned performance

Bing AI Performance

public-preview UI; low

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

SiteOne Crawler

MIT

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

SEOnaut

MIT

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

advertools

MIT

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Scrapy

BSD-3-Clause

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Crawlee

Apache-2.0

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Katana

MIT

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Apache StormCrawler

Apache-2.0

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Trafilatura

Apache-2.0 current

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

changedetection.io

Apache-2.0

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

WordPress REST API

WordPress GPL/public per site

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

Common Crawl

free corpus/index

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

KeyBERT

MIT

Details →

Marketing, demand and conversion · Crawling, extraction and content velocity

SEO Macroscope

GPL-3.0; limited maintenance

Details →

Marketing, demand and conversion · Audience questions and public conversation

AnswerThePublic

proprietary free account; low

Details →

Marketing, demand and conversion · Audience questions and public conversation

Talkwalker Free Social Search

proprietary free UI; low

Details →

Marketing, demand and conversion · Audience questions and public conversation

Talkwalker Alerts

free email/RSS/Slack alerts; medium

Details →

Marketing, demand and conversion · Audience questions and public conversation

GDELT DOC/Context

free HTTP/JSON/RSS; high

Details →

Marketing, demand and conversion · Audience questions and public conversation

Media Cloud

hosted API; client Apache-2.0; high

Details →

Marketing, demand and conversion · Audience questions and public conversation

Stack Exchange API

free REST/key; high

Details →

Marketing, demand and conversion · Audience questions and public conversation

YouTube Data API

proprietary free quota; high

Details →

Marketing, demand and conversion · Audience questions and public conversation

Bluesky Jetstream

dual MIT/Apache-2.0; high

Details →

Marketing, demand and conversion · Audience questions and public conversation

Mastodon APIs

AGPL software; medium

Details →

Marketing, demand and conversion · Audience questions and public conversation

Reddit Data API

proprietary/approval; conditional

Details →

Marketing, demand and conversion · Audience questions and public conversation

LinkedIn Community Management API

proprietary/reviewed; owned pages

Details →

Collection modes

The connector profile decides whether a use is passive, not the product name. CM2 is routed to a separately scoped security engagement; CM3 is prohibited in this system.

Collection modes
ModeMeaning
CM0query third-party/open datasets or analyze already obtained artifacts; passive core
CM1low-impact direct retrieval such as an ordinary public page/DNS lookup or permitted rendered-page capture; policy and rate review required
CM2active resolution/probing, port/service interaction, or third-party scan submission; excluded and routed to a separately scoped security engagement
CM3authentication, credential validation, exploitation, disruption, or alteration; prohibited in this system