Bow Tie Kreative Intel System

Files 05 to 09

The tool and source registry

268 tools, datasets and official sources across five libraries. Each entry keeps its licence or access tier, its honest limitation, and its official link. An open-source collector does not grant rights to collect from an upstream source.

Browse the registry

57 of 268 entries.

Data, AI and orchestration · Acquisition and document processing

Scrapy

Open source, BSD-3-Clause

Details →

Data, AI and orchestration · Acquisition and document processing

Playwright

Open source, Apache-2.0

Details →

Data, AI and orchestration · Acquisition and document processing

feedparser

Open source, BSD-2-Clause

Details →

Data, AI and orchestration · Acquisition and document processing

Trafilatura

Open source, Apache-2.0

Details →

Data, AI and orchestration · Acquisition and document processing

Mozilla Readability

Open source, Apache-2.0

Details →

Data, AI and orchestration · Acquisition and document processing

Apache Tika

Open source, Apache-2.0

Details →

Data, AI and orchestration · Acquisition and document processing

Docling

Open source, MIT

Details →

Data, AI and orchestration · Acquisition and document processing

changedetection.io

Open source, Apache-2.0

Details →

Data, AI and orchestration · Workflow orchestration

Prefect

Open source, Apache-2.0 core

Details →

Data, AI and orchestration · Workflow orchestration

Apache Airflow

Open source, Apache-2.0

Details →

Data, AI and orchestration · Workflow orchestration

Temporal

Open source server, MIT

Details →

Data, AI and orchestration · Workflow orchestration

Mage OSS

Open source, Apache-2.0

Details →

Data, AI and orchestration · Workflow orchestration

n8n

Source-available/fair-code, not OSI open source

Details →

Data, AI and orchestration · Storage, search and analysis

PostgreSQL

Open source, PostgreSQL License

Details →

Data, AI and orchestration · Storage, search and analysis

pgvector

Open source, PostgreSQL License

Details →

Data, AI and orchestration · Storage, search and analysis

DuckDB

Open source, MIT

Details →

Data, AI and orchestration · Storage, search and analysis

Polars

Open source, MIT

Details →

Data, AI and orchestration · Storage, search and analysis

Apache Arrow

Open source, Apache-2.0

Details →

Data, AI and orchestration · Storage, search and analysis

Qdrant

Open source, Apache-2.0

Details →

Data, AI and orchestration · Storage, search and analysis

OpenSearch

Open source, Apache-2.0

Details →

Data, AI and orchestration · Storage, search and analysis

Meilisearch

Open source core, MIT

Details →

Data, AI and orchestration · Storage, search and analysis

SeaweedFS

Open source, Apache-2.0

Details →

Data, AI and orchestration · Storage, search and analysis

Ceph

Open source, LGPL-2.1-or-later components

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

spaCy

Open source, MIT

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

Transformers

Open source library, Apache-2.0

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

Sentence Transformers

Open source library, Apache-2.0

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

Haystack

Open source, Apache-2.0

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

BERTopic

Open source, MIT

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

KeyBERT

Open source, MIT

Details →

Data, AI and orchestration · NLP, retrieval and knowledge extraction

scikit-learn

Open source, BSD-3-Clause

Details →

Data, AI and orchestration · Entity resolution and graph analysis

Splink

Open source, MIT

Details →

Data, AI and orchestration · Entity resolution and graph analysis

Dedupe

Open source, MIT

Details →

Data, AI and orchestration · Entity resolution and graph analysis

OpenRefine

Open source, BSD-3-Clause

Details →

Data, AI and orchestration · Entity resolution and graph analysis

NetworkX

Open source, BSD-3-Clause

Details →

Data, AI and orchestration · Entity resolution and graph analysis

Gephi

Open source, GPL-3.0

Details →

Data, AI and orchestration · Quality, provenance and governance

Pandera

Open source, MIT

Details →

Data, AI and orchestration · Quality, provenance and governance

Great Expectations

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

OpenLineage

Open standard/reference ecosystem, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

Marquez

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

DataHub

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

OpenMetadata

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

MLflow

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

Evidently

Open source core, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

OpenTelemetry

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

Prometheus

Open source, Apache-2.0

Details →

Data, AI and orchestration · Quality, provenance and governance

Grafana OSS

Open source, AGPL-3.0

Details →

Data, AI and orchestration · API, identity and secrets

FastAPI

Open source, MIT

Details →

Data, AI and orchestration · API, identity and secrets

Pydantic

Open source, MIT

Details →

Data, AI and orchestration · API, identity and secrets

Keycloak

Open source, Apache-2.0

Details →

Data, AI and orchestration · API, identity and secrets

OpenBao

Open source, MPL-2.0

Details →

Data, AI and orchestration · Reporting and CRM options

Evidence

Open source, MIT

Details →

Data, AI and orchestration · Reporting and CRM options

Apache Superset

Open source, Apache-2.0

Details →

Data, AI and orchestration · Reporting and CRM options

Metabase OSS

Open source edition, AGPL

Details →

Data, AI and orchestration · Reporting and CRM options

Twenty

Mixed/open-core repository; inspect version and path-specific licensing

Details →

Data, AI and orchestration · Reporting and CRM options

EspoCRM

Open source, AGPL-3.0

Details →

Data, AI and orchestration · Reporting and CRM options

SuiteCRM

Open source, AGPL-3.0

Details →

Data, AI and orchestration · Reporting and CRM options

NocoDB

Source-available Sustainable Use License

Details →

Collection modes

The connector profile decides whether a use is passive, not the product name. CM2 is routed to a separately scoped security engagement; CM3 is prohibited in this system.

Collection modes
ModeMeaning
CM0query third-party/open datasets or analyze already obtained artifacts; passive core
CM1low-impact direct retrieval such as an ordinary public page/DNS lookup or permitted rendered-page capture; policy and rate review required
CM2active resolution/probing, port/service interaction, or third-party scan submission; excluded and routed to a separately scoped security engagement
CM3authentication, credential validation, exploitation, disruption, or alteration; prohibited in this system