GDELT
free/open-access data service; not an OSI software license for corpus
Files 05 to 09
The tool and source registry
268 tools, datasets and official sources across five libraries. Each entry keeps its licence or access tier, its honest limitation, and its official link. An open-source collector does not grant rights to collect from an upstream source.
Browse the registry
42 of 268 entries.
Media Cloud
account/API; official Python client Apache-2.0
Guardian Open Platform
free developer key for noncommercial use
NewsAPI
proprietary dev plan
GNews API
proprietary dev/noncommercial plan
Google Alerts
free UI/email
Talkwalker Alerts
free proprietary alert service
Google Trends
free UI/CSV/RSS; alpha API limited
Common Crawl
free corpus; downloader MIT/Apache-2.0
Wayback Machine
free public archive
Reddit Data API
OAuth API; free access conditional
Bluesky/AT Protocol Jetstream
dual MIT/Apache-2.0 code
Mastodon
AGPL-3.0 server; per-instance APIs
YouTube Data API
proprietary API with free quota
X API
proprietary pay-per-use
Meta Content Library/API
controlled research access
TikTok Research API
controlled nonprofit research access
TikTok Commercial Content API
approval-gated transparency
Google Places API
billing required, monthly no-charge caps
Trustpilot APIs
key/OAuth and contractual terms
Yelp Places
trial/paid proprietary API
BBB
manual spot-check only unless licensed/permitted
Glassdoor
manual citation or licensed data
manual public business review; approved owned-asset APIs
Google Fact Check Tools API
proprietary API-key service
InVID-WeVerify/vera.ai plugin
MIT
Junkipedia
controlled public-interest platform
Hoaxy
GPL-3.0 frontend; archived 2023
RSSHub
AGPL-3.0
FreshRSS
AGPL-3.0
Miniflux
Apache-2.0
changedetection.io
Apache-2.0
Scrapy
BSD-3-Clause
Trafilatura
current Apache-2.0; older releases differ
VADER
MIT
spaCy
MIT library
Transformers
Apache-2.0 library
Sentence Transformers
Apache-2.0 library
BERTopic
MIT
KeyBERT
MIT
scikit-learn
BSD-3-Clause
NetworkX
BSD-3-Clause
Collection modes
The connector profile decides whether a use is passive, not the product name. CM2 is routed to a separately scoped security engagement; CM3 is prohibited in this system.
| Mode | Meaning |
|---|---|
| CM0 | query third-party/open datasets or analyze already obtained artifacts; passive core |
| CM1 | low-impact direct retrieval such as an ordinary public page/DNS lookup or permitted rendered-page capture; policy and rate review required |
| CM2 | active resolution/probing, port/service interaction, or third-party scan submission; excluded and routed to a separately scoped security engagement |
| CM3 | authentication, credential validation, exploitation, disruption, or alteration; prohibited in this system |