A lot of B2B selling starts with "what do they run?". A Shopify app developer wants the stores on Shopify, an agency wants the sites with no ad pixel, an email security vendor wants the companies on Microsoft 365 without a DMARC policy. The answer is sitting in each company's homepage and DNS records; reading it for a few thousand domains by hand is the problem.
This post turns a domain list into a segmented prospect sheet in Python.
Disclosure: I'm Aurelix, and I built the Tech Stack API. It's a paid tool (prices below).
What one row tells you
Each domain is read live: its homepage once (robots.txt obeyed) and its public MX, SPF, DMARC and NS records. One row per domain:
-
One column per category, as a list of names:
cms,ecommerce,analytics,tag_manager,advertising(Meta Pixel, Google Ads, LinkedIn, TikTok...),chat,crm_marketing,payments,consent,framework,backend,web_server,cdn_hosting. -
Email from DNS:
email_provider(Google Workspace, Microsoft 365, Zoho...),email_security(a gateway such as Mimecast or Proofpoint),email_sender(sending services named in SPF),dmarc_policy(none, quarantine or reject), plus the rawmxandspf. -
dns_provider,technologies(every detection as name and category),homepage_checked, and anotewhen the homepage could not be read.
When a site blocks bots, the row still carries the DNS fields, which is often enough to segment by email provider.
From a domain list to segments
pip install apify-client
import csv
import os
from collections import Counter
from apify_client import ApifyClient
DOMAINS = ["allbirds.com", "davidstea.com", "webflow.com", "hubspot.com", "mcgill.ca", "wordpress.org"]
client = ApifyClient(os.environ["APIFY_TOKEN"])
run = client.actor("aurelix/tech-stack-detector").call(run_input={"domains": DOMAINS})
rows = list(client.dataset(run["defaultDatasetId"]).iterate_items())
cols = ["domain", "cms", "ecommerce", "analytics", "advertising", "chat", "crm_marketing",
"email_provider", "email_security", "dmarc_policy", "homepage_checked", "note"]
with open("stacks.csv", "w", newline="", encoding="utf-8") as f:
w = csv.writer(f)
w.writerow(cols)
for r in rows:
w.writerow(["; ".join(r[c]) if isinstance(r[c], list) else r[c] for c in cols])
shopify = [r["domain"] for r in rows if "Shopify" in r["ecommerce"]]
no_pixel = [r["domain"] for r in rows if r["homepage_checked"] and not r["advertising"]]
weak_dmarc = [r["domain"] for r in rows if r["email_provider"] and r["dmarc_policy"] in (None, "none")]
print("On Shopify:", shopify)
print("No ad pixel on the homepage:", no_pixel)
print("Email provider found, DMARC missing or monitor-only:", weak_dmarc)
print("Email providers:", Counter(r["email_provider"] or "unknown" for r in rows).most_common())
Each segment is a different conversation: Shopify stores for an app or agency, sites with no ad pixel for a paid-ads pitch, a missing or monitor-only DMARC policy for an email security vendor. homepage_checked matters for the second one: an empty advertising list only means "none found" when the homepage was actually read.
Where the domains come from:
-
Your CRM or a purchased list: paste the domains or full URLs; only the host is used, so
https://apify.com/storeandAPIFY.COMcount as one domain. -
A local business list: run the Google Maps Phone Scraper for a category and city; its
websitecolumn is this tool'sdomainsinput, andcmsthen shows who is on Wix, Squarespace or WordPress.
Why this tool
- The email side on every row: mailbox provider, security gateway, SPF senders and DMARC policy, read from DNS.
- One column per category, flat and ready for a CRM.
- The DNS columns are still filled in when the homepage blocks bots.
- Unreachable domains are not charged.
- What it doesn't cover: a confidence score or the evidence behind each detection, and pages beyond the homepage.
Limits
- Homepage only, no JavaScript. Tools loaded later by a tag manager, only on inner pages, or only after cookie consent can be missed. Tag managers themselves are detected.
- No history. No first-seen dates or spend estimates; each run is a fresh read, and there is no change-only mode.
- Rule-based detection from our own fingerprint rules; a rare false match or miss is possible, and versions are not reported.
- SPF is read one level deep: includes are matched by name, nested includes and redirects are not followed.
-
Blocked sites get the DNS fields only, with
homepage_checkedfalse and anotesaying why. - Speed: ten domains at a time, about 40 to 60 a minute; for lists above about 2,500 domains, raise the run timeout.
Cost
You pay per domain analysed. A domain whose homepage is blocked is still charged once, because its row carries the DNS fields; domains that neither resolve nor answer, and duplicates in the input, are free. The current price per domain is on the Store page; Apify's free plan includes $5 of credit a month, enough for a few thousand domains.
Top comments (0)