DEV Community

Aurelix Solutions
Aurelix Solutions

Posted on Edited on

Find which prospects run Shopify, HubSpot or Microsoft 365, from a list of domains

A lot of B2B selling starts with "what do they run?". A Shopify app developer wants the stores on Shopify, an agency wants the sites with no ad pixel, an email security vendor wants the companies on Microsoft 365 without a DMARC policy. The answer is sitting in each company's homepage and DNS records; reading it for a few thousand domains by hand is the problem.

This post turns a domain list into a segmented prospect sheet in Python.

Disclosure: I'm Aurelix, and I built the Tech Stack API. It's a paid tool (prices below).

What one row tells you

Each domain is read live: its homepage once (robots.txt obeyed) and its public MX, SPF, DMARC and NS records. One row per domain:

  • One column per category, as a list of names: cms, ecommerce, analytics, tag_manager, advertising (Meta Pixel, Google Ads, LinkedIn, TikTok...), chat, crm_marketing, payments, consent, framework, backend, web_server, cdn_hosting.
  • Email from DNS: email_provider (Google Workspace, Microsoft 365, Zoho...), email_security (a gateway such as Mimecast or Proofpoint), email_sender (sending services named in SPF), dmarc_policy (none, quarantine or reject), plus the raw mx and spf.
  • dns_provider, technologies (every detection as name and category), homepage_checked, and a note when the homepage could not be read.

When a site blocks bots, the row still carries the DNS fields, which is often enough to segment by email provider.

From a domain list to segments

pip install apify-client
Enter fullscreen mode Exit fullscreen mode
import csv
import os
from collections import Counter

from apify_client import ApifyClient

DOMAINS = ["allbirds.com", "davidstea.com", "webflow.com", "hubspot.com", "mcgill.ca", "wordpress.org"]

client = ApifyClient(os.environ["APIFY_TOKEN"])
run = client.actor("aurelix/tech-stack-detector").call(run_input={"domains": DOMAINS})
rows = list(client.dataset(run["defaultDatasetId"]).iterate_items())

cols = ["domain", "cms", "ecommerce", "analytics", "advertising", "chat", "crm_marketing",
        "email_provider", "email_security", "dmarc_policy", "homepage_checked", "note"]
with open("stacks.csv", "w", newline="", encoding="utf-8") as f:
    w = csv.writer(f)
    w.writerow(cols)
    for r in rows:
        w.writerow(["; ".join(r[c]) if isinstance(r[c], list) else r[c] for c in cols])

shopify = [r["domain"] for r in rows if "Shopify" in r["ecommerce"]]
no_pixel = [r["domain"] for r in rows if r["homepage_checked"] and not r["advertising"]]
weak_dmarc = [r["domain"] for r in rows if r["email_provider"] and r["dmarc_policy"] in (None, "none")]
print("On Shopify:", shopify)
print("No ad pixel on the homepage:", no_pixel)
print("Email provider found, DMARC missing or monitor-only:", weak_dmarc)
print("Email providers:", Counter(r["email_provider"] or "unknown" for r in rows).most_common())
Enter fullscreen mode Exit fullscreen mode

Each segment is a different conversation: Shopify stores for an app or agency, sites with no ad pixel for a paid-ads pitch, a missing or monitor-only DMARC policy for an email security vendor. homepage_checked matters for the second one: an empty advertising list only means "none found" when the homepage was actually read.

Where the domains come from:

  • Your CRM or a purchased list: paste the domains or full URLs; only the host is used, so https://apify.com/store and APIFY.COM count as one domain.
  • A local business list: run the Google Maps Phone Scraper for a category and city; its website column is this tool's domains input, and cms then shows who is on Wix, Squarespace or WordPress.

Why this tool

  • The email side on every row: mailbox provider, security gateway, SPF senders and DMARC policy, read from DNS.
  • One column per category, flat and ready for a CRM.
  • The DNS columns are still filled in when the homepage blocks bots.
  • Unreachable domains are not charged.
  • What it doesn't cover: a confidence score or the evidence behind each detection, and pages beyond the homepage.

Limits

  • Homepage only, no JavaScript. Tools loaded later by a tag manager, only on inner pages, or only after cookie consent can be missed. Tag managers themselves are detected.
  • No history. No first-seen dates or spend estimates; each run is a fresh read, and there is no change-only mode.
  • Rule-based detection from our own fingerprint rules; a rare false match or miss is possible, and versions are not reported.
  • SPF is read one level deep: includes are matched by name, nested includes and redirects are not followed.
  • Blocked sites get the DNS fields only, with homepage_checked false and a note saying why.
  • Speed: ten domains at a time, about 40 to 60 a minute; for lists above about 2,500 domains, raise the run timeout.

Cost

You pay per domain analysed. A domain whose homepage is blocked is still charged once, because its row carries the DNS fields; domains that neither resolve nor answer, and duplicates in the input, are free. The current price per domain is on the Store page; Apify's free plan includes $5 of credit a month, enough for a few thousand domains.

Links

Top comments (0)