The Pew Pew Sports crawler

What it is

PewPewSportsAggregatoris the crawler for Pew Pew Sports’ aggregated listings. It indexes public firearms-for-sale listings from other Australian sites to bring them into one structured search. Every result links back to the original listing.

Facts only — make, model, calibre, price, location — plus a link to your listing. We don’t copy your photos or descriptionsand we don’t republish seller contact details. The images, full description, and contact stay on your site, and every result sends buyers there.

How we crawl

Identifiable user-agent: PewPewSportsAggregator/1.0 (+https://pewpewsports.com/aggregator). We honour robots.txt, crawl slowly, and use conditional requests.

Opt out

Add this to your robots.txt and we stop on our next crawl:

User-agent: PewPewSportsAggregator
Disallow: /