Command line

The same engine as the app, for servers and scripts. Requires Node 22 or newer.

npm install -g @sitemoth/engine

sitemoth crawl https://example.com -o example.sitemoth \
  --max 5000 -c 5 --delay 200 --render --exclude "\?replytocom="
sitemoth issues example.sitemoth                      # overview
sitemoth issues example.sitemoth --check rc_client_error_4xx
sitemoth urls example.sitemoth --tab page_titles --filter dup
sitemoth inlinks example.sitemoth https://example.com/old-page/
sitemoth export example.sitemoth --all --format xlsx -o ./export
sitemoth export example.sitemoth --bulk redirect_chains -o chains.csv
sitemoth compare last-week.sitemoth example.sitemoth
sitemoth sitemap example.sitemoth -o sitemap.xml --images
sitemoth report example.sitemoth https://example.com/odd-page/ --note "canonical reported missing"
sitemoth checks | sitemoth tabs                       # reference

Pass a full configuration with --config crawl.json (the same object the app saves). Crawl files open in the desktop app. Exit codes: 0 success, 1 error, 2 refused to overwrite.

Scheduling

Put the crawl and an export in cron on any machine that is always on. Keep the previous file and run sitemoth compare to get a diff you can mail to yourself.