I need a Mac app that can crawl a live website and do a text search (and, as a bonus, a source code search) and report the results.
Surely something like this exists. Help!
When I needed to do this I used AppleScript to feed the text to BBEdit which has a full POSIX regex and excellent AppleScript support. You can probably do it with Automator as well and simply use due shellscript
to pipe the text through your regex.
tell safari to set TheUrl to URL of document 1 as string
and then I used do shell script "curl \"" & TheUrl & "\""
and then set PageSource to the result
From there, it's scripting BBEdit to massage the source code.