Open source SEO crawler

Nice one.
Anyone interested for backlinks here?

Interesting, i'll follow! Good job

This looks awesome ! I'll try it, that is exactly what I was searching for :)

Nice tool, thanks for sharing it +1

Has anyone used this open source equivalent of Screaming Frog? I downloaded it and tested it on two websites. One site it didn't crawl, so it's still somewhat buggy but promising. You can export a *.csv of crawled URLs and I imagine more functionality will be added over time.