Looking for an opensource Laravel simple scraper app – any recommendations? or Has anyone built or us

14 Replies, 659 Views

"Has anyone built or used an opensource laravel simple scraper app?"

Hey folks!

I'm on the hunt for an opensource laravel simple scraper app—something lightweight and easy to tweak.

Anyone got recommendations? Ideally, it should handle basic scraping without too much setup hassle.

I’ve seen a few options but not sure which ones are actually decent.

Bonus points if it’s actively maintained!

Thanks in advance Smile

(Also, if you’ve built one yourself, drop a link—would love to check it out!)
Hey! I’ve used a couple of opensource laravel simple scraper apps, and one that stood out was Laravel Scraper (github repo). It’s pretty lightweight and easy to set up—just a few composer commands and you’re good to go.

Handles basic scraping like pulling titles, links, and even some JS-heavy sites if you pair it with Puppeteer.

Not sure how active the maintainers are tho, last update was a few months back. Still, worth a shot!
If you're looking for something dead simple, check out Goutte with Laravel. It’s not Laravel-specific, but integrates super easily.

I’ve used it for scraping product listings and it’s a breeze. No fancy setup, just install and start scraping.

Downside? Might need some extra tweaking for complex sites, but for basics, it’s solid.
Yo! Built my own opensource laravel simple scraper app last year. It’s called ScrapeEasy (github link in my profile).

Handles basic stuff like meta tags, content extraction, and even has a simple queue system for larger jobs.

It’s kinda niche but might fit your needs. LMK if you try it and hit any snags!
Honestly, most opensource laravel simple scraper apps I’ve tried are either abandoned or overkill.

But Laravel Dusk + some custom logic works surprisingly well for scraping. It’s not *just* a scraper, but if you’re already in Laravel, it’s a smooth addition.

Plus, it handles JS like a champ. Just sayin’.
I’d recommend Spatie’s Laravel Crawler! It’s minimal but powerful.

Used it to scrape a bunch of news sites, and it’s been reliable. The docs are clear, and it’s actively maintained (last update was like 2 weeks ago).

Only gripe? Might need to write a bit more custom code for super specific needs.
Haven’t found a perfect opensource laravel simple scraper app tbh. Most either lack docs or are too bloated.

But Symfony Panther + Laravel is a decent combo. It’s like Goutte but with more power under the hood.

Steeper learning curve, but once you get it, it’s 👌.
OP here—thanks for all the suggestions! Gonna try Spatie’s Crawler first since it seems the most maintained.

Quick Q tho: anyone know if it plays nice with proxies? Got a project where I need to rotate IPs.

Also, shoutout to the ScrapeEasy dev—def gonna check that out too!



Users browsing this thread: 1 Guest(s)