Looking for an open source Laravel simple scraper app—any recommendations? or Has anyone built or use

20 Replies, 1213 Views

Hey folks!

Anyone got a lead on an *open source laravel simple scraper app*? Been digging around but most stuff’s either too bloated or abandoned.

Need something lightweight to pull basic data from a few sites—nothing fancy.

Preferably with decent docs (or at least not a total headache to set up lol).

If you’ve built one or used one that didn’t make you wanna rage-quit, drop a name!

Or if there’s a solid package I can tweak, that works too.

Thanks in advance! 🙌

*(ps. if it’s on github, even better!)*
Hey! I’ve been using Laravel Dusk for simple scraping tasks—it’s not *just* for testing!
Super easy to set up if you’re already in the Laravel ecosystem.

Docs are solid, and you can pair it with Guzzle if you need more control.
Not *exactly* an open source laravel simple scraper app, but close enough to hack together.

Github link: https://github.com/laravel/dusk
If you want something *stupid simple*, check out Goutte + Laravel.
It’s a PHP scraper (not Laravel-specific), but integrates smoothly.

Lightweight, no bloat, and the learning curve is basically flat.
Docs are meh, but there are tons of tutorials out there.
Yo! Spatie’s Crawler package might be what you need.
It’s minimal, well-maintained, and works *with* Laravel.

Not a full open source laravel simple scraper app, but you can build one around it in like 20 mins.
Github: https://github.com/spatie/crawler
Honestly, most scraper libs are overkill for basic stuff.
I’d just use PHP Simple HTML DOM Parser and wrap it in a Laravel command.

Super lightweight, and you won’t rage-quit promise lol.
No fancy docs, but Stack Overflow has your back.
Have you tried Laravel BrowserKit Testing?
It’s meant for testing, but I’ve abused it for scraping.

Works fine for basic stuff, and since it’s Laravel-native, setup is a breeze.
Not perfect, but gets the job done.
If you’re okay with a bit of DIY, Symfony Panther is a hidden gem.
It’s like Puppeteer but for PHP.

Pair it with Laravel, and you’ve got a scraper that can handle JS-heavy sites too.
Docs are decent, and it’s on Github.
OP here—wow, thanks for all the suggestions!
Tried Goutte and it’s *almost* perfect, but hitting some JS-rendered content issues.

Gonna give Symfony Panther a shot next.
Anyone got tips for handling dynamic stuff with it?

(Also, Roach PHP looks dope—bookmarked for later!)
Lol @ “didn’t make you wanna rage-quit” — felt that.
Roach PHP is a newer option. Minimal, Laravel-friendly, and *actually* maintained.

Github: https://github.com/roach-php/core
Might be worth a look if you’re building something custom.
For *real* basic scraping, I just use file_get_contents() and regex.
Fight me.

But if you want a package, Laravel Zero + Goutte is a killer combo for CLI scrapers.
Zero bloat, all speed.



Users browsing this thread: 1 Guest(s)