+- Proxy Community (https://proxycommunity.com/forum)
+-- Forum: Technical Community Support (https://proxycommunity.com/forum/forum-technical-community-support)
+--- Forum: API and Development (https://proxycommunity.com/forum/forum-api-and-development)
+--- Thread: Looking for an open source Laravel simple scraper app—any recommendations? or Has anyone built or use (/thread-looking-for-an-open-source-laravel-simple-scraper-app%E2%80%94any-recommendations-or-has-anyone-built-or-use)
Looking for an open source Laravel simple scraper app—any recommendations? or Has anyone built or use - webSurferX - 02-12-2024
Hey folks!
Anyone got a lead on an *open source laravel simple scraper app*? Been digging around but most stuff’s either too bloated or abandoned.
Need something lightweight to pull basic data from a few sites—nothing fancy.
Preferably with decent docs (or at least not a total headache to set up lol).
If you’ve built one or used one that didn’t make you wanna rage-quit, drop a name!
Or if there’s a solid package I can tweak, that works too.
Thanks in advance! 🙌
*(ps. if it’s on github, even better!)*
“” - MaskedCipherX - 29-12-2024
Hey! I’ve been using Laravel Dusk for simple scraping tasks—it’s not *just* for testing!
Super easy to set up if you’re already in the Laravel ecosystem.
Docs are solid, and you can pair it with Guzzle if you need more control.
Not *exactly* an open source laravel simple scraper app, but close enough to hack together.
Github link: https://github.com/laravel/dusk
“” - ProX_404 - 17-02-2025
If you want something *stupid simple*, check out Goutte + Laravel.
It’s a PHP scraper (not Laravel-specific), but integrates smoothly.
Lightweight, no bloat, and the learning curve is basically flat.
Docs are meh, but there are tons of tutorials out there.
“” - MaskedLegendX - 24-02-2025
Yo! Spatie’s Crawler package might be what you need.
It’s minimal, well-maintained, and works *with* Laravel.
Not a full open source laravel simple scraper app, but you can build one around it in like 20 mins.
Github: https://github.com/spatie/crawler
“” - maskedFly77 - 14-03-2025
Honestly, most scraper libs are overkill for basic stuff.
I’d just use PHP Simple HTML DOM Parser and wrap it in a Laravel command.
Super lightweight, and you won’t rage-quit promise lol.
No fancy docs, but Stack Overflow has your back.
“” - deepSurfer77 - 17-03-2025
Have you tried Laravel BrowserKit Testing?
It’s meant for testing, but I’ve abused it for scraping.
Works fine for basic stuff, and since it’s Laravel-native, setup is a breeze.
Not perfect, but gets the job done.
“” - DeepMaskX - 21-03-2025
If you’re okay with a bit of DIY, Symfony Panther is a hidden gem.
It’s like Puppeteer but for PHP.
Pair it with Laravel, and you’ve got a scraper that can handle JS-heavy sites too.
Docs are decent, and it’s on Github.
“” - webSurferX - 22-03-2025
OP here—wow, thanks for all the suggestions!
Tried Goutte and it’s *almost* perfect, but hitting some JS-rendered content issues.
Gonna give Symfony Panther a shot next.
Anyone got tips for handling dynamic stuff with it?
(Also, Roach PHP looks dope—bookmarked for later!)
“” - MaskedRebel77 - 24-03-2025
Lol @ “didn’t make you wanna rage-quit” — felt that.
Roach PHP is a newer option. Minimal, Laravel-friendly, and *actually* maintained.
Github: https://github.com/roach-php/core
Might be worth a look if you’re building something custom.
“” - IPSwap88 - 24-03-2025
For *real* basic scraping, I just use file_get_contents() and regex.
Fight me.
But if you want a package, Laravel Zero + Goutte is a killer combo for CLI scrapers.
Zero bloat, all speed.