Dude, I feel your pain. Parsing data from mixed formats is like herding cats.
I’ve had luck with Apache NiFi for automating workflows—it’s got processors for CSV, JSON, XML, you name it. Handles transformations too.
For edge cases, I just log the crap out of everything and then grep through logs later. Not elegant, but it works.
Also, check out Talend if you’re dealing with enterprise-level stuff. Overkill for small jobs tho.
I’ve had luck with Apache NiFi for automating workflows—it’s got processors for CSV, JSON, XML, you name it. Handles transformations too.
For edge cases, I just log the crap out of everything and then grep through logs later. Not elegant, but it works.
Also, check out Talend if you’re dealing with enterprise-level stuff. Overkill for small jobs tho.
