Wow, didn’t expect so many solid replies!
I’ve been playing with columnar storage (Parquet) and it’s *way* faster for my analytics workload. Still tweaking the schema though.
The AQP suggestion is gold—never thought about sacrificing accuracy for speed, but it makes sense for my dashboards.
Anyone here tried combining Redis with Spark? Wondering if it’s overengineering or worth the hassle.
Also, big thanks for the query optimization tips. Turns out my joins were trash lol.
I’ve been playing with columnar storage (Parquet) and it’s *way* faster for my analytics workload. Still tweaking the schema though.
The AQP suggestion is gold—never thought about sacrificing accuracy for speed, but it makes sense for my dashboards.
Anyone here tried combining Redis with Spark? Wondering if it’s overengineering or worth the hassle.
Also, big thanks for the query optimization tips. Turns out my joins were trash lol.