Next-Gen AV and The Challenge of Optimizing Big Data at Scale