AI inferencing at crossroads

Bloomberg Intelligence believes techniques such as quantization and distillation may gain momentum to shrink the size of trained models for more privacy-centric use cases, including personal assistants and AI agents.