Recently noticed that vLLM a fast and easy-to-use library for LLM inference and serving.
AI explained to me the difference of llama.cpp vs. vLLM 
:
While vLLM is primarily GPU-driven, given the rise of highly optimized small LLMs and quantized models, do you think there’s a future for vLLM (or a similar project) to offer highly efficient CPU inference backends, especially on powerful Arm64 server CPUs like Ampere One M? What would be the challenges?
The number of AI projects like libraries/Frameworks/MLOps is growing rapidly. Can you share more information about them?