token-aware

Tag

Cards List
#token-aware

Pro-Router: Token-Aware Progressive Model Routing with Adaptive Edge-Cloud Collaboration for Efficient Multimodal LLM Inference

arXiv cs.AI · 3d ago Cached

Pro-Router introduces a token-aware progressive model routing method for efficient multimodal LLM inference, leveraging adaptive edge-cloud collaboration to improve throughput and reduce costs.

0 favorites 0 likes
← Back to home

Submit Feedback