Amazon SageMaker announces general availability of a new inference capability that delivers up to ~2x higher throughput while reducing costs by up to ~50% for generative AI models such as Llama 3, Mistral, and Mixtral models. This allows customers to choose from a menu of the latest model optimization techniques, such as speculative decoding, quantization, and compilation, and apply them to their generative AI models. Learn more docs.aws.amazon.com/sagemaker/latest/dg/model-optimize.html Follow AWS OnAir: LinkedIn: bit.ly/AWSOnAir-LinkedIn Twitch: bit.ly/Twitch-AWS-OnAir ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, larges...