Publications

DeepSeek in Practice: From basics to fine-tuning, distillation, agent design, and prompt engineering of open source LLM

Authors: Andy Peng, Alex Strick van Linschoten, Duarte Carmo

Amazon US · Packt Website

Parallelize speculative decoding with P-EAGLE on Amazon SageMaker AI

Authors: Andy Peng, Daniel Quang, Dan Ferguson, Siddharth Shah

Amazon SageMaker AI introduces EAGLE based adaptive speculative decoding to accelerate generative AI inference

Authors: Andy Peng, Kareem Syed-Mohammed, Ram Vegiraju, Vinay Arora, Xu Deng, Siddharth Shah, Johna Liu, Anisha Kolla

Horizontal Auto Scaling in Serverless Containers

Author: Andy Peng

Enabling AWS X-Ray tracing for AWS App Runner service using AWS Copilot CLI

Authors: Yang Wanxian and Andy Peng

Observability for AWS App Runner VPC networking

Author: Andy Peng

Tracing an AWS App Runner service using AWS X-Ray with OpenTelemetry

Author: Andy Peng