Peng, Andy
Builder, Researcher, Technologist, Advisor.

PNW resident. Engineer, researcher, architect, and advisor. Specializing in large-scale distributed systems and cloud computing.
UTL & Intrapreneur. Building basic services. Has managed and led both 0-to-1 innovation and 10x product scaling across diverse verticals: Amazon Bedrock
(SOTA LLM: Claude+OpenAI etc.), S3
, App Runner
(Serverless Compute, Founding engineer & TLM), Fargate, Alexa AI (Healthcare + Conversational AI, Founding engineer of Healthcare domain), Commerce Platform (Scale $110B ARR Bill Run) and cross-product line involvement in SageMaker, Lambda, ECS and Elastic Beanstalk. In charge of multiple company wide privileged and confidential programs. Diverse experience encompassing both technical leadership and people management, including cross-company and multidisciplinary organizations collaborations.
Organizing committee member for top tier conferences (NeurIPS 25 Co-Chair). Program committee member for ICML, KDD, NeurIPS etc., as well as for Non-Profit Organizations like the Linux Foundation and the Cloud Native Computing Foundation (CNCF). Guest lecturer and mentor at the University of Washington’s Foster School of Business.
Research Areas (current): AI + ML, LLM Inference and Optimization, Model Evaluation and Benchmark, Containers, Serverless Compute & Virtualization, Open Source.
Fan of Orca, Pickleball, Seattle Kraken, Seahawk, Kosaku Shima, Lorde, Quentin Tarantino, Herman Melville.
Collecting magnets and mugs.
Be concise, be curious, be real, and building primitives.
[Links]
- University of Washington Foster School of Business Mentor page
- AWS Blog author page
- ICML Program Committee page
- Cloud Native Computing Foundation (CNCF) Ambassador page
- Open Source Summit Program Committee page
- Open Source Summit GenAI & ML Summit Program Committee page
- Seattle Women in Tech Regatta speaker page
News
Selected Publications
-
LLM
-
LLM
-
-
-
-
Service
-
Mentor
- UWash. Foster School of Business Undergraduate; Master of Science programs 2024 academic year
- AWS AI/ML Mentor Scholarship Program 2024
-
Organizing Committee
- NeurIPS 2025, Workshop Co-Chair
-
Program Committee / Reviewer
- NeurIPS 2025, Workshop Deep Learning for Code (DL4C)
- NeurIPS 2025, Position Paper Track
- KDD 2025 Workshop Agentic & GenAI Evaluation
- KDD 2025 Workshop Inference Optimization for GenAI
- ICML (International Conference on Machine Learning) 2025
- ICML (International Conference on Machine Learning) 2025 Workshop FMSD
- ICLR (International Conference on Learning Representations) 2025 Workshop SCI-FM
- KubeCon + CloudNativeCon North America 2025, India 2024, North America 2024, Europe 2024, China 2024, North America 2023, Europe 2023
- PyTorch Con 2025, 2024
- Open Source Summit Korea 2025, India 2025, North America 2025, Europe 2024, China 2024, North America 2024, Europe 2023
- Open Source GenAI & ML Summit Japan 2024, China 2024, Europe 2024
- Southern California Linux Expo 2025, 2024, 2023 (Cloud Native; Open Source AI and Applied Science)
-
Staff
- KubeCon + CloudNativeCon North America 2019 - 2021
- CVPR 2024, NeurIPS 2019
-
Guest Speaker
-
Recruiting Team - Technical Interviewer
- Grace Hopper Celebration 2021, 2020