Michael Yang

Senior Software Engineer — AI Tools and Security

• Working on AI Tools and Security

Software Engineer — Core Compute Infrastructure

• Implemented support for cheaper instances across Kubernetes services to save up to $300K in annual infrastructure cost

Software Development Engineer II — Amazon Bedrock Guardrails

• Built the initial architecture and implementation of the primary ApplyGuardrail API and underlying service handling 500+ req/s and 1,000+ daily users
• Designed and implemented guardrails features processing over 100,000 text characters/second; helped shape product direction for image modality support
• Designed and delivered backend architecture split and live migration with no downtime; reduced API faults by 20+ per week
• Integrated guardrails with Amazon Bedrock LLM inference APIs for seamless input/output filtering including streaming
• Built internal fault analysis tool that streamlined operational review and reduced oncall load by 10% each week
• Mentored multiple junior engineers throughout various projects

Software Development Engineer I — Amazon Lex

• Optimized EC2 fleet hosting ASR models resulting in 60% host count reduction and $10M saved per month
• Designed an EC2 scaling system using Step Functions to optimize compute fleet size based on customer usage
• Developed a Docker benchmarking tool to unify accuracy evaluation for engineering and science teams
• Built annotation workflow to analyze customer audio traffic and generate accuracy metrics
• Compiled accuracy report reviewed by senior leadership that helped drive model architecture upgrade

Software Development Engineer Intern — Amazon Lex

• Developed a UI using TypeScript and React to submit and manage annotation jobs
• Improved backend Java service to optimize the number of API calls the UI made