Rufus and Alexa Shopping Operations strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging cutting-edge technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide. Program Manager (PM) in OPTIMA Programs Org has to work on defined projects with limited guidance. PM will apply project-management best practices to make the process more efficient and facilitate delivery. PM should be able to assign individual responsibilities, develop appropriate milestones and launch schedules to ensure timely and successful delivery of a project. The PM works backward starting with customers, stakeholders, and any related team owners and work to understand their needs/problem(s) and incorporate their context into project plans. PM negotiates process improvements and needed features (and their priority), distinguishing between important and urgent, accordingly establish milestones and drive sensible deadlines. PM manages project communications like weekly/monthly flashes and may serve as the first point of contact for OPTIMA projects. PM runs effective meetings and is able to dive deeply into details as easily as conveying high-level plans. PM’s verbal and written style are clear and concise. A PM should be able to transform raw thoughts into clear documentation and requirements (e.g., project charter, requirements documentation, responsibility matrix, UAT summary, implementation approach, reporting, etc.)
Key job responsibilities
- Manage HiTL(Human in The Loop) annotation tooling roadmap and periodically collect new requirements from internal customers through workshops, stakeholder discussions, voice of customer sessions etc.
- Work closely with Operations and Software development teams to improve tools, processes and reporting dashboards.
- Drive the roadmap prioritization discussions across stakeholder groups, Ops sites, tech teams etc.
- Enabling flawless launch and adoption of new features for Operations team and other internal customers through pre planned change management activities.
- Ensuring adherence to new feature launch mechanism and highlight any exception on timely basis.
- Keeping the cross functional team (CFT) updated about the projects and progress through weekly/monthly flashes and proactive communication management tools.
- Work with Privacy team to plan periodic compliance activities and ensure OPTIMA’s platforms are compliant with Privacy policies.
- Maintaining WBS (Work breakdown structure) for each project and tracking the action items closely and proactively escalate the risks foreseen (tech and non tech) to drive mitigation.
- Maintaining clear documentation of project files like business requirements, UAT summary, agreements, MoMs etc. and use them to resolve disputes.
- Working closely with Ops PoCs in triaging UAT issues, adoption issues and any tooling related blockers.
A day in the life
- Daily Stand-Ups: Facilitate quick team meetings to discuss progress, plans, and blockers.
- Requirements Alignment: Collaborate with business analysts to ensure project requirements meet stakeholder expectations.
- UAT Planning: Lead discussions on User Acceptance Testing strategies, timelines, and success criteria.
- Stakeholder Engagement: Present project status updates and facilitate GO/NO GO decisions.
- Risk Management: Identify and assess risks, developing mitigation strategies with the project team.
- Team Coordination: Work closely with development and testing teams to prioritize tasks and address challenges.
- Documentation: Maintain current project documentation and prepare status reports for stakeholders.
- 3+ years of program or project management experience
- 3+ years of working cross functionally with tech and non-tech teams experience
- 3+ years of defining and implementing process improvement initiatives using data and metrics experience
- Bachelor's degree
- Knowledge of Excel (Pivot Tables, VLookUps) at an advanced level and SQL
- Experience defining program requirements and using data and metrics to determine improvements
- 3+ years of driving end to end delivery, and communicating results to senior leadership experience
- 3+ years of driving process improvements experience
- Experience in stakeholder management, dealing with multiple stakeholders at varied levels of the organization
- Experience building processes, project management, and schedules