Annotations Business Analyst, Community Feedback Annotation Team at Amazon

• Amazon is looking for a Business Analyst based in Cape Town with experience working to deliver annotated training and evaluation data to train AI models, who will have responsibility to assess the output produced by human in the loop annotators and ML models assessing the quality and provide helpful insights to science teams to improve ML models. Our mission is to employ a leader of leaders who is able to empower, develop and grow their team and to support them in achieving our organizational goals.
• The role will require you to be a leader who prioritizes supporting their team and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces.
• The ideal business analyst ensures that the teams priorities and tasks are aligned to supporting the delivery of high quality labeled/annotated data to support the delivery of ML AI model experiences. To achieve this, an ideal Business Analyst coaches, develops and supports the team to build a work environment where annotators are engaged and feel a positive sense of achievement about their role in delivering world class data.
• You will also be responsible for producing reports that show the quality assessments completed by your team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and business teams.

Key job responsibilities
Leadership

• Knows and communicates the Amazon mission, vision and strategy
• Demonstrates passion for delivering a positive customer experience, and maintain composure in difficult situations
• Demonstrates the ability to give overall direction, performance, coordination and evaluation
• Experience interviewing and selecting people who will maintain a high-performance bar in Amazon
• Strong interpersonal and communication skills, good listener, used to interact with up to Director level
• Positive communicator who understands when necessary how to have tough conversations
• Ability to confidently facilitate team discussions and communicate business messages
• Maintains a high level of professionalism and approachability
• Can adapt well to changing circumstances, direction, and strategy
• Ability to organize, prioritize and schedule work assignments
• Proven ability to manage reporting, data manipulation and analysis
• Experience managing core business KPI’s
• Assist in developing and implementing training programs to improve the quality and productivity of the team

Operational Delivery

• Understands operational principles of service delivery and uses data to support continuous improvement
• Ability to use data and insights to prepare metric reviews
• Acts as the operational representative for business teams to understand voice of the partner in key process or policy changes
• Builds plans to test and experiment new approaches to service delivery

Continuous Improvement

• Uses data to identify areas of ongoing improvement in how service is delivered
• Guideline Development: Collaborate with the annotation team and linguistic experts to refine and develop annotation guidelines, taking into consideration different language nuances, linguistic phenomena, and use cases.
• Feedback Loop: Continuously communicate with the model development team to provide insights and observations regarding annotation challenges, linguistic subtleties, and potential improvements for the language model's performance.
• Data Integrity: Ensure the accuracy and integrity of the annotated data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanliness.
• Collaboration: Work closely with other annotation team members, data scientists, and linguists to ensure effective collaboration and knowledge sharing, contributing to a positive and productive work environment.
• Adaptation: Keep up-to-date with the latest linguistic trends, developments, and emerging language phenomena to adapt annotation strategies and guidelines accordingly.

Basic Qualifications

• Business Analyst with experience working to deliver annotated training and evaluation data to train AI models. Experience working with large data and Quicksights dashboards (building and modification).

Preferred Qualifications

• Experience working with ASW S3 buckets and data input and output workflows.