Data Annotation Project Manager
⚲ Warszawa, Wola
Do uzgodnienia
Wymagania
- Machine Learning
- Data Annotation
- Statistics
Opis stanowiska
Nasze wymagania:
Demonstrated ability to manage data annotation projects across multiple teams, building sustainable processes, coordinating release schedules and building consensus on difficult issues
Practical knowledge of data annotation and quality assurance methods
Good understanding of machine learning concepts, tasks, and metrics
Understanding of statistical concepts applicable to data annotation tasks
Strong verbal and written communication skills in Polish and English
Demonstrated experience of managing annotation guidelines
High attention to detail and demonstrated commitment to data accuracy
High organizational skills, strengths in problem solving, issue-resolution, ability to work in a deadline-driven work environment
Proficiency in standard workflow software (JIRA, Excel, etc.)
Mile widziane:
Degree in Linguistics or STEM related fields
Demonstrated ability to use metrics to back up assumptions and evaluate research or business outcomes e.g. peer-reviewed scientific publications
Basic knowledge of scripting languages, regular expressions, github and coding agents for data processing and workflow automation
O projekcie:
As a Data Annotation Project Manager you will play a vital role in leveraging the potential of AI technology in Allegro by enabling business, technology and research teams to secure and maintain high-quality annotated datasets and eval pipelines.
You will own the end-to-end lifecycle of high-quality data acquisition, annotation and curation to power our AI and ML models. Sitting at the intersection of engineering, product and vendor operations, you will manage project budgets, design domain taxonomies and establish evaluation benchmarks alongside ML engineers and product leaders. By leveraging GenAI tools, LLM-as-a-judge frameworks and process automation, you will streamline labeling workflows, maintain data governance policies and drive scalable dataset curation across the organization.
Zakres obowiązków:
Own the annotation pipelines from raw to annotated ground truth datasets which satisfy both technical and operational constraints
Work with data from multiple sources and domains, such as text, images, and structured datasets in multiple languages.
Cooperate closely with Product Managers and Tech Leaders across the organization to understand business needs, collect requirements for new annotation pipelines and allocate resources (budgets, subject domain experts)
Prepare and improve guidelines by gathering feedback, analyzing annotations and quality/efficiency metrics.
Implement and improve quality assurance processes for data annotation pipelines, optimizing both cost and quality of delivered datasets
Analyze annotated datasets, ensuring their high quality, finding potential biases and risks in using them for training ML models
Dive into the details including occasionally annotating data yourself, providing feedback for existing tools and proposing new features
Oferujemy:
Flexible working hours in the hybrid model (4 days in the office / 1 day remote) - working hours start between 7:00 a.m. and 10:00 a.m. We also have 30 days of occasional remote work.
Long term discretionary incentive plan based on Allegro.eu shares (restricted stock units).
Annual bonus based on your annual performance and company results.
Well-located offices (with e.g. fully equipped kitchens, bicycle parking, terraces full of greenery) and excellent work tools (e.g., raised desks, ergonomic chairs, interactive conference rooms).
A 16" or 14" MacBook Pro or corresponding Dell with Windows (if you don't like Macs) and all the necessary accessories.
A wide selection of fringe benefits in a cafeteria plan - you choose what you like (e.g., medical, sports or lunch packages, insurance, purchase vouchers).
English classes that we pay for related to the specific nature of your job.
A training budget, inter-team tourism (see more here), hackathons, and an internal learning platform where you will find multiple trainings.
An additional day off for volunteering, which you can use alone, with a team, or with a larger group of people connected by a common goal.
Social events for Allegro people - Spin Kilometers, Family Day, Fat Thursday, Advent of Code, and many other occasions we enjoy.
Demonstrated ability to manage data annotation projects across multiple teams, building sustainable processes, coordinating release schedules and building consensus on difficult issues
Practical knowledge of data annotation and quality assurance methods
Good understanding of machine learning concepts, tasks, and metrics
Understanding of statistical concepts applicable to data annotation tasks
Strong verbal and written communication skills in Polish and English
Demonstrated experience of managing annotation guidelines
High attention to detail and demonstrated commitment to data accuracy
High organizational skills, strengths in problem solving, issue-resolution, ability to work in a deadline-driven work environment
Proficiency in standard workflow software (JIRA, Excel, etc.)
Mile widziane:
Degree in Linguistics or STEM related fields
Demonstrated ability to use metrics to back up assumptions and evaluate research or business outcomes e.g. peer-reviewed scientific publications
Basic knowledge of scripting languages, regular expressions, github and coding agents for data processing and workflow automation
O projekcie:
As a Data Annotation Project Manager you will play a vital role in leveraging the potential of AI technology in Allegro by enabling business, technology and research teams to secure and maintain high-quality annotated datasets and eval pipelines.
You will own the end-to-end lifecycle of high-quality data acquisition, annotation and curation to power our AI and ML models. Sitting at the intersection of engineering, product and vendor operations, you will manage project budgets, design domain taxonomies and establish evaluation benchmarks alongside ML engineers and product leaders. By leveraging GenAI tools, LLM-as-a-judge frameworks and process automation, you will streamline labeling workflows, maintain data governance policies and drive scalable dataset curation across the organization.
Zakres obowiązków:
Own the annotation pipelines from raw to annotated ground truth datasets which satisfy both technical and operational constraints
Work with data from multiple sources and domains, such as text, images, and structured datasets in multiple languages.
Cooperate closely with Product Managers and Tech Leaders across the organization to understand business needs, collect requirements for new annotation pipelines and allocate resources (budgets, subject domain experts)
Prepare and improve guidelines by gathering feedback, analyzing annotations and quality/efficiency metrics.
Implement and improve quality assurance processes for data annotation pipelines, optimizing both cost and quality of delivered datasets
Analyze annotated datasets, ensuring their high quality, finding potential biases and risks in using them for training ML models
Dive into the details including occasionally annotating data yourself, providing feedback for existing tools and proposing new features
Oferujemy:
Flexible working hours in the hybrid model (4 days in the office / 1 day remote) - working hours start between 7:00 a.m. and 10:00 a.m. We also have 30 days of occasional remote work.
Long term discretionary incentive plan based on Allegro.eu shares (restricted stock units).
Annual bonus based on your annual performance and company results.
Well-located offices (with e.g. fully equipped kitchens, bicycle parking, terraces full of greenery) and excellent work tools (e.g., raised desks, ergonomic chairs, interactive conference rooms).
A 16" or 14" MacBook Pro or corresponding Dell with Windows (if you don't like Macs) and all the necessary accessories.
A wide selection of fringe benefits in a cafeteria plan - you choose what you like (e.g., medical, sports or lunch packages, insurance, purchase vouchers).
English classes that we pay for related to the specific nature of your job.
A training budget, inter-team tourism (see more here), hackathons, and an internal learning platform where you will find multiple trainings.
An additional day off for volunteering, which you can use alone, with a team, or with a larger group of people connected by a common goal.
Social events for Allegro people - Spin Kilometers, Family Day, Fat Thursday, Advent of Code, and many other occasions we enjoy.
🔍 Dekoder Ogłoszenia
🔴
ability to work in a deadline-driven work environment
Praca pod presją terminów — możliwe częste nadgodziny i stres
🟡
building consensus on difficult issues
Konfliktowe sytuacje między zespołami i konieczność mediacji — może być obciążające