Senior Software Engineer, Data Infrastructure
Senior Software Engineer, Data Infrastructure
lmarena
LMArena is seeking a full-time Software Engineer to join their data engineering team, focusing on building data infrastructure for AI evaluation. The role involves designing data pipelines, collaborating with researchers, and ensuring data quality to support the evaluation of AI models. LMArena aims to provide transparent and human-centered AI evaluation, impacting the future of AI development.
Qualification
- Experience in building data pipelines and data infrastructure.
- Strong programming skills in languages such as Python or Java.
- Familiarity with data processing frameworks and tools.
- Understanding of data quality and integrity best practices.
- Ability to collaborate effectively with cross-functional teams.
Responsibility
- Design and build robust data pipelines to ingest, process, and transform user vote data.
- Collaborate with researchers and product leadership to understand product goals and necessary data.
- Design and implement solutions to generate result dashboards and reports.
- Ensure the integrity, data quality, and reliability of the pipelines.
- Scale data infrastructure to accommodate increasing data volumes and evolving analytical needs.
