Senior Data Engineer
Senior Data Engineer
Agility Robotics
Agility Robotics is seeking a Senior Data Engineer to join their Data Platform team, which focuses on building data infrastructure for humanoid robots operating in human environments. The role involves collaborating with software and hardware teams to manage data for analytics and debugging, ultimately enhancing the performance and reliability of their robots.
Qualification
- Proven experience as a Data Engineer or similar role.
- Strong knowledge of ETL processes and data pipeline development.
- Experience with data processing frameworks such as Spark and orchestration tools like Airflow.
- Familiarity with cloud platforms for data ingestion and processing.
- Ability to work collaboratively across teams and communicate technical concepts effectively.
Responsibility
- Collaborate with robot software and hardware teams to define, collect, and curate data needed for analytics and debugging.
- Develop and maintain ETL pipelines that transform raw robot logs and telemetry into structured datasets using Spark and Airflow.
- Design transformations and author data processing pipelines for reliable and queryable data products.
- Enable engineers to derive insights from telemetry and log data generated by robots in the field.
- Support fleet operations, hardware reliability, and business analytics through effective data management.
