Software Engineer (Ray Data)
Software Engineer (Ray Data)
Software Engineer (Ray Data)
Anyscale
Anyscale is seeking a Software Engineer for their Ray Data team, which focuses on developing a Python-native data processing engine for AI applications. The role involves improving performance, ensuring efficient scaling, and building data solutions for production workloads in a collaborative environment. Anyscale is backed by significant investors and aims to make distributed computing accessible to developers.
Qualification
- At least 3-4 years of relevant work experience.
- Solid background in building scalable and fault-tolerant distributed systems.
- Experience with data processing and database internals.
- Passionate about large scale systems and performance for AI.
Responsibility
- Improve the performance of Ray Data and multi-modal batch inference use cases.
- Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.
- Build data loading solutions for production training workloads.
- Focus on stability and fault tolerance at high scale.
- Work with customers and AI-native companies to scale their AI workloads.
