Software Engineer, Data Plane

Company: Anyscale
Location: San Francisco
Posted on: November 2, 2024

Job Description:

About Anyscale:At , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like , , , , , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.With Anyscale, we're building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.Proud to be backed by with $250+ million raised to date.Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.About the roleAnyscale is looking for a Software Engineer to join the Infrastructure Dataplane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Dataplane team, we build the scalable, secure, and robust backbone to realize this vision.We are seeking a talented Software Engineer with a strong background in dataplane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing dataplane solutions that power our cutting-edge products.You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.As part of your role, you will

• Design and develop components to manage Ray applications and auxiliary containers running on the dataplane
• Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
• Implement and maintain accelerator support
• Manage and optimize storage, networking, and security aspects of the dataplane
• Handle dependencies and container image management
• Participate in code reviews, design discussions, and architecture planning sessions
• Provide on-call support and collaborate with customer and field teams to troubleshoot dataplane issues
• Work with a team of leading distributed systems and machine learning expertsWe'd love to hear from you if you have
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Hands-on experience building high-performance distributed systems at scale
  • Proficiency in Go and Python
  • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
  • Comprehensive understanding of network protocols and associated tools
  • Ability to work independently and collaboratively in a fast-paced environment
  • Customer-focused mindset with excellent communication skillsBonus
    • Master's degree in Computer Science or related technical field
    • Contributions to open-source projects in dataplane or container technologies
    • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and KubernetesAnyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.Anyscale Inc. is an E-Verify company and you may review theand the
      #J-18808-Ljbffr

Keywords: Anyscale, Tracy , Software Engineer, Data Plane, IT / Software / Systems , San Francisco, California