Member of Technical Staff, Research Engineer (Inference)

Company: Tbwa Chiat/Day Inc
Location: Palo Alto
Posted on: November 10, 2024

Job Description:

About the Role
Member of Technical Staff, Research Engineer (Inference)
As part of Inflection's commitment to deploying high-performance models for enterprise applications, our inference team ensures that these models run efficiently and effectively in real-world scenarios. Research engineers in this role focus on optimizing model inference processes, reducing latency, and improving throughput without compromising model performance, ensuring robust deployment in enterprise environments.
This is a good role for you if you:

• 
  
• Have experience with deploying and optimizing LLMs for inference, both in cloud and on-prem environments.
  
• Are adept at using tools and frameworks for model optimization and acceleration, such as ONNX, TensorRT, or TVM.
  
• Enjoy troubleshooting and solving complex problems related to model performance and scaling.
  
• Have a deep understanding of the trade-offs involved in model inference, including hardware constraints and real-time processing requirements.
  
• Are proficient with PyTorch and familiar with infrastructure management tools like Docker and Kubernetes for deploying inference pipelines.
  
  Employee Pay Disclosures
  At Inflection AI, we aim to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contributions to the company. For this role, Inflection AI estimates a starting annual base salary will fall in the range of approximately $200,000 - $350,000. This estimate can vary based on the factors described above, so the actual starting annual base salary may be above or below this range.
  
  #J-18808-Ljbffr

Keywords: Tbwa Chiat/Day Inc, Tracy , Member of Technical Staff, Research Engineer (Inference), Engineering , Palo Alto, California