Python Developer AI Trainer (Model Training Code)
About the role
This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high quality proprietary data. This data serves two main purposes: first, as a basis for fine tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models.
What you'll do
- Design, develop, and maintain efficient, high quality Python code to train and optimize AI models.
- Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
- Familiarity with Python frameworks and libraries
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in Supervised Fine Tuning (SFT), including creating and maintaining high quality, task specific datasets.
- Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
- Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
- Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
- Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
- Collaborate with cross functional teams to improve model performance and contribute to product enhancements.
- Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
Requirements
- 3+ years of strong experience with Python programming language.
- Industry experience and knowledge of code quality, formatting, and best practices of software development
- Experience with Python’s testing ecosystem, including unit, integration, and property based testing.
- Knowledge of multi threading and asynchronous programming in Python.
- Ability to work with architectural patterns and refactor code without introducing regressions.
- Strong debugging skills, including fixing memory and concurrency issues.
- Fluent in conversational and written English communication skills
About Turing
Turing is an AI company based in San Francisco that works with the world's leading AI labs to make their models better at reasoning, coding, languages and more. It also helps businesses build real AI systems, and it works with talent from over 100 countries.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.