We are now looking for exceptionally dedicated individuals to join our team as LLM Reinforcement Learning Framework Intern! At NVIDIA, we are renowned for our continual progress in the fields of graphics and parallel computing. By joining our Architecture group, you will be part of a dynamic team that is spearheading the AI revolution. This remarkable opportunity will allow you to work on innovative projects that extend the frontiers of GPU technology and AI. What you'll be doing: - Help NVIDIA Nemo RL to be efficiently working under large scale post train workload. - Adopt SOTA RL algorithms to Nemo RL. - Improve RL rollout performance. What we need to see: - Having experience with VeRL, Miles, Slime, or Nemo RL is highly beneficial. - Strong proficiency in programming languages such as Python, C++, or CUDA. - Ambitious approach with a proven track record of taking initiative and delivering results. - Experience with PyTorch, RLHF (Reinforcement Learning with Human Feedback), and LLM training frameworks like FSDP/Megatron LLM is a plus. - Familiarity with agentic RL and inference engine development is preferred. - Pursuing A degree in Computer Science, Engineering, or a related field
Summary
Build and improve NVIDIA Nemo RL for large-scale post-training workloads, adopting state-of-the-art RL algorithms and improving rollout performance. Requires strong Python, C++, or CUDA proficiency; a degree in progress in computer science, engineering, or a related field; PyTorch and RLHF experience preferred.
Responsibilities
Help NVIDIA Nemo RL work efficiently under large scale post train workload; adopt SOTA RL algorithms to Nemo RL; improve RL rollout performance
Qualifications
Experience with VeRL, Miles, Slime, or Nemo RL highly beneficial; strong proficiency in Python, C++, or CUDA; ambitious with initiative; experience with PyTorch, RLHF, FSDP/Megatron LLM plus; familiarity with agentic RL and inference engine development preferred; pursuing degree in CS/Engineering/related field
Education requirements
Pursuing a degree in Computer Science, Engineering, or a related field