Research Intern / Master Thesis Student for Reinforcement Learning in LLM Fine-Tuning (m/f/d)
- Neu
- Veröffentlicht am 15.11.2024
- Abschlussarbeit, Praktikum
Research Intern / Master Thesis Student for Reinforcement Learning in LLM Fine-Tuning (m/f/d)
Huawei's vision is to enrich life through communication. We are a fast growing and leading global information and communications technology (ICT) solutions provider.
Driven by a commitment to operations, ongoing innovation, and open collaboration, we have established a competitive ICT portfolio of end-to-end solutions in Telecom and enterprise networks, Devices and Cloud technology and services.
Huawei is active in more than 170 countries and has over 197,000 employees of which more than 80,000 are engaged in research and development (R&D). With us you have the opportunity to work in a dynamic, multinational environment with more than 150 nationalities worldwide.
Huawei's Munich Research Center is responsible for advanced technology research, architectural development, design and strategic engineering of our products.
The Huawei Artificial Intelligence for Cyber-Security (AI4Sec) Research Team is responsible for forefront research on machine learning algorithms and cyber-security. Our research topics of interest include, but are not limited to, malware analysis, web security and network analytics for advanced threat detection. We also foster AI/ML research for multi-modal representation learning, interpretability, robustness and uncertainty, few-shot learning, reinforcement learning (RL) and large-scale machine learning.
Join us as a:
Research Intern / Master Thesis Student for Reinforcement Learning in LLM Fine-Tuning
We are looking for a highly motivated and skilled Research Intern / Master Thesis Student to join our dynamic team, specializing in distillation and fine-tuning algorithms of generative AI, e.g., Large Language Models (LLMs). This internship offers an exceptional opportunity to contribute to cutting-edge research in the field of artificial intelligence, particularly in down-scaling LLMs and enhancing their task-specific performances (e.g., for code analysis), utilizing supervised and RL-based fine-tuning approaches.
Your mission
- As a member of the AI4Sec team, drive the research and development of the next-generation algorithms for low-level code analysis.
- Active engagement in ongoing research focused on refining fine-tuning and distillation techniques for LLMs within the realm of reinforcement learning.
- Work closely with a group of domain experts and researchers from both Huawei teams (cross Munich and London) and academia from external research communities.
- Publish your findings in the most impactful and relevant academic outlets (i.e., NeurIPS, ICLR, ACL, AAAI or IEEE S&P).
Your areas of expertise
- Currently enrolled in a Master's or PhD program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.
- Solid understanding and hands-on experience with transformers/LLMs and other advanced AI/ML models. Familiarity with PPO, RLHF or Knowledge Distillation is an advantage.
- Strong foundation in the mathematical principles of learning, including but not limited to statistics, probability, linear algebra, and calculus.
- Proven ability to conduct independent research and problem-solving skills in the field of AI and machine learning.
- Proficient in programming languages commonly used in AI research such as Python, and familiar with AI/ML frameworks like JAX or PyTorch.
- Excellent communication skills, with the ability to present complex technical information clearly and concisely.
- Demonstrated ability to work collaboratively in a team environment and to engage with external research communities.
By applying to this position, you agree with our Recruitment Privacy Statement. You can read in full our privacy policy here.
Your rewards of working here
- Our culture is characterized by innovative power and team spirit as well as the intensive exchange of knowledge and experience within our global network.
- We offer healthy meals ranging from traditional Chinese to western delicacies in our famous company canteen.
- To keep your development ongoing, you will find a broad range of training opportunities. Many online and face-to-face training programs incl. language courses in German and Mandarin.
- Our diverse and welcoming environment is shaped by different backgrounds and around 40 individual nationalities.
- Self-responsible work in a competent, motivated and constantly growing team.
Please send your application and CV (incl. cover letter and reference letters) in English.
Huawei is a leading global information and communications technology (ICT) solutions provider. Driven by a commitment to operations, ongoing innovation, and open collaboration, we have established a competitive ICT portfolio of end-to-end solutions in Telecom and enterprise networks, Devices and Cloud technology and services. Our ICT solutions, products and services are used in more than 170 countries and regions, serving over one-third of the world's population. With 197,000 employees, Huawei is committed to develop the future information society and build a Better Connected World.