Role overview
The Barcelona Supercomputing Center - Centro Nacional de Supercomputación (BSC-CNS) is the leading supercomputing center in Spain. It houses MareNostrum, one of the most powerful supercomputers in Europe, was a founding and hosting member of the former European HPC infrastructure PRACE (Partnership for Advanced Computing in Europe), and is now hosting entity for EuroHPC JU, the Joint Undertaking that leads large-scale investments and HPC provision in Europe. The mission of BSC is to research, develop and manage information technologies in order to facilitate scientific progress. BSC combines HPC service provision and R&D into both computer and computational science (life, earth and engineering sciences) under one roof, and currently has over 1000 staff from 60 countries.
Look at the BSC experience:
BSC-CNS YouTube Channel
Let's stay connected with BSC Folks!
We are particularly interested for this role in the strengths and lived experiences of women and underrepresented groups to help us avoid perpetuating biases and oversights in science and IT research. In instances of equal merit, the incorporation of the under-represented sex will be favoured.
We promote Equity, Diversity and Inclusion, fostering an environment where each and every one of us is appreciated for who we are, regardless of our differences.
If you consider that you do not meet all the requirements, we encourage you to continue applying for the job offer. We value diversity of experiences and skills, and you could bring unique perspectives to our team.
What you'll work on
- Work closely with colleagues on the design and implementation of solutions required to achieve the group’s goals.
- Contribute to the pre-training and post-training of language models, ensuring high-quality and robust performance.
- Deploy models for inference in the most efficient way possible, supporting internal evaluation, synthetic data generation, and experimentation workflows.
- Optimize existing pipelines and workflows, maximizing cluster resource utilization and ensuring scalability.
- Design and propose new research projects, translating innovative ideas into experiments and scientific publications.
- Maintain high standards of code quality, documentation, and reproducibility, enabling the team to build upon previous work effectively.
What we're looking for
- Education
- Master's degree in Computer Science, Mathematics, Machine Learning, or a related technical field.
- Essential Knowledge and Professional Experience
- 5+ years of proven experience in Natural Language Processing projects.
- 5+ years of professional experience in Python development.
- Track record of publications at major AI venues.
- Experience with full training pipelines, not just fine-tuning.
- Advanced knowledge of High Performance Computing (HPC).
- Hands-on experience with one or more of the following tools: PyTorch, Megatron-LM, NeMo, Transformers, vLLM.
- Additional Knowledge and Professional Experience
- Research literacy and the ability to read, reproduce, and extend state-of-the-art papers.
- Basic knowledge of mathematics and statistics applied to Deep Learning.
- Theoretical broad knowledge of Deep Learning techniques.
- Knowledge of HPC workload managers such as Slurm.
- Familiarity with monitoring tools such as Weights & Biases (W&B) or TensorBoard.
- Knowledge of Continuous Integration / Continuous Delivery (e.g. GitHub).
- Hands-on experience with containerization (e.g. Docker and/or Singularity).
- Basic knowledge of other programming languages such as C++, Matlab and/or Java.
- Experience with machine learning libraries, including PyTorch, Tensorflow, Pandas, Scikit-learn and/or Numpy.
- Knowledge of GPU-based computing, including multi-gpu/multi-node parallelization techniques.
- Fluency in spoken and written Catalan, Spanish and English.
- Comfortable working in Linux environments.
- Competences
- Capacity to explore new research lines.
- Good communication and presentation skills.
- Ability to collaborate effectively in team-based environments, including pair programming settings.
Interview process
BSC-CNS is committed to the principles of the Code of Conduct for the Recruitment of Researchers of the European Commission and the Open, Transparent and Merit-based Recruitment principles (OTM-R). This is applied for any potential candidate in all our processes, for example by creating gender-balanced recruitment panels and recognizing career breaks etc.
BSC-CNS is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or any other basis protected by applicable state or local law.
For more information follow this link