Niyama : Breaking the Silos of LLM Inference Serving
Goel et al.
CV
Education
- B.Tech. in Computer Science and Engineering, PES University, 2019
Work experience
- Dec 2020 - Present: Research Engineer
- Microsoft Research India, Bangalore
- Had the opportunity to work with some fantastic managers, including:
- Muthian Sivathanu, ex-Distinguished Scientist, Microsoft Research India
- Bhargav Gulvani, Principal Engineering Manager, Microsoft
- Ram Ramjee, Partner Research Manager, Microsoft Research India
- Jan 2019 - Nov 2020: Research Assistant
- Indian Institute of Science, Bangalore
- Worked on memwalkd , which accelerates key-value stores using page table walkers.
- Supervisor: Prof. Arkaprava Basu
Skills
- Computer systems research and engineering
- GPU programming
- CUDA
- Triton
- Pytorch
- C/C++
- Python
- Distributed systems
- Linux kernel development
- Performance analysis and optimization
- Data structures and algorithms
- Filesystems and storage
- Machine learning