Sign In

Sandeep Ghael

Director of Machine Learning - LLMs and Generative AI @ Spotify

Sandeep Ghael is a seasoned professional with a strong background in leading R&D teams focusing on LLM and Generative AI experiences at Spotify.

He holds a Master's degree in Electrical Engineering from Stanford University and a Bachelor's degree in the same field from Rice University.

Sandeep has held various key positions in renowned organizations, including being the Former Director of Machine Learning - Generative AI & LLMs at Spotify, Former Sr. Manager of Machine Learning - Content Understanding at Spotify, and Former ML Engineering Manager at Google's Verily NLP Platform.

Prior to these roles, Sandeep Ghael has also served as Machine Learning Manager at Amazon's Alexa Science, Engineering Director, Engineering Manager, and Senior Software Engineer at Localytics, Co-Founder at Active Interview & Ravid, Director of Products and Development at MWM, Senior Product Marketing Specialist at Symantec, DSP / Software Engineer at Cisco Systems, Signal Processing Engineer at Signalworks, Inc., Software Engineer at AuSIM, Inc., Machine Learning Researcher at Gigabeat, and Signal Processing Engineer at Texas Instruments.

Highlights

Apr 18 · linkedin

Early testing of LLaMa 3 (8B) using Ollama versions on a consumer grade gpu (RTX 4090).

It was able to solve "create the snake game in python"! My first attempt failed, but that was using the default q4 quantization. When I moved up to fp16 it nailed it.

Most likely solutions like this appear in the training data, so this may be rote memorization. Even then it's impressive that this was compressed into an 8B-IT model.

Keep in mind, this variant of the model is only instruction tuned, but not fine tuned for code or python.

code produced: https://lnkd.in/ex2j9DwF

#llms, #llama3, #metaai, #genai

Apr 18 · linkedin

If you live with an 8yo, nothing is sacred. This is the expected outcome when you leave your iPad unlocked while reading papers.

Sandeep Ghael
Add to my network

Location

Boston, Massachusetts, United States