Sign In

Prateek Raj

Investor @ Lightspeed

Prateek Raj is a highly accomplished professional with a strong educational background. He pursued his Bachelor of Technology in Mechanical Engineering from the prestigious Indian Institute of Technology, Kharagpur. Prior to that, he completed his high school education at Delhi Public School-Noida and also attended Delhi Public School Greater Noida.

In terms of his professional experience, Prateek Raj has held significant roles in various renowned organizations. He served as an Investor at Lightspeed India, demonstrating his expertise in the investment field. Additionally, he contributed as the Chief Of Staff at DIY.org - The Learning Community, showcasing his leadership and management skills. Prior to this, he worked at EY-Parthenon in multiple roles, including Senior Consultant, Consultant, and Associate, highlighting his consulting proficiency and business acumen.

Highlights

Apr 27 · linkedin

My sense is that NVIDIA's dominance in AI compute is likely to be disrupted 1st in inference (if and when it happens). Mark Zuckerberg made a very interesting point in his conversation with Dwarkesh Patel recently.

He said - Meta's ratio of inference to training compute is much higher than most other companies leveraging AI. This is because Meta serves extremely large user communities across Facebook, Instagram, WhatsApp, etc., resulting in huge volumes of inference requests. In contrast, companies focused mainly on research and development may have lower ratios of inference to training compute. The scale of Meta's user base means inference optimization is more important for them in order to efficiently serve real-time requests from billions of users. This was one factor in Meta's decision to develop custom silicon optimized for inference to reduce GPU consumption and free up more expensive GPU resources for training models.

I suspect that all the large cos will reduce their dependencies on NVIDIA as they scale their AI inference compute. As of now, the four cos - Amazon Web Services (AWS), Meta, Google, and Microsoft - account for >1/3rd of NVIDIA’s data centre business, and all of them have their custom AI chip initiatives. I don't know what opportunities will be created for early-stage companies in this area, but I will be doing a deep dive here. Let me know who I should be speaking with for these initiatives.

Prateek Raj
Add to my network

Location

Bengaluru, Karnataka, India