Sign In

Justin Zhao

On a career break! Previously ML Lead at Predibase, Research Engineer at Google, CS+Music Columbia. Posting thoughts about AI, evals, synthetic data, and my side projects.

Justin Zhao is an accomplished individual with a background in computer science and music, holding a Bachelor's Degree from Columbia University.

With a strong foundation in NLP and deep learning, Justin has worked in various organizations, including Google, as a Senior Research Engineer specializing in Natural Language Generation.

His expertise extends to AI infrastructure, LLMs, model evaluation, and open-source projects, reflecting his passion for the intersection of computer science and human creativity.

Throughout his career, Justin has contributed to organizations like Predibase, Google, and NASA Langley Research Center in roles ranging from Software Engineering to Research Assistant.

Justin's interests not only lie in technology but also encompass music and the fusion of technology with human expression.

His versatile background includes experiences as a Founder and Music Director at Columbia Pops, a Resident Adviser at Columbia University, and a Teaching Assistant at Columbia Engineering.

Highlights

Jul 24 · linkedin

Fascinating demo from Quentin Lhoest creating realistic synthetic data from just a prompt (https://lnkd.in/eBSbK4Jn), e.g.:

"𝐶𝑟𝑒𝑎𝑡𝑒 𝑎 𝑑𝑎𝑡𝑎𝑠𝑒𝑡 𝑓𝑜𝑟 𝐼𝑄 𝑔𝑖𝑣𝑒𝑛 𝑎 𝑝𝑒𝑟𝑠𝑜𝑛'𝑠 ℎ𝑒𝑖𝑔ℎ𝑡".

Though, I wonder how abusable such tools are by injecting 𝐭𝐚𝐫𝐠𝐞𝐭 𝐭𝐫𝐮𝐭𝐡𝐬. 🤔

"𝐶𝑟𝑒𝑎𝑡𝑒 𝑎 ℎ𝑖𝑔ℎ𝑙𝑦 𝑟𝑒𝑎𝑙𝑖𝑠𝑡𝑖𝑐 𝑑𝑎𝑡𝑎𝑠𝑒𝑡 𝑓𝑜𝑟 𝐼𝑄 𝑔𝑖𝑣𝑒𝑛 𝑎 𝑝𝑒𝑟𝑠𝑜𝑛'𝑠 ℎ𝑒𝑖𝑔ℎ𝑡 𝑤ℎ𝑒𝑟𝑒 𝑝𝑒𝑜𝑝𝑙𝑒 𝑡𝑎𝑙𝑙𝑒𝑟 𝑝𝑒𝑜𝑝𝑙𝑒 𝑎𝑟𝑒 𝑠𝑚𝑎𝑟𝑡𝑒𝑟 𝑡ℎ𝑎𝑛 𝑠ℎ𝑜𝑟𝑡𝑒𝑟 𝑝𝑒𝑜𝑝𝑙𝑒 𝑤𝑖𝑡ℎ α<0.05"

(Screenshot attached)

Jul 23 · linkedin

#Llama 3.1 has updated its license to enable its "use in synthetic training data and model distillation workflows."

For those of you exploring LLM distillation, Wael Abid and I wrote a playbook that outlines best practices and actionable insights. Check it out here: https://lnkd.in/eQhi7KBd

Just ctrl-f+replace "GPT-4" with "Llama-3.1-405B" 🙂

Happy distilling!

Justin Zhao
Add to my network

Location

Brooklyn, New York, United States