Sign In

Anupam Datta

AI@Snowflake, ex-Founder@TruEra, ex-Professor@CMU

Anupam Datta is a Co-Founder, President, and Chief Scientist at TruEra with a rich background in accountable data-driven systems, machine learning, privacy, fairness, compliance, and security.

Anupam Datta was a faculty member at Carnegie Mellon University for 15 years, serving as a Professor and Director of the Accountable Systems Lab.

Datta holds a Ph.D. and M.S. in Computer Science from Stanford University and a B.Tech. in Computer Science from the Indian Institute of Technology, Kharagpur.

He has also been associated with organizations like AI@Snowflake at Snowflake and Stanford University in various roles such as Adjunct Lecturer and Visiting Professor.

Anupam Datta's expertise encompasses multiple fields including accountable data-driven systems, machine learning, privacy, fairness, compliance, and security, making him a prominent figure in the technology and academia sector.

Highlights

Mar 14 · linkedin

Early last year, Shayak Sen and I kicked off an initiative to build out TruEra LLM Evaluation and Monitoring anticipating that while 2023 was the year of experimentation with LLM apps (chatbots, RAGs, agents etc), 2024 would be the year of productionizing these apps, thus necessitating observability across dev and prod.

We started with TruLens -- an open source project for Evaluating and Tracking LLM apps. TruLens is now growing roughly 2.5X MoM with an engaged and active developer community who are seeing significant benefits from rapidly iterating and improving their apps. For example, by integrating TruLens early in the dev cycle, Equinix has seen app metrics, such as relevance and groundedness, improve by up to 50% and iteration time go down from 2 weeks to 2 hours.

TruLens users from this community, especially in enterprises, have been asking for LLM monitoring and evaluation at scale. To serve these needs, we are happy to announce a major upgrade to TruEra LLM Observability. TruLens users only have to add in one line of code to connect their LLM runtime environment to TruEra LLM Observability and get started.

This launch brings together a number of different key developments to provide a rich observability experience to users.

  1. Seamless transition from individual developer to team or enterprise use.
  2. Enterprise-class scalability. 
  3. Easy-to-use collaboration tools and upgraded UX 
  4. Robust monitoring for LLM apps.

See Shayak Sen and my launch blog for more details:

https://lnkd.in/e_hWb-h5

Kudos to the entire TruEra engineering & product team for their fantastic work!

#genai #llmops TruEra

Mar 11 · linkedin

[Generative AI on AWS Meetup, April 15, 9am PT] Join Chris Fregly & Antje Barth (Amazon Web Services (AWS)), Margaret Vo (Anthropic), and me for a sharing session that spans building, evaluating, monitoring GenAI models and apps with Anthropic, TruEra, and Amazon Web Services (AWS) offerings.

Looking forward to it!

#genai #genaiobservability #llms #llmops #llmevals

https://lnkd.in/ggcBJE9W

Anupam Datta
Add to my network

Location

Mountain View, California, United States