Sign In

Stephen Murray

VP Engineering, Cofounder at Starry

Stephen Murray is the VP Engineering and Cofounder at Starry, Inc.1 Based on his LinkedIn profile, he is known for being an extremely talented software engineer and a highly intelligent individual.1 Colleagues describe him as someone who can be trusted to complete tasks effectively.1

While specific details about his role at Starry, Inc. are limited in the provided information, his position as VP Engineering and Cofounder suggests he plays a crucial role in the company's technical leadership and strategic direction.

It's worth noting that Stephen Murray has a LinkedIn username of stephenpmurray, which aligns with the information provided in the query.1

Highlights

Dec 30 · linkedin

I finally can publish the initial release of Mistral-Syndicate-7B, a large language model fine-tuning experiment using a custom AI-synthesized dataset.

https://lnkd.in/eYxh8Mja

It took a couple months of failed experiments, botched training runs, painful dataset curation, and hyperparameter dart throwing, but the experience was valuable.

Since most of the recent deep learning research we've been doing at Starry has been focused on time-series and tabular data related to network operations, I've been doing my best to keep up with the large language model world in my limited discretionary time.

Many of the fundamental concepts are the indeed the same, but the significant differences in training dynamics made the experimentation much more challenging than some of the time-series forecasting/analysis that I've become accustomed to.

This is an instruct fine-tuned variant of the Mistral-7B base model originally released by Mistral.ai. The dataset used in training was synthesized via a "syndicate" of other open language models both of similar parameter size and larger. Each model would generate a response for a given instruction, and the group would vote on which model's response was best. The instruction inputs used for the output label synthesis were a curated subset of VMWare's open-instruct with additional instructions synthesized from scratch.

The results are by no means state-of-the-art, nor were they intended to be, but the model currently beats out many other larger models on the Huggingface leaderboards in several task benchmarks.

The intuition and main lesson here is that transfer learning remains a powerful tool and there are opportunities to use AI in the data augmentation process as well. Model collapse concerns notwithstanding, I think we will see more novel breakthroughs in this area in the near future.

Oct 5 · linkedin

You know we're approaching peak hype cycle when the Financial Times is writing articles about how transformers "work" (and get it so very wrong)

Related Questions

What is Stephen Murray's role at Starry, Inc?
How did Stephen Murray get involved with Starry, Inc?
What are some notable projects Stephen Murray has worked on at Starry, Inc?
What is Stephen Murray's educational background?
How long has Stephen Murray been with Starry, Inc?
Stephen Murray
Stephen Murray, photo 1
Stephen Murray, photo 2
Add to my network

Location

Boston, Massachusetts, United States