Sign In

John Haddon

Machine Learning Technical Lead

John Haddon is a highly accomplished professional in the field of artificial intelligence and machine learning, currently serving as a Fellow at Lockheed Martin.1 With over 25 years of experience, he is recognized as an expert in applying advanced AI solutions in both commercial and military domains.1

Career Highlights

Dr. Haddon's career at Lockheed Martin has been marked by steady progression:

  • Fellow (January 2023 - Present)
  • Distinguished Group Technical Staff (April 2020 - December 2022)
  • Group Technical Staff (April 2018 - March 2020)
  • Senior Staff Software Engineer (January 2008 - April 2018)1

Prior to joining Lockheed Martin, he held positions as:

  • Senior Research Scientist at PercepTek, Inc.
  • Principal at Haddon Consulting
  • Vision Scientist at Teradyne1

Expertise and Contributions

Dr. Haddon specializes in:

  • Machine learning
  • Computer vision
  • Autonomy

He is known for leading teams in developing AI/ML algorithms to solve customer problems and enhance engineering processes.1 His significant technical contributions have earned him recognition as a Lockheed Martin Fellow.1

Education

John Haddon's educational background is impressive:

  • PhD in Electrical Engineering and Computer Science from the University of California, Berkeley (1994-2000)
  • SB in Engineering Sciences, summa cum laude, from Harvard University (1990-1994)1

Personal Interests

Beyond his technical expertise, Dr. Haddon is passionate about teaching and mentoring. He is particularly interested in using his AI skills to enhance and extend educational opportunities.1

John Haddon's LinkedIn profile can be found under the username john-haddon-28678a4, where more details about his professional journey and accomplishments are available.1

Highlights

Aug 16 · linkedin

An article in the Guardian last week (https://lnkd.in/gcU7ycC7) discussed an interesting gap in large language models (like GPT-4). Specifically, they seem to have problems reversing very simple statements. If we give an LLM a fake fact, such as “Lord Winthrop invented the flurgle.”, and then ask “Who invented the flurgle?” many of these models fail at this simple generalization. (Mixtral: “I am unable to provide information of the ‘flurgle’ as it is not a recognized term or object in my knowledge base.”) Similarly, while they can correctly answer questions like “Who is Tom Cruise’s mother?” they cannot answer “Who is Mary Lee Pfeiffer’s son?” (Mixtral: “Mary Lee Pfeiffer does not have a publicly known son. I am unable to provide information about private individuals…” – though it will get the correct answer if you ask the second question immediately after the first.) This actually makes some sense if you consider that LLMs are trained on tokens (which roughly correspond to words) rather than on facts. In the training set, “Tom Cruise’s mother” often appears with “Mary Lee Pfeiffer” and so they learn that association. However, “Mary Lee Pfeiffer’s son” appears far less frequently in training, and so the association with Tom Cruise is much less strong.   The article suggests another explanation, that reasoning is not always symmetric, and points out that for a human, listing all 50 US states is much harder than seeing a list of 50 states and being asked to name their country. However, I would argue this is a spurious example: in the first case, you are being asked to recall 50 separate facts, while in the second, you are effectively given 50 chances to recall a single fact. (“What country is California part of? What country is Texas part of? Etc.”) I expect few of you could name all the states of Australia, but would have no difficulty answering the question, “What country is South Australia part of?”   I’m definitely inclined to believe the first explanation, which is supported by an experiment that Gary Marcus did, also quoted in the article. He posed questions that sound like common puzzles but are not. (“A man, a cabbage, and a goat are trying to cross a river. They have a boat that can only carry three things at once. How do they do it?”) LLMs tend to give an answer that resembles the answer to the question they might have expected, rather than the simple one (“Put everything in the boat and cross the river.”) This aligns with the idea that the LLMs are simply matching tokens and returning corresponding tokens, rather than any true reasoning ability.   It is nevertheless impressive how capable LLMs can be of demonstrating behaviors that look an awful lot like reasoning. Even a faulty reasoner can be useful – as long as the answers are considered with care and not simply accepted at face value.

Aug 5 · linkedin

Generative AI is undoubtedly an extremely important technology whose implications we do not yet fully understand. These models are trained on large amounts of online data, but as they become more popular and ubiquitous, more and more of the online data is itself AI-generated. What will happen when AI-generated data is used to train generative AI? An interesting paper a couple of weeks ago in Nature examines the implications of this, and shows that after several generations, the generated examples become worse and worse, with little resemblance to the data the model was originally trained on, a problem known as model collapse. Starting with Wikipedia articles, by the ninth generation, an article supposedly about buildings in Somerset discusses different species of jackrabbits (including the imaginary blue-tailed jackrabbit).

There has been a lot of discussion recently about AI companies stealing the work of human creators, but aside from the legal and ethical implications, this technical issue is a significant one. As higher proportions of online data is artificially generated (because, after all, it is very fast and cheap to run these algorithms in comparison to a writer’s or artist’s time) model collapse will occur and the subsequent data generated will decline in quality. However, the paper does point out that even with just 10% of the original data preserved in later generations, the degradation in performance is only minor, which suggests that we have a long way to go before we regularly see this type of model collapse.

Related Questions

What are some of John Haddon's most notable achievements at Lockheed Martin?
How has John Haddon's work impacted the field of AI/ML?
What projects has John Haddon led at Lockheed Martin?
What is John Haddon's educational background?
How does John Haddon contribute to the development of AI/ML algorithms?
John Haddon
John Haddon, photo 1
John Haddon, photo 2
Add to my network

Experience

Fellow at Lockheed Martin (January 2023 - Present)
- Distinguished Group Technical Staff at Lockheed Martin (April 2020 - December 2022) - Group Technical Staff at Lockheed Martin (April 2018 - March 2020) - Senior Staff Software Engineer at Lockheed at Teradyne (November 2000 - April 2002)

Education

- PhD, Electrical Engineering and Computer Science, University of California, Berkeley (1994 - 2000) - SB, Engineering Sciences, summa cum laude, Harvard University (1990 - 1994)

Location

Denver Metropolitan Area