Sign In

Paul Watson

Junior Section Club Captain at Somerset West Cricket Club

Highlights

Aug 29 · linkedin

"This is done using a technology called retrieval-augmented generation (RAG), which generates a set of search results that are vectorized, providing an authoritative source to be consulted by the model before it generates a response. The generative LLM is said to have grounded its response in the documents provided by these vectorized search results. In essence, it’s not regurgitating content from the pretrained models but rather reasoning on these source snippets to work out an articulate response based on them."

This is misleading. RAG is a tiny fly on the elephant that is the LLM. RAG influences the LLM probabilities but does not guarantee only content from the authoritative documents are used. The foundational training material that constructed the LLM still plays a large role in the articulated response.

Aug 29 · linkedin

I am getting out of generative AI. The ethics, economics, and application of generative AI technology and the market that has grown around it are largely unconscionable*.

tldr; I am looking for work. I have two days a week available and am known to do productive things with code.

Available language models are based on content theft and slave-wage labour, they are subverting climate change goals, they are biased and damaging in use, and their results and performance are gamed. They have fundamental problems that more digging will not solve.

The genAI industry is sucking all the oxygen out of other technology markets. It is concentrating power in a few corporations. It is infesting all digital technology with untested gewgaws. It is harnessing the best and brightest, and all the rest of us, to questionable ends. It has attracted and rewarded the worst of us.

Some are predicting the crash of this boom but I don't know: Damn it, Jim, I'm a a programmer not a prognosticator.

In other news; I am looking for work. I have two days a week available and am known to do productive things with code. Message me. My other work is for a non-profit that strives day and night to align digital technology to social needs. If you want to do some good then come fund a project with OpenUp (formerly Code for South Africa).

  • I have never participated** in an industry that has left me feeling so conflicted. I worked on CaliberAI for nearly 5 years with Neil Brady and an ethical and productive team solving hard problems for embattled journalistic companies. CaliberAI has value and utility but our market was swallowed and then subverted by the rush to generative AI.

** I mostly avoided the previous generation of GPU-spade buyers; blockchain/crypto/web3. I hope to avoid the next GPU-spade buying fad. Nvidia are a dealer, you are their user.

Related Questions

What is Paul Watson's role at Somerset Strikers Cricket Club?
How did Paul Watson transition from Greenpeace to Sea Shepherd?
What are some of Paul Watson's notable achievements in marine conservation?
What is the Captain Paul Watson Foundation's main mission?
How has Paul Watson's work influenced environmental activism?
Paul Watson
Add to my network

Experience

Consultant at Digital Reach Group
Developer at Global Business Register Ltd

Education

Computer Programming

Location

City Of Cape Town, Western Cape, South Africa