Suggestions
Paul Watson
Junior Section Club Captain at Somerset West Cricket Club
Highlights
"This is done using a technology called retrieval-augmented generation (RAG), which generates a set of search results that are vectorized, providing an authoritative source to be consulted by the model before it generates a response. The generative LLM is said to have grounded its response in the documents provided by these vectorized search results. In essence, it’s not regurgitating content from the pretrained models but rather reasoning on these source snippets to work out an articulate response based on them."
This is misleading. RAG is a tiny fly on the elephant that is the LLM. RAG influences the LLM probabilities but does not guarantee only content from the authoritative documents are used. The foundational training material that constructed the LLM still plays a large role in the articulated response.
I am getting out of generative AI. The ethics, economics, and application of generative AI technology and the market that has grown around it are largely unconscionable*.
tldr; I am looking for work. I have two days a week available and am known to do productive things with code.
Available language models are based on content theft and slave-wage labour, they are subverting climate change goals, they are biased and damaging in use, and their results and performance are gamed. They have fundamental problems that more digging will not solve.
The genAI industry is sucking all the oxygen out of other technology markets. It is concentrating power in a few corporations. It is infesting all digital technology with untested gewgaws. It is harnessing the best and brightest, and all the rest of us, to questionable ends. It has attracted and rewarded the worst of us.
Some are predicting the crash of this boom but I don't know: Damn it, Jim, I'm a a programmer not a prognosticator.
In other news; I am looking for work. I have two days a week available and am known to do productive things with code. Message me. My other work is for a non-profit that strives day and night to align digital technology to social needs. If you want to do some good then come fund a project with OpenUp (formerly Code for South Africa).
- I have never participated** in an industry that has left me feeling so conflicted. I worked on CaliberAI for nearly 5 years with Neil Brady and an ethical and productive team solving hard problems for embattled journalistic companies. CaliberAI has value and utility but our market was swallowed and then subverted by the rush to generative AI.
** I mostly avoided the previous generation of GPU-spade buyers; blockchain/crypto/web3. I hope to avoid the next GPU-spade buying fad. Nvidia are a dealer, you are their user.
