Suggestions
Marcos da Silva Ramos
Senior Software Engineer
Marcos da Silva Ramos is a Senior Software Engineer at Hatch, with over a decade of experience in software engineering, research, and development. He began his career in 2010 and has a strong academic background, having earned a Bachelor's degree in Software Engineering from the Universidade de Brasília, where he studied from 2010 to 2015.123
In addition to his technical expertise, Ramos has a keen interest in distributed systems and high availability applications. His professional journey has included various roles that have contributed to his extensive skill set in software development and engineering.3
Highlights
I've started working with generative #AI about 18 months ago after only reading buzz words all over the place, and... it's been quite a ride! 🚀
After TONS of mistakes and attempts to get good results out of several AI models, here are a few tips for those who are either starting to work with or having difficulties when integrating these tools on their product:
-
🤏 𝐒𝐦𝐚𝐥𝐥𝐞𝐫, 𝐜𝐨𝐧𝐜𝐢𝐬𝐞 𝐩𝐫𝐨𝐦𝐩𝐭𝐬 𝐚𝐫𝐞 𝐚𝐥𝐦𝐨𝐬𝐭 𝐚𝐥𝐰𝐚𝐲𝐬 𝐚 𝐛𝐞𝐭𝐭𝐞𝐫 𝐜𝐡𝐨𝐢𝐜𝐞 𝐨𝐯𝐞𝐫 𝐛𝐢𝐠 𝐩𝐫𝐨𝐦𝐩𝐭𝐬: with current state of AI, a combination of small and super focused AI agents orchestrated by a good old state machine will get you incredible results.
-
💣 𝐃𝐞𝐬𝐢𝐠𝐧 𝐟𝐨𝐫 𝐟𝐚𝐢𝐥𝐮𝐫𝐞: AI will hallucinate, models will change over time and requests will timeout. Always have a fallback (even if hard coded) to gracefully handle these scenarios.
-
🔎 𝐀𝐥𝐰𝐚𝐲𝐬 𝐤𝐞𝐞𝐩 𝐚𝐧 𝐞𝐲𝐞 𝐨𝐧 𝐲𝐨𝐮𝐫 𝐋𝐋𝐌 𝐩𝐫𝐨𝐦𝐩𝐭𝐬, keep track of different versions and changes between them. LLMs are not magical, they're probabilistic, so tiny changes on wording and organization might have a huge impact on the outcome.
The #Elixir language has been proving over and over as an excellent fit for this kind of task . Built-in distribution, native async processes, task supervision along with all the good frameworks in the ecosystem (Oban, Bumblebee etc.) allow me to focus on what is really important: deliver features and value to customers!
My good friend Samuel Pordeus also wrote a little bit about it here: https://lnkd.in/dukatTji
On my personal blog you can read more about Elixir (I'm also planning to write more about AI in the near future, but no promises): https://marcosramos.dev
Peace! ✌
I’m happy to share that I’m starting a new position as Senior Software Engineer at Hatch
