← Back to home
mar 3

"if models and agents are so smart and capable, why then do they fail at simple workflows?"

being a human, if im dumber and am still able to do all these tasks, why then can't a "double my IQ machine that knows everything" do the same task as good as me? i've come across this question quite a few times whilst talking to both skeptics and people who are genuinely curious and its honestly the right question to ask. to answer that question, let's dive into our day 1s of a new internship. what does that look like usually? besides the ppt of your hobbies and favorite food to eat ofc - you get a laptop - you get n different accesses - you get a few KTs - you get to work on a small problem statement - you get your work verified - you get a bigger problem statement, hopefully more autonomy and so on - you get feedback and constant advice how then do you expect an agent or model to do the same task as you without providing all of these things? nO buT i wroTe a goOd proMpt so if someone just wrote a very good problem statement and direction of solution, you'd be able to do your job well without your laptop, access, KTs, reviews? obviously, the things that we need and the agents need aren't the same so what do they need? - you need a laptop, they need a harness(an environment where the agent can run) - you get n different accesses, they need tools and API keys to those pieces of software - you get a few KTs, they need a prompt and a few good examples - you get to work on a small problems, they need to be tested locally on small problems - you get your work verified, they need to have verification rules and loops in place - you get a bigger problem statement, they need to be pushed to production - you get feedback and advice, they need to be iterated on or provided a way for them to iterate on themselves based on a review process you get the idea. instruction and knowledge work isn't here to stay. judgement is. empathy is. care is. connection is. if an intern can do it so can your agent. you just need to give the same environment the intern would get to the agent and voila, you will see the magic. i get that we are all scared, i am too but nothing good really comes out of worrying about something which is inevitably gonna happen. we can just ride the wave together and hopefully come of out stronger, smarter and more agentic. that's all nerds. hit me up if you need help w anything.
loading comments...