'I’ve been fooled': Reddit consumer endures the roasting of a lifetime after asking the right way to obtain a 487MB guide they labored on with ChatGPT for over 2 weeks
A Reddit poster going by Emotional_Stranger_5 says they spent 16 days working with ChatGPT on an illustrated youngsters’s guide meant as a present for a gaggle of native youngsters. Believing that the chatbot had been invisibly toiling away creating 700 illustrated pages, they turned to the OpenAI subreddit to ask the right way to obtain the finished doc.
The poster did obtain the useful recommendation they have been on the lookout for, however solely after being roasted to a crisp.
ChatGPT had solely been telling Emotional_Stranger_5 that it had been constructing a 700 web page tome. The eager-to-help tone of enormous language fashions does not replicate precise intent or the long-term “reminiscence” required to generate outputs over a span of days or even weeks. Nothing past the output we see exists, at the very least in typical chatbot designs, and there was no guide to obtain.
For quite a few posters within the thread, Emotional_Stranger_5 acquired due comeuppance for attempting to supply AI slop for teenagers, although the pissed off bookmaker clarified that they’d not requested ChatGPT to jot down a guide from scratch. They mentioned that they personally spent two-and-a-half months adapting tales from Indian mythology and wished ChatGPT to enhance the circulation of their writing and generate illustrations.
One complicated facet of the consumer’s plight is the variety of pages concerned. Who would really feel the necessity to produce a customized 700-page guide for kids and the way may they write that a lot in below three months? My greatest guess is that ChatGPT merely promised 700 pages as a result of it is a quantity that exists, and never as a result of there have been actually 700 pages price of fabric.
To see how probably it’s that somebody actually spent two weeks believing that ChatGPT was cooking up a guide it wasn’t, I requested the bot to supply an illustrated model of Moby-Dick. It affected the tone of a cheerful undertaking supervisor, and laid out the whole lot it wanted from me, together with the guide’s textual content, model directions, and a most well-liked output format.
I uploaded the textual content of Moby-Dick, which is within the public area, and the chatbot produced a “pattern web page” with placeholder textual content the place photographs would go. I used to be in a position to obtain that web page as a PDF, however when it got here time to generate “the total whimsical illustrated version of Moby-Dick,” the bot prevented the duty, asking follow-up questions on my preferences and telling me that “superior PDF technology instruments are quickly unavailable” however that I may type out extra particulars whereas I waited.
I used to be shocked by how straightforward it nonetheless is to get a chatbot right into a BS loop. It is doable Open AI’s new “agentic” AI could possibly be extra able to this kind of long-term process, although CEO Sam Altman has warned that it is “leading edge and experimental.”
In terms of interacting with ChatGPT, Emotional_Stranger_5 says they’ve realized their lesson and can use it to format and illustrate their guide undertaking one web page at a time, trusting solely that it has produced a file after it is really delivered it.
“I settle for that I used to be fooled,” they wrote. “However it was my first expertise with AI and regardless that [it] turned out to be a steep studying curve, I’m blissful I didn’t waste months on it. Due to all of you who made me realise this rapidly and saved time and heartbreak for me.”
A number of posters instructed—with various levels of derisiveness—that Emotional_Stranger_5 realized the flawed lesson from the incident, and that to create a significant reward, they need to cease utilizing ChatGPT and work on their private writing expertise.
“I believe I’m not a author. Not an expert one. Not planning to be,” Emotional_Stranger_5 mentioned of their protection. “It is only a assortment of tales for underprivileged youngsters round me … The children are nice and I wished them to have one thing that they will maintain on to for a very long time.”
It is curious that somebody can apparently spend over two months writing modernized variations of myths after which say (in writing no much less) that they are not a author. You’d anticipate such a non-writer to easily have bought some youngsters’s books, which I am fairly certain can be cheaper than printing and binding two dozen 700-page, absolutely illustrated books.
Unusual days. LLMs are handled like eccentric wizards who will free us from our human limitations, however they certain are not advancing previous their very own unique limitations. In the meantime, the chatbot customers I’ve encountered do appear bold, however on the identical time are satisfied they’ve limitations that they do not.
I am digressing into bathe ideas territory right here, but when I have been backing LLMs, I would be a bit frightened by how a lot of their direct-to-consumer moneymaking already appears to depend on the dodgiest actions the tech allows: looking for shortcuts to creativity, dishonest in class, taping collectively shoddy software program, receiving unlicensed “remedy,” and getting hooked on simulated erotic relationships. All whereas the bots are nonetheless complicated prospects by BSing them as a result of that is perhaps an unfixable drawback.
Possibly it is unrealistic to anticipate new tech to begin life as a shining instance of our highest beliefs, however even only a convincing LLM videogame NPC appears distant or unimaginable, and it isn’t an absurd ask from an trade that likes to assert that that is the ticket to “tremendous intelligence.” (And we’re virtually there, proper?)
To bookend this put up with Star Trek references, you may get an LLM to play the Moriarty to your Sherlock Holmes, however if you happen to challenged the legal mastermind to a recreation of chess, there is a respectable probability he’d change into confused about which piece is which and beg to begin over.