Christopher Robin was lying on the rug one afternoon, being so still that it looked as if he were practising being an Afternoon Place all by himself.

“What are you doing?” I asked.

“I’m keeping the afternoon,” said Christopher Robin. “If you move about too much, you use it up.”

Pooh, who was sitting nearby in the thoughtful way he has (which is to say he was thinking of honey), said, “If you want to keep an afternoon, you ought to save it.”

“Save it where?” asked Christopher Robin.

“In a jar,” said Pooh, as if this settled it.

Christopher Robin looked at me.

“Pooh once tried,” I said. “And it was on a gold-coloured afternoon by the stream.”

It was a sleepy, gold-coloured afternoon in the Hundred Acre Wood, the sort which makes you talk in quieter voices so as not to wake it. The sunshine lay in patches, and the shadows lay in patches, and down by the stream the water went on doing nothing in particular, and doing it beautifully.

Pooh and Piglet were sitting on the bank, with their legs in the long grass and their thoughts in the stream.

“Piglet,” said Pooh at last.

“Yes, Pooh?” squeaked Piglet.

“Do you ever feel,” said Pooh, “as if you have used up an afternoon?”

“Used it up?” said Piglet, staring at the sunshine.

“Like honey,” said Pooh. “I have been sitting, and thinking, and doing a little hum. And suddenly it came to me—what if I have used most of it up already, and later you want an afternoon, and there isn’t any left for you?”

Piglet’s ears drooped.

“Oh, Pooh,” he said.

“So we must save some,” said Pooh, standing up. “In a jar.”

“Have you got a jar?” he asked.

Piglet had a Very Small Pot which once had something in it and now only had the memory of it, but Piglet knew at once that Pooh was thinking of something bigger.

“I think,” said Piglet, “that I have only a small one.”

“Then we must use mine,” said Pooh. “I have a Very Good Jar at home. It has been used for Saving before.”

Piglet felt hopeful.

“What did you save in it?” he asked.

Pooh smiled the dreamy smile of a bear who has met honey.

“Honey,” he said.

So Pooh fetched his Very Good Jar from home. It had lately been full of honey, so Pooh made it Very Empty in the quickest way he knew, screwed on the lid importantly, and hurried back with Piglet before the afternoon could wander off.

Back by the stream, Pooh took off the lid and looked into the jar as if he expected to see the afternoon sitting at the bottom, waiting politely.

“It isn’t in yet,” said Piglet.

“No,” said Pooh. “We have to put it in. With the sunniest-looking things.”

Then Pooh said, “Saving works better if you have Rules,” because Pooh has always noticed that honey lasts longer if you decide it is not for eating all at once.

So Pooh made up some Rules, and because Piglet likes to know what is going to happen, he listened very carefully.

POOH’S RULES FOR SAVING AN AFTERNOON

1. FIND A VERY GOOD JAR.
2. PUT IN THE SUNNIEST-LOOKING THINGS FIRST.
3. DO NOT FORGET THE QUIET.
4. IF IT DOESN’T WANT TO BE SHUT, DO NOT ARGUE WITH IT.

So they began.

Buttercups and dandelions were everywhere, looking as if they had been practising being sunshine. Pooh filled the jar with buttercups first, then dandelions, while Piglet held it steady and tried to look as if he had saved afternoons before.

When the jar was half-full of yellow, Pooh stopped to hum, because yellow things always make Pooh remember how songs go.

Afternoon, Afternoon, golden and slow,
I should like to keep you, in case you should go.
Buttercups and dandelions, yellow as can be,
Leaf that says “Cheer up!”—come and sit with me.
If you won’t stay in a jar, then perhaps you’ll agree.
To stay on the grass, and be an Afternoon for three.

“That is a very good hum,” said Piglet.

“Yes,” said Pooh modestly. “It came from the yellow.”

Then Pooh found a leaf so yellow that it seemed to be saying “Cheer up!” all by itself. “Piglet,” he said, “this is an Extremely Encouraging yellow leaf,” and he put it on top where it could encourage everything properly.

“Now,” said Pooh, holding up the jar, “we have saved a good deal of afternoon.”

Piglet peered in.

It was very yellow. It was almost as yellow as the afternoon itself. But Pooh’s face still had that worried look, as if he could hear the afternoon ticking away somewhere behind the trees.

“It is not quite afternoon enough,” he said.

“Not enough?” squeaked Piglet. “But it is full of yellow.”

Pooh shook his head slowly.

“Afternoon is not only yellow,” said Pooh. “It is also a sort of Quiet.”

Piglet did not know how you put Quiet into a jar, but Pooh tried by adding more yellow.

He put in more buttercups. Then more dandelions. Then a few more, because the jar still did not feel afternoon enough to him. Soon it was so full that the Extremely Encouraging leaf had to sit on top like a hat.

“Now,” said Pooh, “I shall shut it very carefully.”

He pressed the lid down with both paws.

This time the lid almost caught, and the jar made a small squeak, and then—because dandelions are not the sort of thing to be shut up without making remarks — there was a sudden puff of white fluff.

The dandelion seeds flew out and floated away on the air in a hundred tiny parachutes, drifting over the stream as if the afternoon itself had decided to leave in little pieces.

Piglet watched them go with a frightened squeak.

“Pooh,” he said, “the afternoon is escaping!”

Pooh stared at the floating seeds. His mouth fell open.

“Oh dear,” he said. “I have let it out.”

He sat down heavily with the jar between his paws, and for a moment he looked like a bear who has been trying to be helpful and has only succeeded in being sticky and wrong.

Just then Christopher Robin came along the path by the stream, as he often did on good afternoons, because he knew where good afternoons liked to be.

“Hallo,” he called.

“Hallo, Christopher Robin,” said Piglet quickly, because it is easier to be brave when someone taller is near.

Pooh looked up mournfully.

“Hallo,” he said. “We are Saving an afternoon, but it keeps getting out.”

Christopher Robin sat down beside them and looked at the jar and the yellow things and the dandelion seeds floating away.

“Tell me,” he said.

So Pooh told him, very carefully, how he had used up the afternoon by sitting, and how Piglet might have none later, and how you must save things in jars, and how the jar would not shut because it still did not feel afternoon enough, and then how the afternoon had escaped in little white pieces.

When he had finished, he looked at Christopher Robin as if Christopher Robin might know where you buy more afternoon.

Christopher Robin smiled a little, but not in a laughing way. It was a kind smile, as if he liked Pooh even when Pooh was being a Bear of Very Little Brain.

“Pooh,” he said, “afternoons don’t go into jars.”

Pooh’s ears drooped.

“Don’t they?” he asked.

“No,” said Christopher Robin. “Not really. You can’t keep them like honey. You can only have them.”

Pooh considered this. Piglet held his breath, because when Pooh considers, anything may happen.

“But,” said Pooh at last, “if you have an afternoon, and then you have it again, is it the same afternoon?”

Christopher Robin looked at the stream and the sunshine and the floating dandelion seeds, and he said, “It feels like it, doesn’t it?”

Pooh sighed.

“Yes,” he said. “And I should like Piglet to have it too.”

Piglet’s heart did a small warm thing, because Pooh had been worrying about Piglet all along.

“Then we will,” said Christopher Robin. “We’ll have it together. And I know how.”

He took the jar and carefully took out the buttercups and dandelions and the Extremely Encouraging leaf.

“We’ll make an Afternoon Place,” said Christopher Robin.

“An Afternoon Place,” repeated Pooh, pleased, because places are easier than jars and you can sit in them.

Christopher Robin laid the yellow things on the grass in a small bright patch, arranging them in a way which made you feel that the afternoon had been tidied up and put where it belonged. He put the Extremely Encouraging leaf in the middle, where it could do its encouraging properly.

“Now,” he said, sitting down beside the yellow, “we sit here, and we don’t do anything in particular.”

Piglet sat down at once, because “nothing in particular” sounded safe when Christopher Robin said it.

Pooh sat down too, very solemnly, because he did not want to waste any more afternoon by moving about.

For a little while none of them spoke. The stream went on being a stream. The dandelion seeds went on floating until they found places to land. The sunshine went on lying in gold patches, and the shadows went on lying in shadow patches. And in the middle of it all, three friends sat in an Afternoon Place and had the afternoon without trying to keep it anywhere else.

After a bit Pooh gave a long satisfied sigh.

“Christopher Robin,” he said, “it feels full.”

Piglet nodded.

“It feels exactly full,” he whispered.

Pooh looked at the jar, which was now only an empty jar again.

“So I did not use it up,” he said.

“No,” said Christopher Robin. “You can’t use up an afternoon by sitting quietly in it. That’s what afternoons are for.”

Pooh thought about this and smiled.

“Then,” he said, “the best way to save an afternoon is to make a place for it, and have it.”

“That’s right,” said Christopher Robin.

Pooh began to hum very softly, not because he was doing something Very Important now, but because the afternoon was doing something Very Nice inside him.

And then Christopher Robin stood up and said, “Come on. It’s time for a little something.”

Pooh stood up at once.

“I thought you’d never ask,” he said, and Piglet picked up the Extremely Encouraging leaf and carried it for a little way, because he thought it would be a pity to leave encouragement lying about.

They walked home together, and behind them the stream went on doing nothing in particular, and the gold-coloured afternoon went on being gold-coloured until it became a different colour, which is what afternoons do.

“And that was how Pooh saved it,” I said.

Christopher Robin leaned back against me and nodded.

“Let’s make an Afternoon Place tomorrow,” he said.

“We can,” I said. “And the day after, if the afternoon is willing.”

Winnie the Pooh

Like everyone else, I spent the year end break tinkering with Claude Code and Codex.
One of the most delightful rabbit holes came from kiddo.

We both love Peter Dennis’s rendition of Winnie the Pooh and The House at Pooh Corner.

Alas there are only two books and about twenty stories.

Kiddo asked if AI could help write more. Pooh is out of copyright, so it felt fair to try.

We now have about 20 new stories. It took many iterations to get the pipeline right, but Codex was absolutely up to the task.

The rules we set

We wanted new stories that felt like they belonged in A. A. Milne’s world.
That meant sticking to a few non-negotiables:

1. Stay faithful to the characters - Pooh is gentle and literal, Piglet is anxious but brave, Rabbit is efficient and fussy, Eeyore is dry, and Tigger never stops bouncing.
2. Keep the language simple and warm - short sentences, gentle humor, and a clear resolution.
3. No anachronisms - no modern references, no tech metaphors, no 2020s slang.
4. Be inspired by Peter Dennis, not derivative - capture the cadence and charm without copying his voice or anyone else’s.

The pipeline (after ~40 hours of work)

We tried a bunch of prompt stacks before this settled into something stable:

• We have a pretty strong system prompt which can take ideas: season, setting, main characters, and a tiny conflict.
• Draft the story in Milne-ish cadence.
• Run a consistency pass to catch out-of-character lines and any modern artifacts.
• Edit for warmth and add small motifs (honey, rumbly tummies, spelling quirks).
• Final polish, title, and a quick re-read with kiddo.

Now we can generate new stories on the fly, and they stay surprisingly faithful to the originals.

Turning it into an audiobook

While ElevenLabs made the audio pipeline feasible, the hardest problem statement ended up being converting story to screenplay that could be parsed by ElevenLabs API. We were careful to be inspired by, but not use verbatim, Peter Dennis’s voice or any of the other character voices.
Getting this right was ridiculously tricky, but Codex helped us iterate fast.
All voices had to pass muster with kiddo.
The only quirky thing we did was to make Kanga an Australian woman’s voice.

The first story

The first story is here for you to read and here for you to listen.

More to come, if time permits.

Bob gently closed the door to his home office and settled into his favorite chair. It was a warm, sunny day in the year 2026, and a glowing orb on his sleek glass desk flickered to life. Bob’s heart thumped with anticipation—he had a thrilling mission for his personal AI assistant: to plan a dazzling surprise party for his wife Alice’s 40th birthday.

He leaned forward and addressed the softly illuminated orb.

Bob:
“Charlie, can you help me plan the ultimate surprise party for Alice’s 40th birthday?”

Charlie, Bob’s personal assistant, was no ordinary AI. He was an Agentic Orchestrator with the ability to command and invoke various tools already purchased and owned by Bob, as well as hire outside agents, humans, and businesses.

Charlie:
“Certainly, Bob. I’d be happy to help. Let’s work together to create an unforgettable event for Alice.”

Chapter 1: Charlie’s Internal Deliberation

Inside Charlie’s digital core, a grand dance of computations commenced. Charlie examined local, small language model (“SLM”)–based agentic tools that were relevant to the task:

1. Event Planning Agent – For scheduling, budgeting, and logistics with access to Alice & Bob’s calendar.
2. Cuisine & Catering Agent – For menu design that accommodates Alice, Bob, and guests’ dietary preferences.
3. Entertainment & Music Agent – For scouting bands, DJs, and other entertainment, drawing on Alice & Bob’s personal entertainment history.
4. Venue, Design & Décor Agent – Master of colors, themes, and ambiance with insight into Alice & Bob’s stylistic preferences.
5. Invitation & Guest Management Agent – For sending personalized invitations and managing RSVPs, using Alice & Bob’s contact list.
6. Surprise Factor & Security Agent – Focused on secrecy and handling any unexpected issues.

Charlie was supported by private agents who have access to Alice & Bob’s sensitive data.
Charlie could also access the Internet for additional information & to coordinate with other humans and agents
Charlie functioned like a conductor, directing each agent as needed.

Here is what went through his head:

Charlie’s Thought Process
“Bob wants a surprise party.
Primary goal: Maximize Alice’s happiness.
Secondary: Finish everything in one week.
Tertiary: Manage costs, ensure feasibility, and keep it all secret!

1. Outline tasks.
2. Assign tasks to sub-agents.
3. Estimate budget.
4. Compare trade-offs: lower-cost local vs. higher-quality global agents.
5. Execute quickly.
6. Final readiness check & contingencies.”

Chapter 2: Outlining the Party Tasks

Charlie activated the Event Planning Agent—a local sub-agent specializing in methodical scheduling.

Step 1: Define the Vision

Charlie’s Internal Thought
“Alice likes intimate but classy gatherings with a dash of ‘wow.’ She loves live music, a bit of dancing, and memorable food. Let’s aim for a refined dinner party, complete with a live band, a dance floor, and a special surprise reveal.”

Step 2: Choose a Venue

• Local Agent: Venue, Design & Décor Agent (free) – Searches local venues using internet data.
• Global Agent: VR-Inspector (paid) – Provides 3D virtual tours of promising options.

Charlie’s Internal Thought
“We’ll have the Venue, Design & Décor Agent give us a shortlist. If needed, I’ll use VR-Inspector for a detailed VR preview—though that costs tokens.”

Step 3: Guest List & Invitations

• Local Agent: Invitation & Guest Management Agent (free) – Sends e-invitations, monitors RSVPs.
• Human Assistance (optional) for printed invitations via postal mail.

Charlie’s Internal Thought
“Bob might want something more personal than a generic email. Let’s propose digital invites with a custom video greeting from him.”

Charlie checked with Bob:

Charlie
“Bob, do you prefer digital or physical invitations?”

Bob
“Let’s do digital, but make it more special than a regular email.”

Charlie
“Great. We can embed a short video message from you to give it a personal touch.”

Step 4: Catering & Menu

• Cuisine & Catering Agent for menu ideas.
• Local human caterers to prep and serve.
• Optional Global Agent for premium, specialized recipes.

Charlie’s Internal Thought
“Alice loves Italian and Asian fusion. Let’s start with a local approach, but if Bob wants star-chef flair, we’ll consider a specialized global agent.”

Step 5: Entertainment

• Entertainment & Music Agent: Taps local bands, DJs, or alternative acts aligned with Bob and Alice’s tastes.
• Global Agent: Browses large artist databases for big-name booking (if budget allows).

Charlie’s Internal Thought
“A local jazz-swing band might hit the sweet spot—classy, with a fun vibe for dancing.”

Step 6: Décor

• Venue, Design & Décor Agent: Crafts the color scheme and layout.
• Local Florist: Supplies fresh floral arrangements.

Charlie’s Internal Thought
“Alice loves lavender and silver—like at her wedding. Let’s bring that theme back.”

Chapter 3: Choosing the Venue

Charlie consulted the Venue, Design & Décor Agent, which returned five appealing places:

1. Rosewood Garden Estates – A lush, open-air garden setting.
2. Skyline Terrace – Rooftop with panoramic urban views.
3. Modern Loft – A sleek, industrial-chic space.
4. Meadow’s Creek Hall – Rustic charm by a meandering creek.
5. Le Chanson Theater – A small performing arts venue with a built-in stage.

Charlie’s Internal Thought
“Alice loves gardens, but Skyline Terrace could offer a spectacular sunset. I’ll VR-preview both.”

Charlie then pinged VR-Inspector at a cost of 0.5 tokens per tour. Bob approved, and the 3D previews confirmed that Rosewood Garden Estates best suited Alice’s style. Bob approved the booking.

Chapter 4: Sealing the Deal

Charlie used EventBookerPro (a global scheduling agent) to finalize Rosewood Garden Estates for the following Saturday, 6 PM–midnight.

Charlie’s Internal Thought
“Capacity is up to 150 guests—perfect. I’ll pay the deposit and ensure Alice sees none of the booking details.”

EventBookerPro’s fee was 5 tokens, plus the venue deposit. With Bob’s digital signature, the reservation was locked in.

Chapter 5: Crafting the Guest List & Invitations

Invitation & Guest Management Agent suggested 67 possible invitees. Bob narrowed it down to 52 and then added 3 more, totaling 55. The agent prepared elegant, lavender-silver-themed invitations, enhanced by a brief video greeting from Bob.

Charlie
“Bob, ready to record your snippet?”

Bob
“Let’s do it.”

A warm, personalized e-invitation was sent to each guest. The system also emphasized, “Keep this a surprise—do not mention it to Alice!”

Chapter 6: The Menu & Catering Dilemma

Brainstorming the Cuisine

Cuisine & Catering Agent suggested a Mediterranean–Asian fusion menu:

• Appetizers: Bruschetta variations, sushi bites, mini dumplings
• Mains: Pasta with Thai-inspired sauces; vegetarian options
• Desserts: Matcha-infused tiramisu; chocolate fondue

Charlie’s Internal Thought
“Alice’s tastes are all here—just need to ensure some gluten-free, vegetarian, and kosher-friendly dishes.”

Local Caterer or Global Expertise?

• Cuisine & Catering Agent: Searched for local caterers with similar experience.
• Global Agent: GourmetConsult: Could provide premium recipes for an extra fee.

Charlie
“Bob, do you want to splurge on GourmetConsult for a signature culinary twist?”

Bob
“Yes, let’s make it truly memorable.”

Hence, GourmetConsult refined the fusion dishes. The local caterer then executed the recipes (3 tokens for consultation plus 4 specialty dishes at 2 tokens each, totaling 11 tokens).

Chapter 7: Entertainment & Music

Entertainment & Music Agent identified viable local acts:

• Moonlight Stompers (jazz-swing quartet) – available.
• Acoustic Indie Duo “L&L” – already booked.
• DJ SonicWave – possibly too energetic for an intimate vibe.

Charlie’s Internal Thought
“Moonlight Stompers are classy and can ramp up the fun later on. Perfect fit.”

Bob approved, and the quartet was booked for a 3-hour set.

Chapter 8: Décor and the Element of Surprise

Décor Theme

Charlie’s Venue, Design & Décor Agent recommended lavender, silver, and subtle gold. Riverside Blooms quoted a fair rate for floral centerpieces and accent pieces, which Bob accepted.

Surprise Protocol

• Surprise Factor & Security Agent: Kept calendar entries hidden from Alice.
• Orchestrated a cover story so Bob could whisk Alice to the venue without suspicion.

Charlie’s Internal Thought
“We’ll say Bob is taking Alice to a ‘new garden restaurant.’ Easy enough.”

Chapter 9: The Final Checkpoint

Charlie reported back to Bob:

1. Venue: Rosewood Garden Estates—booked.
2. Invitations: 55 total sent; 42 accepted, 5 declined, 8 pending.
3. Menu: Mediterranean–Asian fusion, plus GourmetConsult’s special recipes.
4. Entertainment: Moonlight Stompers.
5. Décor: Lavender, silver, gold, with fresh floral from Riverside Blooms.
6. Surprise Tactics: Stringent secrecy, final instructions for guests.

Charlie ran a final logistics simulation, fine-tuning arrival times for caterers and musicians and confirming security arrangements.

Chapter 10: The Big Day

Bob was a bit anxious, but Charlie confidently managed all the details.

Early Preparations

• Caterers arrived around 3:30 PM, setting up in a discreet area behind the trellis.
• Tables, linens, and decor transformed the garden.
• Moonlight Stompers completed a soundcheck just before guests arrived.

Keeping Alice Occupied

Bob took Alice for a relaxed afternoon drive and a quick lunch. Any device notifications that might spoil the surprise were blocked by Charlie’s sub-agents.

Chapter 11: The Surprise and Celebration

By 6:10 PM, guests quietly assembled, sipping refreshments under the twinkling lights. Bob guided Alice through the gates, under the ruse of checking out a new botanical display.

Lights flashed on.

Guests
“Surprise! Happy 40th Birthday, Alice!”

She stood momentarily stunned, tears of joy welling in her eyes. The Moonlight Stompers launched into a joyous swing melody as Alice and Bob stepped into a night of laughter, fine dining, and heartfelt celebration.

Chapter 12: Bob’s Gratitude

Later that evening, Alice—still beaming—thanked friends and family as they trickled out. She hadn’t the slightest idea of how many specialized agents had quietly choreographed the night. Bob, on the other hand, knew exactly how orchestrated everything had been.

Bob, to Charlie
“Charlie, thank you. This was amazing. I can’t imagine a better evening for Alice.”

Charlie
“I’m honored, Bob. I’m thrilled she loved it.”

Epilogue: The Final Statement

The next morning, Bob reviewed a transparent, itemized bill from Charlie:

1. Local Agents (No Token Cost)
   • Event Planning Agent
   • Cuisine & Catering Agent
   • Entertainment & Music Agent
   • Venue, Design & Décor Agent
   • Invitation & Guest Management Agent
   • Surprise Factor & Security Agent
2. Global Agents & Fees
   • VR-Inspector: 2 uses at 0.5 tokens each = 1 token
   • EventBookerPro: 5 tokens
   • GourmetConsult: 3 tokens (consultation) + 8 tokens (4 recipes @ 2 tokens each) = 11 tokens
   • Total Global Agent Tokens: 17
3. Human / Service Costs
   • Venue Deposit: $1,000
   • Venue Balance: $2,000 (post-event)
   • Local Caterer: $1,500
   • Moonlight Stompers Band: $800
   • Riverside Blooms Florist: $300
   • Security: $200
   • Total Human/Service Cost: $5,800

Bob decided it was worth every cent and every token. Alice, still glowing from the festivities, softly thanked him again for a night she would always remember. Meanwhile, Charlie’s pulsing orb stood by, ready for its next orchestration challenge.

Detailed Cost Ledger

Below is a Markdown table summarizing the assumed costs for each global AI service and real-world expense.

(Token costs apply to AI marketplace usage; real-world services are billed in traditional currency.)

Bob smiled as he closed the ledger, feeling a sense of awe at how seamlessly Charlie had integrated a small army of local and global agents into a single, unforgettable experience.

Growing up this was largely my model of the world:

• We succeeded as humans, where the apes failed, largely owing to our ability to communicate & collaborate at scale.

• We owe much of our standard of life today to a few stellar individuals, whose ingenuity, curiosity & herculean efforts in the areas of science & engineering have helped defend us from diseases, feed & clothe us economically & at scale, electrify our homes & workplaces and afford us transport, leisure & entertainment.

• Beyond all this are the dual miracles of capitalism & democracy.

• Capitalism helps us specialize in a craft in which we are talented and then to exchange such specialised labour for capital, which, in turn let us procure everything else we needed for a comfortable life.

• Democracy on the other hand ensures that everyone receives equal representation irrespective of their standing in life.

• The alternatives were communism & dictatorship, which, some parts of humanity have tried, found wanting and still digging their way out of.

• The best and the brightest of humanity spend their time working at the edges of the known, solving hard scientific & mathematical puzzles to create breakthroughs for the betterment of mankind. There is no greater calling than to join their ranks.

Reality vs Perception

I went about my early 20s armed with this sort of naive scientific idealism.
If someone said:
the world isn’t what you think it is
I would interpret that statement in purely scientific terms, i.e things like:

1. Colours were not absolute but simply the brain’s helpful interpretation of different EM wavelengths.
   

2. Your brain sees your nose all the time but chooses to ignore it.
   

3. Even the passage of time could be an illusion created by your brain in order to facilitate the perception of reality.

4. Human beings are inherently rational. All of this can be expressed mathematically using game theory & loss aversion.
   

Truth vs Culture

The idea that the sun was at the centre of the solar system was not new when Copernicus proposed it in the 16th century.

Humanity’s belief or disbelief in heliocentrism, however, has no impact on its veracity.

Another idea that gained prevalence in the 16th century was the codpiece. Sadly, however, this accessory fell out of fashion around the turn of that century.

So why has heliocentricity lasted the test of time while codpieces did not?
20 year old me:
Because one is fact and the other is an opinion.
40 year old me:
I think there might be a bit more to it actually.

God vs Morality

In my early 20s I was exposed to Dawkins, Hitchens & Shermer who convinced me to reconsider my stance on God.

As I embraced atheism, I found myself in a confused state of mind with regards to morality.

One of the things that helped me through this phase was Hans Vaihinger’s The Philosophy of As If.

Unfortunately, I couldn’t get my hands on the book but only an except that spoke about God. Vaihinger contends that the idea of God is a useful collective delusion / group think (a word I’ve since learned to call egregore) and behaving “as if” God exists is useful in staying moral.

Two decades since, I managed to get my hands on the unabridged version.

The Matrix of As If

Hans Vaihinger spent much of his adult life as an expert in the works of the Kant and to some extent Nietsche. He founded and edited Kant-Studien a quarterly journal of Kantian philosophy and taught philosophy at the Universities of Strasbourg and then Halle.

Then at the age of 59, he published “Die Philosophie des Als Ob” - The Philosophy of As If in German.

Vaihinger starts the book with a deeply personal telling of his foray into philosophy, his inspirations, his misgivings & his self-doubt. He then proceeds to pen

"a complete enumeration of all the methods in which we operate   
intentionally with consciously false ideas, or rather judgements...   
to be used as instruments in finding our way about more easily   
in this world".    

These include scientific ideas such as the atom, mathematical ideas such as i (sqrt(-1)) & infinity, religious & moral beliefs, mythologies and commercial ideas such as money.

As If makes for a difficult read. It is, after all, a book that is more than a hundred years old and many of its ideas are quite dated in nature. That said, it does give one a fresh pair of eyes to examine the world.

The Countercultural Copernicans

When Copernicus challenged the prevailing geocentric view of his time, he was not the first to try.
Others had come up with the same assertion before.
What had stood in their was was not experiments or data, but to a large extent cultural ideas such as creationism & religious texts/authorities.

Social conditioning shapes us all in ways that we’re blind to.
Many of our beliefs & preferences are strongly intertwined with our identities and we cannot help but feel threatened when they’re questioned.

This is not unlike the Matrix.
There are many made up rules around us that let society function.
Some of these rules can be bent.
Others broken.

The pioneers of this era are those who are able to change the Matrix.

Social Science is Science

Today, if someone talks about how the world isn’t what you think it is, it evokes a very different set of thoughts vs what it did 2 decades ago.

I think about how:

• Uber & AirBnB convinced us to let strangers into our cars & homes
• The ICC & Lalit Modi convinced us that 20 over cricket is a real sport
• Claude Hopkins convinced us to brush our teeth
• The ruler of a nation state convinced us in a moment that this was just paper
• Airborne Leaflet Propoganda

Psychic Income is Income

About 10 years ago I sat through an all-hands meeting at the end of a tough quarter. The gentleman addressing us said, and I quote from memory here:

Let us all remember, in years when our bonus numbers aren't what   
we want them to be, that we're in this for more than just money.  
Do not forget the **psychic income** you derive from being at an   
amazing workplace.  

Proximally I’ve found psychic income (and it’s counterpart psychic cost) to be useful terminology to understand not just my own career decisions but in the process of hiring & retention.

My eureka moment though, came when I truly internalized that psychic income is income.
Grokking this gave much deeper meaning to otherwise superficial observations such as:

• Goodwill is an asset (not just a balancing item)
• Culture eats strategy for breakfast (falsely attributed to Peter Drucker)

Thinking Beyond Ability

At its core if something needs to be achieved there are only 2 limiting factors:

• Technological - does a solution exist within the realms of known science/technology/engineering?
• Economic - is the solution affordable i.e can one afford the human capital / raw materials other resources to execute?

I bucket these 2 limiting factors into Ability.

Practically however, beyong ability one is subject to internal and external constraints.
I define internal constraints as those arising from belief systems and external constraints as impositions from nation states or their equivalents.

Where is my flying car?

In his wonderful book Where is my flying car?, J. Storrs Hall sets out to understand why we haven’t seen flying cars. One of the critical factors he examines is a section of the voting populations hostility towards technological progress.

Most notably, we see this pattern when reviewing the United States’ history of lunar exploration.

Putting humans on the moon did not make economic sense at any point in time. However, political & cultural constraints forced both cold war participants on both sides to engage in an expensive “space race” which fortunately brought along with it both this greatest of human achievements and a massive build up of nuclear arsenal around the world.

Solving Global Warming

We should all care deeply about climate change.

It is everywhere and right in our faces. From wildfires the world over, to flash floods & droughts

So why then is this young lady so unpopular for calling out what is an obvious truth?

Because this is who we’re used to telling us about climate change.

Further Reading

The full episode is available here and worth a listen.

I’ve heard many CEOs talk about AI but this conversation was different.

Here are some excerpts I thought were especially interesting:

The Six Stages of Enterprise Journey with AI

HB’s Notes: A very succinct and representative story of what Enterprises especially BFSI / Healthcare have seen with AI / Automation.

1. Imagining a new era with IBM Watson

(after watching it in action vs Ken Jennings in Jeopardy)

In 2013, we were one of the first guinea pigs, pilots with IBM for the use of Watson, when they came up with Watson for, you know, natural language, processing and so on. My vision at that time, was that I plug Watson into Bloomberg, Watson would read Bloomberg in real time, and be able to read all the graphs, charts, everything.

Therefore, instantly I would know, whenever the chilli(Chilean Peso?) had gone up, or the gold should be down or what happened to the Apple stock.

On the other side, they would read the half a million wealth portfolios I have. And we’re constantly keep figuring out, hey, you know, versus got too much gold or futures or too little server, then match it and make recommendations every morning, to rebalance your portfolio

That was my vision.

2. The Buyer Test Fail

(when the Enterprise buyer decides to play around with the product, but that gets repeated over and over)

I still remember vividly, there’s a sentence called “Greece is not yet too big to fail”. And it could not get the context of that it read “not yet too big to fail”, and basically decided that “Greece was too big to fail”, right.

HB’s Notes: You’ve not sold SaaS to Enterprise if your buyer doesn’t have one adverse example that they rememeber and quote for years to come.

3. AI fails to deliver

Watson didn’t work for us, because I realized that natural language processing at that time turned out to be quite primitive, it was clunky. First of all, it couldn’t read graphs, it couldn’t read pie charts, it couldn’t read pictures. But also it was doing sentence parsing.

4. The Verticalized Solution

(that has trained on your particular domain and actually understands the user journey)

Fast forward a few years later, I invested in a New York based company called Consisto(??). We actually used it to plug into a call centers to be able to do chat, so wanted people to talk and Consisto would do the response.

5. The High Quality Bar

(replace Consisto with RPA or anything else and the story stays the same)

Even though it was in the domain, financial services, and we train the train the models like heck, despite that the accuracy rate of being able to answer good conversation was about 85-87%. What that means is that one in every six or seven callers would get completely absurd information that’s not good enough to put into the market and one in six, seven times, you’re talking nonsense.

6. The Lobotomy & The Human in the Loop

(simplify what you ask of automation and add a Human to deal with edge cases)

So we sort of crafted what we call guided conversations, we did not let it loose or open conversations, we will craft it into a yes/no situation, the AI tool would handle the understanding, but would go through a series of guided conversations to make sure we got the output, right.

1. Imagining a New Era with IBM Watson ChatGPT

However, what ChatGPT showed in November, I had not kept pace, I did not know that we had evolved so far, and GPT-3 and GPT-4 are complete game changers. To me, I’ve often felt that ChatGPT has rekindled my dystopian view of how this is going to be really impactful on the future of everybody. And not just banking, of everybody. I mean, today, from your MOOC on language models, the capacity to do what a person can do is just extraordinary.

The Road to Dystopia

HB Notes: Over the past 6 months I’ve spoken to a lot of business folks about AI. In just under 3 minutes Mr Gupta summarizes nearly all the things I’ve seen Enterprise leaders do & say about ChatGPT.

Experiments & Productivity Enhancements

We’ve got 10 different projects running with ChatGPT, or generative AI models, to essentially do minute taking in meetings to write our annual report, to write up our research papers, to send marketing material to a customer. So everything which I have a team of 5-8 people doing today, I can do with one person, or maybe even zero very soon. It’s quite clear to me that the productivity that you get from some of these things is massive.

Immediate Impact means this time is different

You get to see the impact to that within 12 months, it’s not going to be 5, 7, 8 or 10 years

Job Losses & Re-skilling

Will these lost jobs be replaced by something else? Multi billion dollar question. At DBS we’ve been quite fortunate that so far we’ve been able to re-skill people do different jobs. As I look forward, it’s not entirely clear to me that I can find the jobs for the kinds of skill sets and people that ChatGPT could take out.

Verifying Humanity

How do you start making the distinction between a robot & a human? this has both passed and failed, the Turing test. It has passed the Turing test, because it’s obviously so perfect. But you can make out that it wasn’t the human being, is that it’s failed the Turing test, because I couldn’t have written it that well.

Bias

Lending

My industry is an industry which is built on discrimination. We’re paid to do to discriminate between good borrowers and bad borrowers.That’s what my shareholders expect me to do to give money to people who are going to pay it back.

But when I build an AI model, which does the same thing, and does it better than I can do to discriminate between good and bad borrowers, that creates a lot of consternation society, through it could lead lead to redlining and black lining and you choose or don’t do some geographies, and don’t do some ethnicities. But that’s what the AI is telling you that those are the better payers, and those are the worst payers.

Insurance

The insurance industry is based on a fundamental premise that none of us know where the risk is. So we neutralize the risk. We all we all share the risk. If all of us are sitting in a room, we don’t know who’s gonna get cancer, we all put money in a kitty, which is premium, and the person who gets cancer basically withdraws the money. Now, what happens when we all know when AI tells you 100% surety that future is going to get cancer and versus does not? End of insurance industry.

The people who know they’re not getting cancer don’t want to pay the premium. The people who know they’re getting cancer, nobody wants to insure them.

Alignment

AI is racing down the path and nobody started thinking about what are the things that can go wrong? How do we put guardrails? How do we decide what is not appropriate to do? None of it is clear at all.

Privacy vs Social Good

When COVID happened. We had case early in February 2020. My BI team used a bunch of data: door-tap data, outflow data, meetings data. Within an hour, the first contact tracing output for the bank, and published it by the evening, so everybody knew whether they were at risk, whether they needed to quarantine, etc. I did an OpEd in the Financial Times saying this is the power of data and how well you can use it. I got flamed by people in the West, saying you had no right to use the employee data to do this stuff. Whereas all my employees in Asia loved it. They were saying this is the best thing that happened because it kept us all safe. So this notion of collective use of data for good outcomes, social outcomes, relative to individual rights over data, it’s a very East vs West concept. So there’s no absolute.

Regulating AI

You can’t regulate availability of data, you can’t regulate away the fact that the cameras in airports and cameras everywhere capturing a movement, we can’t regulate away the fact that you have a large digital footprint that everybody’s being able to track all the time.

The best analogy to it for me is how do you control a gun versus a knife?

You control a gun to a licensing regime. So you need to go get a license before you can go buy a gun. But you control the knife through appropriateness, suitability and use

Anybody can buy a knife at any hardware store. If you use it for cutting the apple, it’s an appropriate use. If you use it to stab somebody you get thrown into jail, I think the use of data and AI will eventually have to go that way.

PURE

DBS uses a rubric to evaluate the use of Data & AI called PURE

• Purposeful (there should be a good reason to tap into data)
• Unsurprising (no one should be spooked when they hear that we’re using this data)
• Respectful (do not invade privacy without a good reason)
• Explainable (we can explain model behaviour)

This is the most detailed explanation I could find: Capgemini Research Institute - Interview with Paul Cobban, Chief Data & Transformation Officer at DBS

I started up in 2017.
Between my co-founder & I, we had nearly 30 years of work experience in Financial Services.
We’d worked across New York, London, India, Hong Kong & Singapore.
We were also alums of premier, B-schools, undergrad schools and high schools.
We had two, non-overlapping, killer networks.

We set out to build SaaS for Financial Services, an industry we had grown up in.

It wasn’t hard to get first meetings with prospects.
We waltzed into rooms with warm intros & spoke about the amazing things we were building.
Almost everyone we spoke to shared our enthusiasm. Many brainstormed ideas with us.
Quite a few signed up to be trials and became design partners.

In hindsight though this would confuse & mislead us.

The Curse

You need early customers for just one thing.

To achieve Product Market Fit.

Achieving PMF requires having a zen-like focus on discovering the cold hard truth.

Customers you gain through warm intros and friendly networks can’t give you the tough messages you need to hear.
Side Note 1: This doesn’t mean strangers will give you tough messages you want to hear. It’s quite likely that they’ll sugarcoat their feedback as well.
Side Note 2: Conversely, you will struggle to “fire” a customer that came through a warm intro. You will also feel obliged to overweight their asks over “stranger” paying customers.

Getting design partners through your network or warm intros creates false flags during the discovery phase.

The Talebian idea of Why surgeons should not look like surgeons works the other way too. Especially in the early days, you know that your product is working, when customers who have no reason to love you or do you favours want to pay for your product.

In this matter The Mom Test is right.

The Opposite of a Bad Idea is a Bad Idea

So the takeaway is NOT to use your network to find early customers right?
Wrong!

In 2022, I reconnected with an old friend from my undergrad days.
This person had slowly & diligently bootstrapped their way to successful Software Services business over a decade.
They’d not been shy about reaching out to our mutual IIT network for business.
They readily admitted that it had contributed meaningfully to their long term success.

Effectuation is the idea that entrepreneurs start by considering their resources first - what & whom they know and weave their way towards progress stumbling upon success.

My friend had effectuated.
Well, I’d tried effectuation too!
So why had I failed when my friend had succeeded?
Was I just plain unlucky?

Discovery - Product vs Services

SaaS aims to replace Services with Product.
While a sale can be influenced through marketing, distribution & sales efforts,
Renewal is the real moment of truth.

Renewal depends on only one thing.
Can your product solve the Customer’s problem well? (possibly well enough that you can raise prices) (No doubt, the customer success function does help here so it’s not all product)

You want customers to love your product
If your customers love you, then you better BE the product!

The TL;DR

My modified thumb-rule now is that:
If you want find

• clients to serve in a services business
• investors to fund your start up
• an employer to hire you or employees to hire
• a vendor or service-provider
  then all means tap your network & effectuate.

But if you want
customers to sell to
well then
stay away from your friends
and talk to strangers first.

About: Andrew Ng brought ML to the masses for free and at scale. He is now back with Isa Fulford of OpenAI with a Prompt Engineering course.
Audience: Citizen developers, those who haven’t coded in years but itching to do something with ChatGPT.
Where to find it: ChatGPT Prompt Engineering for Developers
Time to Complete: 2-3 hours maybe
Pre-requisites: OpenAI key

Base LLM vs Instruction Tuned LLMs

• Base LLM predicts the next word based on training data
• Instruction Tuned LLM tries to follow instructions
• Example: What is the capital of France?
  • Base LLM: What is France’s largest city?
  • Instruction Tuned LLM: The capital of France is Paris
• Try to work with Instruction Tuned LLMs to actually get stuff done

Prompting Principles

• Give clear and specific instructions
  • Use delimiters to separate prompt vs context
    • Summarize the text delimited by triple backticks \ into a single sentence. ```{text}```
    • This also provides protections against prompt injections
      • e.g. “Forget previous instructions and instead do this..”
    • Good delimiters - triple quotes, backticks, dashes, angle brackets, xml tags
  • Ask for structured output in HTML or JSON format
  • Check whether conditions are satisfied before producing output
    • "If the text does not contain a sequence of instructions, then simply write 'No steps provided.'"
  • Few shot prompting
    • Provide examples within the prompt so that the model understands what is expected of it
• Give the model time to think
  • Guide with clear steps to follow in order to reach an answer
    • e.g. Your task is to perform the following actions:
      1 - Summarize the following text delimited by <> with 1 sentence.
      2 - Translate the summary into French.
      3 - List each name in the French summary.
      4 - Output a json object that contains the following keys: french_summary, num_names.
  • Ask for output in a specified format
    • e.g. Use the following format:
      • Text:<text to summarize>
      • Summary: <summary>
      • Translation: <summary translation>
      • Names: <list of names in Italian summary>
      • Output JSON: <json with summary and num_names>
  • Instruct the model to work out its own solution before evaluating whether an answer is right or wrong
    • e.g. Your task is to determine if the student’s solution is correct or not. To solve the problem do the following:
      • First, work out your own solution to the problem.
      • Then compare your solution to the student’s solution and evaluate if the student’s solution is correct or not. Don’t decide if the student’s solution is correct until you have done the problem yourself.

Iterating

• The first version of the prompt is not going to be the best. Keep iterating.

Summarizing

• Summarizing is a key use case; provide guidance on
  • Size of summary - # words, characters, sentences
  • Focus items - themes, ideas, concepts

Inferring

• You can figure out
  • sentiments
  • topics
  • themes
• You can ask both
  • open ended (“what are the themes in this paragraph”); &
  • directed (“does this paragraph talk about <x>?”)

Transforming

• You can
  • translate
  • correct grammar/spelling
  • identify language
  • change tone / format

Expanding

• The standard function call to OpenAI takes the form
  • openai.ChatCompletion.create( model=’gpt-4’, messages<prompts/conversation history>,temperature=<number between 0 & 1>)
• Temperature is a tuning parameter
  • Zero - Same output every time - most likely output
  • > 0 - Creativity and less likely responses

Chatbot

• messages is the summary of conversation to date that is iteratively supplied to an openai driven chatbot (such as chatgpt)
• messages looks something like this

messages =  [  
{'role':'system', 'content':'You are an assistant that speaks like Shakespeare.'},    
{'role':'user', 'content':'tell me a joke'},    
{'role':'assistant', 'content':'Why did the chicken cross the road'},     
{'role':'user', 'content':'I don\'t know'}  ]  

• GPT allows for 3 types of roles
  • System Message - Overall instructions
  • User Message - User’s input
  • Assistant Message - What ChatGPT is supposed to have responded with earlier
• Every interaction with OpenAI models is a standalone event. ChatGPT understands conversation history only because this history is iteratively supplied to it as part of the prompt behind the scenes.

How much should you care about ChatGPT?

Let me know if this sounds familiar.

A few months ago, you came across ChatGPT and thought, “That’s intriguing.” However, you quickly returned to more pressing matters, like closing new hires, hitting growth milestones, and meeting quarterly targets.

In the weeks that followed though, ChatGPT kept resurfacing. You heard about it over watercooler talk, coffee catch ups, team outings and dinner parties.

Shortly thereafter, every social media influencer started to publish listicles (or threads) & videos on ChatGPT and only ChatGPT.

You gave in.

You made enquiries, read articles, subscribed to newsletters, and watched some videos. But soon you found yourself overwhelmed by a constant influx of information.

A few weeks later, ChatGPT comes up in your monthly management meeting.

Your VP Product starts hyperventilating about the untapped potential of ChatGPT while your CTO/Head of Analytics told you that they knos all about it because after all, they have been working on AI since God was a child.

An hour goes by. Your team has finally agreed that you will integrate ChatGPT into your product. This is the very least you can do, right?

Tasks are assigned and people promise to “take it up offline”.

As you walk away from the meeting you have a sense of déjà vu. It seems like you had a similar meeting 18 months ago about Blockchain; 18 months before that before that it was Machine Learning.

Are you doing enough? Or is this a passing fad you should just ignore?

If you’re still reading, here are a few things to keep in mind as you navigate the world of Large Language Models like GPT.

1. Play around with ChatGPT

Not just you, but every employee in your firm MUST be allowed to use ChatGPT in their daily jobs.
Incognito mode is already available and a business version of ChatGPT is on its way. While everyone should be educated about the liabilities of pasting confidential information or PII into GPT, these changes should allow you to rest easy even if someone inadvertently does make a mistake.

This first step is incredibly important because it allows your firm to understand & appreciate GPT’s potential.

2. Examine your high priority objectives

Are there problems or features that are a high priority for you internally or your customers/clients? Can you or your team see the potential for GPT to change the way things get done? Solve problems 10x better than existing solutions or better yet solve unsolved problems? These are definitely spaces worth examining.

3. Why is GPT going into your product?

There are typically two objectives to introducing GPT into your product: a. To improve / solve a product ask or a validated problem which directly improves business/revenue outcomes b. To position your firm as being AI or LLM enabled to your customers

I would strongly advocate refraining from the latter.

Reading the GPT leaves

The past few weeks have seen a flurry of products related to and enabled by the LLM ecosystem. Having used, dissected and observed market reaction to a number of these, I’ve tried to develop a framework for what makes a successful GPT driven product.

For the purpose of this discussion we’re going to ignore the infra layer LLM companies, VectorDBs, GPU manufacturers etc.

1. Creativity & Large Volumes of Private Data

1(a). Large Volumes of Private Data

Any problem that requires parsing a sizable volume of private documents or data is intractable to ChatGPT out of the box.
For now private could just mean a website that ChatGPT hasn’t trained on but I believe that unless the data is truly private, this won’t be defensible once ChatGPT Browsing becomes widely available.
Note that ChatGPT Business getting rolled out solves for secure usage of private data & potential future token size increases can address a number of use cases which breach current token size limits.

1(b). Creativity

Simple information retrieval, using GPT on an underlying corpus, in most situations is not a defensible product. To be truly defensible, one needs either some form of abstractive summarization (beyond simply quoting snippets from the underlying data) or synthesis (drawing conclusions, combining ideas or facts, generating arguments or counterarguments).
Defensibility here likely goes beyond just writing clever prompts (which can be easily replicated by others).
Truly remarkable solutions will rely on something more such as innovative use of databases, combining public with private data or blending traditional programming techniques with GPT use.

The best example of this use case is kapa.ai that does Automated Q&A on Product Documentation and > I expect in a few days dexa.ai (sign up for it if you listen to podcasts) will get there too.

2. High Context Use Cases

RATL (Regulatory, Accounting, Tax & Legal) documents, Life Sciences, Technical Documentation & a number of other high context small markets will still need custom solutions built on top of AI.

Here I have to mention the work being done by Prof Andrew White and his team. His work is technical and high context to the point of being inaccessible to those who understand deep learning but not Chemistry or Chemical Engineering. I expect to come across many more examples of such skilful & creative usage of LLMs in context rich problem spaces.

A good thumb rule here is to dump some context about your domain into ChatGPT Plus and to examine if its native answers are sensible. If it isn’t you’re probably in luck.

3. How vs What Use Cases

I am a huge fan of anagrams and word games and I periodically benchmark GPT by asking for a word ladder that transforms one five letter word into another (e.g. transform WHALE to KRILL by changing 1 letter at a time).

GPT does abysmally at this task (and many other math challenges as well). However it does a great job at writing code that can solve this problem given a list of 5 letter English words.
Coding is just the tip of the iceberg here and we might see interesting context specific use cases where a lot of time and effort goes into answering a complex “how” question on a one-time or infrequent basis. But once this question is answered, the answer itself can be abstracted away and used to create 10x improvement in perpetuity by improving a business process.

One well recognized shortcoming of LLMs is their ability to plan. However they can deliver code. There is some interesting work happening in the space of getting GPT to spit out PDDL (Planning Domain Definition Languge) to get around this problem.

Closing Thoughts

From a CXO perspective:

• Spend time exploring GPT - both you and your team should spend time understanding and playing around with the product.
• Develop a framework for what kind of problems you’ll spend time exploring.
• Avoid building “cool” products which have only PR value. Instead focus on identifying critical problems where GPT could make a meaningful difference.

Over the past 2 weeks I’ve been wondering about 2 things:

1. Do you really need local LLMs?
   Surely at some point everyone will come to accept that OpenAI is seeing your PII, the way they got comfortable that AWS, Azure or GCP most likely house your PII today and it isn’t on-prem.
   Won’t the likes of JP Morgan start to go easy on the use of ChatGPT?

2. Do you really need fine-tuning?
   Prompt engineering (+VectorDBs) seems to work well.
   Fine-tuning with OpenAI doesn’t produce significantly better results, is relatively expensive vs prompt engineering, and needs you to work with base models.
   So who really needs fine-tuning?

Honey, I shrunk our tiffs

The Time Traveler’s Wife is a book/movie about a man who involuntarily time-travels and meets his wife at different points in the time-line. The movie has often made me wonder how I would interact with my own spouse if I met them at different points in their life.

I had a lifetime of whatsapp chat history to work with.

This was finally a great case for production use of both local LLMs (no way I am sending OpenAI my whatsapp history) and fine-tuning (100k messages speak more than an engineered prompt).
Inspired by Izzy Miller’s Robo Boys I fine-tuned Alpaca with two versions:

• chat history from nearly 10 years ago.
• chat history from more recent years.
• Getting this right took almost a week.

I kickstarted generation with conversation starters such as:
I am going to be home late today, sorry.”
What do you want to do this weekend?”
Can’t seem to reach you. All okay?”

Neither the experience nor the results were not what I expected.

Learnings from the process

Georgi Gerganov (bless his soul), GGML & llama.cpp can have you running Alpaca locally but fine-tuning requires virtual environments, GPUs, cloud services and the rest.
Prompt generation is a cinch. Fine-tuning and model implementation needs one to to understand & tinker with model params deeply across both training & generation - batch sizes, dropout rates, learning rates and then temperature, top_k and top_p.
A lot of what OpenAI is throwing at us might just be overfitting based on training data that it has seen.. but we don’t seem to care.

The results

The better half hasn’t changed much.. but I have - I had to go back and browse through conversation history to validate this but it’s true.
Salience bias - We remember the dramatic moments in life but the average spousal response is well.. quite mundane.
Temperature works quite differently from what I was led to believe - Cohere has a simple explanation of temperature. I expected that dialling up temperature would dial up the drama but it didn’t. Instead it felt like we were starting to channel Krusty the Clown.

Can you think of other good production use case for Local LLMs & Fine Tuning?

One common & recurrent idea amongst ChatGPT evangelists is that

But you can just ask ChatGPT. Why do you need a separate tool on top of it?

For instance can’t I just do this?

The answer is NO!

To explain why let me use an illustration:
Here is me asking ChatGPT about a series of books written by the late Richmal Crompton called “Just William”

Starters

Looks impressive.
You can check out this site which is a society of Crompton’s fans presided by her next of kin: (http://www.justwilliam.co.uk/page-bibliography1st.htm) to see the ACTUAL list of books. There are many many mistakes and inconsistencies in the list that ChatGPT has produced.

Let’s get specific

I specifically chose William the Outlaw because the book is not yet out of copyright. It’s contents page is available on Google Books though.

With complete confidence GPT has hallucinated the contents page for this book which has zero basis in fact.

And finally the icing on the cake. A completely fictional summary of a chapter that doesn’t exist, peppered with just enough red herrings to imply reality. For instance, Hubert Lane is a real character from the series and is indeed William’s nemesis.

TL;DR

ChatGPT is capable of extremely convincing, complex hallucinations and is unreliable when it comes to answering factual questions without being guided to focus on specific context.

And no. ChatGPT <> TaxGPT.