i’m tinkering around with trying to understand agentic AI and tool-use.
What I would like to be able to do is have the AI read a Google Sheet and use Tools to build multiple emails for me.
Hours 1-2
I read that LangChain is a framework for creating Agents. I presume it’s free? I followed these instructions to get a local LLM installed on my laptop. These instructions said to use Ollama so that’s the path I’m heading down. https://js.langchain.com/docs/tutorials/local_rag
My laptop was able to read the example document. That’s a win. I have a Macbook Air M3 with 16GB of RAM that I bought in September 2024 for about $1,400 USD. In other words — a firmly middle-of-the-road new Mac. I presume it’s going to run slow as molasses?
Reading the docs for Llama 3.2B, it appears this new version is OK for tools and designed to run on less powerful machines. I don’t know what 1B or 3B means. I guess 3B words indexed?
Ollama blog notes were very helpful in explaining the steps necessary to index my documents so that AI will be able to do something with the text. It involves making embeddings by using an indexer and a vector store. I don’t know what that means. Hopefully I don’t need to know? https://ollama.com/blog/llms-in-obsidian
Hour 4
So much information my mind is spinning right now.
lost in the ether of wrestling with getting this to call a feed and find relevant articles. Realizing now that reading content has certainly been done-to-death. How can I make this do something more interesting for me?
Hour 6
struggled with having Ollama read and summarize my Flipboard magazine. this has been a waste of an hour
Hour 7
Back to the original idea of why did I want agent AI in the first place?
Goal: I want to increase sales. General one-message-for-all approach is not working. I want to split people up into groups/clusters of interests.
I also want to find a pattern of behavior that occurs before people buy.
It has been suggested to me that a Graph Neural Network (GNN) is a good way to identify this behavior. GNN is a whole different rabbit hole to look into. My friend told me to look at JanusGraph
At this point, I’m not quite sure how AI and Graphs fits into the picture here. The insight will come eventually.
At Calm, we rely heavily on Figma to generate marketing copy proofs for copywriters and other marketing folks to see their text visually in an email mockup.
Typically the process might go as follows:
Using an existing template, our designer mocks up a series of emails containing rough draft.
3-email series x4 population segments = [12 emails x 15 minutes per mockup = 3 hours]
He shares with the copywriters.
Copywriters eyeball the design and write new copy to fit the theme of the year. They don’t have Figma seats, so they write their revisions as Figma comments.
The Designer now transfers the text edits from the Figma comments into the Figma text nodes. [5 minutes per email = 1 hour]
Designer shares the Figma file back to copywriters. Every round of back-and-forth is 1 hour.
Now we have to transfer the text from the Figma into email templates! [15 minutes per email = 3 hours]
The total effort is about 7 hours for a 12-email campaign or 35 minutes per email.
Our work process is overly reliant on having access to a Figma license. The process served us well for several years but we came to a crossroads where there are too many back-and-forths between design and copywriting and it was taking up a lot of time.
In effort to streamline or workload, I created a Figma plugin to pull text from a Google sheet
In Figma,
The Figma mockups have a specific # of text layers. I give each text layer a unique name:
Section1_Header
Section1_Body
Section1_Link
In Google Sheet,
Map a Google sheet row-for-row to each text layer.
Figma Layer Name
Google Sheet A
Google Sheet B
###.Email1
Email1
Email2
Section1_Header
My first newsletter
My second newsletter
Section1_Body
I was vacationing in Anaheim with family…
I was on my way to Albuquerque on business…
Section1_CTA
READ MORE
READ MORE
Section2_Header
Employee of the month
Employee of the month
Section2_Body
Edward Heinz wins for achievement in…
Eliza Doolittle wins for achievement in…
Key difference from other plugins
I setup a Google App Sheets API client so that I could share any Google sheet with a programatically-generated email address (Google provides the email address). I can share any private Sheets document with the special email address rather than making the Sheet publicly viewable. I do not like the idea of a public Sheet.
Hello Reforge team. A quick note: I’m playing around with an AI voice generator to make narrating this video faster!
This is how Calm uses Google Sheets to build and track emails.
I’ve created a simplified version of our sheet specifically for Reforge. In practice, Calm’s sheets have 70 or 80 rows instead of the 28 rows in this example.
At right you can see a basic newsletter. We break up each piece of the newsletter into chunks that we map to blocks of rows on the Google Sheet.
We replicate this google sheet column multiple times to represent different versions. In this example I’ve layed out six email newsletters. It could be 6 months or 6 weeks. whatever your newsletter cadence.
We also use the spreadsheets to manage newsletter translations for different languages.
Each section of the spreadsheet maps to a section of the email. Starting with the hero section on the email mockup, we have a header, a paragraph body, and a call to action link. Each of those elements has a corresponding line on the spreadsheet.
We also have three sections that look the same. Therefore we have three corresponding sections on the spreadsheet.
Finally, we finish with the email section on the bottom.
Now that the copy has a defined structure and pattern, we can interpret the email easily programmatically.
I connected the spreadsheet to a Google Apps Script that shows a basic preview of the newsletter to make the email easier to review and check for errors.
Iterable journeys have two webhook nodes to choose from so I was trying to figure out which node will make an outbound call to an API, receive data, and then write data back into the User Profile.
The “Journey webhook” node will not write data to the user profile.
This is an outbound-only HTTP request.
We can use the webhook to tell external certain things about the user that Iterable knows. But the webhook itself is fire-and-forget.
We are forced to use the “User Profile update” node
Iterable automatically stuffs a ?email=<email address> parameter on every request (security prob?)
This node allows for an Authorization header.
Screenshot shows Authorization: abcdefg
We can do Authorization: Bearer <token> to do basic auth instead of authorization token?
Example request header from User Profile update via webhook
Calm was the subject of a email UX teardown recently which was well-written and had several interesting insights. The obvious first reaction to this post was “oh no, we’re horrible” but the reality is she articulates several weaknesses that the team has been aware of.
We missed an opportunity for personalization
Complaint – She was a happy user churning out of the product. When she churned we hit her with a generic urgent messaging that others recognized not to be soothing. Why are we talking to her like a beginner?
What is the root of the complaint?We don’t distinguish “happy churn” from other types of churn. (Note to self: what are the other types of churn?) Our churned-user experience is certainly under-appreciated.
This user has multiple email addresses: a paid subscription email and a trial churned email. Presumably she used the trial churn email to conduct her research.
The paid subscription email address was unsubscribed from marketing emails. She received transactional emails only. This underlines that we should sneak in some more light marketing into our transactional emails.
What technology do we need to solve this? Lots of people have multiple email addresses. It’s not a technical issue. However we could benefit from having consistent time-based email cadence (use as a default) augmented by an event-based cadence when users are well engaged.
Is there a barrier to fixing it? No barriers. We have the capability to look at the user’s engagement within the last several months or weeks to separate out an engaged user from unengaged users — at all times!
Inconsistent email cadence
Complaint – she experienced an email dead zone where she didn’t see anything messaging from us for weeks (months?)
What is the root of the complaint? There was a dead zone for several weeks after churn from trial. She eventually got enrolled into a monthly email but monthly may not be enough frequency to maintain engagement.
What technology do we need to solve this? Increase production
Is there a barrier to fixing it? Emails are too difficult to specify right now.
Off-brand copywriting
Complaint – The author and several LinkedIn commenters perceived the emails to be aggressive and ironically not “calming”
What is the root of the complaint? She received several sale-oriented headlines during a large revenue-producing campaign.
What technology do we need to solve this? No new technology necessary to write copy. Slow down and work cross-functionally to capture critique from marketing & content teams to get on the same page for user-facing communication.
Is there a barrier to fixing it? We are not trained copywriters. However, we can learn to write in an on-brand voice. That is a marketable skill that can be augmented with AI.
Referring back to the personalization problem, we could come up with alternate subject lines for well-engaged users who do not need urgency-oriented messaging.
One year ago, in March 2022, a startup contacted me out of the blue to see if I could help them get their Lifecycle program off the ground. I started advising them a month later, in April 2022.
They are an East coast-based company with clusters of employees in the US, Europe and India. My Pacific time day job has almost no overlap with their schedules at all. About 8:30am-10am is the only time they’ve sent me a Slack message. Over 90% of my time has been working asynchronously early in the morning, late at night, or on weekends.
On my first week, I was shell-shocked by the amount of work they wanted to complete. Even one year later, the team continues to be laser-focused. I am thoroughly impressed with the speed and urgency at which they ship week-after-week. The pace is frenetic.
This has turned out to be a great learning opportunity for me as an marketer.
A rudimentary lifecycle automation can bring a lot of revenue.
In the chart below we can see when we launched the lifecycle marketing campaigns at the end of July 2022.
The product is a fantastic utility so it’s an easier sale than other products. I wrote a small collection of emails and we started generating enough revenue from Lifecycle each week to easily cover the cost of the CRM and my hourly consulting for 20 to 30 hours each month.
This program is heavily dependent on top-of-funnel channels
No doubt in my mind that paid acquisition is the life blood of this company. You can clearly see when the ad team was spending money and when they weren’t. Any major spike or dip is directly related to increasing spend or pulling back on spend, respectively.
I tip my hat tip anyone working on doing the ad-buying because that is tough, high stakes work. Lifecycle can close the sale but the paid acquisition team is what brings the customers in the digital doorway.
Dormant users are difficult
Email is the natural channel to re-engage dormant users. We have a giant list of 20 million people who came through to look at the product and disappeared forever.
In my experience it has been extraordinarily tough to get a dormant user to look at the product a second time purely because of a discount email. 0.15% — that’s our actual email conversion rate for dormant users who have never paid before.
We don’t need gigantic volume to make money
Originally the plan for Lifecycle was to send millions of emails per month to get as many eyeballs as possible. Problem: high-volume email services are expensive!
After some thought we budgeted our outreach to the quotas of our Customer Service platform (Intercom): 400,000 unique users per month. That’s one-tenth of the 4,000,000 uniques per month that the marketing team originally wanted to reach. Reaching out to all possible users in the database doesn’t help on revenue. The people who buy mostly are (1) users that hit the paywall or (2) past customers that we win back.
On average we reach out to about 250,000 people per month.
I had to add a disclaimer block to some messaging so that users don’t mistakenly look for coupons on Apple or Android.
I suspect this line of text caused some of the drop.
“This discount is valid only for subscriptions purchased through [domain name]. Offer not valid for subscriptions purchased in the Apple Store or Google Play Store.”
I attended Activate in San Francisco held at the Marriott Marquis. It was a fine time. I gravitated toward high-level strategic talks in-person. I take a look
Most insightful talk: Women Language + Power and Standard Communication by Susannah Baldwin
When I walked into the room vaguely labeled “professional development” session I was late so I hurriedly took a seat at the side of the room. After I got settled and composed I realized I was one of two men in a room of one hundred women. Ooops! I felt way out of place but I stayed in the room and happy I’m happy I did.
The speaker’s point was that women are taught at an early age to speak in a soft or indirect manner. To reach the upper echelons of But that’s not
Many Useful takeaways : Find Your Target: Reaching Different Personality Types Without Flooding Your Marketing Channels by Tim Hemingway, Havas Media
Broadening my horizons: Presenting with Impact by Susannah Baldwin
On my nights and weekends I worked with a startup to automate their Lifecycle email program. Within 3 months of working together the company saved $15k/month and increased new trial subscription starts from 50 per week to 200 per week.
Weekly sales revenue growth before Lifecycle and after. The different color bars and coupon discounts that I tested to optimize pricing.
How did they achieve this?
Prioritized revenue automation as our Q3 goal
Eliminated any initiatives not directly related to the Q3 goal. (Such as brand marketing)
Identifiedevents critical during the customer lifecycle that needed to be sent to the marketing platform.
new user sign up
paywall abandon cart
trial and paid subscription churn (user cancellations or time-based expirations)
Partnered with the engineering teams to get the lifecycle events flowing into the marketing platform of choice. In this case, Intercom.
Monitored and tested the data coming from engineering.
Launched Lifecycle programs
Company Profile
This startup is a subscription-based text-to-speech productivity tool available on the web, iOS, Android, and as a Chrome Extension. To keep things simple, I’ll refer to this startup as TTS Inc.
TTS Inc. is a small-but-mature company that the CEO started in dorm-room in his dorm room a number of years ago. The company had mild growth and accelerated when they got into aggressive paid advertising The team is currently ~100 people, including contractors like myself.
TTS Inc. offers a freemium product. The free tier is the core text-to-speech product with a limited feature set. For example on the free tier the reading speed is capped at 150 words per minute while the Premium tier listening speed is 900 words per minute. 900 words per minute sounds crazy but it’s possible to comprehend.
Most users upgrade to the Premium tier subscription by joining a 3-day trial. The trial requires a credit card and converts to a 12-month subscription, renewable annually.
TTS Inc. reached out to me because they wanted to get their martech stack aligned to allow them to scale and automate their Lifecycle marketing campaigns through email, push and in-app messaging.
Execution
Step 1: Prioritize revenue automation
Lifecycle marketing started as a component within the TTS Inc. Brand marketing team. Brand marketing had two goals.
(1) Increase revenue with Lifecycle (2) establish a consistent brand identity.
Having these two goals caused TTS Inc. to make some missteps that harmed them. Part of the Brand team’s plans for the future was to send a highly stylized, beautiful weekly email newsletters to the active user base. Keeping that future brand-focused state caused me personally to get distracted because I was trying to push their marketing infrastructure to support for a future that had not been realized yet. For instance, I was advocating for us to switch to an email service provider that would make sending high volumes of email easier and cheaper than their current system.
By the end of my first two months we missed our revenue goals. We were getting single-digit trial starts per day. Not good. Our lifecycle program was abject failure.
Since we missed our goal, leadership chose to eliminate the Branding team except for Lifecycle. As a regular listener of Alex Hormozi’s podcast I now understand his view in episode 382: branding is a game the big companies. During this time TTS Inc. was not at the stage where it could spend a lot of money on activities that did not have immediate measurable impact on sales – branding is one of those. Brand-related activities included surveys, newsletters, and highly stylized one-off email sales announcements were a distraction and difficult to attribute to sales.
Now my priority was clear: improve LIfecycle revenue.
Step 2: Eliminate all non-core activities
To become hyper-focused on our one goal we had to stop doing non-sales activity. We dropped doing branding which in turn allowed us eliminate other products.
WE eliminated unnecessary software
TTS Inc. had two marketing-related systems: Drip and Intercom.
TTS Inc. was spending $12-$15k per month on Drip — an email marketing platform designed for small-to-medium sized business. TTS was getting very little out of Drip because they had not dedicated serious engineering resources to get their data synchronized with their own user database.
Having two systems made things worse because engineering didn’t know which systems needed which event? If both systems needed the same events or data there would be some minimal amount of maintenance work involved with keeping things accurate on both platforms. It was an all around mess.
With branding removed from the priorities, leadership made the decision to eliminate Drip from the tech stack. Canceling the drip account saved the company $10,000-$15,000 per month.
WE Eliminated resource-heavy activities
Understanding that Intercom is not well-suited to sending a lot of email (too expensive, bad interface) we pared down email production down to just one person to do all the work with minimal concern for visual appeal.
Brand-focused email:
4 people, 1 week
Mockup email (Lifecycle)
Write email copy in the brand’s voice (copywriter)
Design a pretty email (email designer)
Build the HTML email (HTML developer)
Set up the automation (Lifecycle)
Launch the email (Lifecycle)
Ugly email:
1 person, 2 hours
Cobble together some copy text (Lifecycle)
Build HTML email – basic styling (Lifecycle)
Set up the automation (Lifecycle)
Launch the email (Lifecycle)
In the weeks after eliminating the “pretty” emails I have found that sales have not been noticeably harmed. In fact, email-to-trial conversion rates may have actually gone up.
Step 3: Identify critical events and data to use in the marketing platform
Automation was difficult regardless of marketing platform. Neither of TTS Inc.’s marketing platforms were integrated with the business’s data pipelines. Intercom, in particular, was missing a lot of critical account and subscription-related information. In order to get Intercom operational quickly we stripped down our requirements to a set of eight subscription-oriented Lifecycle events that could be the bare minimum backbone for direct sales messaging.
New user created an account
User saw paywall but did not buy (abandoned cart)
Trial started
Trial expired
Trial canceled
Subscription started
Subscription expired
Subscription canceled
In my experience the subscription events are difficult to get because subscription data comes from many sources: paypal, stripe, apple, Google, etc. The team responsible for managing subscription did a fantastic job in delivering subscription events to Intercom on an hourly basis.
Step 4: Partner with engineering
TTS Inc.’s leadership did an outstanding job of aligning engineering resources to prioritize Lifecycle. This was easy because the company’s engineers are naturally business-minded. Leadership communicated clearly and directly to the engineering teams that Lifecycle’s goal for the quarter was to start making money and to prioritize Lifecycle requests over other initiatives. Being business-minded folks, the engineers were also innately eager to help us get these projects off the ground.
We met with the engineers a few times to discuss our minimum needs and the engineers added in some things that would make reporting easier for other departments (such as ad-buying group, or finance). Since we agreed on the set of events ahead of time I was able to start building the user messaging journeys in Intercom in parallel with the engineering data team’s work.
There were many teams involved in this work:
Platform engineering did the work to synch subscription data to Intercom
Web engineering had to start sending new user signup events to Intercom
Product management team found flows that broke and needed to be migrated from Drip to Intercom
After a rapid 3-4 week development cycle engineering completed their work and we were ready to turn things on.
Step 5: Monitor and test the data
Once engineering launched their respective work we had to double check their data.
For the first few days of the launch we observed that many events were under-firing. Engineering found that in many cases the user’s identity was not correctly being established before sending the data to Intercom. This is not necessarily name & phone number identity — i mean database unique id which is usually a jumble of letters and numbers.
This is an important bug. Marketing systems don’t magically tie data to a user. Engineering has to put operations in the correct order. If you do not have the correct order events that do not have a proper user ID will go to a black hole.
Correct order
user sign up
wait until user id assigned by backend system
establish connection to marketing platform
send events
Incorrect order
user sign up
establish connection to marketing platform
send events
user id assigned by backend system
This is an engineering thing but it’s important to know. In one bug we found, the web app was sending a “new user signed up” event before the user’s ID was established on TTS Inc.’s database. So we were getting a lot of events but no user data. The web app made a small code change to wait until the new user’s id was established on the backend before sending the event data to Intercom. After that we were able to send messaging to new web users.
This is the case for many marketing platforms and if you are losing a lot of event data or getting a lot of “anonymous” or “unidentified” users in your SaaS platform this might be the issue.
In summary: order-of-operations is important. Your engineers need to know that the user’s ID needs to be established before logging any events to your marketing or analytics platforms. (Amplitude, Segment, Iterable, Braze, Intercom, Drip, etc.!)
Step 6: Launch the Lifecycle programs
This is the easy part! Once the data is live and flowing we are free to experiment using the marketing platform.
There is no secret sauce here. Other subscription apps and e-commerce websites follow a similar pattern of direct-to-consumer sales. We mapped the events directly to their own set of emails.
We launched the lifecycle automations and by the first full day of emails upsells were 2x the previous day. Over a 3-week period the average weekly web sales volume was three to four times the typical week.
Further refinements that we made:
built a customized and editable web landing page to test and measure conversions
offered discounted plans
sent in-app messages in each workflow
Conclusion
Although it was a bumpy ride at first, TTS Inc.’s marketing automation stack is well-situated for growth. Within the first week, their lifecycle sales automation performed well far beyond my expectations. Now that they have had consistent sales baseline they can begin to experiment with branding and other marketing tricks to boost conversion performance.
