What we learned from our first free pilot
Nobody's talking about this, but free pilots are neither the perfect approach nor are they useless.
We did 1 just after launching with a selected audience on LinkedIn, giving them free access for 4 weeks to our tool.
In total, we enrolled 37 people in the pilot program. However, only 8 actually used our tool (we're collecting usage metrics, so we know). And from those, only 2 converted to paying customers.
What we found is that there's basically 3 steps in the funnel:
- ICP - The person is fitting the ideal customer profile
- Interest - The person is currently interested in your product/service
- Buying Intent - The person will actually pay
In our pilot, we got mostly type 2 people. I would argue it's basically impossible to identify type 3 people without actually asking them to pay (which is the opposite of a free trial).
So, in conclusion: don't do a free trial to get customers/revenue. It's high-touch to manage pilots, and only worth it if you actually have a very high ACV (annual contract value). We’re coming from the agency space, we're used to a high ACV, but our product is actually low ACV, so we had to shift our approach
A free pilot is great if you want to get actual users moving through your signup flow, get some usage, and also some feedback (quick tip: always take the feedback with a grain of salt since it’s coming from people who aren’t paying).
From our free pilot program, we saw patterns emerge, such as the weak spots in our product, because everyone kept running into the same issues.
While the pilot program was useful for a while, we stopped it since we got our feedback, and it wasn't worth it from a monetary point of view.
Now we're working only with paid customers whose opinions we can trust more to shape our product development since they're voting with their wallets and aren't tire kickers.
That's a really good idea, only for use we are having the problem where our service costs a lot on our end (high variable cost) to keep running, so we would loose money if we gave them every feature free for an extended period of time. It's something we've been struggling with. Do you have any idea how we would go about this?
Thanks, Matt!
i'm struggling with this building firstqa.
started with a couple free pilots to see how they use the platform and the oboarding, but now trying to convert into paid.
why 4 weeks? curious if a shorter window would've surfaced the same patterns faster.
Yes, that's likely true
I think the biggest lesson is exactly what you said: activation matters more than signups.
The 37 people showed curiosity, but the 8 who actually used the product were validating a real problem. I'd be digging into what those 8 had in common their timing, workflow, company size, or urgency because that's probably a better definition of your ICP than the original outreach criteria.
Paid customers are definitely a stronger signal, but those activated users often reveal why people become paying customers in the first place.
the 37 > 8 > 2 funnel is the part worth studying. most founders focus on the 37 ("look, signups!") but the 8 who actually used it are the real signal. did you find any pattern in what made those 8 different from the other 29? that's usually where the ICP insight actually lives — not in who signs up, but in who activates without being hand-held.
The ICP / Interest / Buying-Intent split is a clean framework, and the honest "37 enrolled, 8 used, 2 converted" funnel is more useful than most launch-recap posts because you're showing the drop-off, not hiding it.
One sharpening on your conclusion. "Don't do a free trial to get customers, only worth it at high ACV" is half right, but the real variable isn't ACV, it's whether the free version creates buying intent or satisfies it. A free pilot fails when the free thing fully scratches the itch, because the person gets the value and leaves. It works when using the free version makes the unsolved part of the problem more visible. The question isn't "is my ACV high enough to justify the hand-holding," it's "does my free tier make people want the paid tier or replace it." If the pilot satisfies the need, no ACV saves it. If it creates the need, even low ACV converts.
Your low-ACV product probably converted poorly because the free 4 weeks gave people enough to solve their immediate problem without hitting the wall that makes them pay. Worth diagnosing which it was, because the fix differs. If free satisfies, you need a tighter free tier that stops at the cliff. If free created interest but not intent, the conversion mechanism (the ask, the timing, the friction) is the problem, not the pilot itself.
The "take feedback from non-payers with a grain of salt" point is right and most founders learn it too late. The sharpest version: free users tell you what's broken, paid users tell you what's worth building. The first is debugging, the second is roadmap. You need both but they're not interchangeable, and weighting free feedback as roadmap is how products get bloated with things tire-kickers asked for and nobody paid for.
The pivot to paid-only feedback is the right call. What's the conversion looking like now that you're not running pilots, did cutting the free path actually hurt top-of-funnel or did it just remove the tire-kickers?
Good retro! What's your thought on free pilots vs free trials?
Same thing for me
One angle I haven't seen mentioned yet: the 4-week calendar window might have been part of the problem, since it measures time rather than progress. A pilot structured around a specific milestone, like 'get to your first qualified lead' or 'connect your first ICP list,' tends to surface buying intent faster than a fixed calendar period, because you can see exactly who never reaches step one versus who reaches it and stalls. I've also found that switching the ask from 'try it free' to 'book a 15-minute setup call' filters out a huge chunk of tire-kickers before you ever burn support time on them, since low-effort curiosity rarely survives a scheduling step. Now that you're paid-only, has your top-of-funnel volume dropped as much as you'd expect, or did removing the free option mostly filter out noise without hurting the count of serious conversations you're having?
The ICP → Interest → Buying Intent breakdown is sharp. One thing I'd add from being in a pilot right now: the most valuable output of a free pilot often isn't conversions at all — it's the fact that "everyone kept running into the same issues." Finding where the product breaks, from real usage, is worth more at this stage than the two customers.
On the type-2 vs type-3 problem (interested vs. will-actually-pay): a cheap filter that doesn't require asking for money yet is asking them to do a small chunk of setup work — connect an account, import their data, invite a teammate. People with real intent will spend 10 minutes on setup; tire-kickers won't. It's not as reliable as a credit card, but it separates "interested" from "will act" a lot better than raw usage does.
Fully agree on salting free-user feedback, though. The people who didn't pay are describing a product they were never going to buy.
helpful information
Free pilots are gold for this reason — they strip away pricing objections and show you exactly where users actually get stuck (not where you think they'll get stuck). The feedback you get from a 10-person free beta is sharper than from 100 paid signups. How are you measuring success on the pilot? Is it activation or retention?
the free feedback grain-of-salt point is underrated. we had a similar experience — free users will tell you they love features they never actually use, and complain about things that paying customers consider non-issues. the signal quality difference between free and paid feedback is massive, especially for AI products where usage patterns vary so much between "trying it out" and "depending on it daily."
Here I am launching a free pilot of my reconstitution calculator just to read to not do a free trial haha.
The gap between signups and actual usage is brutal and most people don't talk about it. 37 enrolled, 8 used it is pretty common honestly. The ones who convert are almost always the ones who had the problem before finding you, not the ones who signed up out of curiosity. Did you notice any difference in how the 8 who used it found out about the pilot vs the 29 who didn't?
I've been thinking about building a vehicle rental platform, but I'm hesitant because there are already so many established apps in the market.
I'm curious to hear from people who have actually rented bikes or cars.
What do you dislike about the current apps?
Have you ever avoided renting because of a bad experience?
What feature do you wish existed but doesn't?
What would make you switch to a new rental platform instead of using the popular ones?
If you could change one thing about existing rental services, what would it be?
I'm not trying to advertise anything—I just want to understand whether there's still an unsolved problem worth building for.
I'd really appreciate your honest opinions, even if your answer is "the market is already saturated."
Good to test with a free pilot. At least you got to find what the common pain points were and the feedback to improve. Its just lessons learned to help you make a better product and test customer acquistion. Good learning experience.
The number that stands out to me isn't the 2/8 conversion; it's the 8/37 activation — ~78% enrolled and never even logged in. Free access quietly removes the one thing that drives activation: a little skin in the game. People show up for what they've committed to.
That's also the fix for your "can't spot type-3 without asking them to pay" problem — so ask, just smaller. A paid pilot (even a token fee, or a refundable deposit) instead of a free one self-selects out the tire-kickers, and the people who do pay actually use it — so you get real intent signal and higher activation, the two things a free trial kills. For low ACV especially, a few paying design partners beat 37 free seats you have to chase.
Free's still the right tool when the goal is purely usage + finding the weak spots (which you nailed) — just not for revenue or intent. Thanks for posting the real numbers.
The 8 who actually used it are your real ICP, and the conversion lesson sits underneath that. We gave away free migrations at my old company for years, and they converted not because they proved value but because once we had moved a client's infrastructure, walking away meant redoing the pain. A free pilot the user can abandon at zero switching cost rarely converts no matter the ACV, so build the pilot around something they cannot easily unwind.
That 37 -> 8 -> 2 funnel is useful, especially for AI products with real variable cost. One thing we learned building Tokens Forge is that free pilots need a usage budget and a receipt, not just a time limit: which model route ran, which API key/project used it, how much balance it burned, and whether retries/fallbacks inflated the cost. That keeps the pilot useful for learning without letting curiosity traffic look like paid intent.
This matches what I just went through. Ran a free pilot for a voice agent with a small business, and the trap is exactly what you said: a free pilot validates the product, not the demand. I got clean proof the thing works, but the calls were mostly the owner and friends testing it, not real paying intent. Two different validations and people conflate them. The free pilot answers "does it work", only money answers "does anyone actually want this".
This is a useful distinction between interest and actual buying intent.
Free access can make people say yes very easily, but it does not necessarily mean the problem is painful enough for them to pay. I also agree that usage behavior is often more valuable than verbal feedback during a pilot.
The 37 signups turning into 8 active users is especially interesting. Did you notice any clear difference between the 8 who used the product and the 29 who did not? For example, were they facing a more urgent problem, or did they already have an established outbound workflow?
I am working on a consumer subscription app, so the ACV is much lower, but I am facing a similar question: how much free access is enough to learn from users without attracting people who were never likely to pay?
That's a great question. Finding the right balance between free access and paid features often takes testing and user feedback. A limited free experience that highlights your app's value can help attract genuine users while reducing abuse from people who were never likely to subscribe. I’ve noticed a similar approach works well with apps like Capcut Apk, where users can explore core features before deciding whether they need more advanced functionality.
looking good
This is how it's done! Hook them up first and then keep them in the long term.
All the best
That's good feedback! I launched this week and am currently B2C to get some brand recognition and eventually leverage our mission of helping people to get B2B deals to make sure we can make revenue and continue to keep this free for users so eventually a pilot was the goal when we enter B2B. Thanks for the thoughts on this!
Money talks, and only money talks