Waitlist or No Waitlist? 🤔

I wanted to share a few things I learned in the last 72 hours after running a small test on "waitlist/no waitlist" and controlling the flow of feedback:

I ran two tests:
🅰️ brief survey before providing a download link
🅱️ providing the download link and asking for feedback in-app.

Without a 🅰️ performed 10x better from an information exchange standpoint, granted signups were significantly below 🅱️ signups, but then again this was expected as there was no barrier to entry in 🅱️.

🅱️ provided nearly zero feedback. 🅰️ provided useful feedback.

I think moving forward I will keep 🅰️ as is because it has:
✅ narrowed the list down to actual users, not lurkers
✅ provided better and more reliable data
✅ controlled the exchange of information

This means:
⬇️ very small user numbers short term
⬇️ very limited feedback base

The goal is to provide value to folks that are seeking that value while understanding HOW to provide that value.

I think 🅰️ is the most useful at this point in time. I think we all get caught up with seeking that validation early on from a quantitative perspective, that we forget how important qualitative data really is.

Would love to learn how others approached this as well...

Original tweet thread if you want to discuss on the Twitter machine: https://twitter.com/jcalvarezjr/status/1301136897725599751?s=20