It seems like a lot of people value certainty. People buy a lot of products and stories for certainty. Insurance. Investment advice. Forecasts. Indulgences.Many entrepreneurs, in particular those in data science, sell certainty. What else is an F1 score other than a measure of certainty on some level? Given some inputs, our machine transforms them some way, which produces some statement about the past, present, or future, with some quantifiable amount of certainty, so that you can do something with confidence (or feel more secure). We sell certainty. And yet isn’t it curious about how much insecurity we’re creating while we do so? It has always been easier to sample data from the past, pull a heuristic from it, and[…]
Tag: data driven culture
Data scientists spend so much time focused on learning: both machine learning and human learning. A machine can learn. A data scientist spends a lot of time just trying to persuade a machine to learn. It just takes a lot of labelled data. What about collections of people? Organizations can learn too. It’s just that the data isn’t all labelled well. Why Organizational Learning is Important I was so impressed with Carl Anderson’s synthesis two years ago, about Data Driven Cultures, that I unpacked it and applied it to startups and strategy. Coming back to it now, in 2018, a lot of what he was saying is purely about learning. Carl Anderson, 2015, described a data driven culture as on that:[…]
Ben Thompson calls culture the accumulation of decisions. Assume that it’s true. How do decisions at a tech startup come into being in the first place? A startup can be instantiated with the business plan. And if you take a Beinhocker (2006, The Origin of Wealth) approach to it, you may believe that there’s a Library of Smith which contains every single business plan that’s possible. There are trillions upon trillions of potential business plans. And management is pretty much reduced to a machine that is able to execute the plan to generate wealth. Everything that has potential is possible at the beginning and assume competent management. (Image related – a bit esoteric*). In the context of a startup, a[…]
A great mind in public policy told me, just this last September, that people are really bad at judging the rate of technological change and when it’ll affect them. It’s like standing on a railway. You can see the train out there. Some people assume that the train is going to hit them very soon. They get off the tracks. Then, when the train is getting very close, others misjudge the speed and assume that it’s still a far way. And then they get hit. It’s a great analogy because it combines prediction with decision. The rate of technological change is actually quite difficult to predict. If it was easy there’d be a lot more successful startups. One Heuristic Start[…]
Some work is very clearly product work. It’s work on things where the success and failure is dependent on the users of the thing. Your users pay you. Their satisfaction matters above all else. Optimizing for the satisfaction of end users is a distinct activity. Hypotheses have to be assessed and then tested – because it’s very likely that you’re going to be wrong. There’s technology that has to be set up such that it’s reliable and robust for the intermediate to long run. It’s designed to be effective and persistent, with all of the instrumentation that goes along with that. That might include manual A/B testing, user-focused analytics, and extra special attention on the optimization objective. Clear product work is[…]
Why does it seem like all the unimportant, easy stuff gets done first? Look up The Urgency Bias. Employing simplified games and real-life consequential choices, we provide evidence for “urgency bias”, showing that people prefer working on urgent (vs. important) tasks that have shorter (vs. longer) completion window however involving smaller (vs. bigger) outcomes, even when task difficulty, goal gradient, outcome scarcity and task interdependence are held constant.- Zhu, Yeng, Hsee (2014) Even when task difficulty, goal gradient, outcome scarcity AND task interdependence is held constant, urgency wins. Even when it would be more beneficial to do something important instead of something urgent, even when you’re painfully made aware of those incentives, you still gravitate towards doing the urgent. There’s[…]
In general, information retrieval from analytics systems becomes harder with the degree of customization (It gets harder to find things over time). That customization is frequently an expression of the values of a culture over time. The inertia of the technical debt caused by early customization is greater than the inertia of a data driven culture. There are no silver bullets. The rest of this post unpacks that paragraph. Information retrieval from analytics systems becomes harder with the degree of customization Assume a vanilla implementation of Open Web Analytics. Or Google Analytics. Or Adobe Analytics. It’ll tell you a lot about a web system on its own. The optimization objective that is at the core of the business will typically[…]
A data driven culture isn’t necessarily devoid of creativity or imagination. Just the opposite. They’ll have to be especially patient around brand formation. Brands A brand exists in the mind of a person. It usually costs a lot of money for a brand to be impressed upon the cortex of a person. There are certain economies of scale that kick at scale, but still at a considerable cost. If that feels fuzzy, despair not. The framework below is fantastic: Brand and CAC The optimization objective of a startup is valuation. To maximize valuation, Customer Acquisition Cost has to be minimized. As previously explored, nature doesn’t cooperate to keep CAC low. The point of the brand is to reduce CAC[…]
Assume that you’re a founder of a tech startup. Assume that you’ve achieved product-market-solution fit. You’ve nailed it. Time to scale. Many founders are great at sales. But not all founders are great at marketing. And that’s a bit of a problem because of three letters: CAC. The Customer Acquisition Cost CAC is the ratio between dollars spent on marketing, and new customers acquired. And it is related to valuation in a very important way. Let me explain. Take a look at the chart below. This is an output from a standard model of SaaS market penetration. Market size is 333,333 customers, the product will approach saturation at 51% of that target, with a monthly churn rate of 0.20% held[…]
A digital product will go unloved for years. Somebody new comes into the organization and is tasked with the redesign. Two years and a lot of money, tears, and bruises later, a totally changed product is launched. People hate it. Sometimes the creative force behind the redesign, expecting an avalanche of applause and a Lion, can’t believe that people hate it. Traffic falls. And sometimes people get fired. Usually a few just go away. People are afraid to touch the site. A site goes unloved for years. There’s a binge and purge cycle. It may be the case that not too many people are even that good at managing change at all. Maybe that’s a skill that isn’t too common,[…]