I love statistics. But I also recognize how easy it is to be tricked by data.
Here is an example illustrating how factually accurate statistics can be misleading without proper context.
Take a quick look at this chart showing Robotics funding in July 2023.
If you look at that chart, you might conclude that Pittsburgh is a Mecca of innovation in robotics. Carnegie Mellon is there. That makes sense, right?
However, there's an immediate red flag ... it's only for the month of July 2023.
So the question becomes ... why?
Turns out, that entire number is essentially the result of a single check to Stack AV to recapitulate what was Argo. Argo is a Ford and VW-backed autonomous vehicle startup, and Stack AV is the founders' new self-driving startup.
One significant move skewed the scale so strongly that it trumped major countries' expenditures that month.
There's often an issue about not having enough data to be statistically significant. Another common issue is confusing coincidence with causality.
This isn't meant to undermine the effect of one data point on a chart. For example, think about Taylor Swift's impact on the economy. Taylor's Eras Tour has already netted more than $100M but also reportedly has had a $5B impact on the economy.
Cincinnati reported that Taylor Swift's Concert Tour brought $90M to their city in two days. Her 60,000 attendees pushed the city's hotels to 98% occupancy rates. Beyond that, her concert-goers also consumed the city's restaurants, bars, tourism, and retail.
Here is a different example of accurate data leading to an unusual conclusion, At a Genius Network meeting this week, the creator of OsteoStrong and the X3 bar spoke about people's misconceptions about fitness and workouts. One point, in particular, caught my attention. He claimed that most people only get stronger as a direct result of their workouts about ten times in their lives. This isn't true of competitive athletes or weightlifters - but the average gym goer. Why? His logic was you only get stronger when you take your muscle to failure, past its previous limits. Most people rarely work out to exhaustion and don't keep track of their best. They often stop one rep - or even half a rep - before there's a meaningful improvement.
A good lesson for life.
As entrepreneurs, we've all seen people get the "one big break" or the "one domino" that led to success. The goal is often to be good enough that you only have to get lucky once.
While one data point can ruin a statistic, it can also change your life. The power of an inflection point.
Hope that helps.
Riding The Data Wave - Data Is Becoming a New Asset Class
Data is the fastest-growing commodity, and is today’s “wild west” and the battlefield of today’s tech titans. We talk about AI as this gold rush, but data is the underpinning of it all.
A staggering 328.77 million terabytes of data are created daily, which means around 120 zettabytes of data will be generated this year.
Video is still growing rapidly, but so is IoT, with more than 15% annual growth. There are now almost 20 billion connected devices.
Alphabet, Amazon, Apple, Facebook, and Microsoft all have unprecedented amounts of data (and power).
Rapid growth means little time to create adequate rules. Everyone’s jumping to own more data than the next and to protect that data from prying eyes.
As a great example of this, I often warn people to keep their intellectual property off of ChatGPT or other hosted language models.
I also see it trading, but it’s pervasive in every industry and our personal lives as well.
Collecting basic data and using basic analytics used to be enough ... but not anymore. The game is changing.
For example, traders used to focus on price data ... but there has been an influx of firms using alternative data sets and extraordinary hardware and software investments to find an edge. If you’re using the same data sources as your competitors and competing on the same set of beliefs, it’s hard to find a sustainable edge.
Understanding the game others are playing (and the rules of that game) is important. However, that’s only table stakes.
Figuring out where you can find extra insight, or where you can make the invisible visible, creates a moat between you and your competition and lets you play your own game.
Here is a quick high-level video about Data as fuel for your business. Check it out.
It is interesting to think about what’s driving the new world (of trading, technology, AI, etc.), which often involves identifying what drove the old world.
History has a way of repeating itself. Even when it doesn’t repeat itself, it often rhymes.
With that said, the key to unlocking the pathway to the new world often comes from a new or alternative data set that lets you approach the problem, challenge, or opportunity from a different perspective.
Before e-mails, fax machines were amazing. Before cars, people were happy with horses and buggies.
These comparisons help explain the importance of data in today’s new world economics.
gapingvoid
Data as the New Oil
Petroleum has played a pivotal role in human advancement since the Industrial Revolution. It fueled (and still fuels) our creativity, technology advancements, and a variety of derivative byproducts. There are direct competitors to fossil fuels that are gaining steam, but I think it’s more interesting to compare petroleum to data due to their parallels in effect on innovation.
Pumping crude oil out of the ground and transforming it into a finished product is not a simple process. Yet, it is relatively easy for someone to understand the process at a high level. You have to locate a reservoir, drill, capture the resource, and then refine it to the desired product – heating oil, gasoline, asphalt, plastics, etc.
The same is true for data.
In a sense, data fuels the information economy much like oil fuels the industrial economy. The amount of power someone has can be correlated to their control of and access to these resources. Likewise, things that diminish or constrain access or use of these resources can lead to extreme consequences.
Why Data Is Better Than Oil
The analogy works, but it’s just that, an analogy, and the more you analyze it, the more it falls apart. Unlike the finite resource that is oil, data is all around us and increasing at an exponential rate, so the game is a little different:
Using alternative data gives traders an advantage, but it doesn’t always have to be confidential or hard-to-find information. Traders now have access to vast amounts of structured and unstructured data. A significant source that many overlook is the data produced through their own process or the metadata from their own trades or transactions.
In a word of caution, there are two common mistakes people make when making data-driven decisions. First, people often become slaves to the data, losing focus on the bigger picture. It’s the same mistake people make with AI. Both are tools, not the end goal. Second, even the most insightful data can’t predict black swans. It’s important to exercise caution. Prepare for the unexpected.
The future of data is bright, but it’s also littered with potential challenges. Privacy concerns and data misuse are hot-button topics, as are fake news and the ability of systems to generate misleading data. In addition, as we gain access to more data, our ability to separate signal from noise becomes more important.
I think one of the biggest problems facing our youth - and really all of us - is how much information is thrust at us every waking moment of the day. No previous generation has had this much access to data. As a result, many are actually less informed than in the past. Soundbites become the entire news story, and nuance gets lost in the echo chambers.
The question becomes, how do you capitalize on data without becoming a victim of it?
Food for thought!
Posted at 03:58 PM in Business, Current Affairs, Gadgets, Ideas, Market Commentary, Science, Trading, Trading Tools, Web/Tech | Permalink | Comments (0)
Reblog (0)