Last year, around this time I shared an article on data as the new precious commodity. In case you missed it, I thought it was worth revisiting. The closing feels even more relevant today than when I wrote it. Below is the article in its entirety
Data is becoming a precious commodity.
A staggering 90% of all the world’s data (2.5 quintillion bytes per day) has been created in the past two years alone … and its value is rapidly rising.
Rapid growth means little time to create adequate rules. Everyone’s jumping to own more data than the next and to protect their own data from prying eyes.
I see it in trading, but it’s pervasive in every industry and in our personal lives.
Having basic data and basic analytics used to be enough, but the game is changing. Traders used to focus on price data, but now you’re seeing an influx of firms using alternative data sets to find an edge. If you’re using the same data sources as your competitors and competing on the same set of beliefs, it’s hard to find a sustainable edge. Understanding the game they’re playing, and their rules are important, but that’s table stakes.
Figuring out where you can find extra insight, or where you can make the invisible visible, creates a moat between you and your competition, and it lets you play your own game.
I shot a video where I talk high-level about Data as fuel for your business. Check it out.
It is interesting to think about what’s driving the new world (of trading, of technology, of AI, etc.) and that often involves identifying what drove the old world. History has a way of repeating itself.
Before e-mails, fax machines were amazing. Before cars, you were really happy with a horse and buggy.
It’s in these comparisons that I think we can help explain the importance of data in today’s new world economics.
Petroleum has played a pivotal role in human advancement since the industrial revolution; it fueled (and still fuels) our creativity, technology advancements, and a variety of derivative products. There are direct competitors to fossil fuels that are gaining steam, but I think it’s more interesting to compare petroleum to data due to their parallels in effect on innovation.
The process of pumping crude oil out of the ground and transforming it into a finished product is far from simple, but anyone can understand the process at a high-level. You have to locate a reservoir, drill, capture the resource, and then refine it to the desired product – heating oil, gasoline, asphalt, plastics, etc.
The same is true for data.
You've got to figure out what data you might have, how it might be useful, you have to figure out how to refine it, clean it, fix it, curate it, transform it into something useful, and then how to deliver it to the people that need it in their business. And even if you've done this, you then have to make people aware that it's there, that it's changing, or how they might use it. For people who do it well, it's an incredible edge. – Howard Getson
Data can be seen as the fuel to the information economy and oil to the industrial economy. The amount of power someone has can be correlated to their control of and access to these resources … and, leaking of these resources can lead to extreme consequences.
Why Data Is Better Than Oil
The analogy works, but it’s just that, an analogy, and the more you analyze it, the more it falls apart. Unlike the finite resource that is oil, data is all around us and increasing at an exponential rate, so the game is a little different:
Data is a renewable resource. It’s durable, it’s reusable, and it’s being produced faster than we can process it.
Because it’s not a scarce resource, there’s no urge to hoard it – you can use it, transform it, and share it knowing that it won’t diminish.
Data is more useful the more you use it.
As the world’s oil reserves dwindle, and renewable resources grow in popularity and effectiveness, the relative value of oil drops. It’s unlikely that will happen to data.
Also, while data transport is important, it’s not expensive the way oil is. It can be transported and replicated at light speed.
Using alternative data gives traders an advantage, but it doesn’t always have to be confidential or hard to find information. Traders now have access to vast amounts of structured and unstructured data. An important source that many overlook is the data produced through their own process or the metadata from their own trades or transactions.
In the very near future, I expect these systems to be able to go out and search for different sources of information. It's almost like the algorithm becomes an omnivore. Instead of simply looking at market data or transactional data, or even metadata, it starts to look for connections or feedback loops that are profitable in sources of data that the human would never have thought of. – Howard Getson
In a word of caution, there are two common mistakes people make when making data-driven decisions. First, people often end up slaves to the data, losing focus on the bigger picture. Second, even the most insightful data can’t predict black swans. It’s important to exercise caution.
The future of data is bright, but it’s also littered with potential challenges. Privacy concerns and misuse of data have been hot button topics, as have fake news and the ability of systems to generate misleading data. In addition, as we gain access to more data, our ability to separate signal from noise becomes more important.
The question becomes, how do you capitalize on data, without becoming a victim to it?
Back in June, I participated in a series of webinars for IBM. The focus was on building smart and secure financial services. My talk, specifically, was on advanced computing and the new world of trading. Challenging times drive advancement – and what better time to talk about advancements in technology (and their applications) than in the midst of a global pandemic.
You can watch a replay of the Fintech webinar here. There are several interesting presentations. If you just want to watch my presentation, it starts at the 5:16 mark.
In addition, I've uploaded a different version of just my talk that you can watch directly here.
In the past. trading used to be about people trading with people. Markets represented the collective fear and greed of populations. So price patterns and other technical analysis measures really represented the collective fear and greed of a population. If you could capture that data and figure out certain statistical probabilities, you might have had an edge. The keywords is "might have".
If you had more information than your competitors – an information asymmetry – you had an amazing edge. At one time that was being able to print out reports on stocks from that new-fangled technology called the internet. As time passed, it became harder and harder to gain an asymmetric information advantage.
The rules, the players, and the game have all changed. Today, technological asymmetry is a major factor, and your edges come from things like bigger and faster servers and low latency connections to markets.
In the future, I see those edges combining as artificial intelligence starts to leverage exponential technologies and new data sources (like alternative data and metadata feedback loops). It is easy to imagine a time when information is the fuel, but your ability to digest and parse that information is the engine.
I talk about much more in the video but boiling down the main points, ask yourself (in business, in trading, in life) are you separating the signal from the noise?
A technological advantage doesn't mean anything if you're plugging in inaccurate or biased data into it.
We've talked about it over the past few weeks with the never-ending news cycle – but it's a lesson that's infinitely applicable.
We're now two days into August. U.S. GDP is down 33% on an annualized basis, the largest quarterly decline since the series began in 1947. For context, 1% is a recession, "The Great Recession" peaked with 8.4% in December 2008, and 15% was The Great Depression.
Adding insult to injury, approximately 40% of renter households are at risk of eviction. On Friday, the federal moratorium on evictions expired. Consequently, 25 million Americans have stopped receiving their $600 weekly unemployment checks. Many states have stopped or are rolling back their reopening plans.
Jobless rates, which have been trending downward since March, and credit card spending, which had been trending upward, have both reversed. The corrections weren't nearly as pronounced as the initial shocks.
So there's the bad news, but let's try and find some silver linings:
First, the prediction for the contraction was 35%, so we're below that number, and job creation in May and June surpassed expectations by almost 12 million.
Compared to previous contractions, we entered it on a much stronger footing as a result of the long-term expansion.
As well, remember that 33% number is based on an annualized rate (which assumes the trend will continue, meaning the economy is really only about 10% smaller than in the first quarter).
Many states are still reopening, and the rest have various recovery efforts underway.
The economic consequences of the public health crisis and the measures taken in response will continue to affect the course of the economy for a long time. The recovery will be protracted. But, we're resilient, and we know how to dig ourselves out of this hole. In addition, the whole world is going through a similar crisis. For the most part, I'd rather be here than almost anywhere else. My sense is that people with capital feel the same way, and that is a very positive indicator of why our economy will suffer less and recover faster than other economies.
As I've mentioned before, fear plays as much a role in the recovery as other factors. If people believe in the future, their habits affect the economy differently than if they're at home, hoarding what they have left.
Personally, I believe we're about to see a tough time, with increased volatility and a lot of noise. It is increasingly likely that we will see another push downwards in the markets. I believe that America is well-positioned to adapt and recover. As a company, my sense is the strongest are not the most likely to survive and thrive in times like these. This is a time where adapting and responding to new opportunities and threats will separate the winners from the losers.
"Fate has ordained that the men who went to the moon to explore in peace will stay on the moon to rest in peace." – Nixon's Apollo 11 Disaster Speech
In an ideal world, history would be objective; facts about what happened, unencumbered by the bias of society, or the victor, the narrator, etc.
I think it's apparent, that history as we know it is subjective. The narrative shifts to support the needs of the society that's reporting it.
The Cold War is a great example where during the war, immediately after the war, and today, the interpretation of the causes and events has all changed.
But while that's one example, to a certain degree, we can see it everywhere. We can even see it in the way events are reported today. News stations color the story based on whether they're red or blue, and the internet is quick to jump on a bandwagon even if the information is hearsay.
Now, what happens when you can literally rewrite history?
“Every record has been destroyed or falsified, every book rewritten, every picture has been repainted, every statue and street building has been renamed, every date has been altered. And the process is continuing day by day and minute by minute. History has stopped.“ – Orwell, 1984
That's one of the potential risks of deepfake technology. As it gets better, it becomes easier to create "supporting evidence" for whatever narrative a government or other entity is trying to make real.
On July 20th, 1969 Neil Armstrong and Buzz Aldrin landed safely on the moon. They then returned to Earth safely as well.
MIT recently created a deepfake of a speech Nixon's speechwriter William Safire wrote during the Apollo 11 mission in case of disaster. The whole video is worth a watch, but the speech starts around the 4:20 mark.
Media disinformation is more dangerous than ever. Alternative history can only be called that when it's discernible from the truth, and unfortunately, we're prone to look for information that already fits our biases.
As deepfakes get better, we'll also get better at detecting them, but it's a cat and mouse game with no end in sight. In Signalling theory, it's the idea that signallers evolve to become better at manipulating receivers, while receivers evolve to become more resistant to manipulation. We're seeing the same thing in trading with algorithms.
I'm excited about the possibilities of technology, and I believe they're predominantly good. But, as always, in search of the good, we have to acknowledge and be prepared for the bad.
Tomorrow is my 57th birthday. I can't believe how time flies. Birthdays seem to come more quickly as you get older.
It makes sense, though, I suppose. When you were four, a birthday represented a quarter of your life. Now, a year represents a much smaller percentage.
While it's not always pleasant getting older, it sure beats the alternative.
I made a concerted effort this year to make strides towards being more healthy, fit, and vital in mind, body, and spirit. If you are going to live longer, your future has to be compelling. I always strive for my future to be bigger than my past.
As time marches on, I become increasingly grateful for the friends and family who share the journey with me.
When I was a kid, I couldn't imagine being where I am today … nor could I imagine the path that got me here. Looking back, it all seems to make sense (even though it felt pretty random while making my way through it).
I feel lucky to have been in the right place at the right time, so consistently, and to find the gift in most situations (even when it seemed so well hidden).
I'm grateful for a lot today, and as much as I love innovation, sometimes things are perfect just the way they are.
Hopefully, you took time this weekend to let someone know they're important to you. If not, now is a good time for that too!
Jeff Bezos is officially worth ~$172 Billion dollars; more than he was worth before his divorce.
Everyone on earth is closer to being a millionaire than he is. Think about that. He has so much more than $1 million dollars that the homeless person willing to work for food is closer to being merely a millionaire than Bezos. The med school graduate with $100K+ in debt? Closer to being a millionaire than Bezos. Obvious at one level … but crazy to think about on another level, right?
Humans are notoriously bad at large numbers, so it's hard to wrap our minds around something of that scale.
I've recently seen a couple of good visualizations of the difference between a million and a billion dollars.
If you have an hour to "waste," this comprehensive video by Tom Scott shares a couple of different ways to look at it, and he literally goes on a road trip to show the difference.
One good example from the video is "It would take almost 12 days for a million seconds to elapse and 31.7 years for a billion seconds." A billion seconds from today would be 1988.
Another:
1 dollar
0.0043 inches or 0.00010922 meters (thickness)
1B dollars
1B x 0.0043 inches → 4.3M inches → 68 miles
1B x 0.00010922 meters → 109K meters → 109 kilometers
Now multiply that by 172.
In distance, Bezos's net worth is a hair under half the equatorial circumference of the Earth.
Here's a link to specifically understanding Bezos's net worth – https://mkorostoff.github.io/1-pixel-wealth. If you were to spend a dollar every second for an entire day, you would spend $86,400 per day. If you have a million dollars, you can do that for approximately twelve days. With a billion dollars, you can do that for over 31 years. Ignoring the difference between net worth and cash, Jeff Bezos could spend over $9M per day for over 31 years.
Lastly, here's a shorter video visualizing the $10 Trillion in economic stimulus the U.S. government has been undertaking.
Even with these depictions, it's hard to understand. We're wired to think locally and linearly, not exponentially (it's one of the reasons I love AI so much).
The monthly deficit in June was ~$864 billion, which is nearly as much as 2019's yearly deficit. Here's a good link to explore the complexities around the U.S. deficit, and what it means in the greater scheme of things.
Here are some of the posts that caught my eye recently. Hope you find something interesting.
via 
