On Tuesday, for less than an hour, early in the workday, it felt like the internet was down for many. The cause? Cloudflare went down. Cloudflare offers web services to over 16 million websites. That includes sites like HubSpot, Medium, UpWork, 9gag, Discord, Sirius XM, Shopify, Coinbase, Canva, Soundcloud, Buzzfeed, and Capitalogix.
Even down detector was down.
That means when Cloudflare went down, so did a non-trivial portion of the internet. W3techs reports approximately 10% of the internet was affected by Cloudflare being down.
What happened?
via DigitalAttackMap
There was a massive spike in CPU utilization. At the time, it looked like a DDOS attack. People were speculating that it was a Chinese attack trying to mess with the Hong Kong protests.
Turns out, it was bad code - specifically, a single misconfigured rule within their firewall services. They did a global rollout of the code, and so it affected everyone.
This shows the importance of staged rollouts - testing your releases live with test groups before being released globally.
Here's a great write-up from Andy Ellis on preventative measures in the future.
The reality is, using a CDN is still helpful, Cloudflare's downtime doesn't mean you shouldn't use them.
It does mean we should be thinking about what failsafes are needed to keep the internet infrastructure working in the event of attacks or failures.
Attacks are becoming more common, and as we now expect constant improvements/releases to software, we can expect more company errors as well. Facebook had similar issues on Wednesday.
Think of how much relies on the internet as a backbone. It's crazy to think about the impact sustained downtime would have; billions of dollars in business not happening, banking systems down, etc. Realistically, if the entire internet goes down we likely have bigger issues to worry about, but this event shows that large swaths of the internet could be affected at once.
Would a decentralized network help? Are smart contracts necessary for that? Is there a CDN for CDNs?
It feels like we often end up with more questions than answers.
It is why many companies opt for a hybrid cloud with plenty of on-premise compute.
What do you think?
Fueling Alpha: Data is Powering the New World
Data is becoming a precious commodity.
A staggering 90% of all the world’s data (2.5 quintillion bytes per day) has been created in the past two years alone ... and its value is rapidly rising.
With IoT growing from 2 billion devices in 2006 to a projected 200 billion by 2020 you can expect to see that growth continue to explode.
Data is today’s “wild west” and the battlefield of today’s tech titans. Alphabet, Amazon, Apple, Facebook, and Microsoft all have an unprecedented amount of data (and power).
Rapid growth means little time to create adequate rules. Everyone’s jumping to own more data than the next and to protect their own data from prying eyes.
I see it in trading, but it’s pervasive in every industry and in our personal lives.
Having basic data and basic analytics used to be enough, but the game is changing. Traders used to focus on price data, but now you’re seeing an influx of firms using alternative data sets to find an edge. If you’re using the same data sources as your competitors and competing on the same set of beliefs, it’s hard to find a sustainable edge. Understanding the game they’re playing, and their rules are important, but that’s table stakes.
Figuring out where you can find extra insight, or where you can make the invisible visible, creates a moat between you and your competition, and it lets you play your own game.
I shot a video where I talk high-level about Data as fuel for your business. Check it out.
It is interesting to think about what’s driving the new world (of trading, of technology, of AI, etc.) and that often involves identifying what drove the old world. History has a way of repeating itself.
Before e-mails, fax machines were amazing. Before cars, you were really happy with a horse and buggy.
It’s in these comparisons that I think we can help explain the importance of data in today’s new world economics.
via gapingvoid
Data as the New Oil
Petroleum has played a pivotal role in human advancement since the industrial revolution; it fueled (and still fuels) our creativity, technology advancements, and a variety of derivative products. There are direct competitors to fossil fuels that are gaining steam, but I think it’s more interesting to compare petroleum to data due to their parallels in effect on innovation.
The process of pumping crude oil out of the ground and transforming it into a finished product is far from simple, but anyone can understand the process at a high-level. You have to locate a reservoir, drill, capture the resource, and then refine it to the desired product – heating oil, gasoline, asphalt, plastics, etc.
The same is true for data.
Data can be seen as the fuel to the information economy and oil to the industrial economy. The amount of power someone has can be correlated to their control of and access to these resources ... and, leaking of these resources can lead to extreme consequences.
Why Data Is Better Than Oil
The analogy works, but it’s just that, an analogy, and the more you analyze it, the more it falls apart. Unlike the finite resource that is oil, data is all around us and increasing at an exponential rate, so the game is a little different:
Using alternative data gives traders an advantage, but it doesn’t always have to be confidential or hard to find information. Traders now have access to vast amounts of structured and unstructured data. An important source that many overlook is the data produced through their own process or the metadata from their own trades or transactions.
In a word of caution, there are two common mistakes people make when making data-driven decisions. First, people often end up slaves to the data, losing focus on the bigger picture. Second, even the most insightful data can’t predict black swans. It’s important to exercise caution.
The future of data is bright, but it’s also littered with potential challenges. Privacy concerns and misuse of data have been hot button topics, as have fake news and the ability of systems to generate misleading data. In addition, as we gain access to more data, our ability to separate signal from noise becomes more important.
The question becomes, how do you capitalize on data, without becoming a victim to it?
Food for thought!
Posted at 06:53 PM in Business, Current Affairs, Ideas, Market Commentary, Science, Trading, Trading Tools, Web/Tech | Permalink | Comments (0)
Reblog (0)