GPT-3 was released by OpenAI in 2020 - and was considered by many a huge jump in natural language processing.
GPT stands for Generative Pre-trained Transformer. It uses deep learning to generate text responses based on an input text. Even more simply, it's a bot that creates a quality of text so high that it can be difficult to tell whether it's written by a human or an AI.
GPT-3 is 100x bigger than any previous language AI model and comes pre-trained on 45TB of training text (499 billion words). It cost at least 4.6 million US dollars (some estimated as high as $12 million) to train on GPUs. The resulting model has 175 billion parameters. On top of that, it can be tuned to your specific use after the fact.
Here are some interesting GPT-3 based tools:
- Frase - AI-Curated SEO Content
- Emerson - AI Chatbot
- Viable - Customer Feedback Analytics Platform
- Sapling- Customer Service
Practically, GPT-3 was a huge milestone. It represents a huge jump in NLP's capabilities and a massive increase in scale. That being said, there was a frenzy in the community that may not match the results. To the general public, it felt like a discontinuity; like a big jump toward general intelligence.
To me, and to others I know in the space, GPT-3 represents a preview of what's to come. It's a reminder that Artificial General Intelligence (AGI) is coming and that we need to be thinking about the rules of engagement and ethics of AI before we get there.
Especially with Musk unveiling his intention to build 'friendly' robots this week.
On the scale of AI's potential, GPT-3 was a relatively small step. It's profoundly intelligent in many ways - but it's also inconsistent and not cognitively concrete enough.
Take it from me, the fact that an algorithm can do something amazing isn't surprising to me anymore ... but neither is the fact that an amazing algorithm can do stupid things more often than you'd suspect. It is all part of the promise and the peril of exponential technologies.
It's hard to measure the intelligence of tools like this because metrics like IQ don't work. Really it comes down to utility. Does it help you do things more efficiently, more effectively, or with more certainty?
For the most part, these tools are early. They show great promise, and they do a small subset set of things surprisingly well. If I think about them simply as a tool, a backstop, or a catalyst to get me moving when I'm stuck ... the current set of tools is exciting. On the other hand, if you compare current tools to your fantasy of artificial general intelligence, there are a lot of things to be improved upon.
Clearly, we are making progress. Soon, GPT-4 will take us further. In the meantime, enjoy the progress and imagine what you will do with the capabilities, prototypes, products, and platforms you predict will exist for you soon.
Onwards.
Thoughts on the 'Hindenburg Omen' and Market Instability.
There are many interesting 'indicators' of market movements out there ... from the Big Mac Index to the Super Bowl Indicator, and (of course) more common ones like rolling moving averages.
One of the more supposedly nefarious indicators is the Hindenburg Omen, and the pattern has shown up twice recently.
What is it?
It is a fairly obscure technical analysis pattern, which supposedly gives an early warning of unstable market conditions (and even potentially stock market crashes).
While the calculation is based on five factors, the primary conditions indicate a big disagreement about market conditions.
For example, two of the conditions are that a substantial number of stocks have to be at yearly highs, while a substantial number of stocks have to be at new annual lows. Ultimately, it is hard for those two conditions to be met in a short period of time unless there's uncertainty in the market. Moreover, after a rally, uncertainty is often a precursor to a decline.
In addition, technically (for the pattern to be complete), a second sighting of the five elements must occur within 36 days. Logically, lingering uncertainty is a momentum killer.
Should I Be Worried?
This week, Cumberland Advisors' shared the following from Art Cashin, Director of Floor Operations for UBS Financial Services at the New York Stock Exchange.
Art had this to say:
From my perspective, while this pattern may have correctly predicted every big stock market swoon of the past two decades (including the October 2008 decline), not every Hindenburg Omen has been followed by a crash. Resorting to a geometry analogy: All rectangles are squares, but not all squares are rectangles.
Times are strange - and there's reason to be wary of the markets, but indicators like this are a reason to be cautious, not a basis for trading decisions.
Posted at 06:03 PM in Business, Current Affairs, Ideas, Just for Fun, Market Commentary, Trading, Trading Tools | Permalink | Comments (0)
Reblog (0)