Tag
This article reflects on the early use of GPT-3 for vibe coding in 2020, highlighting its role in shaping AI-assisted development.
The article recounts Jerry Tworek’s experience building an AI research idea before it received funding, and how a single encouraging comment from his chief scientist helped move the project forward.
The author reflects on how AI milestones like passing the Turing test and GPT-3's capabilities have been quickly normalized, urging the community to appreciate the current moment of AI advancement towards AGI.
A breakthrough in robotics has been announced, likened to the impact of GPT-3 in AI, with Generalist AI releasing Gen-1.5 as highlighted in an excited tweet.
The article recounts a 2020 VR project featuring a GPT-3-powered toaster named ToastGenie, which engaged users with toast-themed conversations and ejected virtual food items, showcasing early creative AI applications.
Sam Altman's 2022 email reveals OpenAI considered releasing a GPT-3 level model for local consumer hardware to discourage competitors.
Dan Shipper reports that despite automating everything possible with AI agents, his company has grown from 4 to 30 human employees since GPT-3, arguing that AI makes expert competence cheap and drives up demand for human work.
Dan Shipper reports that automating with AI agents has increased human work and employee count, highlighting structural reasons why AI drives up demand for expert labor.
Waymark fine-tunes GPT-3 to automatically generate marketing copy and video scripts, solving a key customer pain point where two-thirds of users struggled with scriptwriting for video ads.
Article discusses using GPT-3 to create advanced AI-powered characters for applications, likely in gaming, interactive media, or virtual environments.
OpenAI researchers demonstrate that GPT-3 can learn to express calibrated uncertainty about its answers in natural language without using model logits, introducing the CalibratedMath benchmark suite to evaluate this capability. The approach shows robust generalization under distribution shift and represents the first evidence of models expressing well-calibrated verbal uncertainty about their own predictions.
OpenAI Codex, a natural language-to-code system based on GPT-3, is now powering 70+ applications across various use cases including GitHub Copilot. Azure OpenAI Service has expanded availability to limited preview, enabling enterprise access to Codex and other OpenAI models.
OpenAI announces new Edit and Insert capabilities for GPT-3 and Codex, enabling mid-file code completion and text editing. The Insert feature is being piloted in GitHub Copilot and is now available in beta via the completions API.
OpenAI introduces InstructGPT, a GPT-3 variant fine-tuned using reinforcement learning from human feedback (RLHF) to better follow instructions and reduce harmful outputs. A 1.3B InstructGPT model is preferred by human evaluators over a 175B GPT-3 model, now becoming the default on OpenAI's API.
OpenAI fine-tuned GPT-3 to answer open-ended questions more accurately by enabling it to use a text-based web browser to search, retrieve, and cite sources. The model outperforms human demonstrators 56% of the time on questions from ELI5 dataset but shows limitations on out-of-distribution tasks like TruthfulQA.
OpenAI has launched fine-tuning capabilities for GPT-3, allowing developers to customize the model on their own data via a single CLI command, resulting in improved accuracy, reduced costs, and lower latency for production use cases. Early customers like Keeper Tax, Viable, and Sana Labs report significant accuracy improvements after fine-tuning.
OpenAI removes the waitlist for its GPT-3 API, allowing developers in supported countries to immediately access the service. The announcement highlights new safety features, the Instruct Series models, content filtering tools, and the introduction of Codex for code generation.
OpenAI trained a system using verifiers to solve grade school math word problems with 90% of child-level accuracy, nearly doubling fine-tuned GPT-3 performance. The approach addresses language models' weakness in multistep reasoning by training verifiers to evaluate candidate solutions and select the best one.
OpenAI announces that over 300 applications are now using GPT-3 through their API, nine months after launch, generating 4.5 billion words daily. Featured use cases include Viable for customer feedback analysis, Fable Studio for interactive storytelling, and Algolia for semantic search capabilities.
A comprehensive discussion summary from OpenAI and Stanford researchers examining GPT-3's technical capabilities, limitations, and broader societal implications across multiple disciplines including computer science, linguistics, philosophy, and policy.