Tag
OpenAI demonstrates an unsupervised system that learns sentiment representation by training a multiplicative LSTM to predict the next character in Amazon reviews, achieving state-of-the-art sentiment analysis on Stanford Sentiment Treebank (91.8% accuracy) while requiring 30-100x fewer labeled examples than supervised approaches. The model discovers a distinct 'sentiment neuron' that captures sentiment information and can be directly manipulated to control text generation sentiment.
OpenAI presents a method for unsupervised third-person imitation learning that enables agents to learn from demonstrations taken from different viewpoints without explicit state correspondence, using domain confusion techniques to learn viewpoint-agnostic features.
OpenAI researchers present a Variational Lossy Autoencoder (VLAE) that combines VAEs with neural autoregressive models (RNN, MADE, PixelRNN/CNN) to learn controllable global representations, achieving state-of-the-art results on MNIST, OMNIGLOT, and Caltech-101 Silhouettes density estimation tasks.
OpenAI publishes an overview of generative models as an approach to developing machine understanding of the world, explaining how these models work by learning to generate data similar to their training sets and their potential applications across various domains.