generative AI编辑历史

# 1 Overview of Generative AI

## 1.1 Definition and Core Concepts

Generative artificial intelligence (generative AI) refers to a class of machine learning models designed to generate new, original content—such as text, images, audio, video, code, or synthetic data—that mimics the statistical patterns of the training data. Unlike traditional discriminative models that classify or predict labels, generative models learn the underlying probability distribution of the data, enabling them to produce novel outputs that are coherent and contextually relevant. The core concept involves modeling the joint probability distribution \( P(X, Y) \) or the unconditional distribution \( P(X) \), allowing the model to sample from that distribution to create new instances. Key techniques include likelihood-based methods (e.g., variational autoencoders), adversarial training (e.g., generative adversarial networks), and autoregressive or diffusion-based approaches. Generative AI is distinguished by its ability to produce high-fidelity, diverse outputs that can be controlled through conditioning variables, such as text prompts or class labels.

## 1.2 Historical Development

### 1.2.1 Early Generative Models (Pre-2010)

Before the deep learning era, generative models were primarily statistical and probabilistic. Notable early examples include hidden Markov models (HMMs) for sequence generation, n-gram language models for text, Gaussian mixture models (GMMs) for clustering and density estimation, and Boltzmann machines (including restricted Boltzmann machines) for unsupervised learning. In the 1990s and early 2000s, Bayesian networks and Markov random fields were used to model dependencies in data. The launch of the statistical machine translation paradigm and early speech recognition systems relied on generative formulations. However, these models were limited by computational constraints and the difficulty of scaling to high-dimensional data like natural images, leading to blurry