@Xudong07452910: Interpreting Jev from this angle is pretty interesting—is this the Renaissance of the Encoder? I still remember that my…

X AI KOLs Timeline 新闻
encoder ai-trends bert gpt discussion nlp social-media

摘要

A tweet discusses the resurgence of encoder models in AI, referencing BERT and GPT, and questions if this marks a Renaissance of the Encoder.

Interpreting Jev from this angle is pretty interesting—is this the Renaissance of the Encoder? I still remember that my first paper used an Encoder to build a time series forecasting model; back then, BERT still had its place.
查看原文
查看缓存全文

缓存时间: 2026/09/19 17:11

Interpreting Jev from this angle is pretty interesting—is this the Renaissance of the Encoder? I still remember that my first paper used an Encoder to build a time series forecasting model; back then, BERT still had its place.

Dongxi 东锡 NLP (@dongxi_nlp): Encoder 的卷土重来

BERT 本来是一条极有潜力的路线：高效地把输入压成 representation。但它停留在了 task-specific 时代，每个任务都需要微调。

GPT 早期同样如此，后来却沿着 scaling、in-context learning 和 instruction tuning 走向了 泛化，把自然语言变成 universal task

相似文章