The advent of large language models (LLMs) has ushered in a new paradigm of search engines that use generative models to gather and summarize information to answer user queries. This emerging technology, which we formalize under the unified framework of generative engines (GEs), can generate accurate and personalized responses, rapidly replacing traditional search engines like Google and Bing. Generative Engines typically satisfy queries by synthesizing information from multiple sources and summarizing them using LLMs. While this shift significantly improves $\textit{user}$ utility and $\textit{generative search engine}$ traffic, it poses a huge challenge for the third stakeholder -- website and content creators. Given the black-box and fast-moving nature of generative engines, content creators have little to no control over $\textit{when}$ and $\textit{how}$ their content is displayed. With generative engines here to stay, we must ensure the creator economy is not disadvantaged. To address this, we introduce Generative Engine Optimization (GEO), the first novel paradigm to aid content creators in improving their content visibility in generative engine responses through a flexible black-box optimization framework for optimizing and defining visibility metrics. We facilitate systematic evaluation by introducing GEO-bench, a large-scale benchmark of diverse user queries across multiple domains, along with relevant web sources to answer these queries. Through rigorous evaluation, we demonstrate that GEO can boost visibility by up to $40\%$ in generative engine responses. Moreover, we show the efficacy of these strategies varies across domains, underscoring the need for domain-specific optimization methods. Our work opens a new frontier in information discovery systems, with profound implications for both developers of generative engines and content creators.
Toward an Evaluation Science for Generative AI Systems
Google DeepMind(谷歌DeepMind);University of California, Berkeley(加州大学伯克利分校);Microsoft Research(微软研究院);Hugging Face;Stanford University(斯坦福大学);Massachusetts Institute of Technology(麻省理工学院);Anthropic
本文针对生成式 AI 静态基准失效与审计难以规模化的问题,借鉴交通、航空航天和制药领域的安全评估经验,提出构建生成式 AI 评估科学的原则与路径。
Generative VS non-Generative Models in Engineering Shape Optimization
University of Strathclyde(斯特拉斯克莱德大学);Nazarbayev University(纳扎尔巴耶夫大学);BAR Technologies(BAR科技公司);Foundation for Research & Technology Hellas (FORTH)(希腊研究与技术基金会)
SCI-Defense: Detecting Persuasion-Structured Manipulation of LLM-Based Ranking in Generative Engines
Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学与数据科学学院);School of Information Sciences, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校信息科学学院);Amazon topcited.ai(亚马逊topcited.ai)
Applying Physics-Informed Enhanced Super-Resolution Generative Adversarial Networks to Turbulent Premixed Combustion and Engine-like Flame Kernel Direct Numerical Simulation Data
Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH(于利希研究中心于利希超级计算中心);RWTH Aachen University(亚琛工业大学)
Multimodal Generative Engine Optimization: Rank Manipulation for Vision-Language Model Rankers
Georgetown University(乔治城大学);University of Southern California(南加州大学);University of Maryland, College Park(马里兰大学学院公园分校);Arizona State University(亚利桑那州立大学)
A Generative Neural Network Approach for 3D Multi-Criteria Design Generation and Optimization of an Engine Mount for an Unmanned Air Vehicle
Institute of Lightweight Engineering(轻量化工程研究所);University of the Bundeswehr Munich(慕尼黑联邦国防军大学);Computer Science in Mechanical Engineering(机械工程计算机科学系);Helmut-Schmidt University(赫尔穆特·施密特大学)
Scalable Generative Game Engine: Breaking the Resolution Wall via Hardware-Algorithm Co-Design
School of Microelectronics, Southern University of Science and Technology (SUSTech)(南方科技大学电子学院);Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);University of Waterloo(滑铁卢大学);School of Marxism, Tsinghua University(清华大学马克思主义学院);Zhongguancun Academy(中关村学院)