这位CEO认为电子游戏比互联网更适合训练数据

OpenAI called the Hugging Face attack unprecedente

This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here. Reading OpenAI’s account last week of how some of its models broke their containment and hacked into the computer systems of Hugging Face, another AI company, ...

每日简报：大语言模型下一个大事件与AI教授的新现实

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. These startups are chasing the next big thing in LLMs Nine years after Google researchers introduced the transformer, this family of neural networks has bec...

Building abundant intelligence

在人工智能领域，一场关于技术普惠与性能突破的变革正在悄然展开。近日，一项旨在通过全栈式方法（full-stack approach）提升高级AI能力、降低其成本并扩大其应用范围的创新理念引起了业界广泛关注。这一战略不仅聚焦于算法层面的优化，更深入到硬件、系统架构、数据管道以及部署流程的每一个环节，试图从根本上解决当前AI发展面临的瓶颈问题。

长期以来，AI技术的进步往往依赖于计算资源的堆砌和模型规模的膨胀。从GPT-3到GPT-4，再到各种多模态大模型，每一次性能的跃升都伴随着训练成本的指数级增长。这种现象使得最先进的AI能力被少数拥有雄厚资本和技术储备的科技巨头所垄断，...

Transformer推理性能测量

This chapter is divided into eight parts; they are: • Metrics for LLM Inference • Measuring a Single Request • Warmup and Synchronization • Measuring GPU Work with CUDA Events • Measuring Memory Usage • Measuring Concurrent Requests • Multiple GPUs and Multiple Machines • Cost per Token The most com...