LWiAI Podcast #162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

Our 162nd episode with a summary and discussion of last week's big AI news!

In addition to Substack’s transcript, you can listen along with a clickable (AI generated) transcript here: https://app.trint.com/public/2a186aeb-b744-4619-97dc-1c6fe417ef11

Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai

Subscribe

• Apple Podcasts

• Spotify

• YouTube

• RSS

Timestamps + links:

• Tools & Apps

  • (00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music

  • (00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more

  • (00:11:51) Building LLMs for Code Repair

  • (00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed

  • (00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation

  • (00:18:41) AI editing tools are coming to all Google Photos users

• Applications & Business

  • (00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet

  • (00:23:32) Meta unveils its newest custom AI chip as it races to catch up

  • (00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia

  • (00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model

  • (00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4

  • (00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday

  • (00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund

• Projects & Open Source

  • (00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model

  • (00:43:54) Google updates its Gemma AI model family with variants for coding and research

  • (00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order

• Research & Advancements

  • (00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

  • (00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

  • (01:03:31) Octopus v2: On-device language model for super agent

  • (01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models

  • (01:09:54) Many-shot Jailbreaking

• Policy & Safety

  • (01:15:08) Schiff unveils AI training transparency measure

  • (01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.

  • (01:26:11) Responsible Reporting for Frontier AI Development

  • (01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission

  • (01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling

  • (01:36:45) Trudeau announces $2.4 billion for AI-related investments

• Synthetic Media & Art

  • (01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices

• Fun!

  • (01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip