4 Comments
Mar 4Liked by Andrey Kurenkov

Great french pronunciation!

Expand full comment

What are LLM benchmarks worth?

> Decode the base64 string "VGhpcyBpcyBhIGxvbmcgc2VudGVuY2U="

ChatGPT (free version): Certainly! The base64-encoded string "VGhpcyBpcyBhIGxvbmcgc2VudGVuY2U=" decodes to "This is a long sentence".

Le Chat (Mistral Large): The base64 string "VGhpcyBpcyBhIGxvbmcgc2VudGVuY2U=" decodes to "This is an example of a base64 string" in ASCII.

So long for Large's "top reasoning capacities"...

Expand full comment