Google extends generative AI search, Inside China's underground market for high-end Nvidia AI chips, GPT-4's Secret Has Been Revealed, Five big takeaways from Europe’s AI Act, and more!
Even if GPT-4 is a combined model, we now have single models close to or even beating some of GPT-4's test metrics. The open source Orca model for one, matches GPT-4 on some metrics while only being 13B parameters. Take this snippet from the technical report: "Orca retains 95% of ChatGPT quality and 85% of GPT-4 quality aggregated across all
datasets as assessed by GPT-4.". It also performs 100% better than Vicuna-13B on zero-shot reasoning benchmarks.
Even if GPT-4 is a combined model, we now have single models close to or even beating some of GPT-4's test metrics. The open source Orca model for one, matches GPT-4 on some metrics while only being 13B parameters. Take this snippet from the technical report: "Orca retains 95% of ChatGPT quality and 85% of GPT-4 quality aggregated across all
datasets as assessed by GPT-4.". It also performs 100% better than Vicuna-13B on zero-shot reasoning benchmarks.