Chamath: The open-source weighted model is about four months away from the best closed-source frontier model

Social Capital founder Chamath Palihapitiya released an in-depth research report stating that open-source weight models are about four months away from matching the best closed-source frontier models in public evaluations, with increasing fluctuations in the gap. If open-source models allow companies more control over data, infrastructure, and customization while approaching frontier performance, the value corresponding to companies still paying for frontier laboratories becomes a business issue. Openness exists on a spectrum, from fully open-source models that can be downloaded and freely modified to open-source weight models with various restrictions, while closed-source models keep weights proprietary.

Palantir CEO Alex Karp warned that companies might hand over differentiated proprietary knowledge and processes to frontier model providers. Microsoft CEO Satya Nadella stated that companies are effectively paying for intelligence twice: once in money and again in the more valuable proprietary knowledge that must be disclosed to make the intelligence useful. Despite concerns, companies are still willing to pay for frontier performance, even if the best open-source weight models are only months behind, with frontier laboratory revenues continuing to accelerate.

Leading companies use both types of models, leveraging open-source models for control and customization while utilizing closed-source frontier models for maximum capability, with some cases reporting up to 12 times engineering efficiency and over 20 times cost savings. Some vendors adopt a dual-track approach, with Google offering both Gemini and Gemma, and Meta providing both Muse Spark and Llama. The 99-page report also discusses the costs of maintaining a lead for frontier laboratories, five factors of model competition, model operating locations, and investments in open-source weights by NVIDIA and Samsung.