Cracking The Code: What Thinking Machines’ Inkling Indicates For AI

Thinking Machines has released its first foundation model, Inkling, a 975-billion-parameter, open-weight, multimodal transformer, openly available on Hugging Face. The company emphasized that Inkling is not the strongest model available, marking a significant departure from typical industry practices of claiming market dominance.

Inkling is a Mixture-of-Experts transformer supporting a 1-million-token context window and trained on 45 trillion tokens across text, images, audio, and video. Its architecture routes tokens through 66 layers with 41 billion active parameters, and it supports multimodal input—text, images, and audio—processed jointly without additional vision adapters. The model’s weights are released under Apache 2.0 license on Hugging Face, enabling free download, modification, and commercial use.

In addition, a smaller variant, Inkling-Small, with 276 billion total parameters and 12 billion active, has been previewed. Its performance, thanks to improved training techniques, matches or exceeds larger models on various benchmarks. The training process involved hybrid optimizers, reinforcement learning, and synthetic data generated by other open models. The release includes detailed performance scores, with notable strengths in speech and safety benchmarks, but moderate results in some language understanding tasks.

While the weights are openly available, reports suggest that Thinking Machines maintains a separate Model Acceptable Use Policy (AUP), which may impose restrictions on surveillance, deception, and automated decision-making, potentially complicating the ‘open’ nature of the release. The company clarified that the weights are not open source in the traditional sense, as the training data and pipeline are not publicly disclosed.

Impact of Transparency and Open Access in AI

This release underscores a shift toward transparency in the AI industry, with Thinking Machines openly sharing weights and acknowledging its model’s limitations. Such honesty can influence industry standards, encouraging other developers to be more transparent about their models’ strengths and weaknesses. It also raises important questions about licensing, restrictions, and the balance between open access and responsible use, especially in sensitive domains like surveillance and automated decision-making.

For users and developers, the open weights mean greater control and flexibility, enabling local deployment and customization without reliance on proprietary APIs. However, the potential restrictions outlined in the company’s AUP could limit certain applications, making it crucial for users to understand the legal and ethical boundaries before deploying Inkling.

Industry Trends Toward Open-Weight Models and Transparency

Over the past year, the AI industry has seen a growing emphasis on open-sourcing models, driven by calls for transparency and democratization. Major players like Meta and EleutherAI have released large models under permissive licenses, emphasizing community-driven development. However, most releases are accompanied by caveats regarding training data, licensing restrictions, or safety policies. Thinking Machines’ approach—releasing weights openly but clarifying limitations—fits within this broader movement towards transparency, contrasting with closed, API-only models from companies like OpenAI and Anthropic. The timing coincides with increased regulatory scrutiny and societal debates over AI safety, bias, and misuse.

Previously, the industry has grappled with issues of model transparency, reproducibility, and responsible deployment. Inkling’s release, with candid performance metrics and open weights, signals a possible trend toward more honest disclosures, even if restrictions remain layered on top.

“We believe in open access and responsible use. Our AUP reflects our commitment to ethical AI deployment.”

— Thinking Machines spokesperson

Unanswered Questions About Licensing and Use Restrictions

While the weights are openly available under Apache 2.0, reports suggest that Thinking Machines enforces a separate Model Acceptable Use Policy (AUP) that may restrict surveillance, deception, and certain automated decision-making applications. The exact scope, enforceability, and legal implications of this policy are not yet publicly confirmed, raising questions about how ‘open’ the model truly is for different use cases.

It remains unclear whether the AUP will be strictly enforced or if it primarily serves as a guideline, and how it compares to traditional open-source licenses. Additionally, the impact of these restrictions on commercial and research use is still to be determined.

Next Steps for Adoption and Community Engagement

Following the release, attention will turn to third-party testing and independent benchmarking of Inkling’s performance and safety. Developers and organizations will likely experiment with fine-tuning and deploying the model in various domains, especially in speech and multimodal applications. Monitoring how Thinking Machines enforces its AUP and whether the community adopts the model responsibly will be crucial.

Further updates are expected as the company releases the full weights of Inkling-Small and provides more detailed performance data. Industry observers will also watch for how competitors respond, whether through open releases or more guarded approaches.

Key Questions

What makes Inkling different from other large language models?

Inkling is a 975-billion-parameter, open-weight, multimodal transformer openly available under Apache 2.0, and it openly admits that it is not the most powerful model currently on the market.

Are the weights truly open source?

The weights are released under Apache 2.0, allowing free use and modification, but the training data and pipeline are not publicly disclosed. Additionally, a separate Acceptable Use Policy may impose restrictions on deployment.

What are the main strengths of Inkling?

It shows strong performance in speech and safety benchmarks, supports multimodal input, and offers a large context window, making it versatile for various applications.

Will the restrictions limit its use?

Potential restrictions in the Model Acceptable Use Policy could limit applications involving surveillance, deception, or automated decision-making, but the full scope is not yet clear.

Source: ThorstenMeyerAI.com