How Early Inkling From Thinking Machines Could Influence AI Development
AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Thinking Machines has released Inkling, a large open-weight AI model, along with candid details on its training and licensing. This development raises questions about open-source practices and AI ethics, potentially influencing future AI strategies.

Thinking Machines has released its first foundation model, Inkling, under an open-source license, making its weights publicly available on Hugging Face. This marks a notable shift in AI development, emphasizing transparency and ownership, and directly challenges the industry norm of proprietary models.

Inkling is a 975-billion-parameter multimodal transformer supporting text, images, and audio inputs, with a 1-million-token context window. It was trained on 45 trillion tokens, including diverse media types, using a hybrid optimizer on NVIDIA systems. The model’s weights are available under Apache 2.0 license, allowing download, modification, and commercial use, representing a move toward more open AI ecosystems.

However, the announcement also notes a separate Model Acceptable Use Policy (AUP) that restricts certain uses, such as surveillance and deception, raising questions about the true openness of the release. The company emphasized that the weights are not open source in the traditional sense, as the training data and pipeline remain proprietary.

Early benchmark results show Inkling performing strongly in safety and multimodal tasks but only mid-tier in some language benchmarks. The release includes a smaller variant, Inkling-Small, which matches or surpasses the larger model on several tests. Full weights and further testing are expected after ongoing evaluation.

At a glance
breakingWhen: announced March 2024
The developmentThinking Machines publicly launched Inkling, a 975-billion-parameter multimodal AI model, with open weights under Apache 2.0, marking a significant step in open AI development.

Implications of Open-Weight AI Models for Industry and Ethics

The release of Inkling under open licenses signals a potential shift toward more transparent and accessible AI development, enabling organizations to own and modify models independently. This move could challenge existing proprietary paradigms, fostering innovation and competition. However, the accompanying restrictions via the AUP highlight ongoing tensions around true openness, ethical use, and control, which could influence how future models are governed and adopted.

For AI developers, policymakers, and users, this development raises critical questions about data privacy, safety, and the limits of open-source licensing. The industry’s response to such models will shape the landscape of AI ownership, regulation, and ethical standards in the coming years.

Amazon

AI development open source tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on Open-Weight AI Model Releases and Industry Norms

Until now, most large foundation models have been released with proprietary weights or limited access, emphasizing commercial control. Open-source initiatives, such as Meta’s Llama or EleutherAI’s models, have aimed for transparency but often with restrictions or incomplete data sharing. Thinking Machines’ approach with Inkling—offering full weights under Apache 2.0—represents a notable departure, aligning with broader efforts to democratize AI development.

The industry has recently faced debates over model safety, licensing, and control, especially after governments and organizations have taken steps to restrict or shut down certain models. The release of Inkling, despite its restrictions via the AUP, underscores a growing interest in balancing openness with responsible use, reflecting evolving norms in AI transparency and governance.

“Our goal was to provide a powerful, flexible model that organizations can own and tailor, while maintaining responsible use through our policies.”

— Thinking Machines spokesperson

Amazon

multimodal AI models

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unresolved Questions About Inkling’s Open Release and Use Policies

It remains unclear how strictly the Model Acceptable Use Policy will be enforced and how it might limit the practical openness of Inkling. The extent to which the proprietary training data and pipeline influence the model’s transparency is also uncertain. Additionally, the industry’s response to this hybrid approach—balancing open weights with restrictive policies—is still developing, and the long-term impact on AI innovation and regulation is unknown.

Amazon

large language model training hardware

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps in Testing, Policy Clarification, and Industry Adoption

Further independent testing of Inkling’s performance and safety benchmarks is expected as the model undergoes community evaluation. Clarifications on the scope and enforcement of the AUP are anticipated from Thinking Machines. Industry observers will monitor how competitors and regulators respond, potentially influencing future open-weight releases and licensing frameworks.

Amazon

AI model licensing and ethics books

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Is Inkling truly open source?

No, while the weights are under Apache 2.0 license, the training data and pipeline are proprietary, and the company has a separate acceptable use policy that imposes restrictions.

What are the main restrictions on Inkling’s use?

The company’s policy reportedly prohibits surveillance, deception, and automated decision-making affecting individuals’ rights, but the enforceability and scope are still unclear.

How does Inkling compare to other models?

In benchmark tests, Inkling shows strong safety and multimodal capabilities but ranks mid-tier on some language benchmarks. Its open weights offer unique opportunities for customization and ownership.

What does this mean for AI regulation?

This development could influence future licensing and regulation strategies, emphasizing transparency and ownership but also highlighting ongoing debates over restrictions and true openness.

What is the significance of the open weights being under Apache 2.0?

The license allows free use, modification, and commercialization, but does not automatically ensure transparency of training data or enforce restrictions, which are governed separately.

Source: ThorstenMeyerAI.com

You May Also Like

A Possible Future For Damn Interesting

Speculation surrounds the future of Damn Interesting as creators consider new directions amid uncertainty about its continuation.

Build, Rent, Or Quantize: Cutting Your Memory Bill Without Cutting Capability

Exploring strategies to reduce AI memory expenses through building, renting, or quantizing models, with a focus on recent advances and practical implications.

Mac vs GPU Tower for Local LLMs: The Heat-and-Noise Tradeoff

Comparing Mac Studio and GPU towers for local large language models reveals stark differences in heat, noise, capacity, and performance tradeoffs.

Is AI The Key To Unlock The China Open-Weight Window For Global Leaders?

Exploring whether AI developments, especially open weights, could influence China-US tech policies and global AI governance strategies.