AI

Kimi K3: Indistinguishable from Claude in Practical Use

A developer shares a firsthand comparison of Kimi K3 and Claude, highlighting Kimi K3's lower costs and comparable performance. The article also critiques U.S. AI regulations.

5 min read Reviewed & edited by the SINGULISM Editorial Team

Kimi K3: Indistinguishable from Claude in Practical Use
Photo by Daniil Komov on Unsplash

A post on Hacker News titled “The Kimi K3 Moment” has been gaining attention. Written by sbochins, the article details the author’s experience using Moonshot AI’s Kimi K3 alongside Claude for daily coding tasks. The most striking claim made by the author is that “for practical purposes, it is impossible to distinguish between the two.”

No Performance Difference in Practical Use

Sbochins compared Kimi K3 and Claude on identical tasks and reported that the output quality was similar, with both models consuming almost the same number of tokens to deliver equivalent answers. Initially skeptical about open models, fearing “sloppy outputs” and “inefficiency in token usage,” these preconceptions were overturned through practical use.

This experience underscores the importance of evaluating AI models not solely on benchmark scores but also on their real-world usability. Kimi K3, a large-scale model with 2.8 trillion parameters, maintains quality in response speed and output consistency, comparable to closed frontier models.

API Costs Are Less Than One-Third

The cost disparity between the two models is even more significant. K3’s API charges $3 per 1 million input tokens and $15 per 1 million output tokens. By contrast, Claude’s top-tier model costs $10 and $50 for the same token volumes, over three times the cost of K3.

The subscription pricing also shows a stark difference. Kimi’s paid plans start at $19 per month, with a $39-per-month plan tailored for coding tasks. Sbochins noted that this plan is “far more generous” compared to Claude’s plans in the same price range. They pointed out that, for developers frequently engaged in agent-based tasks, Claude’s pay-as-you-go model can lead to token limits being exhausted before noon.

Practical Implications of Subscription Plans

Sbochins also delved deeper into subscription plan discrepancies. They criticized Anthropic for discontinuing access to its Fable model under the $20 plan, effectively downgrading users to the Opus model. This reveals a structural issue in the design of their subscription plans, where flagship models are deactivated due to “economic unsustainability.”

In contrast, Kimi’s plans are free from such caveats. Sbochins remarked scathingly, “If the model advertised in the plan’s headline can be switched off for economic reasons, then the model was never really for sale in the first place.”

The Paradoxical Impact of U.S. AI Regulations

The article goes beyond just comparing costs. It also critiques U.S. government policy on AI. The U.S. government reportedly pressured Anthropic to release its Fable model only in a restricted version, resulting in a model that refuses to perform certain categories of tasks.

In stark contrast, Chinese research institutions, which are beyond the reach of U.S. regulation, have released unrestricted frontier models of comparable quality. Sbochins concluded that “the rationale behind gatekeeping American models was not well thought out.” Ironically, the only customers suffering from these restrictions are in the U.S.

A Case Study: GLM 5.2

This trend isn’t limited to Kimi K3. According to research by Semgrep, China’s GLM 5.2 outperformed Claude in cybersecurity benchmarks. The reason is simple: restricted models refuse certain tasks, while open models perform them.

GLM 5.2, released under the MIT License, surpasses the latest Opus release in practical performance while being available at a fraction of its cost. This raises questions about the relationship between AI model performance and regulatory constraints.

Comparison with OpenAI

On the other hand, OpenAI has managed to offer its flagship GPT-5.6 model under a $20 plan after undergoing government review processes. Sbochins noted, “Whatever you think of OpenAI, they have leeway that Anthropic lacks.”

This suggests that government regulatory processes have resulted in different outcomes for different companies. While Anthropic faces stricter constraints, OpenAI seems to have navigated a more lenient review process.

Future Outlook and Concerns on Industrial Policy

Sbochins also speculates about future developments, suggesting that the government might attempt to regulate AI—particularly open-source AI—using strategies similar to those employed in the automotive industry. Decades of subsidies, bailouts, and protective tariffs have rendered U.S. automakers focused on domestic truck sales, with little international competitiveness.

Sbochins warns, “The government may push public-private partnerships to bolster domestic models. These models might find use only within the U.S. and fail to compete globally. The sad outcome will be that Americans alone will lack access to the best models at the best prices.”

Editorial Opinion

The report that Kimi K3 performs on par with Claude challenges fundamental notions of AI model value. In the short term, trust in Chinese AI models may rise, and cost-conscious developers and startups may accelerate their shift to Kimi or GLM 5.2. The threefold cost gap in API fees is a factor that cannot be ignored in the economics of cloud services.

Looking further ahead, the impact of U.S. AI regulation on its domestic industry could be profound. Restrictions on GPU exports and model releases may inadvertently accelerate Chinese AI research, fostering the emergence of competitive open models. Unlike the dynamics of the Cold War-era semiconductor policies, a different set of forces is at play here.

For Japanese AI developers, the choice between domestic and Chinese open models is becoming increasingly crucial. The editorial team poses this question: What stance should Japan’s AI policy take as it navigates the tightrope between the U.S. and China? Could aligning with U.S. regulations inadvertently deprive the Japanese market of access to competitive AI models? This is a topic that merits industry-wide discussion.

References

Frequently Asked Questions

What are the API costs for Kimi K3?
The API costs $3 per 1 million input tokens and $15 per 1 million output tokens. Compared to Claude's top-tier model, which costs $10 and $50 respectively, Kimi K3 is about one-third the cost.
Is Kimi K3 really on par with Claude in practical performance?
According to a firsthand report shared on Hacker News, Kimi K3 and Claude delivered nearly identical output quality and token consumption for the same tasks, making them indistinguishable for practical purposes.
What subscription plans does Kimi K3 offer?
Paid plans start at $19 per month, and there's a $39 plan designed for coding. These plans are considered more generous than Claude's similarly priced plans and are well-suited for developers performing agent-based tasks.
Source: Hacker News (Best)

Comments

← Back to Home