Startup Recursive veroeffentlicht Coding-Modell Flint fuer den Laptop

Richard Socher at the World Economic Forum’s Annual Meeting of the New Champions in Dalian, China, in June 2024

Recursive Superintelligence, the startup trying to build AI that improves itself, has released its first model. Flint is a free coding model small enough to run on a laptop. Recursive says its own automated research system helped build nearly every part of it. The company announced Flint on Wednesday and published the weights on Hugging Face under the Apache 2.0 licence, which allows free use and changes.

Recursive calls the system its Eureka Machine. It proposes ideas, builds them, tests them and uses the results to choose what to try next. A small team of people and agents built Flint from scratch in under four months, the company said.

The Eureka Machine worked on the data, the training recipes, the infrastructure and the code that runs the model, according to Recursive. It also searched for the model’s shape. Flint has 40 billion parameters, but only 2.5 billion of them work on each word or code fragment. That design, called mixture of experts, keeps it light enough for a laptop.

The system then compressed the model’s output layer to 4 bits, which Recursive says goes “against common practice”. It also wrote custom code to run Flint faster on Apple and Nvidia chips. Chief executive Richard Socher said on X that the low-bit work shrank Flint by 71% with almost no loss in quality, TechCrunch reported.

Nvidia said in a blog post that this code sped up Flint on its RTX Spark machines by 55%, without changing the model itself.

Recursive says Flint produces more than 125 tokens, or chunks of text, per second on a MacBook Pro with an M4 Pro chip. On Nvidia’s RTX Spark laptops it tops 150. In the company’s tests, similar models such as Google’s Gemma 4 managed 58 to 69 on the same Mac, TechCrunch reported.

In Recursive’s own tests, Flint scored 74.2% on SWE-bench Verified, which measures how well AI fixes real software bugs. It scored 54.9% on Terminal-Bench 2.1. The company says it leads mixture-of-experts models under 50 billion parameters on these coding tests. TNW has not verified the scores, and Recursive’s model card notes that test setups vary.

Recursive also says Flint may need more guidance than larger closed coding models. It suggests breaking big tasks into smaller steps. The model card warns that Flint can still produce wrong or harmful content and faulty code.

“It suggests that fully recursive self-improvement, or RSI … is getting closer,” Will Knight wrote for Wired after testing Flint.

Recursive came out of stealth in May after it raised $650 million. TechCrunch puts its valuation at $4.65bn, with GV, Nvidia and AMD Ventures among its backers. It later signed a $410M AWS deal for computing power.

“Our goal at Recursive is to build recursively self-improving superintelligence to automate knowledge discovery,” the company wrote.

Socher told Wired the long-term aim is full recursive self-improvement, with humans overseeing the process and able to stop it, according to TechCrunch. Larger labs are moving the same way. Sergey Brin said last week that Gemini now helps build the next Gemini.

The idea is contested. Some researchers fear AI that improves itself could slip out of human control. In the US, Ro Khanna has planned a bill to ban self-improving AI.

With expertise in digital marketing, product management, and branding & identity, Ana Maria Constantin develops strategies that resonate (show all) With expertise in digital marketing, product management, and branding & identity, Ana Maria Constantin develops strategies that resonate with our target audience in the software/SaaS industry. Collaboration and teamwork are paramount to her, as she loves empowering her colleagues to achieve outstanding results and unlock their full potential.

Get the most important tech news in your inbox each week.

Thanks! Check your inbox to confirm your subscription.

By subscribing you agree to our Privacy Statement.