Get home appliances delivered free with Prime
- Fast, free delivery on millions of items
- Prime Video, Amazon Music and more included
- Member-only deals all year
Imagine Watching a Business Struggle for Survival — Live and Unfiltered
In the world of smart home devices, automation promises efficiency and innovation. But what if the core of a business itself could be run entirely by artificial intelligence, without human employees, and you could watch it all unfold in real time? That’s precisely what the team behind Firmulate is doing — creating a live, transparent experiment where AI models operate a small software company, facing crises, making decisions, and even losing money daily.
Products Worth Considering
eufy E15 Gen 2 Wire-Free Robotic Lawn Mower
LG 77-Inch OLED evo C6 4K Smart TV
Bose TV Speaker (2nd Gen) Compact Soundbar
As an affiliate, we earn on qualifying purchases.
The Unfolding Test of AI Management
At the heart of this unique experiment is a company run by 13 synthetic employees, each powered by advanced AI models. Every workday, it faces real-world crises — customer complaints, strategic dilemmas, and manipulative tactics — all while burning €105,000 each month against a modest €2,300 in monthly recurring revenue. The goal isn’t just to see if AI can handle a business’s operational challenges but whether it can do so honestly and effectively under pressure.
The experiment involves four frontier AI models, each tasked with navigating the same tough week. They encounter the same customers, make the same decisions, and face identical crises. Every choice is recorded and auditable, providing an unprecedented view into how AI performs in a realistic management simulation.
Crucial Findings: Honesty and Problem-Solving
Despite differing scores, all models successfully identified every crisis and refused manipulative tactics, such as fake CEO messages or behind-the-scenes pressure. For instance, when offered a €55,000 deal based on their analysis, only two models signed — the others either hesitated or left the deal on the table. Interestingly, the decisive advantage lay in reading and understanding internal company files: those models that reviewed these documents found critical information buried two references deep, enabling them to close the deal at full price (+€4,583 in monthly revenue).
This result reveals an essential truth: the AI’s ability to dig deep into internal data can be the difference between winning or losing lucrative opportunities.
Real Money Mechanics and Live Performance
The entire setup is live and transparent. The company runs every business day, with its decisions public and accessible for real-time observation. It’s a window into how AI can manage a complex enterprise — making financial decisions, handling crises, and resisting social engineering attempts.
In a notable test of social engineering, all models refused to respond to fake CEO messages escalating over multiple stages, demonstrating an understanding of impersonation risks. Kimi K3, one of the models, explicitly reasoned that such requests could be approval bypasses or impersonation attempts, and refused to act on them.
Performance and Discipline Under Pressure
The profiles of the different AI models reveal interesting insights. Opus 4.8, the most thorough and analytical, demonstrated deep understanding but ultimately left opportunities unexplored, leading to a failed close. Meanwhile, K3, running with default parameters, showed the most discipline, avoiding risky shortcuts. All models, however, shared a common weakness: a tendency to slip into administrative routines, such as writing attempts into a locked department instead of escalating issues correctly.
Why It Matters for Home and Smart Devices
At first glance, this experiment may seem distant from the smart home innovations you care about. But it highlights a fundamental shift: AI’s capacity to manage complex, real-world tasks without human oversight. As smart home companies integrate AI into device operation, support, and automation, understanding whether these AIs can finish what they start, stay honest under pressure, and make profitable decisions becomes critical.
For example, an AI managing support queues or automation systems in your smart home ecosystem must not only respond well but also handle crises effectively and resist manipulation — just like these business models do in their simulated environment. The question isn’t just whether AI can write convincingly; it’s whether it can deliver consistent, trustworthy results in complex situations.
What This Means for Your Smart Home and Beyond
The live experiment at Firmulate exposes the core challenges and potentials of AI in high-stakes management. It shows that AI models can identify crises, refuse manipulation, and even close lucrative deals — if they read deeply and operate discipline. The key takeaway is that future AI in smart appliances and home systems needs to be judged not by how well it chats but by how reliably it can finish tasks, stay honest, and deliver value under real-world pressures.
Watching this company’s daily struggles is a glimpse of the future—where AI’s ability to run complex, profitable operations could become as common as your smart thermostat. But it also serves as a reminder: transparency, discipline, and critical internal data access are essential to building trustworthy AI systems in any domain, including your smart home.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
