AI Challenges in Software Development – REWORK

By 37signals

Categories: Startup, Product

Summary

37signals' Basecamp 5 was their first fully AI-accelerated product, shifting from AI as a lookup tool to AI as the starting point for most features—but the team discovered AI's major limitation: it gives you exactly what you ask for, not what you actually need, requiring constant iteration and human judgment.

Key Takeaways

  1. AI enabled designers to implement features independently without waiting weeks for developer availability, compressing design-to-feedback cycles from 1-3 weeks to days by letting designers deploy and test with real data immediately.
  2. Development workflow shifted from starting in code editors to starting with prompts as the majority workflow—most fixes and feature upgrades now begin with a prompt rather than manual coding, accelerating initial implementation speed.
  3. AI's 'monkey's paw' problem: it fulfills requests literally without understanding intent, delivering technically correct but functionally wrong solutions, requiring developers to validate every output against actual user needs.
  4. Not all customers want AI-first features—significant customer segments actively reject AI as a lead feature, making audience validation critical before investing in AI-heavy development roadmaps.
  5. Human collaboration between developers and designers still produces superior outcomes through extended interaction; close pairing often yields better results than AI solo development, indicating hybrid approaches beat full automation.

Related topics

Transcript Excerpt

There are qualities with the slower handwritten approach that we not just appreciate but actually miss. There's something about the interaction when a developer and a designer is working closely together for a longer period of time on a feature where occasionally you end up with something that's better. >> And I would encourage people who are listening to not just jump on the AI and bandwagon and going every customer is looking for AI this, AI that. Like there are plenty of people who are not and big huge huge massive groups of customers who do not want that as the lead feature. >> If you tell the AI to well you don't tell the AI you just start a new session right and boom amnesia they've completely forgotten that they spend a lot of expensive tokens producing this stuff and they're not of…

More from 37signals