Rajath

To Summarise or Not to Summarise?

There's been a lot of talk (and fear-mongering) about AI taking away people's jobs, and in some domains that fear has turned out to be partially valid. But there's a parallel fear that I've been thinking about more: that people are slowly losing their ability to think, reason, and stay with hard material.

This isn't just an abstract concern. It shows up in students who finished college around and after the Covid-19 years, right in the middle of the ChatGPT boom, and in how they interact with tools that promise instant answers and instant clarity. Everywhere online you see comments like "@grok explain this" and a growing group of people excitedly describing how agentic browsers handle their browsing for them.

Feature image for summarization blog post

For the last 9 months, I've been working on conversation summarisation at NeoSapien. We built a device that transcribes meetings and conversations, and working on this has made me hyper-aware of where summaries genuinely help, and where they quietly make people worse at thinking.

The Pressure for Width

In conversations with friends and younger colleagues, a particular pattern keeps showing up: a pressure to consume as much information as humanly possible. The goal seems to be maximum "width" across topics, even if that means sacrificing depth almost entirely.

Out of this mindset come ideas like building agentic workflows that subscribe to a dozen popular newsletters, auto-summarise them, and email only the "best parts" to the user, without even including links back to the originals. Another conversation involved a request to pull the top five Hacker News posts every day, summarise them, and send a weekly digest.

I get it. Social media and professional platforms are optimised to make you feel like you're always behind, that someone else is learning more, hustling faster, and reading everything. In that environment, automated summarisation feels like a cheat code.

But the desire to "eat the entire internet" is a cultural pressure, not a necessity. If someone genuinely wants to keep up with trends in a healthy, sustainable way, there have always been slower, more deliberate options: curated magazines, a small number of trusted blogs, or periodicals that arrive at human, not algorithmic, intervals.

Where Summaries Quietly Harm

The first time this really hit me was around 2019, watching many people treat book summaries as interchangeable with books and counting those as reads on Goodreads. The idea that you could swap a 400-page novel or a dense non-fiction work for a 10-minute text and claim the same experience felt deeply wrong.

I wouldn't do this myself, replace reading a book with reading its summary. But I did recently read a summary of East of Eden to recall what happened in the book. The summary was terrible compared to the actual book. It gave me plot points, but none of the weight of Steinbeck's language, the moral complexity of the characters, or the way the biblical parallels deepen as you read.

The same logic applies to movies and other art forms. A plot summary of The Usual Suspects cannot give you the same experience as actually watching the film, with its tension, performances, and slow reveal.

Think of the Mona Lisa. You can see it in a museum, reproduced in a textbook, or as a tiny pixel-art icon on your screen. All three capture something, but only one gives you the full experience, the scale, the brushwork, the subtle details you notice when you stand in front of it. A pixel-art version is useful for navigation or reference, but it can't replace the real thing.

Three versions of Mona Lisa: original painting, low-poly version, and pixel art

Mona Lisa in original and two other art forms of representation. Credits: low-poly, pixel art

Summaries used as replacements aren't tools, they're counterfeits. Good enough to fool you into believing you've experienced something you haven't. Here's the uncomfortable truth: compression is lossy by definition.

Where Summaries Actually Help

None of this means summarization is inherently bad. Working on this has made it clear just how powerful it can be when used in the right way and at the right layer of thinking. The key shift is to treat summaries as navigation aids and memory supports, not as replacements for the original material. AI summaries can even reveal blind spots, like surfacing unexpected connections across documents that humans might miss.

One of the most obvious examples is long meetings. After 90 minutes of discussion, almost everyone forgets the exact order in which points were raised, and smaller but important details blur together. A good summary here is a gift: it makes it possible to revisit key decisions, capture action items, and remember who promised to do what without replaying the entire recording. The cognitive load is reduced, but the people who were in the room still have access to full context if they need it.

Ebbinghaus forgetting curve showing memory retention over time

The Ebbinghaus forgetting curve showing how rapidly we lose information over time without reinforcement. Credits: Wikipedia

The same holds for books and long-form content. Thoughtful book summaries can be incredibly helpful for revising material you've already read, especially when they preserve structure and argument rather than just "three key takeaways." Summaries are an art when they help a past version of you talk to your future self: "this is what mattered to you when you read this deeply."

There's no one-size-fits-all compression. Deciding what to preserve and what to compress is a product decision as much as a technical one. That's where human judgment still matters.

A Framework for When to Summarise

Different people need different compression levels for the same content, and the same person needs different levels depending on context. But here's a framework that's helped me think about it:

✅ Use summaries when:

  • You need to review material you've already engaged with deeply
  • You're navigating a large volume of content to find something specific
  • You're triaging time-sensitive information (emails, news, updates)
  • Memory is the bottleneck, you understood it once but need to recall it now

⛔ Don't use summaries when:

  • It's your first encounter with the material
  • The content is meant to shape your thinking, not just inform you
  • The structure, language, or pacing is part of the meaning (art, stories, essays)
  • Nuanced arguments matter, where the "how" is as important as the "what"

In our product, we have the full transcript always one tap away. The summary is a starting point, not an endpoint. If something catches your attention, you can dive into the full conversation and see the context around it. There's also an option to chat with your entire conversation history, ask questions, dig deeper, or clarify what the summary might have missed.

Screenshot of Neo app showing chat with memory feature

A screenshot from our app where you can chat with the entire context of the conversation not just the summary

Here's a concrete example: If you're reading a Paul Graham essay for the first time, read it. The structure of his arguments and the way he builds to a point is part of the value. But if you're trying to remember which PG essay discussed a specific idea, use a summary to navigate.

Slow Reading in a Fast World

Nothing in this essay is completely new. For years, there's been a broader "slow" movement: slow food, slow living, slow reading. The basic idea is simple: in a world that optimizes speed and volume, deliberately choosing slowness can be an act of care for your attention, your taste, and your ability to think.

What worries me more than speed-reading is the idea of replacing reading with reading summaries. I've noticed in myself that the more I've worked on summarization, the more deliberate I've become about when I use them. I summarize meeting notes because I was there and I need to remember. I don't summarize essays I haven't read yet, because reading is the point.

The Choice Is Yours

The biggest insight from summarization has been this: deciding what to preserve versus what to compress is product design, not just engineering. There's no single "summary quality" metric like WER (Word Error Rate) for transcription. What makes a good summary depends entirely on what the user needs it for.

Summaries can save time. They can help you remember. They can let you navigate large volumes of information without drowning in it. But they can also quietly shrink your capacity for deep engagement, for sitting with hard material, for experiencing things that can't be compressed without loss.

No one else can dictate where you should go deep and where you can safely skim. This piece isn't an attempt to play that role. The point is to notice the difference between using a tool to extend your mind and using it to quietly replace the work of thinking.

If I had to leave you with one rule, it's this: slow read the things that shape your thinking; summarize the things that exhaust your memory. Use summarization to help you remember, review, and navigate, not to avoid ever touching the original material.

If you'd like to see more posts on AI, product management, and thoughtful tech takes, please consider subscribing to the blog.

To Summarise or Not to Summarise?