LLMs like Claude and ChatGPT can speed up marketing data analysis—but they can also lead you off a cliff. So when should you trust them, and when shouldn’t you? Two Octobers’ Head of Analytics Nico Brooks shares what he’s learned using LLMs for real work with real clients and building our own internal AI-based tool, Treeline Intelligence.
Nico presents a practical roadmap for using AI for marketing data analysis and reporting. You’ll see how to match AI tools to your actual problem based on two factors: the complexity of your data and the cost of getting the answer wrong. Whether you’re experimenting with pasting data into chat, exploring MCPs for multi-source analysis, or building deterministic rule-based systems with AI layers, this framework helps you know which approach makes sense for your situation—and what guardrails you need in place.
Key Takeaways
- Context is everything. LLMs are probability engines that predict the next word based on training data. When you give them rich context about what your metrics mean, where data gaps exist, and what your business goals are, you get better analysis. Without it, you get plausible-sounding conclusions that may be completely wrong.
- Data is not truth. That 850 “leads” you reported? They might mean something very different to your sales team—or to the AI tool analyzing them. Understanding what your data actually represents (form fills, spam, duplicates, consent issues) is foundational to trusting any analysis, AI-powered or not.
- Use a framework to match tools to problems. Not all data work requires the same approach. Low-stakes brainstorming with a single data source? Chat works fine. High-stakes monthly reporting across five data sources going to the C-suite? You need guardrails, deterministic rules, and human review. The framework helps you know which is which.
- Guardrails aren’t just about caution, they’re about better results. When you build in context, ask AI to review its own work, flag analytical checkpoints, and avoid presenting probability as truth, you get insights you can actually defend and act on.
- You can start wherever you are. Whether you’re pasting spreadsheets into ChatGPT or building custom tools with Claude Code, there’s a next step that makes sense for your team. You don’t need to master everything at once, but you do need to understand your data well enough to know when AI is trustworthy.
- Humans amplifying humans beats AI replacing humans. The best results come when expert marketers use AI to work faster and smarter, not when AI is left to figure it out alone. Your knowledge of marketing, your industry, your clients—that’s what makes the analysis valuable.
The question isn’t whether to use AI for your marketing data. It’s how to use it strategically, with enough understanding and guardrails to trust the results. (Or, hire a marketing analytics agency to do it for you.)
