Key takeaways
- An AI model without your data can only answer from retail in general. Even connected straight to a company database, models still get most real business questions wrong.
- Accuracy comes from a defined data model: what a sale, a store and a margin mean in your chain, written down once, with the AI reading through it.
- A copilot must be allowed to say it does not know. A confident wrong number costs more than an honest gap.
- Every suggestion should show its evidence and leave the decision to a person, and overrides are worth recording.
- Measure an accepted action against comparable stores that did not act. Before and after alone mixes the action with everything else that changed.
Ask a general chatbot why margin fell in your fifth store last week and it will tell you what usually lowers margin in retail: supplier prices, promotions, shrink. All true, and none of it about your fifth store. An AI copilot for retail operations is worth having only when it answers from your stores' own numbers, says when it does not know, and turns what it finds into a suggestion someone can check, act on and measure.
This guide takes those requirements one at a time, starting with the data.
A general chatbot
A copilot on your data
Why did store 5's margin fall last week?
Why a general model cannot answer for your stores
A language model knows a great deal about retail and nothing about your chain. It has not seen yesterday's receipts, this week's deliveries or the cost price of anything you sell, so its answer to a question about your stores is a description of stores in general.
Connecting the model to your database is not enough on its own. Spider 2.0, a benchmark built from real company data and the questions analysts ask of it, gave one of the strongest models an agent that could explore the database and write queries; it solved 21.3% of the tasks1. Among the main obstacles the authors name is finding the right tables and columns in very large databases. A model that cannot tell which column holds net sales will return a confident number from the wrong one.
Give the AI a data model, not just a database
What fixes most of that is meaning, written down before the AI arrives. In one test on an insurance company's database, GPT-4 answered 16.7% of business questions correctly when it worked from the raw tables, and 54.2% when the same database was described to it through a model of what each table and relationship means2. The authors build such models for a living, so read it as one careful test rather than a law; the direction matches what anyone who has cleaned retail data would expect.
For a store chain the data model is the dull work: one definition of a sale, one business day, one list of stores and one category tree, so that every question is answered on the same terms. The guide to consolidating POS data across stores covers it step by step. A copilot sitting on top of that work can answer "why did margin fall" by reading margin as the chain defines it, for the store and the week asked about.
A copilot that says "I don't know" is worth more
Language models are trained and scored in ways that make guessing pay. Researchers at OpenAI argue that models hallucinate because training and evaluation reward guessing over admitting uncertainty: on a test that gives no credit for a blank, a guess always scores better3. In a business tool the scoring runs the other way. An answer that says last Tuesday's data from one store has not arrived costs a minute; a made-up figure for that store can cost a wrong decision.
So the rules for the copilot's answers should be explicit, and checked on every answer:
Every number comes from a query on the chain's own data
Every number in the answer matches what the query returned
The answer names the period and the stores it covers
Data that is missing is named, not filled in
Send the answer
Fails a step: say what is missing or uncertain instead of guessing
From a finding to a suggestion a person can check
A finding is "store 5's margin fell". A suggestion is "move these units of a slow line from store 5 to store 2, where it sells", with the evidence next to it: what the copilot saw, against what baseline, and what the move should change. The evidence is what lets a manager decide quickly, and it changes how well they decide. In two preregistered experiments, one in factory quality inspection and one in radiology, people working with an AI that showed why it reached a prediction caught 96.9% of its wrong predictions, and people working with an unexplained AI were 3.6 times more likely to overrule a prediction that was right4.
Evidence helps only if someone reads it. A review of 35 studies on automation bias, the habit of accepting what a system recommends, found that explanations often make a system more acceptable without making decisions more accurate, and that asking people to verify reduces complacency5. So the check belongs in the process, not left to goodwill: the person who accepts a suggestion confirms the evidence before it goes ahead.
Let the manager decide, and keep a record of overrides
Store managers know things no dataset holds: a building site opening next door, a supplier who is about to be late. In a convenience store chain that introduced replenishment recommendations in some stores and left others unchanged, the stores with the system reached a 2.9% higher service level without holding more stock, and managers spent 36.5% less time on daily orders. When managers overrode the system, interviews showed they were usually anticipating demand it had not yet seen6.
Overrides are not always right, though. A study of a supermarket chain's automated replenishment found that after a stockout, managers tended to order less than the system proposed, which led to stockouts of their own making7. Record every override with its reason, and look at them together once a month. The pattern tells you whether the system or the habit needs fixing.
Measure the effect against stores that did nothing
When a suggestion is accepted and carried out, sales before and after will differ, but so would they have without it: a holiday, the weather, a competitor's promotion. The standard method compares the stores that acted with similar stores that did not, over the same weeks. It rests on one assumption, that the two groups would have moved in parallel without the action8, so check that they did move together beforehand.
Week 1Week 10
- Stores that carried out the action
- Comparable stores that did not
The same applies to the copilot itself. If it is worth what it costs, the stores using its suggestions should pull ahead of comparable stores, and you should be able to see by how much. The dead-stock guide shows one kind of suggestion, a store-to-store transfer, end to end.
How marql AI works
marql AI answers from the chain's own sales, stock and cost data. The data a question needs is fetched by fixed queries before the model writes anything, and the model can call further tools that read the same tables. It cannot change anything in the chain's systems from the chat; the only thing it can create there is a task. Its instructions forbid inventing numbers and require it to say when a period has no data, and after each answer the numbers in it are checked against what the tools returned. Store names are replaced with codes before a question reaches the model provider, a store manager sees only their own stores, and it answers in six languages.
Every morning at six, local time, it sends a short brief: yesterday's revenue, margin and receipts, the strongest and weakest store, the day's weather and the past week's anomalies, each measured against the store's own normal pattern. For each store it also works out how sales have moved with the weather over the past 90 days, and uses that in the brief and in its answers, so a rainy-day dip is not mistaken for a problem in the store. When a person accepts a proposed action, the Impact Ledger freezes the baseline and, at the end of the window, compares the stores that acted with at least four similar stores that did not, or with the store's own history when there are not enough of them. The marql AI page shows the questions it answers.
Sources
- Lei, F., Chen, J., Ye, Y. et al. (2025). Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows. ICLR 2025. arXiv:2411.07763. arxiv.org
- Sequeda, J. F., Allemang, D. and Jacob, B. (2024). A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases. Proceedings of GRADES-NDA 2024, ACM. Figures from the preprint, arXiv:2311.07509. doi:10.1145/3661304.3661901
- Kalai, A. T., Nachum, O., Vempala, S. S. and Zhang, E. (2025). Why Language Models Hallucinate. arXiv:2509.04664. arxiv.org
- Senoner, J., Schallmoser, S., Kratzwald, B., Feuerriegel, S. and Netland, T. (2024). Explainable AI improves task performance in human-AI collaboration. Scientific Reports, 14, 31150. doi:10.1038/s41598-024-82501-9
- Romeo, G. and Conti, D. (2026). Exploring automation bias in human-AI collaboration: a review and implications for explainable AI. AI & Society, 41(1), 259-278. doi:10.1007/s00146-025-02422-7
- Li, M., Wang, S. and Xu, L. (2025). Replenishment Recommendation in Convenience Stores. Production and Operations Management, published online 19 August 2025. doi:10.1177/10591478251367129
- Özdemir, B. and Tenhiälä, A. (2026). Discretion in Automated Supermarket Replenishment: Censorship Bias and Self-Inflicted Stockouts. Manufacturing & Service Operations Management, articles in advance, 5 August 2026. doi:10.1287/msom.2023.0426
- Roth, J., Sant'Anna, P. H. C., Bilinski, A. and Poe, J. (2023). What's trending in difference-in-differences? A synthesis of the recent econometrics literature. Journal of Econometrics, 235(2), 2218-2244. doi:10.1016/j.jeconom.2023.03.008
TopicsAI copilot, Retail AI, Store operations, Decision support