Hewett Health Blog

How accurate is AI calorie counting?

Photo-based AI calorie counting is usually accurate to within about 10–30% of a meal's true calories — good enough to spot trends and keep a consistent deficit, but not lab-grade. Accuracy is best for simple whole foods and worst for mixed dishes, and it improves sharply when you confirm portion sizes yourself.

That answer surprises people in both directions. Sceptics expect AI estimates to be wild guesses; optimists expect them to be exact. The truth sits in the middle, and — more importantly — a 10–30% error range is smaller than the error range of the average person logging food by hand. Here's how that works, and how to use it to your advantage.

How does AI calorie counting work?

When you photograph a meal, the model does three jobs in sequence:

  1. Food identification — recognising what is on the plate (ribeye, eggs, butter, broccoli).
  2. Portion estimation — judging how much of each item is there, using visual cues like plate size, food height and typical serving geometry.
  3. Nutrition lookup — mapping each identified food and portion to calorie and macro values from nutrition databases.

Step 1 is now genuinely reliable for whole foods — modern vision models identify common single foods with high accuracy. Step 3 is just arithmetic. Almost all of the error lives in step 2, portion estimation, because a photo is a 2D projection of a 3D plate. A camera can't weigh your steak; it can only infer.

What does the research say?

Studies of image-based dietary assessment have converged on a consistent picture:

  • For single whole foods (a steak, an apple, a fillet of salmon), automated estimates typically land within 10–20% of weighed values.
  • For mixed and composite dishes (curries, stews, sandwiches), errors grow, commonly reaching 30–40% — mostly because hidden fats and sauces are invisible to the camera.
  • Human manual logging is worse than most people assume. Doubly-labelled water studies — the gold standard for measuring true energy expenditure — repeatedly find that people under-report their intake by 20–40%, with under-reporting increasing in people trying to lose weight.

That last point is the one that matters. The realistic comparison isn't "AI vs. a laboratory" — it's "AI vs. you, tired, estimating a portion at 9pm and forgetting the cooking butter." Against that baseline, a consistent AI estimator does well.

Where AI estimates go wrong

Hidden fats and cooking oils

Fat is the most calorie-dense nutrient (9 kcal per gram), and it's the thing a photo literally cannot see. A tablespoon of butter used to cook your eggs adds roughly 100 kcal and leaves almost no visual trace. This is the single largest source of underestimation.

Mixed dishes and sauces

A beef curry might be 400 kcal or 800 kcal depending on the cream and oil in the sauce. The AI sees "beef curry, medium bowl" — the recipe is invisible. Errors here are structural, not a model-quality problem any vendor has solved.

Portion size and camera angle

Top-down photos flatten food height; angled close-ups exaggerate it. A pile of mince shot from above can read as 150g or 300g. Small visual differences in calorie-dense foods (cheese, nuts) translate into large calorie differences.

How to get more accurate results

You don't need to fix the AI — you need to close the specific gaps above. Four habits cover most of it:

  1. Confirm the portion, don't just accept it. One tap to adjust "250g" to "350g" is the highest-value correction you can make. Research on assisted dietary assessment shows human-confirmed portions dramatically tighten accuracy.
  2. Tell it about cooking fat. If your food was cooked in butter, tallow or oil, add it. This single habit removes the biggest systematic underestimate.
  3. Shoot at a consistent, slight angle (roughly 45°) with the whole plate in frame, so the model gets both area and height cues.
  4. Trust weekly averages, not single meals. Random errors partially cancel across a week of meals. If your weekly average intake and your weight trend line up, your tracking is working — regardless of any single meal's estimate.

Is it accurate enough to hit your goals?

For the goals most people actually have — losing fat at a sensible rate, holding maintenance, eating enough protein — yes, comfortably. Fat loss needs a consistent deficit of roughly 300–500 kcal per day; an estimator that's within 20% on individual meals but is applied to every meal gives you a truer weekly picture than precise logging you abandon by Thursday. Consistency beats precision.

Where photo AI alone isn't enough: clinical contexts, physique-competition prep at very low body fat, or any situation where a 100-kcal daily error genuinely matters. There, combine AI logging with a food scale for calorie-dense items.

Simple eating styles also stack the odds in your favour. A carnivore or whole-food plate — steak, eggs, salmon, butter you added yourself — is exactly the "single identifiable foods" case where AI accuracy peaks, and hidden-ingredient errors barely exist.

The bottom line: AI calorie counting is accurate enough to steer by, as long as you confirm portions, account for cooking fat, and judge progress on weekly trends rather than individual meals.

Frequently asked questions

Is AI calorie counting more accurate than manual logging?

Often, yes — not because the AI is smarter than you, but because it removes the two biggest manual-logging failure modes: forgetting to log at all, and picking the wrong database entry. Studies consistently show people under-report intake by 20–40% when logging by hand. An AI estimate that's within 20% but captures every meal usually beats a 'precise' log with missing entries.

Can AI count calories from a photo of a mixed dish like a curry or casserole?

It can estimate, but mixed dishes are the hardest case. The AI can't see how much oil, butter or cream went into the sauce, so errors are largest here — sometimes 40% or more. For mixed dishes, confirm the portion size and add a note about cooking fats, or log the recipe's main ingredients directly.

Do I need to weigh my food if I use AI calorie counting?

Not for most goals. If you're maintaining or losing at a moderate deficit, consistent AI estimates are enough to steer by, because the errors average out over a week. Weighing is worth it for calorie-dense foods where small visual differences are big calorie differences — nuts, cheese, oils, nut butters — or if you're cutting to very low body fat.

How does Hewett Health estimate calories from a photo?

You snap a meal photo and the AI identifies the foods, estimates portion sizes, and returns calories plus protein, fat and carbs — tuned for whole-food and carnivore-style eating. You can correct the portion in one tap before saving, which is exactly the confirmation step that research shows tightens accuracy the most.