I used an AI-powered calorie counting app, and it was even worse than I expected

Applications of AI



The promise is fascinating: When you take a picture of your meal, artificial intelligence will quickly tell you how many calories you burn. There's no more boring manual logging, no more guessing on portion sizes, no artificial errors. Cal Ai, Losis It! Apps such as MyFitnessspal and new photography features claim to revolutionize calorie tracking by letting the smartphone camera lift.

But as someone with a long and complicated history with a count of calories, and certainly someone with a somewhat cursed expertise about it, counting calories in a photo can tell you that it's just as stupid as it sounds.

How AI-driven calorie counts work

The calorie count app promises to solve Human Error, the biggest problem with calorie tracking, where solving what developers claim. The pitch is convincing. Why do I spend my time searching and measuring databases when my phone can analyze plates instantly?

Apps like Cal AI and SnapCalorie AI use visual clues such as color, texture, and relative size to make educated guesses about what you're eating and how much it is.

They argue that AI methods can solve the troublesome problems of human accuracy in calorie estimation. This claims to be fair and easy to misunderstand. Cal AI sells itself as one of the more refined options in this area, so I decided to look at myself. The app was free for the first three days and then $29.99/year.

The setup process is simple. Download the app, create an account, enter basic demographic information, and set goals. That's when I came across the first red flag. The app hilariously informed me that “losing 10 pounds is a realistic goal.” Except that by losing 10 pounds, I pushed me into the territory of my underweight BMI. This type of blanket statement reveals something about the lack of nuance regarding individual health needs.

The Cal AI photo logging process follows these steps:

  1. Ideally take a clear picture of your food against a plain background.

  2. Make sure all the ingredients are visible and bright.

  3. Include reference objects (such as coins and hands) for scale.

  4. Upload the image and wait for AI analysis.

  5. Review and modify the app's identification and partial estimates.

  6. Save entries to the daily log.

This app provides detailed tips for better results. Use natural lighting, avoid shadows, keep the camera parallel to the plate, and make sure no constituents are hidden. While these guidelines sound rational in theory, they suggest the fundamental challenges these apps face: the complexity of real-world diets.

The reality is very disappointing

I started my test with something simple: 222 grams of pink female apple weight. Certainly this is an easy victory for AI. April is one of the most photogenic foods on the planet, with a distinctive shape and colour that can be instantly recognised.

Calai confidently identified my apple as tikka masala.

cal ai identifies an apple as tikka masala.

Gorgeous Tikka Masala, yes?
Credit: Meredith Dietz

I gave it another chance, this time I was sitting on a kitchen scale that photographed the apple along with that barcode and displayed its exact weight. This time I was perceived as Apple, but I estimated it to be 80 calories if the actual count was supposed to be close to 120. This is an underestimation of 33%.

The actual test had a more complicated diet. Lunches of tofu, onions, cucumbers, tomatoes, feta and chickpeas filled with my current meal are all gene-smellingly dressed with oil-based homemade vinaigrette. This is a kind of mixed dish that appears to showcase the benefits of AI over manual logging. There is no need to search for individual components or estimate their amounts.

The result was a masterclass of algorithm overconfidence. The app has identified golden brown fried tofu as Croutons. This had to be fixed manually. Recognizing vegetables and feta did a pretty good job, but the oil content made me feel completely unwell. The salad is visibly sparkling with the dressing, but the app estimated the entire dish at 450 calories.

This estimate was hilariously low. A single can of chickpeas contained around 400 calories, and my portion contained a substantial amount of feta cheese and a few tablespoons of olive oil-based dressing, in addition to that amount. The realistic calorie count for this meal will be close to 800-900 calories.

Estimating part of the app proved to be even more problematic than identifying components. When filming a small serving less than a quarter of the original salad, the CAL AI estimated to have 250 calories. According to the app's own logic, under 25% of the meals contained more than 55% of the calories. Mathematics doesn't work.

Cal AI Display

Calai was far apart.
Credit: Meredith Dietz

This highlights the basic limitations of photo-based calorie counts. The camera captures two-dimensional images of three-dimensional objects. Without a consistent reference point or refined depth analysis, estimating amounts from photographs remains primarily inferred. Even humans struggle with this task, so nutrition experts usually recommend measuring food for accuracy.

We also tested two other popular apps, Snapcalorie and Calorie Mama, to take a full photo of the AI ​​calorie count landscape.

SnapCalorie: Better numbers, same problem

Snapcalorie quickly eased skepticism by suggesting a much more rational daily calorie goal of 1,900 calories compared to Cal AI problematic weight loss messaging. However, this accuracy comes at a sudden price. After just a week of free trial, it's $79.99 a year, making it the most expensive option we've tested.

This app offers one interesting feature. An “add” function that allows the camera to provide additional context for materials that are not visible. In theory, this addresses one of the fundamental limitations of photo-based tracking.

Snapcalorie analyzes apples.

SnapCalorie has useful “add” features and more accurate results.
Credit: Meredith Dietz

When testing SnapCalorie with the same pink female Apple, it performed much better than the Cal AI, estimated at 115 calories. However, the Greek salad test revealed a familiar problem. Snapcalorie's initial estimate was absurdly low at 257 calories. When I filmed the smaller portion, the same quarter serving that baffled the cal ai, snapcalorie estimated 184 calories. Mathematics wasn't working yet. This small portion should be about 25% of the larger serving, not 70%.

Determined to give the app a fair shot, I used the memo function to manually specify “a full container of tofu, feta, chickpeas and olive oil.” With this human intervention, Snapcalorie hit the estimate on 761 calories. It's still on the lower side, but more reasonable and accurate.

However, this raises obvious questions. If you need to manually enter detailed ingredient information to get accurate results, what exactly does the photo achieve? I essentially do my job of traditional calorie counting while experiencing the photography movement.

What do you think so far?

Calorie Mama: When AI isn't even trying

Calorie Mama provided the most frustrating and laughable experience with three apps. The interface feels rudimentary and the AI ​​performance is so poor that the app essentially abandons the premise of automatic photo analysis.

After uploading the photo, Calorie Mama will need to manually check the size of the portion, not only the food. This beats the entire purpose of photo-based logging. I do all the work that manual entry requires anyway.

When uploading a photo of a Greek salad, Calories Mama identified it simply as “tofu.” Vegetables, feta cheese, chickpeas and fully dressed. The app then asked me to manually adjust the portion size and it seemed to think the record was perfect, as if the complicated mixing dish had no plain tofu.

This was not merely inaccurate. It was useless. At least Cal Ai and Snapcalorie tried to recognize multiple components, even when calorie estimates were off. Calorie Mama appears to have given up on the Core Challenge completely, kicking out AI beyond the gimmick photo storage system.

The calorie count that powered AI wasted my time

The promise of AI-powered calorie counting is efficiency. But my experience revealed a different reality. I spent quite a bit of time modifying the identification of the ingredients, adjusted the portion size and estimated the app second. It would often be faster, using traditional manual logging with food scales and database searches.

This creates an annoying conundrum. Without scrutiny of AI results, inaccurate data becomes extremely inaccurate. However, looking at all the entries will lose the time saving benefits you justified using technology in the first place. It's the worst of both worlds. It is a manual tracing effort combined with the uncertainty of automated guesses.

Perhaps the most concerning thing is what happens when the user does not have a background to recognize inaccurate estimates. My experience with calorie counting for years may be problematic, like its history, but it gave me the knowledge I find when my Cal Ai count is turned off. But what about users who trust technology?

Systematic underestimation of calories can be particularly harmful to people trying to lose weight. Conversely, overestimation can cause unnecessary food restrictions or anxiety. In any case, inaccurate data undermines the overall purpose of the tracking.

The basic problems with AI Calorie counting apps are not just technical, but philosophical. These tools emerge and enhance from the idea that accurate calorie tracking is necessary and beneficial for health. However, research suggests that obsessive calorie counts can be more harmful than good for many people.

An intuitive diet focusing on internal hunger and satiety cues rather than external metrics shows promise as a more sustainable and psychologically healthy approach to nutrition. This framework emphasizes developing healthy relationships with food based on how you feel rather than hitting a specific numerical target.

For most people, understanding the general principles of balanced nutrition, eating enough vegetables, and choosing whole grains over refined grains with the right protein will improve long-term results over meticulous calorie tracking.

Conclusion

AI-powered calorie counting apps promise to resolve human errors in diet tracking, but introduce new forms of inaccuracy while still maintaining many of the old problems. If your goal is simply to roughly estimate the number of calories found in common foods, these apps may offer some value. However, for those seeking accuracy in intake tracking, traditional methods combined with food scales are more reliable.

More importantly, question whether an accurate calorie count will help your health goals. For many people, building a more intuitive relationship with food based on satisfaction, energy levels, and overall well-being rather than a numerical target is aimed at improving physical and mental health. Perhaps our old-fashioned approach to listening works better than any algorithm.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *