PRE2023 3 Group6

Foodini

Group members

Name	Student number	Study	E-mail
Sem van Birgelen	1813862	Industrial Design	s.v.birgelen@student.tue.nl
Manka Huszár	1581368	Computer Science and Engineering	m.huszar@student.tue.nl
Aydan Bakhshi	1671189	Applied Physics	a.bakhshi@student.tue.nl
Yi Hang Cheung	1014298	Computer Science and Engineering	y.h.cheung@student.tue.nl
Bohao Ye	1809903	Computer Science and Engineering	b.ye1@student.tue.nl
Vlad Chibulcutean	1780980	Computer Science and Engineering	v.chibulcutean@student.tue.nl
Jip van Hoef	1555960	Computer Science and Engineering	j.v.hoef@student.tue.nl

Introduction

Problem Statement

Food waste can be defined as "Food appropriate for human consumption being discarded, whether after it is left to spoil or kept beyond its expiry date." Food waste is recognized as a serious threat to food security, the economy, and the environment. 37% percent of food is wasted in households in the US, and in the EU, households generate more than half of the total food waste (54%). The causes of food waste could be food expiration, overshopping, and often these relate to poor meal planning and insufficient food management skills. Solving the problem of food waste will help combat undernourishment and meet the increasing food demand across the world.

Objectives

• Create an app that suggests recipes based on the contents of the user's fridge;
• Investigate how technology can be used to combat food waste. More specifically:
  • How much food is wasted in households;
  • What are the main reasons for food waste;
  • How to prevent food waste;
  • What would be a convenient way for users to keep oversight of fridge contents;
  • What incentives could be used to motivate consumers to prevent food waste
  • How AI can assist in preventing food waste
  • Check other recipe suggesting apps / websites, what features would be useful to add / what's missing.

Users & Requirements

Users

Adults in households, possibly restaurants and grocery stores.

User requirements

• Easy to use platform to save food
• Recipe suggestions
• Reminders about expiry dates

App requirements

Basic features:

• Firebase account login
• Inventory:
  • Shopping list
  • Edit list
  • Expiry date (barcode)
• Recipe suggestions based on:
  • Inventory
  • Expiry dates
  • [Optional] Cuisine (Italian, Asian, Mexican, etc.)
  • [Optional] Preparation time

Extra features:

• Look at local supermarkets for ingredients about to expire and, if possible, include them in recipes against discounted price (Analogous to "To Good To Go");
• Scan the barcode of the product to add it to the list automatically.

Planning

Research team

• Sem
• Aydan
• Vlad

Development team

• Manka
• Yi Hang
• Bohao Ye

Underlined = deliverables

Week 1

Research

• Choose a subject - Everyone
• Research the problem - Everyone
• Find 25 articles and summarize (partly for now) – Sem, Aydan, Bohao

Development

• Implement sign up and sign in – Yi Hang

Week 2

Development

• Complete mock-up user interface designs ½ - Manka, Sem

• Start Page
• Login  
• Sign up

Research

• Investigate state-of-the-art apps, add to wiki ½ – Aydan, Vlad
• Survey questions - Aydan
• App requirements (MoSCoW) - Bohao

Week 3 – Complete the survey

Development

• Complete mock-up user interface designs 2/2 - by Wednesday – Manka, Sem

• Inventory page
• Recipe page

• XML for login, sign up and inventory – Manka
• App Logo - Manka
• Implement Inventory – Yi Hang

• Page for item entry
• Enter expiration date

Research

• Investigate state-of-the-art apps, add to wiki 2/2 - Aydan, Vlad
• Summary of survey, add to wiki - Aydan

Week 4

Development

• XML for recipe page – Manka
• Implement Recipe page – Bohao, Yi Hang
• Notifications – Bohao

Research  

• Put together contents for info page – Aydan, Vlad

Week 5 – First working version

Development

• Notifications – Bohao
• Information page – Manka

Week 6

Research

• Conduct user test – Everyone + 3rd party
• Collect and analyze user test results - Everyone

Week 7 – Final version

Development

• Add fixes to app according to user feedback – Development team

Week 8

• Create final presentation - Everyone
• Peer review - Everyone

Timesheet

Timesheet Excel file

Week 1

	Time (H)	Summary	Notes
Yi Hang	11:45	Meetings, implement sign up and login
Manka	08:50	Meetings, work on UI designs, research, summaries, wiki edits
Aydan	16:10	Meetings, research, summaries, editing wiki
Bohao	11:40	Meetings, research, summaries
Sem	9:55	Meetings, research, summaries
Vlad	7:10	Meetings, research

Week 2

	Time (H)	Summary	Notes
Yi Hang	13:18	Meetings, and programming
Manka	14:35	Meetings, Design, Frontend programming
Aydan	11:10	Survey questions, state-of-the-art apps research and testing, editing wiki
Bohao	12:20	Meeting, Research, Recommendation Class structure Design, Planning of Recommendation Algorithm
Sem	10:15	Meetings, Aesthetic Literature Research, Interface Design Photoshop, Aesthetic Related Interview Questions, Reading/Writing
Vlad

Week 3

	Time (H)	Summary	Notes
Yi Hang	16:10	Programming
Manka	16:37	Design polishing, frontend programming (adding new features to the UI)
Aydan	08:00	Data analysis, editing wiki, writing
Bohao
Sem
Vlad
Jip

Week 4

	Time (H)	Summary	Notes
Yi Hang
Manka	20:25	Color days till expiration, savestate of fragments, onbackpressed behavior, recipe page, profile page, full deisgn update
Aydan	04:45	Literature review, food waste facts for the info tab, survey analysis
Bohao
Sem
Vlad

Week 5

	Time (H)	Summary	Notes
Yi Hang
Manka	23:00	Recipe show page, bottom navigation for both gesture and soft key navigation, info page, small fixes
Aydan	08:35	Meetings, affinity diagramming, literature review, editing wiki
Bohao
Sem
Vlad

Week 6

	Time (H)	Summary	Notes
Yi Hang
Manka
Aydan
Bohao
Sem
Vlad

Week 7

	Time (H)	Summary	Notes
Yi Hang
Manka
Aydan
Bohao
Sem
Vlad

Week 8

	Time (H)	Summary	Notes
Yi Hang
Manka
Aydan
Bohao
Sem
Vlad

Total

	Time (H)
Yi Hang
Manka
Aydan
Bohao
Sem
Vlad

Literature study

Current literature study: https://tuenl-my.sharepoint.com/:w:/g/personal/y_h_cheung_student_tue_nl/EQentLDOXeZPvfcCXSIoa-MBu4dp48m7xNqvfVzt4Jfd-Q?e=D1pmI2

Behavioral change models and metrics: https://tuenl-my.sharepoint.com/:w:/g/personal/y_h_cheung_student_tue_nl/EWN1MURJPppJqeaXPCezpzwBY8VYtNO8ZU6RGyWK0-Kscw?e=JgPNsa

Preliminary literature study (week 1)

Food waste matters - A systematic review of household food waste practices and their policy implications

In recent years concerns regarding food waste have increased due to its environmental impact . Resource depletion and greenhouse gas emissions that food waste causes are a important reason for this. "Globally, nearly one third of food produced for human consumption is lost or wasted, equalling a total of 1.3. billion tonnes of food per year”. Food waste is also indirectly accompanied by other environmental impacts like: soil erosion, deforestation, water and air pollution as well as green house emmisions which occur during the food production process, also thik of transportation. In the food supply chain, households represent the largest food waste section. In summary, if food is wasted in households, all energy was in vain and the complementary environmental impacts are for nothing. A holistic food waste prevention has to go beyond putting the responsibility solely on the consumers, policy makers need to be commited as well. Food waste prevention has to become the more attractive option for households.

Learning from and designing after pandemics. CEASE: A design thinking approach to maintaining food consumer behaviour and achieving zero waste

According to this article, a CEASE (Community, Engagement, Actions, Sharability and Ecosystem) approach to the food waste problem would be beneficial. What this means is that the design to combat food waste should be: 1) Community based, it should emphasize with the user. This focuses on the emotional and social desires of a community, the goal is to highlight the value that are basis for emerging behaviour patterns. Secondly, Engagement, interacting with the users is important and they need a sense of empowerment. Thirdly, actions, this is the part where you ideate for solutions and come up with potential prototype. Shareability is about creating a prototype that can be shared. Lastly Eco-systems are tested in to predict long term results and possible problems.

Food Waste Prevention: a design intervention for Households

This is the report of an Industrial Design student from Delft who did a design project about food waste prevention in households. The article discovers the main traits of the wasters. For example, young adults mainly waste food because of their busy lifestyle while large households (4+ members) generally waste the most due to less consciousness in reusing leftovers into new meals. It also takes a look at already existing initiatives like: Eetmaatje, the fridge and freezer sticker, slim koken app, de verspillingsvrijeweek, and educational initiatives in general.  

The final design were the “Eetkaartjes”, a design that aimed to make leftovers more apperent, force a sense of responsibility on the user and have the fridge more organised.

Design an Intervention to Support Food Waste Prevention at Home

Another Design graduation project was that of by Fauza Karomatul Masyhuroh, also from the TU Delft. From user research, it was concluded that “In the current practice, people already display food. However, sometimes this makes the kitchen a bit messy, and some food is still discarded due to getting rotten. So they expect the food in a neat and pretty way and ease them organising older and newer food to prevent spillage.  

The final design that was created was Foodi, a storage system for fruits and partly vegetables. To slow down the riping process, different fruits were seperated to contain their Ethylene gasses.

Food Waste at Consumer Level

This source explores food waste at consumer level in depth. It tries to understand the consumer behaviour that causes food waste. The general conclusion this paper made was that . It concluded that household food waste depends on consumer food management which means: “planning, provisioning, storing, preparing, consuming, disposal, and the consumer decision process: planning, pre-acquisition, acquisition, preparation, consumption, disposition.”

Food Waste Management: Solving the Wicked Problem

This article gives an research-based overview of food-waste by looking at environmental, socia-economic, economic, social and ethical considerations. In the 4th part it also looks at practical innovative solutions like for example insect-based bioconversion or Gleaning. The first one being about how insects could consume waste while producing valuable resources. Gleaning however is a very old technique used to salvage crops from farms which would otherwise rot.  It also looks at assumptions made about consumers and how they relate to campaigns against food waste. Additionally, the book explored food waste reducing apps.

Over Orbisk

Orbisk is a start-up company that aims to make the global food system more sustainable. They want to use emerging technologies like Computer Vision and AI to automatically monitor all food that is thrown away on ingredient level. The sensors used would be a camera above the trash bin. These insights can then be used by for example restaurants to adjust their menu.

Healthy cooking behavior monitoring devices

This article is about a study regarding at home cooking practices using the healthy cooking index. This could be relevant to Foodini since optimizing nutrition values is also an important aspect of food. This article user tested the effectiveness of using devices that could asses (healthy) cooking behaviour and it concluded that these tools have the potential to enhance cooking education, disease prevention and health outcomes.

Understanding Food Loss and Waste—Why are we losing and wasting food?

Definitions of food loss and food waste, quantification, causes of food loss and waste at different stages of the food supply chain.

Key points:

• Four main criteria affect food waste during the consumption stage: household size and composition, income, culture, and demographic factors;
• In addition to these four main factors, it has been widely confirmed in the literature that the individual attitudinal factor could also influence the FLW reduction.

A systematic literature review on food waste/loss prevention and minimization methods

• 1/3 of the edible parts of food produced for human consumption worldwide is either wasted or lost
• food loss and prevention methods can be an effective alternative for substantially reducing food waste through
  • food waste policies
  • programs
  • campaigns
  • changes in human behavior

A systems approach to assessing environmental and economic effects of food loss and waste interventions in the United States

TODO Yi Hang

Digital platforms: mapping the territory of new technologies to fight food waste

This article presents a comprehensive list of digital platforms for food waste management.

Using artificial intelligence to tackle food waste and enhance the circular economy: Maximising resource Efficiency and Minimising Environmental Impact: A review

The role of AI in preventing food waste, more specifically in smart monitoring, predictive analytics, smart inventory management, consumer awareness and education, donation and redistribution.

Food Waste Management: AI Driven Food Waste Technologies

This article is about how AI driven technologies can be utilized to combat food waste. It describes that current strategies exist out off combating food waste mainly in the supply chain and however these have their limitation. The article discusses how AI can be used to optimize supply chain management, predict demand and could reduce food spillage. Food Cowboy and Winnow are an example, they help commercial kitchens distribute the surplus of food and hereby prevent spillage. It also talks about the ethical and societal consequences AI in food waste combat could potentially have.

Smart strategies for household food waste management

The article presents an integrated system that aims at reducing household food waste. The system consists of a cloud database, a smart fridge, and a web application. The web application allows the user to interact with the smart system. The 4 main app features are:

• Ingredients management: Tracks food in the fridge, freezer, and pantry, the left quantity, and the date of purchase, opening, and/or expiration. Suggests actions depending on the expiry date on a daily basis. Adds depleted items to the shopping list.
• Proper food placement guiding: Leads the user in placing the products in the right fridge compartment to guarantee better storage conditions and increase the shelf life.
• Shopping list management: Remembers the products available at home. Also notifies the user of promotional items and adds them to the list of suggested products.
• Smart recipes suggestion: Suggests recipes by checking, filtering, and ordering ingredients available at home and closest to their expiration date.

Determinants of Food Waste from Household Food Consumption: A Case Study from Field Survey in Germany

A study conducted in Germany revealed that households in high-income countries contribute significantly to food loss and waste. On average, per capita food waste stands at 59.6 kg annually, with 49% of it being avoidable. Fruits and vegetables are the most wasted food items as per the compiled estimated composition of food waste. The study identified many reasons for food disposal, with 38% of the respondents citing lack of time to process food as the primary driving force. The second most common reason was that people cook more food than required, leading to leftovers being disposed of.

Household food waste: Attitudes, barriers and motivations

This study delves into people's attitudes towards food waste, examining the obstacles that hinder efforts to reduce it and the underlying factors that cause wastage. The key findings reveal that "Lack of environmental awareness" and "Exemption from responsibility" due to bulk and near-to-expiry sales are major contributors. Furthermore, it has been observed that guilt is a powerful tool in curbing food waste, as it encourages individuals to provide only the necessary amount of food for themselves or their loved ones.

To address these issues, several recommendations have been made. These include educational campaigns in collaboration with educational institutions and workplaces to inform the public about the environmental and socio-economic impacts of food waste. Additionally, practical measures such as providing free waste sorting bins to households, implementing financial incentives or penalties like the "Pay-As-You-Throw" system, and strengthening legal and regulatory frameworks are suggested. These approaches have been proven effective in various countries.

Preventing wasted food at home

benefits of saving food:

• save money by buying only what you actually need and consume
• reduce environmental and climate footprint
  • wasted food = wasted services like: transport, processing, preparing, storing etc.

ways to prevent food waste:

• Keep list of meals and their ingredients that your household already enjoys → shop for meals that are most likely to be consumed
• Look in your refrigerator to avoid buying food you already have
• Make a list each week of what needs to be used up and plan upcoming meals around it.
• Plan your meals for the week before you go shopping and buy only the things needed for those meals.
• Take into consideration how many days you will eat out vs eat at home and think about eating leftovers before you shop
• Include quantities on your shopping list noting how many meals you’ll make with each item to avoid overbuying. For example: “salad greens - enough for two lunches”
• Buying in large quantities (e.g., buy one get one free deals/discount deals) only saves money if you use all the food before it spoils
• Purchase imperfect produce or upcycled products. Imperfect produce may have physical imperfections but is just as safe and nutritious and can sometimes be found at discounted prices. Upcycled products are made from ingredients that might have otherwise gone to waste

Storage tips

• Properly store fruits and vegetables for maximum freshness
  • Most veggies should go in the high humidity drawer of the fridge
  • Most fruits should go in the low humidity drawer of the fridge
  • Some fruits (such as bananas, apples, pears, stone fruits, and avocados) release ethylene gas as they ripen, making other nearby produce ripen, and potentially spoil, faster. Store these away from other vegetables and fruits.
  • Some vegetables, such as potatoes, eggplant, winter squash, onions, and garlic, should be stored in a cool, dry, dark, and well-ventilated place

• Make sure you are properly storing food in your refrigerator.
  • refrigerator door is the warmest part of the fridge → store condiments there, but it is not recommended to store milk or eggs in the door
  • The lower shelves are the coldest part of the fridge. Store meat, poultry, and fish here.
• Store grains in airtight containers and label containers with contents and the dates.
• Befriend your freezer and visit it often. Freeze food such as bread, sliced fruit, meat, or leftovers that you know won’t be eaten in time. Label with the contents and dates.

Cooking and preparation tips

• Produce that is past its prime, as well as odds and ends of ingredients and leftovers, may still be fine for cooking. Repurpose these ingredients in soups, casseroles, stir fries, frittatas, sauces, baked goods, pancakes, or smoothies
• Learn the difference between “sell-by,” “use-by,” “best-by,” and expiration dates.

Household Food Waste: The Meaning of Product’s Attributes and Food-Related Lifestyle
product attributes that contribute to waste:

• meat, seafood, fruits and vegetables are wasted the most because they are fresh products
• visually non appealing foods are wasted a lot, e.g, imperfect fruit

consumer related determinants of food waste include

• time for food related activities
• cooking skills
• knowledge and awareness

housholds' inability to estimate their own consumption is a major contributor to food waste

3 consumer clusters were found in the study

1. consumers who are against wasting products with favorable taste or healthy products → mostly women and people with the highest income
2. consumers who are againts wasting food that is convenient/easy to prepare → mostly students
3. consumers who have no food wasing morale and who are thus the most wasteful → mostly people with full time jobs

State-of-the-art apps

Prior to creating a mobile application, it is instructive to look at the state-of-the-art apps and investigate their functionality. For this purpose, ten apps were selected from Google Play based on the number of downloads and user ratings. The selected apps can be divided into two main categories: apps that suggest recipes and help with meal planning and apps that keep track of expiry dates. The summaries are provided below.

Recipes & Meal Planning Apps

Samsung Food: Meal Planning

Figure 1. Samsung Food App.

Samsung Food is a multi-purpose cooking app that offers a large collection of recipes and assists in meal and grocery shopping planning. The user can join a large number of communities based on various cuisines and diets, such as vegetarian recipes, healthy eating, low-carb recipes, one-pot wonders, freezer meals, etc. In the communities, the user can view recipes from other people as well as share theirs. The user can also search for recipes within a certain community and apply filters, such as ingredients, meal type, diet, and cooking time. The user can also follow a specific creator. The recipes can be personalized by editing the ingredients manually or using AI for healthier alternatives. Another feature of the app is that the user can save recipes from the web and add them to the shopping list. Also, the app has a meal-planning feature. The user can add recipes to specific days and specific meals. Also, the app displays the total nutritional value, such as calories, carbs, fiber, protein, and fat, of the added recipes. The created meal plan can be shared with other users. Lastly, the app has an integrated shopping list, and the ingredients added to the list can be sorted by aisles or recipes. The shopping list can also be shared with others. Overall, the app has an intuitive interface and minimalist design.

Mealime Meal Plans & Recipes

Figure 2. Mealime App.

Mealime is an app that helps create meal plans and shopping lists based on that. The user starts by indicating the typical number of servings per meal, as well as allergens or food dislikes. Then, the user can choose from a large variety of meal plans offered in the meal plan section. The meal plans are sorted by various categories, such as Mediterranean, vegetarian, baked, BBQ & Grilling, Soups, Stews & Chillis, etc. After adding the recipes and the number of servings per dish, the app automatically creates a shopping list with all the necessary ingredients. The user can go grocery shopping or use the integrated online shopping option, where the ingredients can be ordered from one of the local stores. A distinct feature of the app is that it keeps track of the amount of food waste saved by creating meal plans and reusing the same ingredients in different dishes. Also, the user can add their recipes, either manually or by importing from the web. Overall, the app has a minimalist and intuitive interface.

HelloFresh: Meal Kit Delivery

Figure 3. HelloFresh App.

HelloFresh is a meal-planning app with an emphasis on choosing meal plans and getting ingredients for the selected meals delivered to your doorstep. The user starts by indicating their preferences and the number of servings per meal. The app features a large collection of recipes that can be filtered based on cooking time, nutritional value, ingredients, and cuisines. The ingredients for the selected meals can be ordered directly from the app. The app has a green and minimalist design with a limited number of features.

Meal Planner – Plan Weakly Meals

Figure 4. Meal Planner App.

Meal Planner is a simple meal-planning app. The app features an agenda where meals can be added to different days and different meals. The created meal agenda can be shared with other users. The app also features a recipe tab, where the user can add their recipes as well as select from ones suggested by the app.  Lastly, the app has an integrated shopping list, where the ingredients can be added manually as well as by scanning a barcode. The user can also keep track of the ingredients already available at home. The app features a minimalist design with limited features.

SuperCook – Recipe Generator

Figure 5. SuperCook App.

SuperCook is a recipe-suggesting app. The user can add ingredients available at home and based on that the app will suggest various recipes. A distinctive feature of the app is that the user can add ingredients to the virtual pantry via voice input. Also, the app assumes that salt, pepper, and water are available by default. The app has a large variety of categories and corresponding ingredients that can be added by pressing on an item. This presents an advantage as the user does not have to type in the ingredients manually. After selecting all the ingredients, the app suggests recipes that can be filtered by diet, rating, cooking time, meal type, key ingredients, etc. It is also possible to exclude or include additional ingredients. Also, the user can save recipes to favorites. Additionally, the app has an integrated shopping list. The user can add items that are running out to the shopping list directly from the virtual pantry. The app has a simple and intuitive interface equipped with unique features.

SideChef: Recipes & Meal Plans

Figure 6. SideChef App.

Side Chef is a versatile meal-planning and recipe-suggesting app. The user receives recipe suggestions tailored to the user’s dietary preferences as well as allergens and dislikes. The recipes can be added to specific days of the week, and the serving size can be adjusted as well. The user can also add custom recipes or import from the web. After completing the meal plan, the user can add all the ingredients required for the recipes to the shopping cart. The user can add additional ingredients manually if necessary. The app also features a virtual pantry and corresponding recipe suggestions similar to previous apps. A unique feature of the app is that the pantry can be automatically prefilled with basic ingredients, such as dairy products, grains, sauces and condiments, spices and seasonings, etc. Then the user can manually add or remove items. Similar to SuperCook, the items can be added by pressing on corresponding pictures from the selection. Overall, the app has a simple and minimalist design.

Eat This Much – Meal Planner

Figure 7. Eat This Much App

Eat This Much is a meal-planning and recipe-suggesting app. The app automatically creates a meal plan tailored to the physical parameters of the user (height, weight, sex, fat contents), lifestyle, dietary preferences, and allergens. The curated meal plan can be manually adjusted by the user. Additionally, the app offers a wide variety of recipes and collections created by other users. Also, the user can add specific ingredients to the meal plan and set them as recurring. The ingredients can be added by choosing from the app selection or scanning a barcode. The paid version of the app also includes a virtual pantry and an integrated shopping list. Overall, the app emphasizes the weight goal of the user and the nutritional value of the ingredients.

The main features of the apps were summarized and compared in the table below.

Requires sign up

Recipe suggestions

Social media aspect

Shopping list

Meal planning

Add own recipes

(Explicit) use of AI

Dietary preferences

Allergies

Food waste awareness

User physical profile

Expiry date tracking

Unique features

Samsung Food

Y

Y

Y

Y

Y

Y

Y

Y

N

N

Y

N

Mealime

Y

Y

N

Y

Y

Y

N

Y

Y

Y

N

N

HelloFresh

N

Y

N

N

Y

N

N

Y

N

Y

N

N

Meal Planner

N

Y

N

Y

Y

Y

N

Y

N

N

N

N

Barcode scanner

SuperCook

N

Y

N

Y

N

N

N

Y

N

N

N

N

Voice input

SideChef

Y

Y

Y

Y

Y

Y

N

Y

Y

N

N

N

Prefill pantry

Eat This Much

Y

Y

N

Y

Y

Y

Y?

Y

Y

N

Y

N

Automatic meal planning, tutorial, barcode scanner

As can be seen, none of the apps mentioned above include expiry date tracking. Therefore, the apps with this specific functionality are investigated below.

Expiry Date Tracking Apps

BEEP - Expiry Date Tracking

Figure 8. BEEP App.

BEEP is an app that keeps track of the expiry date of products. The products can be added to the inventory by scanning the barcode and the expiry date indicated on the packaging. Alternatively, the user can add items manually via text input. The user also has an option to add a picture of the item. The items are displayed in the list with items close to the expiry date being on the top. Additionally, the items in the inventory can be sorted by categories specified by the user. The user can create groups and invite other users, for example family members. The app also sends notifications once certain products are about to expire. Overall, BEEP is a simple app with minimalist design and limited functionality.

Best Before - Food Tracker

Figure 9. Best Before App.

Best Before is an expiry date managing app. Similarly to BEEP, the items and their corresponding expiry dates can be added to the pantry. Additionally, the items can be classified by food category and storage location. The user can also set notifications for each individual item in case of expiry or as a reminder after opening. The user can sort items in the list by name, purchase date, best before date, or remaining quantity. Also, the items can be grouped by category or storage location. Overall, the items in the pantry are divided into 3 categories: items ready to eat, items that have been opened, and items that have expired. The items that have expired are added to the corresponding section automatically. Additionally, in the “Consumption” section, the user can keep track of all the items that have been consumed and/or trashed. The app also features a “Shopping list” section. In conclusion, Best Before is an effective tool for food tracking and expiry date managing; however, the interface is difficult to navigate at first.

Food Expiration Dates

Figure 10. Food Expiration Dates App.

Food Expiration Dates is an app that keeps track of the expiry dates of the items in the pantry. Similar to the previous two apps, the items in the list are shown with the items closest to the expiry date being on top. The app has a simple and minimalist interface without any additional features.

Survey results and discussion

To investigate whether there is a demand for an expiry-tracking and recipe-suggesting app, a survey was conducted. The results and the analysis of the survey are presented below.

Results

The questions can be divided into two main categories: general questions regarding user food habits and knowledge about food waste, and questions related to the app design and functionality. The first part of the questionnaire aims to compare the data acquired from the literature study with the real-life responses, and the second part aims to aid app development and identify the functionality that the users require the most.

The first question asks the respondent to indicate their age. As can be seen from Figure ?, the majority of the respondents (61.5%) are between 18 and 24. As for other age groups, 17.3% (9 respondents) are between 35 and 44, 15.4% (8 respondents) are between 25 and 34, 3.8% (2 respondents) are between 55-64, and 1.9% (1 respondent) are between 45 and 54. Thus, the survey includes responses from a large variety of age groups, with most responses coming from younger users.

In the next series of questions, the respondents are asked to indicate to what extent they agree with the presented statements. For the first statement, “I frequently throw away food,” the majority of the respondents, namely 67.3%, responded negatively, while 21.2% neither agreed nor disagreed.

As for the next statement, “I throw away a large amount of food,” most respondents (92.3%) replied negatively.

In response to the statement “I often forget about the food in my fridge,” a large portion of the votes (57.7%) replied negatively, 21.2% remained neutral, and 21.2% replied positively.

For the question "I cook more than I can eat", 63.5% replied negatively 15.4% neither agreed nor agreed, and 21.2% replied positively.

Regarding the statement “I don’t reuse leftovers,” the majority of the respondents (86.5%) replied negatively.

The next statement, “I don’t cook / don’t want to cook because I” aims to find the most common reasons why people avoid cooking. For half of the respondents (55.8%), the statement is not applicable, while 36.5% indicate that they don’t have enough time for cooking. As for the rest, 13.5% indicate that they don’t know what to cook, and 7.7% don’t cook well. Other responses attribute not cooking mainly to laziness.

As for the next two statements, “I am aware of the problem of food waste” and “I am willing to reduce the amount of food waste I produce,” the majority of votes (78.8% and 82.7%, respectively) were positive.

The second part of the questionnaire is related to app design and functionality.

First, the respondents were given a brief description of the app:

"To combat food waste at a consumer level, we are making a mobile application that keeps track of ingredients available at home and suggests recipes based on that."

For the statement “Would you consider using such an app," 30.8% of respondents replied “Yes,” and 50% replied “Maybe.” Thus, the answers indicate that there is an interest in such an app.

The next three questions ask the respondent to choose a mock-up that looks most appealing. The results can be seen in the figures below.

The next question is related to the preferred method of inputting items into the virtual inventory. The most popular options are via taking a picture and via text input with 31 and 27 votes, respectively.

The following question reads “What additional features would you like to see in an app?” The most popular request with 45 votes is to notify when the product in the inventory is about to expire. Also, adding the expiry date to the product automatically and recipe filtering were popular choices, with 31 and 32 votes, respectively.

Finally, the respondents are asked to provide additional comments or suggestions. In total, 11 responses were submitted. These can be found below.

Nice idea guys

Using expiration dates given by manufacturer labels is problematic as they are completely arbitrary. I often have items in my fridge weeks beyond their stated expiration date but still in a very good condition. I am fairly convinced manufacturers inentionally set very early expiration dates to boost their sales

It would be interesting to see how you implement expiration date compared to when the food actually spoils. Of course you could send a notification of when food is about to hit its expiration date, but it would be much more useful if you could actually estimate how far away the food is from spoiling.

You could provide advices on how to reduce use of packaging - list of brands/locations/shops where the same products can be bought with less plastic packaging.

Inform me about where I’m supposed to store food (fridge or no)

The app should have a dark theme.

The ways I had for adding food items are nice and fast, however they do not account for the expiration date as cameras can not see when a piece of food will expire especially when the food is in a carton since the expiration date could just happen to be on the back of the product. the same goes for the barcode, as far as I am concerned, barcodes do not have any information on expiration date on them as the barcode is the exact same on every product of a single type, I would like to know how the app tracks when a product will expire.

For the rest, I like the idea, I believe things like this have been done before (Fridgely, BEEP, Best before etc) so I would like to know what your selling point is. There is definitely a market (and a need!) for such a product as food waste is a huge issue. Good luck :)

This kind of app should be possible without an account, I'm a bit wary about user data harvesting.

would love tips about increasing lifespan or freshness e.g. putting lemons in water

Being able to connect the app to an Albert Heijn bonus kaart or Jumbo extras account to avoid manual input

I really like the concept of this app, would definitely use if it delivers on this concept

Discussion

Several conclusions can be drawn from the results of the survey. Firstly, the sample size of 52 is too small and, therefore, not representative of the full population. Therefore, definitive conclusions cannot be drawn. Moreover, the information provided by the literature might not agree with the questionnaire results.

Secondly, it can be observed that most of the respondents (61.5%) are in the age group of 18-24. In other words, this age group represents students and/or recent graduates. Therefore, it can be presumed that the amount of food waste in this age group correlates with limited finances. As noted by [4], financial concerns create a stronger motivation to limit the amount of food waste than environmental or social ones.

Another conclusion that can be drawn from questions 2 and 8 specifically is that there is a correlation between the amount of food waste and the awareness about food waste in general. As mentioned by [4], concern about food waste is a significant factor regarding food waste reduction. To explore this hypothesis more, a heatmap was created. The horizontal axis represents the responses to the statement “I frequently throw away food,” and the vertical axis represents the responses to the statement “I am aware of the problem of food waste.” The numbers on the heatmap indicate the number of people who have selected a specific answer. As can be seen, the respondents who answered 1 or 2 (Strongly Disagree and Disagree, respectively) are highly aware of the food waste problem with scores of 4 and 5 (Agree and Strongly Agree, respectively). Also, as can be noted, the number of respondents who are aware of food waste but still throw away food frequently is significantly less. Therefore, one of the strategies for reducing food waste could be raising awareness about food waste among the public. More specifically, the users can be informed about food waste via a dedicated info tab in the mobile application.

Lastly, the information collected via a survey is limited and does not provide the full picture of the causes of food waste and food-related habits. Thus, further investigation in the form of interviews is required.

User Studies

Interview

Interview Robots Everywhere

1. How significant do you think the global issue of food waste is, and to what degree do you believe your actions contribute to this problem?
2. Would you welcome support in addressing your impact on the issue of food waste, regardless of the specific medium? If yes, can you specify the areas where you would most appreciate assistance?
3. How do you personally imagine that current technologies could be used to minimize household food waste? Provide some examples, if possible.
4. Our proposed solution is a mobile application designed to combat food waste by suggesting recipes tailored to the user's fridge contents. Additionally, the app may recommend specific, additional products to purchase when the fridge inventory is insufficient. What, in your opinion, are the advantages and disadvantages of such an app? Also, which features, whether mentioned or not in our description, do you view as essential for this application's effectiveness?
5. Would you consider it inconvenient to manually enter your kitchen ingredients, their expiry dates and potentially their quantities into the app? To what degree would you prefer an automated input system, like using QR codes or photo analysis for product information?
6. How important is it for you to tailor the app's recipe suggestions to match users’ personal preferences and restrictions, like allergies and preferred cuisines? Additionally, are there any other possible customizations you would want the app to offer?
7. Are you currently using any existing applications or methods to help reduce food waste in your daily life? If yes, please share your experiences and any limitations you've encountered.
8. Are there any concerns or reservations you have about the privacy and security of personal information when using an application that involves tracking kitchen inventory and consumption patterns? If so, please briefly describe them.
9. Would you be willing to share your food waste reduction efforts on social media or participate in a community aspect within the app to encourage and inspire others? Generally, would you be interested in the application including any sort of social features?
10. How open would you be to trying new recipes and ingredients suggested by the app, especially if they contribute to minimizing food waste?
11. How important do you view user interface design in influencing your decision to use and engage with the application regularly? What would be some specific features that you would like to see included in the user interface?
12. Would you be more inclined to use the app if it offered incentives, rewards, or discounts related to sustainable practices or reduced food waste? If so, what such rewards would motivate you most?
13. Would you prefer the app to offer educational content or tips on sustainable cooking practices to further enhance your awareness and knowledge about reducing food waste?
14. Considering potential time constraints in your daily life, how much time would you be willing to dedicate to using the app for meal planning and managing food inventory every day, or week?
15. Are there specific social or cultural considerations that you believe the app should incorporate to be more inclusive and relevant to diverse user demographics?

Design related questions

Furthermore we have design related questions for this interview. First of all, the design Aesthetic.

1. If you imagine an app that supports you in combatting food waste at home. What kind of feel would you prefer. Use keywords to describe it.
2. If you take a look at the following theme of aesthetic (figure 1). Which aspects do you like and which aspects do you dislike? Does it give you the feeling of empowerment and sustainability?
3. If you take a look at the following theme of aesthetic (figure 2). Which aspects do you like and which aspects do you dislike? Does it give you the feeling of empowerment and sustainability?
4. If you take a look at the following theme of aesthetic (figure 3). Which aspects do you like and which aspects do you dislike? Does it give you the feeling of empowerment and sustainability?

Look at the following interface. This interface is a virtual fridge, it keeps inventory on all the items that are placed in you're fridge and it should give an clear overview opposed to your chaotic fridge. The goal would be to motivate you to waste less food.

5. Take a look at figure 4. What are you're impressions? Do you think this interface is intuitive, clear, pleasant to use and efficient? Also mention why.

6. Take a look at figure 5. What are you're impressions? Do you think this interface is intuitive, clear, pleasant to use and efficient? Also mention why.

7. Take a look at figure 6. What are you're impressions? Do you think this interface is intuitive, clear, pleasant to use and efficient? Also mention why.

Now in terms of Aesthetics, look at the following pictures of interfaces. What emtions or feels do come up when you look at each interface. Which ones do you like/dislike and why? What do you think of the different kind of styles the food ingredients are displayed (pixel art/realistic...) and what consequences do they have for the clearity of the interface?

8. Figure 7

9. Figure 8

10. Figure 9

11. Figure 10

12. If you compare the 3 different options, what main differences do you see and which differations do you prefer between them and why?

13. Which of the three variation of the virtual fridge has your preference? Explain why

14. Do you feel like these interfaces that show statistics about you food waste analytics would make you feel more in control of the food waste as a societal issue? Why would that be or not be? (show figure 11)

Link to complementary figures in Interview: https://tuenl-my.sharepoint.com/:p:/r/personal/y_h_cheung_student_tue_nl/_layouts/15/Doc.aspx?sourcedoc=%7BAE9ECC3E-09E6-4A0D-AB51-C92C02CDA097%7D&file=Interview%20Complementary%20Images.pptx&action=edit&mobileredirect=true

Link to the transcription of the first 5 interviews:

Link to the MIRO: https://miro.com/app/board/uXjVNxRrTmo=/

Survey

Link to Google Forms: https://forms.gle/2RRD5r4F2SRnbFrW9

Survey questions:

1. Please indicate your age:

• Below 18
• 18-24
• 25-34
• 35-44
• 45-54
• 55-64
• Above 65

For the first part of the survey, please choose the options that best reflect your experience.

(On a scale from 1 to 5, with 1 and 5 being "Strongly disagree" and "Strongly agree", respectively.)

2. I frequently throw away food.

3. I throw away a large amount of food.

4. I often forget about the food in my fridge.

5. I cook more than I can eat.

6. I don’t reuse leftovers.

7. I don’t cook / don’t want to cook because I (multiple options possible):

• Don’t have enough time
• Don’t know what to cook
• Don’t cook well
• Not applicable
• Other:

8. I am aware of the problem of food waste.

9. I am willing to reduce the amount of food waste I produce.

To combat food waste at a consumer level, we are making a mobile application that keeps track of ingredients available at home and suggests recipes based on that.

10. Would you consider using such an app?

• Yes
• No
• Maybe

For the next three questions, please choose designs that are most appealing to you (multiple options possible).

11. Overall look:

• Option 1
• Option 2
• Option 3
• Option 4
• Option 5
• Option 6

12. Login page:

• Option 1
• Option 2
• Option 3
• Option 4

13. Display of food items:

• Option 1
• Option 2
• Option 3

14. What would be the most convenient way to add food items to the inventory (multiple options possible)?

• Via text input
• Via voice input
• Via scanning a barcode
• Via taking a picture of the product
• Other:

15. What additional features would you like to see in an app (multiple options possible)?

• Notify when the product is about to expire
• Have an integrated shopping list
• Add expiration date to the list automatically
• Filter recipes (by preparation time, cuisine, etc.)
• Inform the user about food waste
• Other:

16. If you have any additional comments / suggestions please leave them below:

User Requirement List Based on Interviews and Survey

Must have:

• Virtual Inventory: The users can store their product inventories in the app.
• Textual input: The users can input their bought products into the app by writing down their names, quantities, and expiration dates.
• Notifications: The app informs the user when a product in the inventory is about to expire.
• Recipe suggestions & filtering: The app suggests recipes based on the ingredients available in the user’s inventory. The recipes can be filtered by cuisines, cooking time, calorie count, and available cooking utensils.
• Storage of User Information (relevant to recipe filtering): The users can input their allergies, chronic diseases, cultural/religious food limitations, and diets, which are stored in the user profile and then accounted for when recommending recipes.
• Anonymous Login: The users can log in to the app anonymously to maintain their privacy.

Should have:

• Adjustable portion size: Users can adjust the portion size depending on the number of people in the household.
• Info tab: General information about food waste, could also include tips on how to store various groceries, such as fruit and vegetables and generally on cooking sustainably. This should be at the back of the app, accessible but not too annoying
• Scanning Data Input: QR scanning for inputting bought items into the virtual inventory.
• Expiry Date Prediction: The app predicts the approximate expiry date of certain products that do not have a specific expiry date, also based upon where it is stored (fridge, freezer or shelf).
• Saving Liked Recipes: The app has a “favorite” page where users’ favorite recipes are stored.
• Ingredient Substitutes: Have the possibility to substitute ingredients in the recipes with analogous products.

Could have:

• Rewards: Continuous use of the app can gain the user some sort of virtual points, which can be used to acquire discounts at big retailers or even full-on food packages.
• Calorie Tracking: Users of the app can select the number of calories that they want to eat of their chosen meals, and the app consequently recommends ingredient quantities.
• Statistics: The app includes personalized information on how well the user is utilizing the app, like streaks of daily use and perhaps comparisons to other users.
• Tutorial: When a new user joins the app, there is a short, optional tutorial that teaches the user how to properly use the app.
• Integrated shopping list: The user can add ingredients that are required for a specific recipe to the shopping list. Also, when a product runs out it gets added to the shopping list automatically.
• Social Features: Users can contact each other and form communities where they can share information and interact.

Won’t have:

• Filling per calorie: List meals based upon how much they fill
• Food Freshness: An additional indicator based on predictions, next to whether the food is within the expiry date and whether one indicating food is still fresh (nice to eat).
• Health Statistics: Month overview of food eating patterns and health wise comparison to yourself
• Custom recipes: The user can add their custom recipes to the app, with option to share it with others

General Findings:

• People don't think they need assistance because they don't waste a lot, which however they do.
• The design should be minimalistic and intuitive, prioritizing functionality.
• Virtual Fridge: mix different elements from the 3 fridges: From 1st fridge, have it look like an actual fridge, use PNG images. 2nd fridge: color coding and expiry date. 3rd fridge: group by expiry date, high quality pictures
• People want bright aesthetics, food is a happy thing

Recommendation algorithms/techniques

Steps to take before we can filter and sort the recommendations:

There are a few steps that have to be taken before the actual prioritization of the left over recommendations:

1. Before we even send a call to the api we have to define some ingredients we can assume that people will have in their homes. These are things like oil, salt, pepper etc.
2. When this is done, we will send a call where the available ingredients are the default ones + the ingredients in the fridge. From this, we get an return that has different recipes with a list of ingredients needed for those recipes.

Possible options:

The best option for our use case is probable to use a content-based filtering algorithm. This is a method where you just compare the contents of the recipes with the contents of the fridge, and give a score to each item in the fridge. Then for all items in the recipes that are items in the fridge the scores are added together and the recipes with the highest scores are displayed first.

Score calculation:

With the calculation of the scores we can take into account that we want to prioritize items that are close to or just over the expiration date. We can do this by mapping an exponential function to the score, where it gets higher when the item is closer to the maximum expiration date. This date is something we can set based on the category of the item, and the expiration date the user would putt in. So for example, for some kind of vegetable this could be expiration date + 5 days. Ofcourse, when an item is over the expiration date given by the manufacturer, there will be a warning to check the food well before use. Also, to make sure that no recipes get recommended with items that are over the maxiumum date, we can set the score of those items to a large negative number, making sure that the score of that total recipe will be very low thus not making it on the list.

Possible upgrades that probably are out of scope for this project:

In the future, when the app would have a substantial use case it would be possible to switch to another hybrid recommendation system. In this system there would be a collaborative filtering aspect to it. This would give the user a more tailored experience, while also discovering more new recipes. This is only possible with a large user base because the collaborative filtering system recommends recipes that other similar users have made. For this, the app would build a profile of the user where it looks at what kind of recipes the user cooks, and look at similar other users for some recipes that the user has a high probability of also liking. Because the main focus of this application is to reduce food waste we will go with the content-based filtering and focus on the scoring calculation.

!! Remove later ( notes for the actual algorithm)

func calculatePriorityScore(expiration_date, current_date, max_overtime)

delta = expiration_date - current_date //Delta should be days

if(delta < -max_overtime)

return -99999

else return exp(delta)

func calculateRecipeScore(recipe, fridge_items)

for item in recipe

if item /in fridge_items

score += fridge_items[item][score]

return score

func recommended recipes(recipes, fridge_items)

at start of api call, call calculatePriorityScore once to get dictionary or something of scores for every item

then loop over recipes and call calculateRecipeScore forEach.

return recipes that have score above 0 sorted from highest to lowest score.

Design iterations

Design iterations (popup + list view of inventory) (Figma)

Design iterations (inventory grid view). Top color schemes were for text color variations.

Icon ideation + coloring

Some pages from the current app. The design was changed quite a lot throughout building the app, including many different color schemes and layouts. This can be seen for example from the difference between the original Figma layout vs what is in the app on the inventory page.