Checking the accuracy procedure
Checking the accuracy of recognized products and price tags in the photo is performed according to a specific scenario:
- Every day, each Inspector Cloud Accuracy Checker is selecting random visits for a specific date.
Note
If necessary, the scope of the check and random selection procedure is agreed with the client, or performed on client’s side.
- Staff members manually check scenes and photos during the visits.
- If errors are found during a check, they are noted on photos.
- After checking, Accuracy Checkers update the dashboard information.
The recognition accuracy is calculated by the formula:
- Errors are checked only on the Faces of client's products (or products recognized as the client's) in the specified categories.
- The denominator of the formula contains the total (true) number of goods Faces of specified categories in the photo.
- Duplicate annotations are not checked.
Attention!
Accuracy check is performed only on those scenes, photos of which were taken without violating the rules of photography.
Types of errors
When checking the recognition accuracy, errors are determined in both goods and price tags.
Notes
In some situations, the goods on the shelf may not be recognized correctly, but this won’t be an error.
Product recognition errors
Sizing error (SIZ)
The size of your product (or a competitor’s one) packaging , entered into the system before the SKU, is incorrectly determined.
False positive alarm (FP)
The competitor's product is incorrectly identified as own.
False negative alarm (FN)
Your product is incorrectly identified as a competitor's one, or as «Unknown».
Another error (UNK)
Your own product, which is not in the IC catalog. For example, new SKUs, or new designs for existing SKUs.
Taste definition error (TAS)
The «taste» of your product, or a competitor's one, was incorrectly determined. For example, there is a Prill «Mango and Grapefruit product» on the shelf, but it is recognized as Prill «Raspberry and Red Currant».
Detection error (DET)
One product has several specific (not Unknown) detector frames, or several products got into one frame.
Label recognition errors
Blurred price tag read incorrectly (BP)
Checking price tags is optional and is performed depending on the quality of the photo. If the photos in the scene are blurry, of low quality, or the price tag cannot be disassembled, then the price tag check is not performed.
Price not read (PNR)
When the price tag was recognized without a price, or not recognized at all.
Price is incorrectly read (INC)
When the price was recognized, but not the one indicated on the price tag.
Error in determining the promo/regular price tag (PRO)
When a regular price tag is recognized as a promotional price tag, or vice versa.
Not taken into account for the calculation
When checking scenes, some situations cannot be attributed to errors.
Cropped Edge Photo Items
Products, some of which are closed or cut off, have the same visible size as smaller SKUs.
Products that stand at the back of the shelf
Items at the bottom of the shelf have the same visible size as the lower volume SKUs.
Products for which it is impossible to determine the class
For example, it is impossible to determine the taste of a product from an image.
Product is covered by a price tag on a shelf or other item
Also, when checking, situations are not taken into account if the lower shelf has a deep rim and the bottles standing on it are one-third closed. Their visible height is the same size as the smaller SKU.
Product reflected in refrigerator doors and sidewalls
For example, the bottle is reflected in the sidewall of the refrigerator on the right. Its reflection is not taken into account in the recognition accuracy report.
Low image quality
The photo is cloudy or the products are overexposed.
Incorrect product location
These include photos where the product:
- located so that it is impossible to accurately determine the SKU. For example, partially hidden, turned upside down, or not facing;
- lies horizontally;
- located at an angle, with a distortion of size.
Products in boxes
There are no price tags, it is impossible to visually determine the size of the product to others.
The display of products is completely absent, the packs are located at the ends or only the corner of the pack is visible.
If you have any questions, or experience any issues, please contact our technical support team.