Skip to main content

DQI

Data Quality Indicators (DQI) is a quantitative measure for the quality of data that is obtained from image recognition in a visit. DQI allows you to evaluate the quality of photos in scenes and the reliability of the data obtained from them.

DQI is formed for:

  • individual photo — for example, sharpness or perspective;
  • scenes — for example, check the statement that not all products of the target category in the store were photographed;
  • visit — for example, if the value of one of the indicators is very different from the historical data.

View DQI

The DQI list is available in the results of the entire visit, each task of the visit, or each photo in a scene.

To view DQI open Visits and select a visit to view.

If the visit is not yet completed, correct the comments pointed out by the portal and check the results again.

The results of the visit show the entire DQI list, which is obtained from the results of the tasks.

Press DQI and view the list. To go to a photo with DQI, click on its name.

Types of DQI Alerts

The DQI warning states:

  • Severity — warning type;
  • Associated — which part of the visit is related to the warning;
  • DQI type — a type of error or warning;
  • Value — DQI indicator value;
  • Treshold — value below or above which (depending on the type of DQI) the indicator value should not be.

Severity

  • CRITICAL — critical alert, such as photo fraud.
  • WARNING — warning, such as wrong category or perspective.
  • INFORMATION — remark, for example, a very blurry photo.
  • DISABLED — indicator is disabled and not calculated.

Associated

  • IMAGEsingle photo on a visit. Indicators are calculated after photo recognition.
  • SCENEvisit scene. Metrics are calculated before updating the metrics for the scene.
  • VISITvisit, indicators are calculated after the visit is closed.

All indicators are calculated each time anew: old indicators associated with the specified object are deleted, and new ones are saved to the database.

DQI type

Photo

The type of DQI that is output for the visit photo.

Sharpness

A quantitative measure of the sharpness of the photo.

How does it work:

The photo analyzes the sharpness indicator. If the score is below the threshold, then the system generates a DQI. By default, Threshold=300.

Horizontal perspective

The angle is a measure for horizontal lines.

How does it work:

The system analyzes the app_perspective_angle_hor indicator in the photo. If the score is below the threshold, then the system generates a DQI. Default Threshold=0.3.

Vertical perspective

The angle is a measure for vertical lines.

How does it work:

The system analyzes the app_perspective_angle_vert indicator in the photo. If the score is below the threshold, then the system generates a DQI. Default Threshold=0.3.

Horizontal camera angle

An indicator that reflects the excess of the shooting angle horizontally.

How does it work:

After taking a photo, the system analyzes the horizontal angle of the photo and records the result in the dqi_camera_angle_horizontal index. If the score is greater the threshold, then the system generates a DQI. Default Threshold=5.0.

Vertical camera angle

An indicator that reflects the excess of the shooting angle vertically.

How does it work:

After taking a photo, the system analyzes the vertical angle of the photo and records the result in the dqi_camera_angle_vertical index. If the score is greater the threshold, then the system generates a DQI. Default Threshold=5.0.

Scale

The system uses a scale when defining a key figure. This is the average height of the annotation to the height of the photo, or scale in millimeters per pixel as estimated by the size correction algorithm.

How does it work:

The system takes all the annotations for a particular photo, calculates the average height, and divides it by the height of the photo. The result is written to the scale_coef.

The system generates a DQI if the value of scale_coef is:

  • more than the upper threshold value. Default Threshold=0.25;
  • less than the lower threshold value. Default Threshold=0.05.

Photo without products

A metric for a photo that has no products or all products classified as "unknown SKU".

How does it work:

The system takes all SKUs recognized in the photo (except for "unknown SKU") and records their number in the sku_count indicator. If the score is below or equal to the threshold, the system generates a DQI with the value sku_count.

Default Threshold=0.

Fraud Screen

Created for photos of products that are taken from any device with a screen - phone, computer, or tablet.

How does it work:

A neural network classifier is used to determine the fraud. The system analyzes the information from the photo and compares it with the parameters of the model. If the value obtained from the photo is higher the threshold, the system determines the type of fraud and creates a DQI. By default, Threshold=0.9.

Fraud Paper

Created for photos of products that are made from paper: magazines, catalogs, planograms, and so on.

How does it work:

A neural network classifier is used to determine the fraud. The system analyzes the information from the photo and compares it with the parameters of the model. If the value obtained from the photo is higher the threshold, the system determines the type of fraud and creates a DQI. By default, Threshold=0.9.

Fraud Place

DQI is created if in the photo:

  • there are products, but they are not in the store. For example, a photo of a product in a car or on the street;
  • there are objects, but they are without goods. Like an empty refrigerator.

How does it work:

A neural network classifier is used to determine the fraud. The system analyzes the information from the photo and compares it with the parameters of the model. If the value obtained from the photo is higher the threshold, the system determines the type of fraud and creates a DQI. By default, Threshold=0.9.

Scene

Wrong category

Product metrics for the scene, which reflect the number of faces in the target category to the total number of faces.

How does it work:

The indicator is calculated as the % of faces in the target categories for the scene with the total number of recognized faces. Target categories are set in the visit task settings.

Category not fully shot

An index indicating that the photos contain annotations of the target product category that are not captured in their entirety, which means it can be assumed that there may be a continuation of this display beyond the borders of the photo.

How it works:

After pasting, annotations that are adjacent to the edge of the pasting and are not in the whole frame are counted. By default, the DQI trigger threshold is 1, meaning that any target category annotation that is cropped by the frame will trigger warnings. Target product categories for a task are set when creating and customizing the task.

Visit

Too far from the store during the visit

Appears if the employee was far from the store during the visit.

How does it work:

During the visit, the system determines:

  • store_distance_m - device distance from the store;
  • accuracy_m - accuracy.

If during the visit there was at least one record where the sum of the indicators is greater than the threshold value, then the system creates a DQI. The DQI value specifies the maximum value of the sum of store_distance_m and accuracy_m.

Default Threshold=500, measured in meters.

Long time without photos during the visit

The system keeps track of timestamps for photos, and calculates long periods of inactivity during the visit.

How does it work:

The system takes all photos for non-deleted visits, sorts them by date of creation, and checks the delta indicator - the period between the time the photo was created.

If the value is greater than the threshold value, then the system generates a DQI. The DQI value records the longest period during which no photos were taken.

Default Threshold=60, measured in minutes.

Very short/long visit

The system analyzes the duration of the visit. The system sets a time limit for the visit; short visits are considered suspicious.

How does it work:

The system determines the time from the beginning to the end of the visit according to the application clock and records it in the delta indicator. Then, this indicator is compared with the threshold value. If the value is above or below the threshold, create a DQI and write the delta value into it.

DQI has generated if the indicator value:

  • below the threshold value. Default Threshold=5;
  • above the threshold value. Default Threshold=720.

Measured in minutes.

Short time interval between visits to different stores

The system determines the time limit between consecutive visits or the speed of movement between stores. To do this, the system divides distance between stores on the map by time between visits to them. Too high speed can signal fake GPS.

How does it work:

  1. The system takes the distance between the store with the current visit and the store where the previous visit was made.
  2. The time between the end of the previous visit and the start of the current application according to the clock is determined.
  3. The system calculates the travel speed.

If the movement speed is greater than the threshold, then a DQI is generated. Its value is the speed of movement.

By default, for short visits Threshold= 60, measured in km/h.

The value of the indicator is very different from previous visits to the same store

The system determines how different the indicator is from previous visits to the same store.

How does it work:

The system takes the number of photos in the current visit and divides it by the average number of photos of the last 10 visits (the current session is not taken into account). If the received value is below the threshold, a DQI is generated.

Default Threshold=50, measured in %.

If you have any questions or problems, contact support.

DETECTED FAKE GPS

Fixing fake coordinates on the device.

How does it work:

Any modification of the coordinate system with the value swap during the visit triggers Fake GPS. For example, VALUE swap can be performed by third-party applications (GPS Emulator, Mock Locations, and others).