-
Notifications
You must be signed in to change notification settings - Fork 59
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #679 from pupil-labs/heatmap_cloud_docs
Cloud Heatmap docs
- Loading branch information
Showing
3 changed files
with
36 additions
and
1 deletion.
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,38 @@ | ||
# Heatmap | ||
|
||
Coming soon! | ||
The output of the [Reference Image Mapper](https://docs.pupil-labs.com/neon/pupil-cloud/enrichments/reference-image-mapper/) and [Marker Mapper](https://docs.pupil-labs.com/neon/pupil-cloud/enrichments/marker-mapper/) Enrichments can be visualized as a traditional Heatmap. This shows you which parts of your reference image or surface were gazed at more often by an observer. | ||
|
||
For example, below and to the left is a view of a kitchen that was used as a reference image. On the right, you can see the output of the Heatmap Visualization for a recording that was made while the observer was preparing ingredients. | ||
|
||
![An example of a heatmap from Pupil Cloud. On the left is a photo of a kitchen countertop. On the right is the same photo with a gaze heatmap overlayed.](heatmap_example.png) | ||
|
||
The Heatmap is a Gaussian blurred 2D histogram of gaze data from all selected recordings. No normalization for recording time is performed, so longer recordings will carry more weight and contribute more to the Heatmap. | ||
|
||
The colors in the heatmap range from 0 to 100%, as indicated by the color bar to the right. A value of 0% means a point was never gazed at and 100% means it had the longest gaze duration. | ||
|
||
The output of the Heatmap Visualization is two image files: one image with just the Heatmap and another where it is overlayed on the reference image. | ||
|
||
:::: details Implementation Details | ||
|
||
1. Compute the 2D histogram over the raw gaze data of all recordings. The histogram has the same aspect ratio as the reference image, with the wider side set to 300 bins: | ||
|
||
``` | ||
gaze_histogram2d = hist2d(gaze_x, gaze_y, bins=[nbins_x, nbins_y]) | ||
``` | ||
2. Apply a 2D Gaussian blur to the 2D histogram and normalize the resulting values to the maximum: | ||
``` | ||
gaze_heatmap = GaussianBlur(gaze_hist2d, 0.01 * scale) | ||
gaze_heatmap /= max(gaze_heatmap) | ||
``` | ||
3. Resize the Heatmap using Lanczos smoothing interpolation: | ||
``` | ||
final_heatmap = resize(gaze_heatmap, | ||
(ref_img_width, ref_img_height), | ||
interpolation=LANCZOS) | ||
``` | ||
:::: |