From 4596a0b8718c0942ad8b29c8b3ac7f1864ed1820 Mon Sep 17 00:00:00 2001 From: Nathakit Sae-Tan Date: Wed, 21 Feb 2024 00:19:38 +0700 Subject: [PATCH] Fix apriltag download link --- core/software/pupil-capture/index.md | 168 ++++++++++-------- .../enrichments/marker-mapper/index.md | 72 ++++---- 2 files changed, 134 insertions(+), 106 deletions(-) diff --git a/core/software/pupil-capture/index.md b/core/software/pupil-capture/index.md index 6a4f2cc0c..005981f04 100644 --- a/core/software/pupil-capture/index.md +++ b/core/software/pupil-capture/index.md @@ -1,9 +1,11 @@ # Pupil Capture + Pupil Capture is the software used with your Pupil Core Headset. The software reads the video streams coming in from the world camera and the eye camera(s). Pupil Capture uses the video streams to detect your pupil, track your gaze, detect and track markers in your environment, record video and events, and stream data in realtime. ![Pupil Capture](./pc.png) ## World Window + The World window is the main control center for Pupil Capture. It displays a live world camera video feed from your Pupil Core headset. ![Pupil Captuere callout](./capture-callout.jpg) @@ -25,6 +27,7 @@ The World window is the main control center for Pupil Capture. It displays a liv | `i` | Camera intrinsic estimation: Take snapshot of circle pattern | ## Video Source Selection + By default Pupil Capture will use Local USB as the capture source. If you have a Pupil Core headset connected to your computer you will see videos displayed from your Pupil Core headset in the World and Eye windows. If no headset is connected or Pupil Capture is unable to open capture devices it will simply display a gray screen. @@ -35,7 +38,6 @@ If no headset is connected or Pupil Capture is unable to open capture devices it --> - ## Troubleshooting ### Windows @@ -54,8 +56,10 @@ Still having trouble? [Chat with us.](https://pupil-labs.com/chat "Pupil Labs ch ### Linux If the cameras are listed as `unknown` and you are not able to access cameras in Pupil Capture. Please try the following: + 1. Shut down Pupil Capture if it is still running. 2. Add your user to the `plugdev` group by executing the following command in the terminal: + ```sh sudo usermod -a -G plugdev $USER ``` @@ -65,11 +69,14 @@ sudo usermod -a -G plugdev $USER Due to new [technical limitations](https://github.com/libusb/libusb/issues/1014), Pupil Capture and Pupil Service need to be started with administrator privileges to get access to the video camera feeds. To do that, copy the applications into your /Applications folder and run the corresponding command from the terminal: Pupil Capture: -``` zsh + +```zsh sudo /Applications/Pupil\ Capture.app/Contents/MacOS/pupil_capture ``` + Pupil Service: -``` zsh + +```zsh sudo /Applications/Pupil\ Service.app/Contents/MacOS/pupil_service ``` @@ -78,6 +85,7 @@ sudo /Applications/Pupil\ Service.app/Contents/MacOS/pupil_service **Note**: When recording with administrator privileges, the resulting folder inherits admin file permissions. Pupil Player will detect these and ask you for the administrator password to reset the file permissions. This will be only necessary once per recording. ## Pupil Detection + Pupil Core's algorithms automatically detect the participant's pupil. It runs two detection pipelines in parallel, the 2D and the 3D pupil detection. 2D detection uses computer vision technology to detect the pupil location in the camera image. @@ -89,14 +97,15 @@ Pupil Core's algorithms automatically detect the participant's pupil. It runs tw ### Fine-tuning Pupil Detection + As a first step it is recommended to check the eye camera resolution as some parameters are resolution dependent. #### Pupil Detector 2D Settings Some settings of the 2D pupil detector can be adjusted to improve pupil detection. For a better visualization of these settings, go to the `General Settings` menu of the eye windows and enable the `Algorithm Mode` view. The detector settings can be adjusted in the `Pupil Detector 2D` plugin. -* `Pupil Min/Max` : In `Algorithm Mode` the two red circles represent the min and max pupil size settings. The green circle visualizes the current apparent pupil size. Set the min and max values so the green circle (current pupil size) is within the min/max range for _all_ eye movements. -* `Intensity Range` : Defines the minimum "darkness" of a pixel to be considered as the pupil. The pixels considered for pupil detection are visualized in blue when in `Algorithm Mode`. Try to minimize the range so that the pupil is always fully covered while having as little leakage as possible outside of the pupil. Be aware that this is dependent on the brightness and therefore has a strong interaction with `Video Source/Sensor Settings/Absolute Exposure Time`. +- `Pupil Min/Max` : In `Algorithm Mode` the two red circles represent the min and max pupil size settings. The green circle visualizes the current apparent pupil size. Set the min and max values so the green circle (current pupil size) is within the min/max range for _all_ eye movements. +- `Intensity Range` : Defines the minimum "darkness" of a pixel to be considered as the pupil. The pixels considered for pupil detection are visualized in blue when in `Algorithm Mode`. Try to minimize the range so that the pupil is always fully covered while having as little leakage as possible outside of the pupil. Be aware that this is dependent on the brightness and therefore has a strong interaction with `Video Source/Sensor Settings/Absolute Exposure Time`. ::: tip Keep in mind that pupil size values are defined in pixels and are therefore dependent on the resolution settings of your sensor. @@ -127,7 +136,6 @@ Pupil Core headsets come in a variety of configurations. Calibration can be cond Before starting a calibration, ensure that the participant's pupil is robustly detected and tracked, and that the headset is comfortable for the participant. Make sure that the world camera is in focus for the distance at which you want to calibrate, and that you can see the entire area you want to calibrate within the world camera's field of view (FOV). -
@@ -149,6 +157,7 @@ Before starting a calibration, ensure that the participant's pupil is robustly d All calibrations require a participant to look at a specific point in the real world or on screen. The way in which markers are presented is called a `Choreography`. Pupil Core provides different choreographies for common use cases. #### Screen Marker Calibration Choreography + This is the default choreography, and a quick way to get started.