Smart Sensor

3D x AI Technology

3D x AI aeroTAP Smart Sensor

The aeroTAP Smart Sensor is a device that integrates 3D and AI technology through a stereo vision 3D sensor, offering features such as "human posture recognition," "3D head movement tracking," "spatial sensor," "virtual gates," and "virtual cages."


The AI, trained with depth images, recognizes human postures and some body parts. The 3D sensor technology continuously analyzes the space, allowing it to track human movements in 3D space. Unlike 2D cameras, it constantly provides "distance and dimension information".

Differences from RGB AI cameras:

■ Privacy considerations using depth images
It uses depth images that do not identify individuals or specific details like clothing or facial features, making it suitable for use in public facilities, restrooms, and changing rooms

Accurate understanding of spatial relationships in 3D
For example, instead of merely detecting whether something is in view of the camera, it can determine the distance from dangerous areas and assess real risk, reducing unnecessary false positive alarms.


Key Features:

Small, lightweight sensor for easy mobility and setup
Manageable over a network with multiple sensors
Can be integrated with existing systems ( Customization required)


Functions of Smart Sensor

The following features are available using 3D x AI technology:

AI-based human posture detection
Detects unusual or abnormal postures, such as lying down or crouching.

AI-based body part detection
Detects the position of the head and hands. For example, by tracking the head in 3D space, it can detect the moment someone falls. It visualizes human behavior in 3D space.

Virtual gate
Sets up virtual gate within a space to count the number of people passing through. It can also measure the height of individuals.

■ Aerial sensor
Detects objects entering a defined space. For instance, it can monitor someone getting out of bed, falling, or leaving the bed area.

■ Virtual cage
Detects when specific objects or people enter or leave a designated space.

Usage for Smart Retail System

Retail behavior analysis

By analyzing the data collected with the Smart Sensor, customer behavior in front of store shelves can be visualized. It can track customer movements in 3D space, count the number of people entering through virtual gates, and detect which shelves customers reach for. This helps in understanding the duration of stay in specific areas and provides insight into customer behavior, such as how they become interested in products and when they decide to make a purchase. This data can improve store layout, better meet customer needs, and enhance customer satisfaction by optimizing service.

Suspicious or dangerous postures of customers can also be detected.

Shelf access count
Stopped time measurement
Person tracking, movement path, and height (3D tracking)
Unauthorized entry detection in restricted areas
Counting the number of people passing through or entering/leaving a space
Detection of suspicious postures or falls

Contributes to increased sales, improved customer satisfaction, and improved safety.

Usage for Smart Factory System

Workspace behavior analysis

By analyzing data collected with the Smart Sensor, the behavior of workers in the workspace can be visualized. This allows optimization of workspace layout to improve efficiency and safety by analyzing how workers move and what postures they work in. The spatial sensor function can also monitor entry into dangerous areas and ensure safety around work robots.

Obstacle detection: Notifies if objects or people are in the path of equipment or AGVs
Counting the number of people passing through virtual gates.
Detecting and notifying when someone has collapsed in the facility.
Counting the number of people present or passing through a space.
Non-contact operation of devices using spatial sensors.
3D worker behavior tracking.


Contributes to improved safety, productivity, and quality.

Usage for Smart Care System

Nursing care monitoring and caregiver behavior analysis

By analyzing the data collected with the Smart Sensor, both the behavior of caregivers and care receivers can be visualized. Optimizing the care environment layout can improve efficiency and safety by analyzing how caregivers move and in what postures they work.

The spatial sensor function also enables real-time detection of care recipients getting out of bed, entering or leaving rooms, or becoming trapped in the restroom.

Alerts are triggered when someone falls or enters dangerous areas.

Bed exit detection
Wandering detection
Fall detection in corridors or facilities
Posture monitoring in bed (lying down, sitting up, standing, etc.)
Fall detection in restrooms
Call assistance via spatial sensors
Person counting and tracking

Contributes to safe and secure caregiving and helps alleviate staff shortages.


>> Goto SmartCare Service

Other uses


Crowd detection in elevators and waiting areas

Counts the number of people in special spaces like elevators while respecting privacy, making it suitable for public spaces.

Heatmap of movement paths

Generates a heatmap of people’s movement paths within a specific space, with privacy considerations for public use.

•    Suspicious person detection

Detects people exhibiting suspicious behavior in specific spaces. RGB images can also be used for security purposes.

contributes to building a safe and secure social environment.


Anticipated Use Cases



Care facilities
Not only monitors behaviors like bed exits, wandering, and falls but also analyzes the actions of care staff to improve efficiency.
Medical facilities
Monitors patient movements and fall risks in bed.



Personal care
Monitors distant family members through the internet while respecting privacy.

Factories
Analyzes worker behavior, confirms safety, and detects entry into hazardous areas.
Commercial facilities
Analyzes crowd behavior, creates 3D heatmaps, and supports store layout planning based on customer behavior analysis.

Entertainment/Gaming
Uses spatial sensors for interactive digital content development based on person tracking.


Smart Sensor System Configuration Example

Smart Sensor Box          
Dimension : 140mm x 95mm x 90mm
Power: 5V
Network: WiFi or LAN
Weight: 260g
Detection Range: 3m x 3m x 3m
利用用途の応じて、様々なシステム構成が可能です。

TypeA:
3Dカメラから直接管理PCに接続(最大2台)

Type B:
スマートセンサーからLAN/Wifiで接続(複数台)