Sony Semiconductor Solutions and Raspberry Pi have introduced a new AI camera that includes an AI processor. The camera works with all Raspberry Pi computers and uses Sony’s IMX500 vision sensor, which has built-in AI processing. This allows the camera to handle AI tasks without relying on the Raspberry Pi’s main processor. Since April 2023, Sony and Raspberry Pi have been working together on edge AI technology, aiming to provide a platform for developers using Raspberry Pi.
Key features of the AI camera include:
(i) 12.3-megapixel resolution (4056 x 3040 pixels)
(ii) 7.857-mm diagonal sensor with a 1/2.3 aspect ratio
(iii) 1080p video at up to 240 frames per second (fps)
(iv) Full video with AI processing at 30 fps
(v) Built-in AI processing, image signal processing (ISP), and high dynamic range (HDR) video
(vi) AI tensor input from 64 x 48 to 640 x 480 pixels (int8 or uint8 format)
(vii) 8.4 MB memory for firmware, network weight files, and working memory
(viii) The camera’s dimensions are 25 mm x 24 mm x 11.9 mm, with mounting holes compatible with Raspberry Pi Camera Module 3
This camera can capture both video and still images while processing AI data without needing the Raspberry Pi to assist. This makes it possible to create advanced AI vision systems without extra processors. Software support for AI features is available through libraries like libcamera, Picamera2, and the rpicam-apps suite.
Support for Raspberry Pi
As with other Raspberry Pi hardware, this AI camera comes with detailed setup and usage guides. Raspberry Pi has a strong reputation for providing extensive support to users.
AI in the Maker Community
The Raspberry Pi, first launched in 2012, was designed to be an affordable, educational single-board computer (SBC). Since then, over a dozen models have been released, along with a custom-built microcontroller. Raspberry Pi devices run on Linux and other operating systems and use Arm-compatible processors.
The mission of the Raspberry Pi Foundation is to teach computing skills and encourage creativity with digital tools. Raspberry Pi computers are easy to use for beginners while still powerful enough for professionals. By introducing the IMX500 AI Camera, the company is making AI image processing more accessible to a wider audience than other platforms.
Key Features of the AI Camera
The AI camera uses the IMX500 intelligent vision sensor with built-in edge processing. This sensor can capture images and perform AI processing before sending the data to the host computer. It is designed in a stacked structure with on-chip SRAM and a digital signal processing (DSP) engine.
AITRIOS Development Tools
The Pi AI Camera is not limited to hobbyists and makers; it also works with Sony’s AITRIOS AI sensing development platform. AITRIOS is a commercial edge AI platform specifically designed for developing Internet of Things (IoT) vision applications. It efficiently handles large amounts of data while reducing delays in data transmission, processing, and analysis. The platform supports various input devices and provides application-specific services, along with cloud integration.
How to Purchase a Raspberry Pi AI Camera
The camera is currently available from authorized Raspberry Pi resellers and will remain in production until January 2028. Software for the camera can be found on the Raspberry Pi website, the official Raspberry Pi GitHub repository, and several third-party GitHub sites.