Kitchens
Indian, European and Brazilian home kitchens, lived-in and cluttered, plus small commercial kitchens and pantries.
Cooking preparationWashing upCupboards and drawersAppliancesPouring and scooping
Tactile gloves and sensorised grippers log contact and pressure per fingertip alongside video, so a model can learn the difference between holding an egg and holding a mug from the signal, not the pixels.
Vision tells a policy that a hand touched a cup; it does not say how firmly, or when the grip slipped. The tactile line adds a pressure map per fingertip and palm — or per gripper jaw — synchronised to the video, with contact onset, hold and release marked per event.
Tasks are chosen for contact richness: fragile and deformable objects, lids and fasteners, stacking with feedback, and hand-overs. Every episode ships with the raw pressure stream and the derived contact events, so you can re-threshold it yourself.
Tasks are recorded where they actually happen — not in a studio dressed to look like a kitchen. Hover a room to see the kind of setting the protocol calls for.
Indian, European and Brazilian home kitchens, lived-in and cluttered, plus small commercial kitchens and pantries.
Real Western homes in Spain, Germany, France and Italy, and apartments in India, Brazil, Japan and Korea. Sofas, wardrobes, shelves, laundry.
Open-plan and small offices: desks, pantries, meeting rooms, filing and cable clutter.
Kirana stores, groceries, pharmacies and supermarket aisles, with real stock and real customers out of focus.
Racking aisles, packing benches, courier depots and small production lines with pallets, trolleys and parts bins.
Mechanical and electronics workshops, repair benches and robotics labs where a follower rig can be set up.
Polytunnels, packing sheds, market stalls and yards, in daylight that changes from one episode to the next.
Your site, or a space recreated to your drawings, run by an NDA'd crew with limited-visibility workflows and no clip leaving your region.
Labelled on the same bench as our speech work, to a written guide, behind the same calibration test.
The task family, the environments, the rig, the sensors, the episode count. One page, agreed before anything is bought or anyone is recruited.
A written capture protocol — framing, lighting, where a task starts and ends, what counts as a failed take — and the kit list. Operators are trained and tested on it before a single episode is paid for.
A small batch, ten to thirty episodes, delivered with QC status and a quality report. This is where the protocol breaks — on purpose, and cheaply.
You review the pilot, we fix the protocol, then the run scales on a weekly delivery cadence with the same report attached to every batch.
The task stays in frame; hands and workspace inside the protocol's bounds for the whole episode.
No blown highlights or focus hunting beyond the tolerance set for the room.
No camera whip, no dropped frames; IMU continuous where the rig has one.
Every stream aligned within one frame; timestamps monotonic across cameras, state and action logs.
Start and end states match the SOP; no skipped or reordered steps unless the protocol allows it.
Inside the episode window for the task family; overruns are trimmed to the protocol, not the clip.
Environment, task, rig, operator id, session and consent reference present and valid on every episode.
No bystander faces, screens or documents without consent; blurred where the protocol flags it.
Intrinsics and extrinsics on file per rig and session for depth, stereo and multi-camera capture.
Where annotation is ordered, agreement against the gold set above the threshold before the batch ships.
Tactile streams are delivered with the per-pad calibration they were recorded under, so a sample is cut to your glove or gripper spec.
First-person RGB video of real people doing real tasks.
RGB-D, stereo and LiDAR capture for 3D scene understanding.
Human-guided robot demonstrations, one episode at a time.
In-the-wild wrist-gripper demos for grasp generalisation.
Absolute 3D hand pose ground truth, occlusions included.
Your hardware and protocol, our crews, rooms and QA.
Segmentation, captions, masks and success labels on Foundry.
Watch and download sample episodes, and see what every line is recorded with.