Thursday, June 18, 2020

Facebook AI/PanAf collaboration update - Densepose: AI for orienting humans (and chimps) in space

We're happy to announce the results from our first collaboration with facebook AI where they used the PanAf chimpanzee videos to test whether their Densepose algorithm could retrain itself to identify the planes of a new species. Originally Densepose was trained on human videos and can identify an individual's horizontal and vertical planes - so it can identify what is the front and the back, the left side and right side, and  the top and bottom of various body parts, which all move together to document how a person (or chimp) is moving.

In the example below you can see:
Top left panel - a still from the original video with 2 chimps
Top right panel - each of the body parts that can be detected by Densepose, head, hand, forearm, upper arm, torso, etc each coded in a different colour.
Lower left panel - the horizontal plane is coded for each body part. For example, the left side of the head is yellow, the right side is blue.
Lower right pane - the vertical plane is coded: the top of the head is yellow and the bottom is blue.

Put all together, the animal can be oriented in space!

No comments:

Post a Comment