Which 3D reconstruction is better?

A short study on 3D reconstructions of people interacting with objects · around 5 minutes

Each screen shows a photo of a person interacting with an object, and two rotating 3D reconstructions of that interaction, A and B. The person is shown in blue and the object in orange. Both reconstructions are rotated so that the person faces the same way.

Which 3D reconstruction better matches the shown human-object interaction from the image (relative human-object pose, contacts and mesh intersections)?

Contact matters more than penetration: if the image shows the human touching the object, a small intersection between the meshes is a minor flaw compared to an object floating far away.

Example

example photo
Photo, with the person (blue) and object (orange) highlighted
✓ Better Correct contact and pose; the chair slightly intersects the body.
✗ Worse No intersection, but the person floats above the chair.

How it works

  • 60 comparisons, around 5 minutes, plus two easy checks to make sure the task is clear.
  • It is normal to see the same photo more than once: each photo is shown with different pairs of reconstructions.
  • Click A is better, B is better, or Same if they are equally good (or equally bad); you then move on automatically. You can go back and change an answer.
  • Use the Rotation speed slider under the reconstructions to rotate them slower or faster, and Pause to stop them.
  • Swipe left / right to go to the next / previous comparison.
  • Keyboard: ← / → previous / next, Space pause the videos.

Your data

We store only your answers, how long each one took, whether you used a phone, and a random identifier in your browser so that you are not shown the same photos again if you participate more than once. Don't forget to press Submit at the end to record your answers.