Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Hand Poses Stability #71

Open
andrearosasco opened this issue Apr 17, 2023 · 1 comment
Open

Improve Hand Poses Stability #71

andrearosasco opened this issue Apr 17, 2023 · 1 comment
Assignees

Comments

@andrearosasco
Copy link
Member

I'm kind of playing ahead with this one since, until we actually start closing the loop, I don't know if the noise of the hand poses is too much.

Anyway, the hands were jiggering a lot because of the variability of:

  • partial point cloud
  • subsampling
  • denoising
  • plane fitting

I tested different solutions and the best one I've found is to tackle the problem upstream.
The solution consists of fitting planes on the input point cloud.

  1. We fit two planes to the current partial point cloud (if we can't, just a face is visible hence we skip the reconstruction)
  2. We measure the fitness score of the previous iteration planes on the current point cloud
  3. If current_plane_score - previous_plane_score is within a certain threshold we keep using the previous output; otherwise, we recompute everything.
@andrearosasco andrearosasco self-assigned this Apr 17, 2023
@andrearosasco
Copy link
Member Author

With the right threshold, we keep the old hand poses if the box doesn't move too much

Image

And still, be able to track the box when the point of view changes

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant