Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Register gaze at rear mirror #161

Open
StijnOosterlinck opened this issue Apr 5, 2024 · 6 comments
Open

Register gaze at rear mirror #161

StijnOosterlinck opened this issue Apr 5, 2024 · 6 comments
Labels
question Further information is requested

Comments

@StijnOosterlinck
Copy link

Hi,

In egosensor.cpp, the egovehicle is added as an ignoredactor for computing the gaze trace, which is useful. However, if I want to register the moments at which someone looks at the rear mirror, how could i do this? Essentially, I would want to add the vehicle as an ignored actor, except for the rear mirror, is this possible in some way?

Thx!

@ajdroid
Copy link
Contributor

ajdroid commented Apr 5, 2024

Do you need this in real time or is it okay for it to be in post-processing?

@ajdroid
Copy link
Contributor

ajdroid commented Apr 5, 2024

Off the top of my head, I think the easiest way to do this would be to replace the AddIgnoredActor with an AddIgnoredComponent and loop through all the components of the ego vehicle except the mirrors. You should be able to do Vehicle->GetComponents and then loop through them. Maybe log them to get an understanding of what all is in there

@StijnOosterlinck
Copy link
Author

I don't need it in real-time, i'm only looking at the gaze intersections in post-processing. Does this change anything?

Else, I'll indeed look into adding ignored components instead of actors.

@ajdroid
Copy link
Contributor

ajdroid commented Apr 5, 2024

This may be more complicated but, in post-processing you can figure out what the region of 3D space is that corresponds to the mirror. This is constant in the ego vehicle's reference frame. Then, at each recorded timestep you can figure out if the gaze ray passed through that 3D space. Does that make sense?

@ajdroid ajdroid added the question Further information is requested label Apr 5, 2024
@StijnOosterlinck
Copy link
Author

Hi,

I tried the method of adding ignoredcomponents instead of the vehicle itselt. If i do this, then it seems like every gaze at the rear mirror is labeled as 'None'. I assume this happens because the rear mirror is part of the vehicle mesh, and the vehicle mesh is an ignored component.

I tried removing the vehicle mesh from the ignored components list, but then the gaze constantly intersects with that, so this is also not useful. How could i modify it such that the vehicle mesh is ignored, but the rear mirror not?

@StijnOosterlinck
Copy link
Author

This may be more complicated but, in post-processing you can figure out what the region of 3D space is that corresponds to the mirror. This is constant in the ego vehicle's reference frame. Then, at each recorded timestep you can figure out if the gaze ray passed through that 3D space. Does that make sense?

If what I previously mentioned is not possible, could you elaborate on where and how I need to look to implement this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants