Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[P3] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. #98

Open
CESARDELATORRE opened this issue Feb 10, 2024 · 5 comments
Assignees
Labels
bug Something isn't working control-plane-app P3 (Long-term and much less priority) Features and improvements to have in the backlog, still to be triaged and prioritied.

Comments

@CESARDELATORRE
Copy link
Contributor

CESARDELATORRE commented Feb 10, 2024

[UPDATED] Read the latest message. IT's working but it need 5 minutes to delete the FramrSplitter POD. We should do it in a few secs, right?

Repro:

I removed the camera that was working, it's empty now:

image

However, MEC-Accelerator was still getting new ALERTS, like if it didn't delete the provisioning for that camera (FRame-splitter, etc. should be deleted for that camera, right?).

It was still processing. I there are no cameras provisioned in control-plane there should not be ALERTS coming through?...

image

However, I think this is NOT a bug... I think there were many ALERTS queued in MQTT since it was creating many, all the time...

After a few minutes, the ALERTS stopped being created... So, I think the behavior is correct.
Please, confirm this is the case. :)

@CESARDELATORRE CESARDELATORRE added bug Something isn't working P1 (High priority) High priority means fixes/featureswe should be working in DEV branch asap.Also, docs if high prio. control-plane-app P0 (Urgent) Bug fixes or actions to fix asap in MAIN and DEV branches.. P2 (Less priority) Features or improvements with lower priority to do in upcoming weeks. and removed P1 (High priority) High priority means fixes/featureswe should be working in DEV branch asap.Also, docs if high prio. P0 (Urgent) Bug fixes or actions to fix asap in MAIN and DEV branches.. labels Feb 10, 2024
@CESARDELATORRE CESARDELATORRE changed the title Control-Plane app not removing camera-process in MEC-Accelerator after removing a camera from control plane [NOT a bug?] Control-Plane app not removing camera-process in MEC-Accelerator after removing a camera from control plane Feb 10, 2024
@CESARDELATORRE
Copy link
Contributor Author

I still think that it takes too long to delete the pods processing the camera... I deleted the camera 5 minutes ago and it's still getting ALERTS... so I think it needs too much time to delete the related pods? - Please, confirm...

@CESARDELATORRE
Copy link
Contributor Author

CESARDELATORRE commented Feb 11, 2024

I confirm it's a problem related to the time needed to delete the FrameSplitter POD. Consistently is always taking around 5 minutes.

Once I delete the camera in the "Control Plan App", I see that the FrameSplitter related pod is still alive in K8s:

image

But after approximately 5 minutes, the ALERTS stop appearing and the POD is now deleted:

image

So, can we delete the PODs in just a few seconds instead of 5 minutes?

@CESARDELATORRE CESARDELATORRE changed the title [NOT a bug?] Control-Plane app not removing camera-process in MEC-Accelerator after removing a camera from control plane Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. Feb 11, 2024
@CESARDELATORRE CESARDELATORRE changed the title Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. [P2] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. Feb 11, 2024
@CESARDELATORRE CESARDELATORRE added P1 (High priority) High priority means fixes/featureswe should be working in DEV branch asap.Also, docs if high prio. and removed P2 (Less priority) Features or improvements with lower priority to do in upcoming weeks. labels Feb 11, 2024
@CESARDELATORRE CESARDELATORRE changed the title [P2] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. [P1] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. Feb 11, 2024
@CESARDELATORRE
Copy link
Contributor Author

Answer with the AKRI issue description and we'll contact the AKRI team asking for workaround.

@CESARDELATORRE
Copy link
Contributor Author

Let's keep it as P1 until we get an answer from the AKRI team, ok?

@CESARDELATORRE CESARDELATORRE self-assigned this Feb 17, 2024
@CESARDELATORRE CESARDELATORRE changed the title [P1] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. [P3] Control-Plane app needing 5 minutes to remove FrameSplitter POD after camera is removed from control plane app. Feb 22, 2024
@CESARDELATORRE
Copy link
Contributor Author

AKRI team said it's a hardcoded value.
Config might come in future versions of AKRI...
Moving to P3 to check it out in the future.

@CESARDELATORRE CESARDELATORRE added P3 (Long-term and much less priority) Features and improvements to have in the backlog, still to be triaged and prioritied. and removed P1 (High priority) High priority means fixes/featureswe should be working in DEV branch asap.Also, docs if high prio. labels Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working control-plane-app P3 (Long-term and much less priority) Features and improvements to have in the backlog, still to be triaged and prioritied.
Projects
None yet
Development

No branches or pull requests

2 participants