Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to obtain multiple hotspots? #6

Closed
ubless607 opened this issue Mar 21, 2024 · 66 comments
Closed

How to obtain multiple hotspots? #6

ubless607 opened this issue Mar 21, 2024 · 66 comments

Comments

@ubless607
Copy link

@shikharbahl
I tried to reproduce the image on the project page, but I could only get one.
Is there any option that I have to turn it on?

Expected:
Snipaste_2024-03-21_22-27-46

Output:
kitchen_out
@ubless607
Copy link
Author

@yolo01826 Can you write your e-mail address?

@ubless607
Copy link
Author

@yolo01826 sent!

@jun7-shi
Copy link

jun7-shi commented May 23, 2024 •
edited
Loading

@ubless607 hi, could you please send me the pretrained weights as well? [email protected] , thanks!

@ubless607
Copy link
Author

@jun7-shi Sent!

@jun7-shi
Copy link

@ubless607 thanks so much.
Using the pretrained weights you provided, i could reproduce the results of multiple hotspots.

@ZY199301
Copy link

hi, could you please send me the pretrained weights as well? [email protected], thank you very much!

@ubless607
Copy link
Author

@ZY199301 sent!

@JaneLin-0409
Copy link

@ubless607 hi, could you please send me the pretrained weights as well? [email protected] , thanks!

@wadeKeith
Copy link

@ubless607 Could you please send me the pretrained weights as well? [email protected], thank you very much!

@ubless607
Copy link
Author

@JaneLin-0409 sent!

@ubless607
Copy link
Author

@wadeKeith sent!

@fuyh20
Copy link

fuyh20 commented Jun 25, 2024

@ubless607 I also need the pretrained weights. Could you send me it? [email protected], thanks!

@Byo0923
Copy link

Byo0923 commented Jun 26, 2024

@ubless607
I also need the pretrained weights too.
Could you please send me the pretrained weights as well? , [email protected] , thanks!

@ubless607
Copy link
Author

@fuyh20 Sent!

@ubless607
Copy link
Author

@Byo0923 Sent!

@Byo0923
Copy link

Byo0923 commented Jun 27, 2024

@ubless607
I was able to download the checkpoints. Thank you very, very much. I will try it.

@Kimagure7
Copy link

Kimagure7 commented Jun 28, 2024 •
edited
Loading

I also need the pretrained weights too. Could you please send me the pretrained weights as well? [email protected] , thanks! @ubless607

@ubless607
Copy link
Author

@Kimagure7 Sent!

@fuyh20
Copy link

fuyh20 commented Jul 2, 2024 •
edited
Loading

@ubless607 Thanks for the model weights. And I have already used it. You can set the manual seed in order to get different outputs, and the output is random.

@YujpVc
Copy link

YujpVc commented Jul 3, 2024

I also need the pretrained weights, could you send me well? [email protected], thanks

@nys601350111
Copy link

@ubless607 I also need the pretrained weights, could you send me well? [email protected]](mailto:[email protected]) thanks!

@ubless607
Copy link
Author

@YujpVc sent!

@ubless607
Copy link
Author

@nys601350111 sent!

@YujpVc
Copy link

YujpVc commented Jul 8, 2024 via email

@Hotsburp
Copy link

Hi @ubless607 or anyone in the above thread, could you send the weights to me? Thank you very much in advance! :) My email is: [email protected]

@Kimagure7
Copy link

Hi @ubless607 or anyone in the above thread, could you send the weights to me? Thank you very much in advance! :) My email is: [email protected]

sent!

@Hotsburp
Copy link

Did anyone face any issue pip installing the lang-segment-anything portion from the "pip install -U git+https://github.com/luca-medeiros/lang-segment-anything.git" command?

Mine seems to be stuck at this portion for really really long.

Collecting lightning<3.0.0,>=2.0.1
Using cached lightning-2.0.2-py3-none-any.whl (1.8 MB)
Using cached lightning-2.0.1.post0-py3-none-any.whl (1.8 MB)
Using cached lightning-2.0.1-py3-none-any.whl (1.8 MB)

Not sure if i am doing anything wrong or it just takes super long to install. Thanks in advance again!

I will open a new issue but just wanted to ask here since some of you may be active.

@ubless607
Copy link
Author

@Hotsburp I don't have any problem.
Did you try on new conda envrionment? / Did you update pip to the lastest version?

@Hotsburp
Copy link

Hi @ubless607, thanks for getting back! Yup i tried on new conda environment and also updating pip.

I think the issue is with the GroundingDino that LangSegmentAnything uses because there are a lot of issues with the version conflict of packages recently due to GroundingDino updates.

May i know which commit version (date or hash) of the LangSegmentAnything did you use or did you just use the latest version at that point of time? This is because this affects the version of GroundingDino used and i would also like to track back the date of the version that VRB used.

While i managed to now install somewhat properly, i had to manually find an older version of both LangSegmentAnything and GroundingDino.

But by doing so, i had this error when running demo.py using the weights:
=> _IncompatibleKeys(missing_keys=[], unexpected_keys=['label_enc.weight'])

This results in:
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory

I would appreciate if you all have any insights! :)

@ubless607
Copy link
Author

@Hotsburp It has been a while I tested this repository. Can you check this issue?
luca-medeiros/lang-segment-anything#66

@Hotsburp
Copy link

Hotsburp commented Aug 1, 2024 •
edited
Loading

@ubless607 During running demo.py on this image. Do you face the error "ValueError: tile cannot extend outside image"? I think i may be something to do with image crop as the error comes from the input_img in Line 84 of inference.py.

If i input img instead of input_img in Line 84, i get this:

kitchen_out4

I guess there is still multiple hotspots but the script is sensitive to the cropped image and its dimensions.

@bethalageetachandraraju
Copy link

can anyone from the above thread send me pretrained weights please, my email: [email protected]
@ubless607 @Byo0923 @wadeKeith @JaneLin-0409 @64327069 @Kimagure7

@ojh6404
Copy link

ojh6404 commented Aug 5, 2024

can anyone from the above thread send me pretrained weights please, my email: [email protected] @ubless607 @Byo0923 @wadeKeith @JaneLin-0409 @64327069 @Kimagure7

Could anyone send me pretrained weights, too? my email : [email protected]

@achrxme-1838
Copy link

could anyone from the above thread send me pretrained weights too please, my email: [email protected]
I'll be very appreciate it!!
@ubless607 @Byo0923 @wadeKeith @JaneLin-0409 @64327069 @Kimagure7

@ubless607
Copy link
Author

@achrxme-1838 @ojh6404 @bethalageetachandraraju Sent!

@achrxme-1838
Copy link

achrxme-1838 commented Aug 19, 2024 via email

@ubless607
Copy link
Author

@ubless607 During running demo.py on this image. Do you face the error "ValueError: tile cannot extend outside image"? I think i may be something to do with image crop as the error comes from the input_img in Line 84 of inference.py.

If i input img instead of input_img in Line 84, i get this:

kitchen_out4

I guess there is still multiple hotspots but the script is sensitive to the cropped image and its dimensions.

I didn't encounter that error message. Have you done any additional work on this?

@Tom-Huang
Copy link

could anyone from the above thread send me pretrained weights too please, my email: [email protected]

@ubless607
Copy link
Author

@Tom-Huang Sent!

@Hotsburp
Copy link

Hey @ubless607, yeap i tried out a few more use cases but it is sensitive to the image size and dimensions. As mentioned, I got good results only for certain tasks and angles but there are also a lot of wrong trajectories too haha.

Would be good that they release more tasks and also how this can be used for 3d pose/state beyond 2d image coordinates.

What about yourself, did you explore more too?

@codepk37
Copy link

codepk37 commented Aug 24, 2024 •
edited
Loading

@ubless607 @Byo0923 @wadeKeith @JaneLin-0409 @64327069 @Kimagure7 Could anyone please send me the pretrained weights aswell? (mailto: [email protected])

@ubless607
Copy link
Author

@Hotsburp I didn't try on this much further :(

@ubless607
Copy link
Author

@codepk37 Sent!

@ashiqfauna
Copy link

ashiqfauna commented Sep 5, 2024 •
edited
Loading

@ubless607 Could you please send me the pretrained weights as well? (mailto: ashiq).

Thanks :)

@ubless607
Copy link
Author

@ashiqfauna Sent!

@dtbpkmte
Copy link

@ubless607 Can I have the weights please? My email address is [email protected]. Thank you!

@ubless607
Copy link
Author

@dtbpkmte Sent!

@prac-101
Copy link

@ubless607 @Byo0923 @wadeKeith @JaneLin-0409 @64327069 @Kimagure7 I also need the pretrained weights, could anyone please send me the pretrained weights too please? My email address is [email protected], thanks a lot!

@tindarin
Copy link

tindarin commented Oct 8, 2024

@ubless607 @Byo0923 @Tom-Huang @wadeKeith @dtbpkmte @prac-101 @dtbpkmte I also need the pretrained weights, could anyone send me? My email address is [email protected] or [email protected] , thanks!

@SuQinghang
Copy link

@ubless607 Could you please send me the pre-trained weights as well? My email address is [email protected]. Thanks!

@ubless607
Copy link
Author

@ZTE-dzq @SuQinghang @tindarin @prac-101 Sent!

@shubhgoel20
Copy link

@ubless607 Hi could you please send me the pretrained weights as the link provided in the readme is not working. Email: [email protected]
Thanks in advance

@mschoene
Copy link

mschoene commented Nov 7, 2024 •
edited
Loading

@ZTE-dzq @SuQinghang @tindarin @prac-101 @ubless607 Could you send me the pretrained weights as well? Thanks a lot in advance!
[email protected]

@SuQinghang
Copy link

@ZTE-dzq @SuQinghang @tindarin @prac-101 @ubless607 Could you send me the pretrained weights as well? Thanks a lot in advance! [email protected]

@mschoene Sent!

@hwh23
Copy link

hwh23 commented Nov 15, 2024 •
edited
Loading

@ubless607 @SuQinghang @mschoene @ZTE-dzq Hi! Could you please send me the pretrained weights as well, my email:
[email protected]
Thanks a lot in advance!

@earth15354
Copy link

@ubless607 @SuQinghang @mschoene @ZTE-dzq @hwh23 Hi! If you have the model weights, can you please send me the model weights as well? Thank you very much in advance!

My email is [email protected]

@taeyeopl
Copy link

taeyeopl commented Dec 5, 2024

@ubless607 @mschoene @achrxme-1838 Could I also have a chance to get the pre-trained weights?

Thanks in advance.

[email protected]

@Arunkumar137
Copy link

Arunkumar137 commented Dec 6, 2024 •
edited
Loading

@ubless607 @mschoene @tindarin @ZTE-dzq @SuQinghang @tindarin @prac-101 Could you send me the pretrained weights as well? Thanks ([email protected])

@zlm200
Copy link

zlm200 commented Jan 7, 2025

@ubless607 @mschoene @Byo0923 @SuQinghang @Tom-Huang Could you send me the pretrained weights as well? Thanks （[email protected]）

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests