mlx-community/deepseek-vl2-8bit config excessive, pad_token / image_token missing? Verbose param affects results??

[jrp2014]

The description that is produced below is not as accurate as other models which spot the fact that two people are walking. For reference, here is the pic:

mlx version: 0.22.0.dev20250117+0c259961a
mlx-vlm version: 0.1.10
The most recently modified file is: /Users/x/Pictures/Processed/20250111-154612_DSC01918.jpg
Image dimensions: 8383x5589 (46.9 MPixels)

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/deepseek-vl2-8bit
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 32728.66it/s]
Some kwargs in processor config are unused and will not have any effect: normalize, pad_token, candidate_resolutions, patch_size, downsample_ratio, image_mean, image_std, sft_format, ignore_id, add_special_token, image_token, mask_prompt. 
Add pad token = ['<｜▁pad▁｜>'] to the tokenizer
<｜▁pad▁｜>:2
Add image token = ['<image>'] to the tokenizer
<image>:128815
Added grounding-related tokens
Added chat tokens
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 36717.81it/s]
A serene scene of a person and a dog taking a walk on a beach at sunset. The person is walking the dog on a leash, with the sun setting in the background, casting a warm, golden light over the scene. In the background, there is a large container ship on the water, and the reflection of the setting sun is visible on the water's surface.
Output generated in 7.66s
Memory used: 27.36 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

If I set verbose to True, I seem to get results that are a bit different. Here is a full run:

python check_models.py -v
mlx version: 0.22.0.dev20250117+0c259961a
mlx-vlm version: 0.1.10
The most recently modified file is: /Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg
Image dimensions: 8383x5589 (46.9 MPixels)
vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running HuggingFaceTB/SmolVLM-Instruct
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 45100.04it/s]
Some kwargs in processor config are unused and will not have any effect: image_seq_len. 
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 17409.77it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|im_start|>User:<image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<end_of_utterance>
Assistant:
 A man and a woman are walking on a beach with a dog. The man is wearing a black jacket and the woman is wearing a yellow jacket. The dog is wearing a harness. There is a large ship in the background.
==========
Prompt: 1217 tokens, 1055.973 tokens-per-sec
Generation: 47 tokens, 120.526 tokens-per-sec
Peak memory: 6.209 GB
 A man and a woman are walking on a beach with a dog. The man is wearing a black jacket and the woman is wearing a yellow jacket. The dog is wearing a harness. There is a large ship in the background.
Output generated in 2.10s
Memory used: 5.24 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running meta-llama/Llama-3.2-11B-Vision-Instruct
Fetching 15 files: 100%|████████████████████████████████████████████████████████████| 15/15 [00:00<00:00, 27618.33it/s]
Fetching 15 files: 100%|████████████████████████████████████████████████████████████| 15/15 [00:00<00:00, 37338.02it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|begin_of_text|><|start_header_id|>user<|end_header_id|>

Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<|image|><|eot_id|><|start_header_id|>assistant<|end_header_id|>


The image depicts a serene scene of two individuals strolling along a beach with their dog, set against the backdrop of a large cargo ship in the distance.

* Two people walking on a beach with a dog on a leash:
	+ The two individuals are dressed in warm clothing, suggesting a chilly weather condition.
	+ The dog appears to be a small breed, possibly a terrier or a poodle, and is walking on a leash held by one of the individuals.
* A large cargo ship in the background:
	+ The ship is a large vessel, likely a container ship, with numerous containers stacked on its deck.
	+ It is positioned in the distance, creating a sense of depth and perspective in the image.
* The sky is orange and hazy:
	+ The sky is a warm, orange hue, indicating a sunset or sunrise.
	+ The haze in the sky adds a sense of atmosphere and mood to the image, creating a peaceful and serene ambiance.

Overall, the image captures a tranquil moment of people enjoying a walk on the beach with their dog, set against the backdrop of a large cargo ship in the distance, all set against a warm and hazy sky.
==========
Prompt: 36 tokens, 10.482 tokens-per-sec
Generation: 241 tokens, 3.711 tokens-per-sec
Peak memory: 31.729 GB
The image depicts a serene scene of two individuals strolling along a beach with their dog, set against the backdrop of a large cargo ship in the distance.

* Two people walking on a beach with a dog on a leash:
	+ The two individuals are dressed in warm clothing, suggesting a chilly weather condition.
	+ The dog appears to be a small breed, possibly a terrier or a poodle, and is walking on a leash held by one of the individuals.
* A large cargo ship in the background:
	+ The ship is a large vessel, likely a container ship, with numerous containers stacked on its deck.
	+ It is positioned in the distance, creating a sense of depth and perspective in the image.
* The sky is orange and hazy:
	+ The sky is a warm, orange hue, indicating a sunset or sunrise.
	+ The haze in the sky adds a sense of atmosphere and mood to the image, creating a peaceful and serene ambiance.

Overall, the image captures a tranquil moment of people enjoying a walk on the beach with their dog, set against the backdrop of a large cargo ship in the distance, all set against a warm and hazy sky.
Output generated in 68.79s
Memory used: 17.58 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running microsoft/Florence-2-large-ft
Fetching 9 files: 100%|███████████████████████████████████████████████████████████████| 9/9 [00:00<00:00, 19650.57it/s]
ERROR:root:No safetensors found in /Users/jrp/.cache/huggingface/hub/models--microsoft--Florence-2-large-ft/snapshots/bb44b80c15e943b1bf7cec6e076359cec6e40178
Failed to load model or config at microsoft/Florence-2-large-ft: 
No safetensors found in /Users/jrp/.cache/huggingface/hub/models--microsoft--Florence-2-large-ft/snapshots/bb44b80c15e943b1bf7cec6e076359cec6e40178
Create safetensors using the following code:

from transformers import AutoModelForCausalLM, AutoProcessor

model_id= "<huggingface_model_id>"
model = AutoModelForCausalLM.from_pretrained(model_id)
processor = AutoProcessor.from_pretrained(model_id)

model.save_pretrained("<local_dir>")
processor.save_pretrained("<local_dir>")

Then use the <local_dir> as the --hf-path in the convert script.

python -m mlx_vlm.convert --hf-path <local_dir> --mlx-path <mlx_dir>

        
================================================================================

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running microsoft/Phi-3.5-vision-instruct
Fetching 14 files: 100%|████████████████████████████████████████████████████████████| 14/14 [00:00<00:00, 23366.60it/s]
/opt/homebrew/Caskroom/miniconda/base/envs/mlx/lib/python3.12/site-packages/transformers/models/auto/image_processing_auto.py:590: FutureWarning: The image_processor_class argument is deprecated and will be removed in v4.42. Please use `slow_image_processor_class`, or `fast_image_processor_class` instead
  warnings.warn(
Fetching 14 files: 100%|████████████████████████████████████████████████████████████| 14/14 [00:00<00:00, 25453.08it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|user|>
<|image_1|>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<|end|>
<|assistant|>

Two people and a dog are walking along the shore, with a large cargo ship in the background. The sky is painted with warm hues of orange and yellow, indicating either sunrise or sunset. The calm water reflects the colors of the sky, creating a serene atmosphere. Keywords: walking, shore, cargo ship, orange sky, sunrise, sunset, calm water, reflection, dog, people.<|end|>
==========
Prompt: 795 tokens, 914.080 tokens-per-sec
Generation: 90 tokens, 10.043 tokens-per-sec
Peak memory: 19.108 GB
Two people and a dog are walking along the shore, with a large cargo ship in the background. The sky is painted with warm hues of orange and yellow, indicating either sunrise or sunset. The calm water reflects the colors of the sky, creating a serene atmosphere. Keywords: walking, shore, cargo ship, orange sky, sunrise, sunset, calm water, reflection, dog, people.<|end|>
Output generated in 10.17s
Memory used: 7.47 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/Florence-2-large-ft-bf16
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 34100.03it/s]
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 25203.63it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
<s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s>
==========
Prompt: 29 tokens, 98.138 tokens-per-sec
Generation: 500 tokens, 167.137 tokens-per-sec
Peak memory: 7.842 GB
<s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s><s>
Output generated in 3.78s
Memory used: 1.77 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/Llama-3.2-11B-Vision-Instruct-8bit
Fetching 10 files: 100%|████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 20331.09it/s]
Fetching 10 files: 100%|████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 14242.12it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|begin_of_text|><|start_header_id|>user<|end_header_id|>

Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<|image|><|eot_id|><|start_header_id|>assistant<|end_header_id|>


The image depicts a serene scene of two individuals strolling along a beach with their dog, set against the backdrop of a large cargo ship sailing in the distance.

**Description:**
The two people, dressed in warm attire, are walking on the beach, which is characterized by its dark, wet sand and shallow water. The dog, a small white breed, is also present, adding to the tranquil atmosphere of the scene.

**Keywords/Tags:**
Cargo ship, beach, people, dog, sunset, ocean, sea, water, sand, shore, coastal, nature, wildlife, marine, transportation, travel, leisure, relaxation, calm, peaceful, serene, scenic, beautiful, picturesque, idyllic, tranquil, soothing, calming, relaxing, enjoyable, happy, joyful, uplifting, inspiring, motivational, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating,
==========
Prompt: 35 tokens, 10.258 tokens-per-sec
Generation: 500 tokens, 8.475 tokens-per-sec
Peak memory: 21.815 GB
The image depicts a serene scene of two individuals strolling along a beach with their dog, set against the backdrop of a large cargo ship sailing in the distance.

**Description:**
The two people, dressed in warm attire, are walking on the beach, which is characterized by its dark, wet sand and shallow water. The dog, a small white breed, is also present, adding to the tranquil atmosphere of the scene.

**Keywords/Tags:**
Cargo ship, beach, people, dog, sunset, ocean, sea, water, sand, shore, coastal, nature, wildlife, marine, transportation, travel, leisure, relaxation, calm, peaceful, serene, scenic, beautiful, picturesque, idyllic, tranquil, soothing, calming, relaxing, enjoyable, happy, joyful, uplifting, inspiring, motivational, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating, inspiring, uplifting, encouraging, empowering, motivating,
Output generated in 62.83s
Memory used: 10.69 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/Molmo-7B-D-0924-8bit
Fetching 16 files: 100%|████████████████████████████████████████████████████████████| 16/16 [00:00<00:00, 26102.24it/s]
Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.48, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
Fetching 16 files: 100%|████████████████████████████████████████████████████████████| 16/16 [00:00<00:00, 38568.31it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
 Two men walking a dog on a beach at sunset, with a large cargo ship visible in the distance. The scene captures a peaceful moment of outdoor recreation against a stunning backdrop of orange sky and blue water.

Keywords: beach, sunset, men, dog, ocean, cargo ship, orange sky, blue water, outdoor recreation
==========
Prompt: 1225 tokens, 34.088 tokens-per-sec
Generation: 65 tokens, 41.187 tokens-per-sec
Peak memory: 41.811 GB
 Two men walking a dog on a beach at sunset, with a large cargo ship visible in the distance. The scene captures a peaceful moment of outdoor recreation against a stunning backdrop of orange sky and blue water.

Keywords: beach, sunset, men, dog, ocean, cargo ship, orange sky, blue water, outdoor recreation
Output generated in 37.99s
Memory used: 8.07 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/Molmo-7B-D-0924-bf16
Fetching 18 files: 100%|████████████████████████████████████████████████████████████| 18/18 [00:00<00:00, 19779.27it/s]
Fetching 18 files: 100%|████████████████████████████████████████████████████████████| 18/18 [00:00<00:00, 15582.55it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
 A couple walking their dog on a beach at sunset, with a large cargo ship visible in the distance. The scene captures the serene beauty of coastal life during the golden hour. The image showcases the contrast between the small, intimate moment of the people and their pet enjoying the beach, and the impressive scale of maritime commerce represented by the massive ship on the horizon.

Keywords: beach, sunset, couple, dog, cargo ship, ocean, horizon, golden hour, coastal life, serenity, contrast, human-animal bond, maritime industry, natural beauty, evening light, family outing
==========
Prompt: 1225 tokens, 33.740 tokens-per-sec
Generation: 117 tokens, 26.425 tokens-per-sec
Peak memory: 48.657 GB
 A couple walking their dog on a beach at sunset, with a large cargo ship visible in the distance. The scene captures the serene beauty of coastal life during the golden hour. The image showcases the contrast between the small, intimate moment of the people and their pet enjoying the beach, and the impressive scale of maritime commerce represented by the massive ship on the horizon.

Keywords: beach, sunset, couple, dog, cargo ship, ocean, horizon, golden hour, coastal life, serenity, contrast, human-animal bond, maritime industry, natural beauty, evening light, family outing
Output generated in 41.21s
Memory used: 12.02 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/Phi-3.5-vision-instruct-bf16
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 21714.84it/s]
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 17216.91it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|user|>
<|image_1|>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<|end|>
<|assistant|>

Two people and a dog are walking along the shore, with a large cargo ship in the background. The sky is painted with warm hues of orange and yellow, indicating either sunrise or sunset. The calm water reflects the colors of the sky, creating a serene atmosphere. Keywords: walking, shore, cargo ship, orange sky, sunrise, sunset, calm water, reflection, dog, people.<|end|>
==========
Prompt: 795 tokens, 850.983 tokens-per-sec
Generation: 90 tokens, 10.161 tokens-per-sec
Peak memory: 12.789 GB
Two people and a dog are walking along the shore, with a large cargo ship in the background. The sky is painted with warm hues of orange and yellow, indicating either sunrise or sunset. The calm water reflects the colors of the sky, creating a serene atmosphere. Keywords: walking, shore, cargo ship, orange sky, sunrise, sunset, calm water, reflection, dog, people.<|end|>
Output generated in 10.14s
Memory used: 7.82 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/SmolVLM-Instruct-bf16
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 55800.05it/s]
Some kwargs in processor config are unused and will not have any effect: image_seq_len. 
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 27578.99it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|im_start|>User:<image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<end_of_utterance>
Assistant:
 A man and a woman are walking on a beach with a dog. The man is wearing a black jacket and the woman is wearing a yellow jacket. The dog is wearing a harness. There is a large ship in the background.
==========
Prompt: 1217 tokens, 1053.517 tokens-per-sec
Generation: 47 tokens, 119.811 tokens-per-sec
Peak memory: 7.591 GB
 A man and a woman are walking on a beach with a dog. The man is wearing a black jacket and the woman is wearing a yellow jacket. The dog is wearing a harness. There is a large ship in the background.
Output generated in 2.14s
Memory used: 4.28 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/deepseek-vl2-8bit
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 40874.03it/s]
Some kwargs in processor config are unused and will not have any effect: candidate_resolutions, ignore_id, add_special_token, image_std, patch_size, sft_format, image_token, mask_prompt, pad_token, normalize, image_mean, downsample_ratio. 
Add pad token = ['<｜▁pad▁｜>'] to the tokenizer
<｜▁pad▁｜>:2
Add image token = ['<image>'] to the tokenizer
<image>:128815
Added grounding-related tokens
Added chat tokens
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 16170.21it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|User|>: <image>
Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.

<|Assistant|>:
Why can be thethe can not be thethecan be thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecanbe in thethecan be in thethecan be in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in? thecan be in? thecanbe in thecanbe in thecanbe in? theimg be in thethecanbe in? thethecanbe in? theimg be in thecanbe in? theimg be in thecanbe in? theimg be in theimg be in theimg be in thethecanbe in? thethecanbe in? thecan be in thecanbe in? thecanbe in? theimg be in theimg be in theimg be in theimg be in theimg be in thecan? thecanbe in? theimg be in theimg be in thecanbe in? theimg be in thecanbe in? theimg be in theimg be in thecanbe in theimg be in theimg be in? theimg be in thecan? theimg be in thecan? thecanbe in? theimg be in theimg be in theimg be in theimg be in theimg be in theimg be in the can you be in? thecanbe in theimg be in theimg be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in
==========
Prompt: 2050 tokens, 433.738 tokens-per-sec
Generation: 500 tokens, 57.783 tokens-per-sec
Peak memory: 31.971 GB
Why can be thethe can not be thethecan be thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecan be in thethecanbe in thethecan be in thethecan be in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in thethecanbe in? thecan be in? thecanbe in thecanbe in thecanbe in? theimg be in thethecanbe in? thethecanbe in? theimg be in thecanbe in? theimg be in thecanbe in? theimg be in theimg be in theimg be in thethecanbe in? thethecanbe in? thecan be in thecanbe in? thecanbe in? theimg be in theimg be in theimg be in theimg be in theimg be in thecan? thecanbe in? theimg be in theimg be in thecanbe in? theimg be in thecanbe in? theimg be in theimg be in thecanbe in theimg be in theimg be in? theimg be in thecan? theimg be in thecan? thecanbe in? theimg be in theimg be in theimg be in theimg be in theimg be in theimg be in the can you be in? thecanbe in theimg be in theimg be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in the can you be in
Output generated in 13.88s
Memory used: 27.34 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/idefics2-8b-chatty-8bit
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 38597.89it/s]
Fetching 12 files: 100%|█████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 9374.49it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: User: Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<image><end_of_utterance>
Assistant:
In the image, a tranquil scene unfolds on a beach at sunset. The sky, painted in hues of orange, serves as a stunning backdrop to the vast expanse of the ocean. The ocean itself is a canvas of blue, dotted with white waves that crash onto the shore.

Two individuals are seen walking their dog on this beach. They are dressed in warm winter clothing, their breath likely visible in the crisp air. The dog, full of energy, is pulling on its leash, eager to explore the beach.

In the distance, a large cargo ship can be seen. Its silhouette stands out against the orange sky, adding a touch of industrial contrast to the otherwise natural landscape. The ship's presence suggests that this beach might be located near a busy port or shipping lane.

The image captures a moment of peace and companionship amidst the grandeur of nature and the signs of human activity. It's a snapshot of life by the sea, where man, dog, and nature coexist.

Keywords: Beach, Sunset, Orange Sky, Ocean, Waves, Dog, Walking, Winter Clothing, Cargo Ship, Port, Shipping Lane.<end_of_utterance>
==========
Prompt: 105 tokens, 134.391 tokens-per-sec
Generation: 258 tokens, 48.033 tokens-per-sec
Peak memory: 15.478 GB
In the image, a tranquil scene unfolds on a beach at sunset. The sky, painted in hues of orange, serves as a stunning backdrop to the vast expanse of the ocean. The ocean itself is a canvas of blue, dotted with white waves that crash onto the shore.

Two individuals are seen walking their dog on this beach. They are dressed in warm winter clothing, their breath likely visible in the crisp air. The dog, full of energy, is pulling on its leash, eager to explore the beach.

In the distance, a large cargo ship can be seen. Its silhouette stands out against the orange sky, adding a touch of industrial contrast to the otherwise natural landscape. The ship's presence suggests that this beach might be located near a busy port or shipping lane.

The image captures a moment of peace and companionship amidst the grandeur of nature and the signs of human activity. It's a snapshot of life by the sea, where man, dog, and nature coexist.

Keywords: Beach, Sunset, Orange Sky, Ocean, Waves, Dog, Walking, Winter Clothing, Cargo Ship, Port, Shipping Lane.<end_of_utterance>
Output generated in 6.60s
Memory used: 0.86 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/llava-v1.6-34b-8bit
Fetching 17 files: 100%|████████████████████████████████████████████████████████████| 17/17 [00:00<00:00, 19208.83it/s]
Fetching 17 files: 100%|████████████████████████████████████████████████████████████| 17/17 [00:00<00:00, 27246.15it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <|im_start|>user
<image>
Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.<|im_end|>
<|im_start|>assistant

Failed to generate output for model at mlx-community/llava-v1.6-34b-8bit: unsupported operand type(s) for //: 'int' and 'NoneType'
********************************************************************************

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/llava-v1.6-mistral-7b-8bit
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 27030.96it/s]
Fetching 12 files: 100%|████████████████████████████████████████████████████████████| 12/12 [00:00<00:00, 20971.52it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: [INST] <image>
Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily. [/INST]
The image is a photograph. 
==========
Prompt: 2185 tokens, 190.817 tokens-per-sec
Generation: 8 tokens, 24.165 tokens-per-sec
Peak memory: 44.967 GB
The image is a photograph. 
Output generated in 12.39s
Memory used: -0.32 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/paligemma2-10b-ft-docci-448-6bit
Fetching 8 files: 100%|███████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 15849.99it/s]
Fetching 8 files: 100%|███████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 18216.30it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
A long shot view of a man and woman walking their dog on a beach with a large container ship in the background. The man and woman are walking towards the left side of the image, the dog is walking towards the right side of the image. The dog is in the middle of the image, the man is on the left side of the image and the woman is on the right side of the image. The dog is on a leash that is attached to the man's hand. The man and woman are wearing jackets. The water is covering the sand on the beach, the water is creating a pattern of lines in the sand. The sky is clear and orange.
==========
Prompt: 1051 tokens, 458.787 tokens-per-sec
Generation: 136 tokens, 37.440 tokens-per-sec
Peak memory: 10.677 GB
A long shot view of a man and woman walking their dog on a beach with a large container ship in the background. The man and woman are walking towards the left side of the image, the dog is walking towards the right side of the image. The dog is in the middle of the image, the man is on the left side of the image and the woman is on the right side of the image. The dog is on a leash that is attached to the man's hand. The man and woman are wearing jackets. The water is covering the sand on the beach, the water is creating a pattern of lines in the sand. The sky is clear and orange.
Output generated in 6.41s
Memory used: 7.53 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/paligemma2-10b-ft-docci-448-bf16
Fetching 10 files: 100%|████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 16690.43it/s]
Fetching 10 files: 100%|████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 29767.95it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
A long shot view of a man and woman walking their dog on a beach. The man is on the left and the woman is on the right. The dog is in between them. The dog is facing to the right. The dog is on a leash. The leash is attached to the man's hand. The leash is extending diagonally from the bottom left corner of the image to the bottom right corner of the image. The dog is a light gray color. The man is wearing a black jacket. The woman is wearing a yellow jacket. The beach is made up of sand and water. The water is reflecting the sky. The sky is orange. A large container ship is in the background. The ship is facing to the left. The ship is casting a shadow on the water in front of it.
==========
Prompt: 1051 tokens, 462.988 tokens-per-sec
Generation: 163 tokens, 4.596 tokens-per-sec
Peak memory: 26.484 GB
A long shot view of a man and woman walking their dog on a beach. The man is on the left and the woman is on the right. The dog is in between them. The dog is facing to the right. The dog is on a leash. The leash is attached to the man's hand. The leash is extending diagonally from the bottom left corner of the image to the bottom right corner of the image. The dog is a light gray color. The man is wearing a black jacket. The woman is wearing a yellow jacket. The beach is made up of sand and water. The water is reflecting the sky. The sky is orange. A large container ship is in the background. The ship is facing to the left. The ship is casting a shadow on the water in front of it.
Output generated in 38.22s
Memory used: 18.10 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/paligemma2-3b-ft-docci-448-bf16
Fetching 8 files: 100%|███████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 54738.06it/s]
Fetching 8 files: 100%|███████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 12782.64it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
A long shot view of two people walking a dog on a beach at low tide. The dog is pulling the leash from the left side of the image, the person on the left is wearing a black jacket and a yellow vest, the person on the right is wearing a black jacket and a black shirt. The dog is white and is facing the left side of the image. The water is low and the sand is wet, there are horizontal lines of water extending across the image. There is a large container ship in the background of the image. The sky is orange at the top of the image and fades into blue at the bottom of the image.
==========
Prompt: 1051 tokens, 1298.130 tokens-per-sec
Generation: 131 tokens, 16.108 tokens-per-sec
Peak memory: 18.587 GB
A long shot view of two people walking a dog on a beach at low tide. The dog is pulling the leash from the left side of the image, the person on the left is wearing a black jacket and a yellow vest, the person on the right is wearing a black jacket and a black shirt. The dog is white and is facing the left side of the image. The water is low and the sand is wet, there are horizontal lines of water extending across the image. There is a large container ship in the background of the image. The sky is orange at the top of the image and fades into blue at the bottom of the image.
Output generated in 9.41s
Memory used: 5.46 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/paligemma2-3b-pt-896-4bit
Fetching 7 files: 100%|███████████████████████████████████████████████████████████████| 7/7 [00:00<00:00, 31947.91it/s]
Fetching 7 files: 100%|███████████████████████████████████████████████████████████████| 7/7 [00:00<00:00, 25530.55it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <image>Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.
ship
==========
Prompt: 4123 tokens, 1246.807 tokens-per-sec
Generation: 2 tokens, 67.004 tokens-per-sec
Peak memory: 9.104 GB
ship
Output generated in 3.82s
Memory used: 1.61 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/pixtral-12b-8bit
Fetching 11 files: 100%|███████████████████████████████████████████████████████████| 11/11 [00:00<00:00, 148830.14it/s]
Fetching 11 files: 100%|████████████████████████████████████████████████████████████| 11/11 [00:00<00:00, 29881.70it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <s>[INST][IMG]Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.[/INST]
**Caption:**
Two individuals walk their dog along a beach at sunset, with a large cargo ship visible in the distance.

**Description:**
The image captures a serene beach scene at sunset. Two people, dressed in casual attire, are walking their dog along the shoreline. The sand is wet and reflects the warm hues of the setting sun. In the background, a large cargo ship is silhouetted against the sky, adding a sense of scale and depth to the scene.

**Keywords:**
Beach, sunset, dog, people, cargo ship, shoreline, sand, sea, sunset, silhouette, reflection, casual, walk, distance, serene, scene, nature, coastal, ship, ocean, evening, dusk, tranquility, leisure, walk, pet, companion, reflection, horizon, sky, warm, hues, calm, peaceful, large, vessel, maritime, journey, travel, transport, commerce, industry, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport
==========
Prompt: 2824 tokens, 376.170 tokens-per-sec
Generation: 500 tokens, 26.974 tokens-per-sec
Peak memory: 19.786 GB
**Caption:**
Two individuals walk their dog along a beach at sunset, with a large cargo ship visible in the distance.

**Description:**
The image captures a serene beach scene at sunset. Two people, dressed in casual attire, are walking their dog along the shoreline. The sand is wet and reflects the warm hues of the setting sun. In the background, a large cargo ship is silhouetted against the sky, adding a sense of scale and depth to the scene.

**Keywords:**
Beach, sunset, dog, people, cargo ship, shoreline, sand, sea, sunset, silhouette, reflection, casual, walk, distance, serene, scene, nature, coastal, ship, ocean, evening, dusk, tranquility, leisure, walk, pet, companion, reflection, horizon, sky, warm, hues, calm, peaceful, large, vessel, maritime, journey, travel, transport, commerce, industry, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport, commerce, industry, journey, travel, transport
Output generated in 26.55s
Memory used: 12.78 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
Running mlx-community/pixtral-12b-bf16
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 24909.07it/s]
Fetching 13 files: 100%|████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 24158.60it/s]
==========
Image: ['/Users/jrp/Pictures/Processed/20250111-154612_DSC01918.jpg'] 

Prompt: <s>[INST][IMG]Provide a factual caption, description and comma-separated keywords or tags for this image so that it can be searched for easily.[/INST]
**Caption:**
Two individuals walk their dog along a beach at sunset, with a large cargo ship visible in the distance.

**Description:**
The image captures a serene beach scene at sunset. Two people, dressed in casual attire, stroll along the shoreline, accompanied by their dog. The sand is wet and reflective, creating a mirror-like effect. In the background, a large cargo ship is silhouetted against the vibrant orange and pink sky, adding a sense of scale and depth to the scene.

**Keywords:**
Beach, sunset, dog, people, cargo ship, sand, sea, sky, sunset, walk, silhouette, reflection, calm, serene, orange, pink, ship, ocean, shore, evening, dusk
==========
Prompt: 2824 tokens, 389.924 tokens-per-sec
Generation: 152 tokens, 3.716 tokens-per-sec
Peak memory: 36.136 GB
**Caption:**
Two individuals walk their dog along a beach at sunset, with a large cargo ship visible in the distance.

**Description:**
The image captures a serene beach scene at sunset. Two people, dressed in casual attire, stroll along the shoreline, accompanied by their dog. The sand is wet and reflective, creating a mirror-like effect. In the background, a large cargo ship is silhouetted against the vibrant orange and pink sky, adding a sense of scale and depth to the scene.

**Keywords:**
Beach, sunset, dog, people, cargo ship, sand, sea, sky, sunset, walk, silhouette, reflection, calm, serene, orange, pink, ship, ocean, shore, evening, dusk
Output generated in 48.64s
Memory used: 23.01 GB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

PS: I quite enjoyed https://x.com/kmett/status/1878340240181432667 (which is not a bad summary of the current state of (Python + AI) things :-) )