Skip to content

fix: handle MobileCLIP tensor lookup on DataParallel replicas#79

Open
kiwigitops wants to merge 1 commit into
apple:mainfrom
kiwigitops:fix-mobileclip-dataparallel-device
Open

fix: handle MobileCLIP tensor lookup on DataParallel replicas#79
kiwigitops wants to merge 1 commit into
apple:mainfrom
kiwigitops:fix-mobileclip-dataparallel-device

Conversation

@kiwigitops

Copy link
Copy Markdown

Summary

  • resolve MobileCLIP dtype/device from regular parameters, DataParallel replica parameters, or buffers
  • avoid StopIteration when multi-GPU replicas expose tensors through _former_parameters

Closes #66.

Tests

  • python -m py_compile llava/model/multimodal_encoder/mobileclip_encoder.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

StopIteration error at "return next(self.vision_tower.parameters()).device"

1 participant