There is dimension error. How can I resolve this?
I think it's because context_dim in configs(yaml file) of cin256-v2 model is 512.
What is the shape of cali_y[:32] in your code?
File "./quant_scripts/quant_layer.py", line 372, in forward
out = self.fwd_func(input, weight, bias, **self.fwd_kwargs)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (3072x64 and 512x384)
Occured at In 'quantize_ldm_naive.py',
_ = qnn(cali_images[:32].to(device),cali_t[:32].to(device),cali_y[:32].to(device))
There is dimension error. How can I resolve this?
I think it's because context_dim in configs(yaml file) of cin256-v2 model is 512.
What is the shape of cali_y[:32] in your code?
File "./quant_scripts/quant_layer.py", line 372, in forward
out = self.fwd_func(input, weight, bias, **self.fwd_kwargs)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (3072x64 and 512x384)
Occured at In 'quantize_ldm_naive.py',
_ = qnn(cali_images[:32].to(device),cali_t[:32].to(device),cali_y[:32].to(device))