[examples] Introduce new examples#719
Conversation
This commit introduces new examples. TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
| Examples: | ||
|
|
||
| ```text | ||
| llama_gptq_ptq.yaml |
There was a problem hiding this comment.
@mhs4670go
llama_gptq_ptq.yaml is planned to be landed in some next PR?
|
|
||
| ```bash | ||
| python -m tico.quantization.examples.quantize \ | ||
| --config tico/quantization/examples/configs/llama_gptq_ptq.yaml \ |
There was a problem hiding this comment.
M.b llama_ptq_only.yaml would be more safe ?
| ``` | ||
|
|
||
| ```bash | ||
| python -m tico.quantization.examples.inspect \ |
There was a problem hiding this comment.
This PR does not contain inspect folder 😢
| ``` | ||
|
|
||
| ```bash | ||
| python -m tico.quantization.examples.inspect \ |
There was a problem hiding this comment.
the same as in This PR does not contain inspect folder 😢
There was a problem hiding this comment.
Please refer to the draft when there's codes that are not included in this PR. I just split the draft into few files. But, it was hard to split codes in a single file. It would have benn too burden.
|
|
||
| ```bash | ||
| python -m tico.quantization.examples.quantize \ | ||
| --config tico/quantization/examples/configs/llama_ptq_only.yaml \ |
|
|
||
| output_dir = cfg.get("export", {}).get("output_dir") | ||
| if output_dir: | ||
| save_effective_config(Path(output_dir) / "effective_config.yaml", cfg) |
| def run(self, ctx: RecipeContext, stage_cfg: Mapping[str, Any]) -> RecipeContext: | ||
| payload = stage_payload(stage_cfg) | ||
| # Build the algorithm config from payload. | ||
| # config = AWQConfig(**payload) |
There was a problem hiding this comment.
I'll apply this in the next PR.
| norm_weight_dtype: int16 | ||
| strict_wrap: true | ||
|
|
||
| evaluation: |
There was a problem hiding this comment.
@mhs4670go
No way to evaluate original model to assess model degradation?
There was a problem hiding this comment.
I'll add this feature.
| VLM example: | ||
|
|
||
| ```yaml | ||
| calibration: |
There was a problem hiding this comment.
Could you clarify, please, do we plan to use mixed calibration datasets in such recipe configs?
There was a problem hiding this comment.
I'll add this feature, too. Thank you.
|
We can proceed this PR without @dvsav approval, he is out of the office |
3 participants
This commit introduces new examples.
Related: #716
Draft: #717
TICO-DCO-1.0-Signed-off-by: seongwoo mhs4670go@naver.com