[examples] Refactor examples

[mhs4670go]

This commit refactors examples.

The changes are really big. Therefore, please run a few simple command-level test first before approving the PR, and improve it incrementally as we use it. Or, you can just review the README files.

Related: #716
TICO-DCO-1.0-Signed-off-by: seongwoo mhs4670go@naver.com

[mhs4670go]

I'll remove datasets and lm_eval dependencies. On second thought, it's too heavy for unittest.

[Torrero]

I'll remove datasets and lm_eval dependencies. On second thought, it's too heavy for unittest.

but lm_eval is used for evaluation of some benchmarks (piqa, truthfulqa e.t.c.), should it be reimplemeted without lm_eval?

[dvsav]

The change is indeed large. I guess, it implements all of the improvements suggested in the issue #716. I can see that the improvements there are broken into several items (1-4). Could this PR be split into multiple PRs accordingly? (just out of curiosity 😄 )

[mhs4670go]

@Torrero

I'll remove datasets and lm_eval dependencies. On second thought, it's too heavy for unittest.

but lm_eval is used for evaluation of some benchmarks (piqa, truthfulqa e.t.c.), should it be reimplemeted without lm_eval?

Ah, no. It was only about unittest.

[mhs4670go]

@dvsav

Could this PR be split into multiple PRs accordingly? (just out of curiosity 😄 )

Sure. I"ll split the PR into a few several PRs soon. But, it would be good to elaborate a little bit what are broken before posting another PRs.

[mhs4670go]

@Torrero @stamalakhov PTAL. I've posted remain parts. I'll update some codes according to recent updates in exising examples.

[stamalakhov]

👍

[stamalakhov]

LGTM! Thank you!

[Torrero]

LGTM, thank you!