encoding

[cocodamol]

although you set ensure_ascii=False it's not handling non-western characters well

fixed it with
import io
with io.open(self.out_file, "w", encoding='utf-8') as f:

[ilamaaa]

yep yep, just need to set the encoding.

PS: with all your debugging have you found the biggest bug of all yet?

[cocodamol]

no the code is beautiful though some stupid translators decided to translate the 'on page' tag or edit the tags you used for parsing basically breaking everything

not really just resulted in empty jsons and i fixed that