Handle HTML input

[Keyrxng]

Input should be properly sanitized and then stored according to the database schema. It appears that markdown is handled correctly but HTML is not and it should be as it's a supported GitHub comment format.

ubq-testing#5

[0x4007]

We just should rename the column to markup then

We need to test if embeddings work better with plaintext or all the markup context.

[Keyrxng]

Well We aren't using GPT for creating embeddings so idk but GPT likes markdown and they used to write the system message in markdown so I'd assume it's better than plaintext as you can signify inner context with block quotes, headings etc but plaintext over HTML all day long if that was in the mix too.

[ubiquity-os-beta]

Note

The following contributors may be suitable for this task:

zugdev

1% Match ubiquity/ts-template#87

gentlementlegen

0% Match ubiquity-os/ubiquity-os-kernel#125