@halva i was thinking of doing smth similar lol, its pretty easy with hugging face libraries on your own hardware. (at least it was with google bert for sequence classification but hugging face makes it super easy to just plug in different models for different purposes afaik)
