Replicate (https://replicate.com/) has hosted ML instances that can be programatically spun up using Cog (written in Python, ew). This repository is a Rust implementation of Cog. Just spin up any ML model you want and it comes with an auto-generated HTTP server. Pretty cool stuff.

I haven’t played around with this yet but I can already think of some cool ideas.