I've been monitoring some of the image generation progress for game sprites for a while and was really impressed by Gemini Flash. This demo lets you upload a picture and turns it into an animated pixel character (a lil digi gif that you can download). I chain together the pixel art frames and insert the player into a tricky platforming level.
video demo:
https://www.youtube.com/watch?v=EK7z-HltssE
api usage:
Unfortunately Gemini Flash 2.0 image Gen has really tight API limits that don't scale up for paid tiers -- if anyone on the team sees this and wants to help me out, my email is in my profile or you can reach me at hello@lildigi.me
level stats:
For the speedrunners out there, the fastest glitchless times I've seen around 17-18s.
stack:
cloudflare pages + aws lambda + gemini
happy to answer any questions!
You may be able to take advantage of CORS so the Gemini call is client-side and your backend never sees the key. Simon Willison did this for Claude and wrote it up here: https://simonwillison.net/2024/Aug/23/anthropic-dangerous-di...
Very cool idea, thanks for sharing!