OpenAI CLIP model deployment for zero-shot learning on Android devices. TL DR: the app is here, feel free to experiment with it!

General classifier works well for concept generalizing (app screenshots taken by author). Inspired by Ed van duijn from unsplash (center) and HelloI’mNik from unsplash (right)

What is CLIP and why it is interesting?

This January, a big breakthrough has been done into the field of image processing — OpenAI has presented a new neural network generator Dall-E, which can generate an image based on a textual description. Despite its name, OpenAI has not made it opensource. Nevertheless, I was very interested in one that was presented as an auxiliary neural network for Dall-E training and best-generated examples selection. CLIP in contrast to Dall-E is an open-source project published under MIT license, so one can easily use it everywhere. That neural network may be not so impressive for presenting, but it impresses me. In…

A tensorflow implementation of DenseNet architecture for video conversion: from idea to cloud implementation

Several months ago I was talking with my close friend into the bar about the direction of new hype technologies, such as VR or modern neural networks, thinking about more and less evident applications. Suddenly a thought appears in my mind: Is it possible to combine VR with Convolutional neural networks. The first idea was to draw the missing environment from a photo or painting to create an immersive experience. Nevertheless, I found a similar task almost completely solved using transformer architecture for image generation, so the task was not seemed challenging. The second idea was the creation of stereoscopic…

Neural network for real-time superresolution

Jagged Alliance screenshot (Image by author)

Real-time superresolution (RTSR) neural network for game graphics enhancement (Nvidia GPU-only)

In the 90s, when I was a kid, I loved playing video games on my PC. In Russia, PCs were not very abundant at that time, so my first gaming station was ZS Spectrum with games on tapes. The colorful and bright DOS games later became a real discovery for me. For me, the majority of existing genres arose from the 90s. After a bit of nostalgia, I decided to recall my youth and run one of the old games on the Dosbox emulator and was unpleasantly hit by…

Alexander Kharin

Finished Material science department in Moscow State University (Russia), PhD in chemistry (Lyon 1 university, France). Data Science enthusiast

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store