Microsoft has just released a new online application, CaptionBot, that tries to understand the content of your photos and write captions for them!
And while we didn't expect it, it's surprisingly impressive! You can simply upload an image to CaptionBot and it will return a caption for you. (It's worth noting that Microsoft keeps the images to learn from them, although it says it doesn't keep any personal information.) The results are pretty impressive, as you can see in the photos:
Of course, it's not the first AI product to try to write captions. A few years ago, Google announced that it had written an impressive set of algorithms that did exactly the same thing. What Microsoft is offering works in much the same way. It combines two neural networks. One deals with image recognition and the other with natural language processing. By studying a number of images that have been captioned, the software works out how to match the image's features with human descriptions of what they show, and then reproduces that when presented with new images.
https://www.secnews.gr/102827/facebook-texniti-noimosunh-gia-tuflous-xrhstes/Facebook: Artificial Intelligence for blind users!
Of course, it doesn't always work correctly and makes mistakes when it comes to more abstract images like the photo below, but overall it's very good. CaptionBot joins a series of applications created by Microsoft's research team that do things like guess your age or your emotion just from a photo. Try it yourself and see if it succeeds here
