Bing Improves Image Search With Better Understanding of User Queries

    Bing is making its image search engine more precise through an improved understanding of the relationships between user queries, images, and webpages.

    In addition, Bing is also bringing multi-granularity matching to image search with new vector-match, attribute-match, and best representative query match techniques.

    Being explains how these enhancements will improve the image search:

    “… Bing image search has employed many deep learning techniques to map both query and document into semantic space greatly improving our search quality. There are however still many hard cases where users search for objects with specific context or attributes (for example: {blonde man with a mustache}, {dance outfits for girls with a rose}) which cannot be satisfied by current search stack. This prompted us to develop further enhancements.”

    Here’s more about Bing’s multi-granularity matching.

    Vector match

    Using the above-mentioned example of “dance outfits for girls with a rose,” Bing illustrates how its new vector match for image search works:

    Bing Improves Image Search With Better Understanding of User Queries

    “With recent advancements we incorporated BERT/Transformer technology leveraging 1) pre-trained knowledge to better interpret text information … 2) attention mechanism to embed the image and webpage with the awareness of each other, so that the embedded document is a good summarization of the salient areas of the image and the key points on the webpage.”

    Attribute match

    Attribute match utilizes a set of techniques to extract a set of object attributes from both the query and source document and use those attributes for matching.

    Using the example query “elderly man swimming pictures,” Bing shows how it applies attribute detectors to extract descriptions of the person’s appearance and behavior.

    Bing Improves Image Search With Better Understanding of User Queries

    “Despite the webpage having insufficient textual information for this image, we are now able to detect certain similar attributes from the image content and its surrounding text. Now the query and document can be considered a “precise match” since they share the same attributes.”

    Best Representative Query (BRQ) match

    Bing has enriched the metadata for images with Best Representative Query information. The Best Representative Query for a given image is a query that the image would be a good result for.

    BRQs resemble user queries, which means they can be naturally and easily matched to incoming queries. They are typically a summarization of the main topics of the webpage and the major image content.

    Generating a richer set of BRQs for images will leads to better search results, Bing says.

    Recent Articles

    Donald Trump finally wore a mask in public. Let’s take the high road on this one.

    Look. I don't like Donald Trump. There's evidence of that all over this very website. But I'm not going to razz him for finally...

    Poll: Are you trying the iOS 14 beta or waiting until the fall?

    Apple announced iOS 14 at WWDC 2020 last month with a redesigned home screen and features like widgets, App Library, Car keys, and more....

    Cast and crew of ‘Greyhound’ take viewers behind the scenes in new clip

    Go behind the battle with the cast and crew of 'Greyhound'. What you need to know Apple has released a new behind the scenes video of...

    GBWhatsapp APK Download 2020

    How can I download WhatsApp GB? If you're looking for how to download GBWhatsapp good luck because you're in the right place GBWhatsApp is an enhanced...

    Galaxy Note 8 gets July security update ahead of Galaxy Note 20 launch

    Everyone at Samsung is probably busy preparing for the upcoming Galaxy Note 20 launch, but that hasn’t stopped the company from continuing to push...

    Latest Stories

    Stay on op - Ge the daily news in your inbox

    Do NOT follow this link or you will be banned from the site!
    Translate »