Missing large number of results through Bing Search API (web results only)

When making multiple calls to the Bing Web Search API (with a different $skip parameter), many queries I try seem to be missing many of the result I'd expect.
For example, searching for the string 'obama' on bing.com shows 107,000,000 results available.
When I search using the web search API using:
https://api.datamarket.azure.com/Bing/SearchWeb/v1/Web?Query=%27obama%27&%24format=json
I get 50 results, and the '__next' parameter is given as 'https://api.datamarket.azure.com/Data.ashx/Bing/SearchWeb/v1/Web?Query='obama'&$skip=50'
If I repeat this several times, eventually I get a response with less than 50 results, and no '__next' parameter, indicating there are no more results.
However, I always get far fewer than 1000 results (I'd expect there to be at least 1000). Trying to get 1000 results (by making a request and querying against the '__next' URL), I get different numbers of results each time:
attempt 1: 355 results
attempt 2: 441 results
attempt 3: 358 results
attempt 4: 692 results
attempt 5: 692 results
attempt 6: 694 results
attempt 7: 659 results
Querying for this should always return at least 1000 results, since 'obama' has 107,000,000 results listed when searching from bing.com
Any idea what's going on here?

Sorry to respond to this old thread, but the problem persists. It exists in both the web UI and the API. The initial result page (on the web) or result object (in the API) report millions of search results, however after clicking through a number of result
pages (on the web) the total number is reduced to a few hundred. Similarly, in the API, setting the '$skip' parameter above this number does not return results. In the Obama case the first page shows 18.2 million results (http://www.bing.com/search?q=obama&go=Submit+Query&qs=bs&form=QBRE)
but from page 35 and over only 529 results are reported (e.g., http://www.bing.com/search?q=obama&qs=n&pq=obama&sc=8-3&sp=-1&sk=&ghc=1&cvid=92729d6076e24a37a9e6ee099da99a4a&first=527&FORM=PERE7). Therefore the above problem
does not seem to be related to the difference between the API and the web UI, but rather that Bing does not provide any results from a certain point (presumably because nobody is interested in them anyway). However, for data mining/web content analysis it
is desired to get all results, even uninteresting ones. Is this behaviour documented somewhere, or can it be influenced?

Similar Messages

  • Bing Search API exact phrase match not working?

    Dear Microsoft support,
    I have recently subscribed to the Bing Web Search API and now found a problem with exact phrase match.
    When searching for "engineering it has over medical", encoded as %27%22engineering%20it%20has%20over%20medical%22%27 I get two results back from you - unfortunately on closer inspection neither one of them contains the phrase I searched for.
    I could understand less results than actually exist due to a limited index, but this seems to be a bug.
    Please check and let me know how to resolve this.
    Thank you very much!
      Johannes

    Hi,
    Thanks for your posting.
    I try to search for "engineering it has over medical" in Bing Search API (Web), here is the expressed query url: https://api.datamarket.azure.com/Bing/Search/v1/Web?Query=%27engineering%20it%20has%20over%20medical%27,
    it gives me a lot of data, so I don't think this is a bug, if I misunderstand, please feel free to let me know, if it proved to be a bug, I will report this issue.
    Best Regards,
    Jambor
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • Bing Search API: how do I know where there is no transactions left. What happens then?

    I'm using Bing Search API
    to search for some Images. I'm using free subscription, so I can use Bing Search for 5000 times.
    How do I know that I exceed the limit? What will Bing do, when if I use this API more than 5000 times?

    Hello.
    If you exceed your quota, the Bing Search API returns a 403 Forbidden error. You then have the option of upgrading to a higher level of service.
    For more information, please see
    Bing API FAQ.
    Best regards,
    Eric

  • Bing Search API sort option

    Hi,
    I have the next problem:
    Everything works just fine when i query:
    'https://api.datamarket.azure.com/Bing/Search/v1/News?Query=%27teamnet%27&Market=%27en-US%27'.
    But, when i add sort by date option, and query this:
    'https://api.datamarket.azure.com/Bing/Search/v1/News?Query=%27teamnet%27&Market=%27en-US%27&NewsSortBy=%27Date%27'
    It's empty data, can someone help please?
    And another question, it's possible to query with a since parameter ? Or something like that.
    Thank you!

    This forum is for the speech service. You should use the search forum for this question.

  • How do I apply my $200 of Azure trial credit to the Bing Search API?

    Hello,
    I want to use this product:
    https://datamarket.azure.com/dataset/bing/search
    However it appears I'll have to pay for it but I want to use my $200 credit that comes with my Azure signup. Is this possible? Do I have to use some sort of promo code?

    Which way(s) of searching are you referring to?
    *searching via the location bar (pref: keyword.URL)
    *search bar on the Navigation Toolbar
    *search bar on the about:home page (pref: browser.search.defaultenginename)
    *other search bar (e.g. added by extension)
    If you do not keep changes after a restart then see:
    *http://kb.mozillazine.org/Preferences_not_saved

  • Sharepoint 2013 bing search results

    I have integrated bing search to my sharepoint 2013. Its returning results but i am facing two issues.
    1) The bing search is always returning only 8 results
    2) I want to get results for only particular website and i have used following query. But its always returning 8 results and first 3 results are website related and rest 5 results are not related to the site. If i use same query in bing site search
    text box its returning results properly. Any idea why the sharepoint bing search is returning results differently?
    query.QueryText =
    "tender|road Site:http://www.kenha.co.ke/";
    Thanks

    Hi - Thank you for your reply. We dont have proxy server and i tried the steps mentioned in your blog now i am getting 10 results. Is there any setting i need to enable to get all the results or sharepoint restricts the results automatically? I
    could have attached screen shot but its not allowing.
    And my second question is how to restrict bing results to one website. The following query param restrics the search to Kenha when i search in bing directly. But when i search from sharepoint its returning mixed results.
    "tender|road Site:http://www.kenha.co.ke/";
    Thank you for help

  • Based on Characteristics, populate variants/article through custom search help

    Dear Experts,
    In IS-Retail, MM43 transaction, based on characteristics how to display variant number/s(matnr) through custom search help.
    Regards,
    Abbas.

    Hi Syed,
    This is possible, if you set the field attributes of the screen as given below.
    Program Attirbutes:
    Check the checkbox for 'Output Field'
    Check the checkbox for 'Output Only'
    Display Attributes:
    Check the checkbox 'As label on right'
    Regards
    Gangadhar

  • About the Error after applying product key for bing search rest service

    For the Project Siena I ve created the product key for Bing search rest service and i applied that product key which is valid even though i got the error when i click TRY button .can anyone please help me to find the solution
    There was an error in retrieving sample data. Error : Unable to reach service. Please check if your service connector configuration is valid and you have network connectivity

    Hello,
    Thanks for your post. I am jotting down few steps to get the Bing search account key (you may have completed many/all of these).
    To add Bing Search Service, go to
    https://datamarket.azure.com/account/datasets and search for "Bing Search API". After you have subscribed to the service, navigate to "My Data" and click on Use. Click on Show and copy the
    Primary Account Key information.
    Note if your key contains a special character like / or = then double clicking on the content will copy the key partially.
    Make sure you have copied the full key correctly. If the is incorrectly pasted in Siena's Primary Account Key field, you will get the error below:
    This is similar to the error you have posted. Since the Primary Account Key is masked you can never be sure the contents are correct. It's best to clear the field and paste the key again.
    If you still face the issue, please post your machine configuration (x86/OS) information.
    Hope this helps,
    -Karthik
    This posting is provided "AS IS" with no warranties and confers no rights.

  • Query and sort content from two lists using search API

    Hi,
    I have a custom web part which I would like to query two different lists and sort the results by Created Date. One is a list of news articles and the other contains blogs. So basically the result set will be an intermix of news and blog items sorted by date.
    I would also like to do this by query through the search API. Does anybody have any sample code to do this?
    thanks,
    Sherazad.
    Sherazad

    Hi Sherazad:
    To use the JOIN operator in CAML, your lists must have a
    defined relation(Lookup column). You can refer to sample code that I list as follow.
    Create your query from one of your lists.
    SPList Projects= SPContext.Current.Site.RootWeb.Lists["Projects"];
    SPQuery query = new SPQuery();
    To do the join, setquery.Joins
     <Join Type="INNER" ListAlias="Contacts">
        <Eq>
            <FieldRef Name="ProjectManager" RefType="ID" /> ///
    ProjectManager is a Lookup Column.
            <FieldRef List="Contacts" Name="ID" />
        </Eq>
     </Join>
    And query.ProjectedFields (To tell SharePoint how to project the lookup columns into the result)
    <Field Name="Project Name" Type="Lookup" List="Projects" ShowField="Title">
    /// My Project Name is a Display Name in Memory so you can give a name by yourself But ShowField must be Internal Name of the Column(Project Name)
    You can add a lot of columns that you want to display.
    Everything comes from memory.
    To choose the fields to display set query.ViewFields
    <FieldRef Name="Your Internal Name of Column Or
    ProjectedFields - Field Name">
    <FieldRef Name="Your Internal Name of Column Or
    ProjectedFields - Field Name">
    <FieldRef Name="Your Internal Name of Column Or
    ProjectedFields - Field Name"> 
    Then
    SPListItemCollection result = ListA.GetItems(query);

  • AS3 & Google Search API - How?

    I am trying to learn APIs and AS3, can anyone tell me of a
    good tutorial for putting Google Search into Flash?
    Thanks.

    Hi,
    As far as I know, we can’t directly filter the results by date in Azure Bing search API.
    You could only filter results by your logical and code when you have got the result.
    Also, you could submit a feature request on this page:
    http://feedback.azure.com/forums/216369-azure-marketplace/suggestions/5222360-enable-websearch-api-to-filter-by-date
    Regards,
    Azam Khan

  • Search API payment update!

    I can't figure out how to change a credit card for the payment for Bing Search API, please help!

    Hi,
    This billing issue is out of my scope, I would suggest you contact with azure support, it is a good choice for you, here is the support channel:
    http://www.windowsazure.com/en-us/support/contact/
    Best Regards,
    Jambor 
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • Retrieving a photo from Bing's APIs

    how to search a photo via currant  locations.
    and search a image for currant places.
     

    Search photo via current location in the sense? If you could elaborate the question bit more?
    P.S: If you're looking for the Bing's Search API in order to search for images:
    Bing Search API in Windows Phone
    Happy Coding!

  • Search API Causing Timeout

    Hi there,
    I'm not sure if this is a problem occuring with anyone else, but since the recent change of the affiliates program, we have come across a few issues that points towards what I believe to be the Search API.
    When we query the search API between 8AM (PST) until around 12PM (PST), any page which runs a query through the Search API takes a very long time to load and then causes the page to timeout. Even when I type in the query URL directly (http://itunes.apple.com/lookup?id=xxx), it takes quite awhile to load the output page too.
    Has there been a recent change that could be causing this or what as this problem was not there until recently.

    Anyone from Apple able to help on this, or others who are facing this same issue?

  • Search result to get data from bing search and display it in sharepoint page.

    I have configured result source which gets data from bing site,i have given following url as source url
    http://www.bing.com/search?q={?searchterms}&format=rss&Market=en-Us
    but it returns only 8 results from RSS. i want to get all results of search and display it in my SharePoint search results page. 
    any pointers will be helpful. 

    Hi,
    According to your post, my understanding is that you wanted to search result to get data from bing search and displayed it in sharepoint page.
    To display more items, you can modify the item number when you add
    New Query Rule.
    To get all results, I recommend to use the “Show More”
    link in the result page.
    You can enter the URL when you add New Query Rule:
    "More" link goes to the following URL: http://www.bing.com/search?q={searchterms}
    Here is a great blog for your reference:
    http://sharepoint-community.net/profiles/blogs/integrate-bing-with-sharepoint-online-2013-search
    Best Regards,
    Linda Li
    Linda Li
    TechNet Community Support

  • How to remove large number of "sent" but still keep them available in case I need to search for something?

    Over several years, I have accumulated some 1400 messages in the SENT folder.
    Lately my Thunderbird is taking a long time for some actions that used to be instant, like selecting another message to read or delet.
    I regularly remove incoming messages to keep the in-box under 300, and I have almost nothing in the other folders.
    I tried changing the "local folders" to a different directory, but when I do that, all the old "sent" messages become un-available for searching and potentially continuing a conversation.
    Is there a way to move the large number of "sent" messages from the "local folders" but still keep them available for access from within Thunderbird, in case I need something from past chains of replies?

    https://wiki.mozilla.org/Thunderbird:Testing:Antivirus_Related_Performance_Issues#McAfee

Maybe you are looking for