{"id":4279,"date":"2011-09-27T19:05:32","date_gmt":"2011-09-27T13:35:32","guid":{"rendered":"http:\/\/www.tothenew.com\/blog\/?p=4279"},"modified":"2011-09-28T10:43:46","modified_gmt":"2011-09-28T05:13:46","slug":"how-to-get-google-indexed-pages-count-andor-do-google-searches-through-ajaxprogmatically","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/how-to-get-google-indexed-pages-count-andor-do-google-searches-through-ajaxprogmatically\/","title":{"rendered":"How to get Google Indexed Pages Count, and\/or do Google searches through AJAX\/programmatically"},"content":{"rendered":"

Hi,
\nRecently i had to get the count of the Pages Google has Indexed<\/strong> for a perticular web Site progmatically.
\nIn the process i found that Google offers an AJAX Search API to perform Google Searches.
\n.
\nHence i Implemented a Class<\/strong> which does the same for me easily(Ajax Search in Google).
\nAnd this Solution Does Google Searches programmatically<\/strong> and Also<\/strong> Give us the Indexed Pages Count<\/strong>.
\nNote:<\/strong> Its Groovy Implementation, Similar can be done in JavaScript using Ajax though intent will remain the same.
\nThe class has been named GoogleAjaxSearch because it uses the Google AJAX Search API \ud83d\ude09<\/em>
\n
\nUse Cases Are As Follows:
\n[java]
\n\/\/Case 1 Simple Search
\nString searchQuery = "my search Query"
\nGoogleAjaxSearch googleAjaxSearch = new GoogleAjaxSearch(searchQuery)
\nprintln googleAjaxSearch.results \/\/Type List<Expando>, Just print it to see available properties
\n[\/java]
\n
\n[java]
\n\/\/Case 2: Get Number Of Indexed Pages in Google
\nString searchQuery = "site:intelligrape.com"
\nGoogleAjaxSearch googleAjaxSearch = new GoogleAjaxSearch(searchQuery)
\nprintln googleAjaxSearch.estimatedResultCount
\n[\/java]
\n
\n[java]
\n\/\/Case 3: Redo a search with same SearchQuery or a different Search Query
\nString searchQuery = "search string"
\nGoogleAjaxSearch googleAjaxSearch = new GoogleAjaxSearch(searchQuery)
\ngoogleAjaxSearch.redo() \/\/Re-Search with same query
\ngoogleAjaxSearch.redo("New Query") \/\/ Re-Search With New Query
\n[\/java]
\n
\n[java]
\n\/\/Case 4: All Details Available
\nString searchQuery = "site:intelligrape.com"
\nGoogleAjaxSearch googleAjaxSearch = new GoogleAjaxSearch(searchQuery)
\nprintln googleAjaxSearch.estimatedResultCount \/\/Gives the result count, indexed pages count
\nprintln googleAjaxSearch.currentPageIndex \/\/Search result server side pagination – current page
\nprintln googleAjaxSearch.results \/\/List<Expando> containing results
\nprintln googleAjaxSearch.responseStatus \/\/HTTP Status Code
\nprintln googleAjaxSearch.responseDetails \/\/Details for response, if any
\nprintln googleAjaxSearch.searchQuery \/\/Search Query
\nprintln googleAjaxSearch.moreResultsUrl \/\/ Url to hit for next Page of results
\nprintln googleAjaxSearch.jsonResult \/\/ Complete raw JSON Result from google
\nprintln googleAjaxSearch.pages \/\/ Pagination Pages Details
\n[\/java]<\/p>\n

The Class Code Is As Follows:<\/p>\n

\n

[java]
\npackage myPackage.googleSearch<\/p>\n

import grails.converters.JSON<\/p>\n

class GoogleAjaxSearch {<\/p>\n

public String searchQuery
\n public String responseDetails
\n public String moreResultsUrl
\n public String jsonResult<\/p>\n

public Integer responseStatus
\n public Integer currentPageIndex
\n public Integer estimatedResultCount<\/p>\n

public def pages<\/p>\n

public List<Expando> results = []<\/p>\n

private static final String ajaxSearchTarget = "http:\/\/ajax.googleapis.com\/ajax\/services\/search\/web?v=1.0&q=###SEARCHQUERY###&filter=0"<\/p>\n

public GoogleAjaxSearch(String searchQuery) {
\n this.searchQuery = searchQuery
\n search()
\n }<\/p>\n

public GoogleAjaxSearch() {
\n this(null)
\n }<\/p>\n

public void redo() {
\n search()
\n }<\/p>\n

public void redo(String newSearchQuery) {
\n this.searchQuery = newSearchQuery
\n search()
\n }<\/p>\n

private void search() {
\n if (searchQuery) {
\n URL url = new URL(ajaxSearchTarget.replace(‘###SEARCHQUERY###’, searchQuery))
\n URLConnection connection = url.openConnection()
\n connection.setDoInput(true)
\n InputStream inStream = connection.getInputStream()
\n BufferedReader searchResultContent = new BufferedReader(new InputStreamReader(inStream))
\n jsonResult = searchResultContent.getText()
\n parseJsonAndPopulateObject()
\n }
\n }<\/p>\n

private void parseJsonAndPopulateObject() {
\n def jsonArray = JSON.parse(jsonResult)
\n this.responseStatus = Integer.parseInt(jsonArray.responseStatus as String, 10)
\n this.responseDetails = jsonArray.responseDetails
\n this.moreResultsUrl = jsonArray.responseData.cursor.moreResultsUrl
\n this.currentPageIndex = Integer.parseInt(jsonArray.responseData.cursor.currentPageIndex as String, 10)
\n this.pages = jsonArray.responseData.cursor.pages
\n this.estimatedResultCount = Integer.parseInt(jsonArray.responseData.cursor.estimatedResultCount as String, 10)
\n results = jsonArray.responseData.results.collect {
\n new Expando(
\n content: it.content,
\n GsearchResultClass: it.GsearchResultClass,
\n titleNoFormatting: it.titleNoFormatting,
\n title: it.title,
\n cacheUrl: it.cacheUrl,
\n unescapedUrl: it.unescapedUrl,
\n url: it.url,
\n visibleUrl: it.visibleUrl
\n )
\n }
\n }
\n}<\/p>\n

[\/java]<\/p>\n

Hope That Helps \ud83d\ude42
\nRegards
\nKushal Likhi<\/p>\n","protected":false},"excerpt":{"rendered":"

Hi, Recently i had to get the count of the Pages Google has Indexed for a perticular web Site progmatically. In the process i found that Google offers an AJAX Search API to perform Google Searches. . Hence i Implemented a Class which does the same for me easily(Ajax Search in Google). And this Solution […]<\/p>\n","protected":false},"author":28,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":6},"categories":[7],"tags":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/4279"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=4279"}],"version-history":[{"count":0,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/4279\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=4279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=4279"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=4279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}