{"id":10608,"date":"2013-08-12T18:49:48","date_gmt":"2013-08-12T13:19:48","guid":{"rendered":"http:\/\/www.tothenew.com\/blog\/?p=10608"},"modified":"2013-08-12T18:52:00","modified_gmt":"2013-08-12T13:22:00","slug":"how-to-use-crawlme","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/how-to-use-crawlme\/","title":{"rendered":"How to Use CRAWLME"},"content":{"rendered":"

How to implement CRAWLME<\/a>?<\/strong><\/p>\n

    \n
  1. Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls.<\/li>\n
  2. Insert the CRAWLME\u00a0middleware before your server in the chain of Connect\/Express middlewares.<\/li>\n
  3. Crawlme takes care of rest.<\/li>\n<\/ol>\n

    Example:<\/strong><\/p>\n

    var connect <\/code>= <\/code>require('connect');\r\nvar http <\/code>= <\/code>require('http');\r\nvar<\/span><\/span> crawlme <\/code>=<\/span> <\/code>require('crawlme');<\/span> <\/code>\r\nvar app <\/code>= <\/code>connect() \u00a0 <\/code>\r\n.use(crawlme()) \u00a0 <\/code>\r\n.use(connect<\/code>.static(__dirname <\/code>+ <\/code>'\/webroot'));\r\nhttp<\/code>.createServer(app<\/code>).listen(3000);<\/pre>\n
    How to install CRAWLME?<\/strong><\/p>\n
    npm install crawlme<\/code><\/pre>\n
    How crawlme help pages index AJAX files?<\/strong><\/p>\n
    When Google bot detects that your url of your page, \u00a0your.server.com\/page.html#!key=value<\/em>\u00a0contains hashbang #!, it tries to get url:\u00a0your.server.com\/page.html?escaped_fragment=key=value<\/em>\u00a0<\/em>where it finds the HTML snapshot of webpage. The method continues for all original ajax pages to generate HTML snapshot.<\/p>\n
    Google\u0092s\u00a0Fetch as Googlebot<\/a>\u00a0can also be used which lets you see Google page as Google sees it.<\/p>\n","protected":false},"excerpt":{"rendered":"
    How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME\u00a0middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require(‘connect’); var http = […]<\/p>\n","protected":false},"author":64,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":1},"categories":[1],"tags":[96,1179,33,55],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/10608"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/64"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=10608"}],"version-history":[{"count":0,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/10608\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=10608"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=10608"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=10608"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}