Bugs

As I understand it, Nop generates its own Robots.txt (on the fly) in the Common Controller. So you can either manually setup the entire Robots.txt (good luck with that!). By telling the web.config file to ignore the current Robots.txt path. Or hope plugin creators have a way to tell Nop to add exclusions, without making core changes.

...same holds true for the sitemap. -- Really annoying that Nopcommerce doesn't just do things the way everyone else has them done. It wouldn't be hard to code sitemap [as a XML] and Robots [as a TXT] file generation based on settings. After all, it's what all webpage creation software do out of the box.

I have added to custom robots.txt



Disallow: /catalog7spikes/getfilteredproducts
. But problems still persists, because other crawlers than Google do not respect it.

Hi, I think that crawler is searching for "Url" string in HTML code and afterwards trying to extract it.
Rename  data-getFilteredProductsUrl= to data-getFilteredProductsAddr=  in two files NopFilters.cshtml and Filters.min.js
. ( I also found , that crawler's IP address belongs to Blue Coat Systems , so definitely not Google )

We have applied nop ajax filter on our live site and it was working fine, but before few days it was not working on one page  and giving error like " Cannot read property 'toLowerCase' of undefined TypeError: $(...).attr(...) is undefined in  Filters.min.js file" in browser console.  

Page url is "https://dermawear.co.in/all-products" on which it shows error.

Need help to resolve this issue as soon as possible.
Refer these Screenshots :
http://prntscr.com/h77e9i
http://prntscr.com/h77erf