#e61919
Support Staff
224482
0
1
Apr 24, 2024 16:47:46 GMT -8
Scott
23,285
August 2015
socalso
|
Post by Scott on Aug 7, 2020 12:03:13 GMT -8
hotwire, a pageview is any time a page is requested and since indexing bots are requesting pages they will be recorded as a pageview by the forum.
|
|
inherit
50785
0
Mar 1, 2024 0:07:44 GMT -8
hotwire
153
July 2005
hotwire
|
Post by hotwire on Aug 7, 2020 13:31:32 GMT -8
hotwire , a pageview is any time a page is requested and since indexing bots are requesting pages they will be recorded as a pageview by the forum. I checked my Google Search Console and there doesn't appear to any given reason for an increase in crawl traffic. Some help would be greatly appreciated here because I can't afford to pay for more Ad Free at this level and if I can't afford that then the forum as it stands becomes untenable. I read something on Google suggesting a spike in traffic could be caused by an infinite internal loops caused by missing nofollow attributes. I checked the default theme on here though and it doesn't appear to have an nofollow attr on anything (unless I'm missing something fundamental).
|
|
#e61919
Support Manager
154778
0
1
Apr 22, 2024 12:15:24 GMT -8
Michael
19,550
May 2010
wiseowl
|
Post by Michael on Aug 7, 2020 13:44:48 GMT -8
hotwire , a pageview is any time a page is requested and since indexing bots are requesting pages they will be recorded as a pageview by the forum. I checked my Google Search Console and there doesn't appear to any given reason for an increase in crawl traffic. Some help would be greatly appreciated here because I can't afford to pay for more Ad Free at this level and if I can't afford that then the forum as it stands becomes untenable. I read something on Google suggesting a spike in traffic could be caused by an infinite internal loops caused by missing nofollow attributes. I checked the default theme on here though and it doesn't appear to have an nofollow attr on anything (unless I'm missing something fundamental). When I had systems check into this the first thing that was checked is that there was no internal infinite loop occurring. We could rate limit the bots but that would affect the normal indexes of pages/content.
|
|
inherit
50785
0
Mar 1, 2024 0:07:44 GMT -8
hotwire
153
July 2005
hotwire
|
Post by hotwire on Aug 7, 2020 13:58:58 GMT -8
When I had systems check into this the first thing that was checked is that there was no internal infinite loop occurring. We could rate limit the bots but that would affect the normal indexes of pages/content. I can rate limit Google's indexing from within the console, but that doesn't seem like the proper solution either. I can't seem to find a record of what Google is indexing in the console and obviously don't have access to the logs (and it doesn't report the visits in its own analytics). So I've not got a massive amount of visibility. I'm trying to think if there is anything I've done in the past few days to the theme that could have caused some oddity, but I can't think of anything. I'm about to head to bed (yay time difference), I'll pick up and check anything you need in the morning if you think of anything. Will have another run through everything Google side again tomorrow incase there is anything I missed.
|
|
#e61919
Support Manager
154778
0
1
Apr 22, 2024 12:15:24 GMT -8
Michael
19,550
May 2010
wiseowl
|
Post by Michael on Aug 7, 2020 14:08:11 GMT -8
When I had systems check into this the first thing that was checked is that there was no internal infinite loop occurring. We could rate limit the bots but that would affect the normal indexes of pages/content. I can rate limit Google's indexing from within the console, but that doesn't seem like the proper solution either. I can't seem to find a record of what Google is indexing in the console and obviously don't have access to the logs (and it doesn't report the visits in its own analytics). So I've not got a massive amount of visibility. I'm trying to think if there is anything I've done in the past few days to the theme that could have caused some oddity, but I can't think of anything. I'm about to head to bed (yay time difference), I'll pick up and check anything you need in the morning if you think of anything. Will have another run through everything Google side again tomorrow incase there is anything I missed. Did you verify and check the crawl stats report for your custom domain? support.google.com/webmasters/answer/35253This may give you the visibility for whatever it is that the bots seem to be so interested in and guide us towards a better long term solution.
|
|
inherit
50785
0
Mar 1, 2024 0:07:44 GMT -8
hotwire
153
July 2005
hotwire
|
Post by hotwire on Aug 8, 2020 2:29:37 GMT -8
I can rate limit Google's indexing from within the console, but that doesn't seem like the proper solution either. I can't seem to find a record of what Google is indexing in the console and obviously don't have access to the logs (and it doesn't report the visits in its own analytics). So I've not got a massive amount of visibility. I'm trying to think if there is anything I've done in the past few days to the theme that could have caused some oddity, but I can't think of anything. I'm about to head to bed (yay time difference), I'll pick up and check anything you need in the morning if you think of anything. Will have another run through everything Google side again tomorrow incase there is anything I missed. Did you verify and check the crawl stats report for your custom domain? support.google.com/webmasters/answer/35253This may give you the visibility for whatever it is that the bots seem to be so interested in and guide us towards a better long term solution. I can't find within Search Console a log of which Urls it is crawling, however I suspect i have an issue similar to this : support.google.com/webmasters/thread/54239462?hl=enWhich seems to be only identifiable through the server logs, for the url being crawled. Yesterday topped three million page views, which is pretty much my entire months budget in a single day!! I'll have a manual look for any relative links that I can find which could cause an issue, but some logs from whatever google is crawling would be useful.
|
|
inherit
257946
0
Feb 19, 2024 11:58:20 GMT -8
VanWoman84
412
March 2019
ukhippies
|
Post by VanWoman84 on Aug 10, 2020 9:00:45 GMT -8
I don't know if this is of any help, but three days ago I had an unexplained visitor spike. From just under 1000 to over 3000! Nothing on the scale of the OP, but a random increase all the same.
|
|
inherit
50785
0
Mar 1, 2024 0:07:44 GMT -8
hotwire
153
July 2005
hotwire
|
Post by hotwire on Aug 10, 2020 10:19:12 GMT -8
Yesterday I got 4.9 million page views. Would love a steer on what these are attempting to index, so I can find the issue and resolve it.
|
|
#e61919
Support Manager
154778
0
1
Apr 22, 2024 12:15:24 GMT -8
Michael
19,550
May 2010
wiseowl
|
Post by Michael on Aug 10, 2020 14:50:33 GMT -8
Hi,
I'll see what we can pull from our logs.
|
|
#e61919
Support Manager
154778
0
1
Apr 22, 2024 12:15:24 GMT -8
Michael
19,550
May 2010
wiseowl
|
Post by Michael on Aug 10, 2020 16:12:10 GMT -8
I'll send you a PM about this issue.
|
|