On Mon, May 13, 2019 at 11:58:18AM -0700, Roger wrote:
I wanted to thank everyone for their help with the google issue I’m having. It is not resolved but I’ve made some discoveries. It looks like a fair number of the ampr.org sites that come up on google may in fact be done via BGP. Rob’s is and the others that I did a traceroute on, terminate on an address that is not 44. But that said, I now think this is a 100% Google issue. I don’t know what kind of stupidity they are up to but Yandex and Bing, have no problems indexing my site. I have read of others having similar issues. Bing and Yandex actually use Google’s same system for verification and they crawl just fine.
73 Roger VA7LBB
After Roger mentioned that AMPRNet BGP-advertised web sites were getting indexed, but not very many others, and then someone posted that Google's indexing bots often run in the IP address range 66.249.x.x, I took a look at the ingress filter in amprgw.
66.249.90.x and 66.249.91.x were indeed blocked.
I have unblocked them. Roger, you may see Google crawling your web site from addresses in those subnets now. If you have some way to stimulate them to do so, you might want to try that.
I don't know how among many possible ways that those addresses got on the blocking list, as it was too long ago for the current logs to reflect it. - Brian