AI 시대, 커뮤니티 트래픽이 줄은 이유

요즘 애들은 구글링을 안 해요 ㅠㅠ

AI 시박 것

졸라 크롤링은 하면서, 자기들 고객만 모으는 시박 것들 같아요.

트래픽 2년전보다 30% 줄어든 것 같아요.

➜  nginx cat access.log-20250916 | grep -i bot
172.68.71.2 - - [15/Sep/2025:00:01:18 +0000] "GET /f/http%3A%2F%2Fxn--80atgfckdeggg.xn--p1ai/odte61tr HTTP/1.1" 200 405 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.7339.127 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "66.249.64.129"
172.70.80.112 - - [15/Sep/2025:00:01:43 +0000] "GET /?page=15 HTTP/1.1" 200 80224 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "54.39.0.233"
172.70.80.112 - - [15/Sep/2025:00:03:40 +0000] "GET /en?page=121 HTTP/1.1" 200 77454 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "54.39.0.190"
172.70.80.112 - - [15/Sep/2025:00:05:33 +0000] "GET /admin?c=food&l=ko&p=84 HTTP/1.1" 200 48453 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "148.113.130.99"
172.70.80.113 - - [15/Sep/2025:00:07:17 +0000] "GET /food?page=13 HTTP/1.1" 200 83997 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "54.39.210.206"
172.69.130.21 - - [15/Sep/2025:00:09:06 +0000] "GET /admin?c=food&l=ko&p=2 HTTP/1.1" 200 49657 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "54.39.136.172"
172.71.178.34 - - [15/Sep/2025:00:10:58 +0000] "GET /robots.txt HTTP/1.1" 200 10 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "198.244.168.210"
172.71.190.34 - - [15/Sep/2025:23:56:46 +0000] "GET /?page=1 HTTP/1.1" 200 78000 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36" "52.167.144.225"

...중략...
...AI를위한봇들의크롤링쩐다요...

108.162.241.243 - - [15/Sep/2025:23:59:52 +0000] "GET /mib/nodejs/prisma HTTP/1.1" 200 7532 "-" "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)" "148.113.130.102"