JSoup 웹 크롤링 Read timed out 에러

Question

자바로 웹 크롤링 연습을 해보고 있던 와중에 쿠팡 사이트를 크롤링 해보려고 하는데 자꾸 에러가 납니다. 다른 사이트에서는 잘 작동하던데... 원인이 무엇인가요? package crowling; import java.io.IOException; import org.jsoup.Jsoup; import org.jsoup.nodes.Document; import org.jsoup.select.Elements; public class coupong { public static void main(String[] args) { String url &#61; &#34;http://www.coupang.com/vp/products/172879969?itemId&#61;494069638&vendorItemId&#61;4253776530&q&#61;%EB%AA%A8%EB%8D%98%EC%8B%AC%ED%94%8C&#43;%EC%BB%B4%ED%93%A8%ED%84%B0%EC%B1%85%EC%83%81&#43;1000&itemsCount&#61;36&searchId&#61;3fa2ed7e78b448589023712d3e8e2fed&rank&#61;0&isAddedCart&#61;&#34;; Document doc &#61; null; try { doc &#61; Jsoup.connect(url).get(); } catch (IOException e) { e.printStackTrace(); } Elements element1 &#61; doc.select(&#34;h2.prod-buy-header__title&#34;); // 제품 이름 Elements element2 &#61; doc.select(&#34;span.total-price strong&#34;); //판매가격 Elements element3 &#61; doc.select(&#34;div.clearFix img[class&#61;_1O-4yHyOQu]&#34;); // 제품 이미지 링크 System.out.println(element1.text()); System.out.println(element2.text()); System.out.println(element3.attr(&#34;abs:src&#34;)); } } 아래는 오류 메시지 입니다.java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(Unknown Source) at java.net.SocketInputStream.read(Unknown Source) at java.net.SocketInputStream.read(Unknown Source) at java.io.BufferedInputStream.fill(Unknown Source) at java.io.BufferedInputStream.read1(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) at sun.net.www.http.HttpClient.parseHTTPHeader(Unknown Source) at sun.net.www.http.HttpClient.parseHTTP(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at java.net.HttpURLConnection.getResponseCode(Unknown Source) at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:750) at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:722) at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:306) at org.jsoup.helper.HttpConnection.get(HttpConnection.java:295) at crowling.coupong.main(coupong.java:21)

JohnMark · Answer

UrlEncoding 문제일 수 있습니다. 쿼리 파라미터들은 따로 인코딩해서 붙여주세요

JSoup 웹 크롤링 Read timed out 에러

1개의 답변

#read 목록