1.獲取博客園的博客標題以及博客地址,獲取友情連接html
2.代碼實現:java
public static void main(String[] args) throws Exception{ // 建立httpClient實例 CloseableHttpClient httpClient = HttpClients.createDefault(); // 建立httpGet實例 HttpGet httpGet = new HttpGet("http://www.cnblogs.com"); httpGet.setHeader("User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"); CloseableHttpResponse response = httpClient.execute(httpGet); String content = null; if(response != null){ HttpEntity entity = response.getEntity(); content = EntityUtils.toString(entity, "UTF-8"); // 獲取網頁內容 Document document = Jsoup.parse(content); // 解析網頁,獲得文檔對象 // 1.經過選擇器查找全部博客標題以及連接 Elements ele = document.select("#post_list .post_item .post_item_body h3 a"); for(Element e : ele){ System.out.println("博客標題:" + e.text() + "---博客地址:" + e.attr("href")); } // 2.獲取友情連接 Element linkEle = document.select("#friend_link").first(); System.out.println("友情連接純文本:" + linkEle.text()); System.out.println("友情連接HTML:" + linkEle.html()); } if(response != null){ response.close(); } if(httpClient != null){ httpClient.close(); } }
3.Jsoup學習地址post