200字范文 > 爬虫概念与编程学习之如何爬取网页源代码（一）

爬虫概念与编程学习之如何爬取网页源代码（一）

时间：2024-05-08 17:43:49

直接，去看一个网页的源代码，这个很简单!

1、新建maven项目

2、选择代码保存位置

3、选择quickstart

4、设置Group Id和Artifact Id

5、得到新建好的maven项目

pom.xml里需要自行添加(httpclient 4.4 、htmlcleaner 2.10 )

设置好pom.xml配置文件

最后的pom.xml文件为

<project xmlns="/POM/4.0.0" xmlns:xsi="/2001/XMLSchema-instance"

xsi:schemaLocation="/POM/4.0.0 /xsd/maven-4.0.0.xsd">

<groupId>zhouls.bigdata</groupId>

<artifactId>mySpider</artifactId>

<version>0.0.1-SNAPSHOT</version>

<name>mySpider</name>

<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>

</properties>

<groupId>junit</groupId>

<artifactId>junit</artifactId>

</dependency>

<groupId>org.apache.httpcomponents</groupId>

<artifactId>httpclient</artifactId>

</dependency>

<groupId>net.sourceforge.htmlcleaner</groupId>

<artifactId>htmlcleaner</artifactId>

</dependency>

</dependencies>

</project>

当然，这个配置文件，以后自行可以去修改。

新建包zhouls.bigdata.mySpider.util

编写代码

运行

<!DOCTYPE html><html><head><meta http-equiv="X-UA-Compatible" content="IE=Edge" /><meta http-equiv="Content-Type" content="text/html; charset=utf-8" /><meta name="keywords" content="微微一笑很倾城 - 高清全集在线观看" /><meta name="description" content="微微一笑很倾城,微微一笑很倾城在线观看,微微一笑很倾城全集,电视剧微微一笑很倾城"/><meta name="data-spm" content="a2h1n" /><title>《微微一笑很倾城》30集全—大陆—电视剧—优酷网，视频高清在线观看—又名：《A Smile Is Beautiful》《微微一笑很倾城电视剧版》</title><link rel="stylesheet" href="///youku/dist/css/find/g_72.css" /><link rel="stylesheet" href="///youku/dist/css/find/program/program_10.css" /></head><body data-spm="8261147"><script>

with(document)with(body)with(insertBefore(createElement("script"),firstChild))setAttribute("exparams","userid=&aplus&sidx=tlvQF3JPdlgAAAAAKEdPUx4Q/iSAyogM&ckx=listyoukucomshowidz9cd2277647d311e5b692html|",id="beacon-aplus",src="///alilog/mlog/aplus_o.js")

</script><script type="text/javascript"> (function(d) { var b = d.body;var c = b.className || '';var w = (d.documentElement || b).clientWidth;if( w <= 1330 && w > 1160 ){c += ' w1080 ';}else if (w <= 1160){ c += ' w860 ';}b.className = c;})(document);</script><script type="text/javascript">

// 去掉860的栅格 ipad

(function(d) {

var isMobile = !!((navigator.userAgent.toLowerCase().match(/android/i) || [''])[0]);

/*检查移动设备是否为移动设备*/

if (navigator.userAgent.indexOf('iPad') > -1 || isMobile) {

var m = d.createElement('meta');

m.setAttribute('name', 'viewport');

m.setAttribute('content', 'width=1210px');

d.head.appendChild(m);

d.body.className += ' w1080';

}else{

var b = d.body;

var c = b.className || '';

var w = (d.documentElement || b).clientWidth;

if( w <= 1330 ){

c += ' w1080 ';

}else {

c += ' w1300 ';

}

b.className = c;

}

})(document);

var ykQHeader = {

ltrim:function(s){ return s.replace( /^(\s*|*)/, "") },

rtrim:function(s){ return s.replace( /(\s*|*)$/, "") },

trim:function(s){ return this.ltrim(this.rtrim(s));},

doSearch: function () {

this.form = document.getElementById('qheader_search');

if(!this.form){ return; }

this.input = this.form.getElementsByTagName('input')[0];

var q = this.trim(this.input.value), url = '',

stat = 'spm=a2hww.20023042.#qheader_search~10';

if (window.logPvid) {

stat += '&_rp=' + window.logPvid;

}

if (q == '') {

url = '?inner' + ('&' + stat);

} else {

if (this.form.action.indexOf('/q_') === -1) {

q = encodeURIComponent(q);

url = this.form.action + '/q_' + q + ('?' + stat);

} else {

url = this.form.action + ('&' + stat);

}

window.open(url);

this.form.action = '/search_video';

return false;

}

</script>

</div>

<dl>

<dd>

</dd>

</dl>

<dl>

<dd>

<a href="/show/id_zd432f9ec588711e6b9bb.html" target="_blank">拜拜啦肉肉</a>

<a href="/show/id_ze4d19b7a424f11e6b32f.html" target="_blank">飞刀又见飞刀</a>

<a href="/show/id_zc275562c474811e6a080.html" target="_blank">火星情报局2</a>

</dd>

</dl>

<dl>

<dd>

</dd>

</dl>

<dl>

<dd>

<a href="///index/wireless" target="_blank">移动APP</a>

<a href="///pc" target="_blank">PC客户端</a>

<a href="/app/download" target="_blank">来疯App</a>

</dd>

</dl>

</div>

<li>

</li>

<li>

</li>

<li>

</li>

<li>

</li>

<li>

</li>

</ul>

</div>

</div>

</a>

</div>

</div>

</a>

</div>

</div>

</a>

</div>

</div>

<a href="///page/msg/index?retry=1" target="_blank" class="fr">查看所有消息</a>

</div>

</div>

<li>

<em></em> 上传视频

</a>

</li>

<li>

<em></em> 视频管理

</a>

</li>

<li>

<em></em> 我的自频道

</a>

</li>

<li>

<em></em> 数据分析

</a>

</li>

</ul>

<a href="///zpd" target="_blank" class="mr10">自频道加油站</a>

<a href="///red/click.php?tp=1&cp=4011030&cpp=1001005&url=/yc" target="_blank" >自频道认证</a>

</div>

下载PC客户端，上传视频更轻松！

</div>

<form id="qheader_search" action="/search_video" method="get" target="_blank" οnsubmit="

if(typeof(XBox) == 'object'){

return false;

}

else if(typeof(ykQHeader) == 'object'){

return ykQHeader.doSearch();

}

</div>

</form>

</div>

<div class="s-body"><div class="yk-content"><div class="mod mod-new"><div id="ab_101486" data-adid="101486" class="ad-flag-wrap"></div><div class="mod fix"><div class="p-post"><div class="yk-pack p-list"><div class="p-thumb"><a title="微微一笑很倾城" href="///v_show/id_XMTY5NDg2MzY5Ng==.html" target="_blank" ></a><i class="bg"></i><img src="/051600005768E31767BC3C120C01224D" alt="微微一笑很倾城" /><div class="p-thumb-taglt"><span class="ico-lt">独播</span></div><div class="p-thumb-tagrt"><span class="ico-SD">超清</span></div></div></div></div><div class="p-base"><ul><li class="p-row p-title"><a href="///category/show/c_97.html" target="_blank">剧集</a>：微微一笑很倾城<span class="sub-title"></span><a class="p-sub-btn p-sub-action" style="display: none;" href="javascript:void(0)">订阅</a></li><li class="p-row p-renew">30集全 </li><li class="p-alias" title="微微一笑很倾城电视剧版/A Smile Is Beautiful">别名：微微一笑很倾城电视剧版<i class="p-s">/</i>A Smile Is Beautiful</li><li ><span class="pub"><label>上映：</label>-12-21</span></li><li><span class="pub"><label>优酷开播：</label>-08-22</span></li><li class="p-score">评分： <span class="p-star p-star-50"></span><span class="star-num">9.9</span></li><li class="p-performer" title="杨洋/郑爽/毛晓彤">主演：<a href="///star/show/uid_UOTM2MjA=.html" target="_blank">杨洋</a><i class="p-s">/</i><a href="///star/show/uid_UNjkwODA=.html" target="_blank">郑爽</a><i class="p-s">/</i><a href="///star/show/uid_UMTU1NzAzNg==.html" target="_blank">毛晓彤</a></li><li >导演：<a href="///star/show/uid_UOTAxMDQ0.html" title="林玉芬" target="_blank">林玉芬</a></li><li>地区：<a href="///category/show/c_97_a_大陆.html" target="_blank">大陆</a></li><li>类型：<a target="_blank" href="///category/show/c_97_g_剧情.html">剧情</a><i class="p-s">/</i><a target="_blank" href="///category/show/c_97_g_都市.html">都市</a><i class="p-s">/</i><a target="_blank" href="///category/show/c_97_g_言情.html">言情</a></li><li>总播放数：16,951,241,809</li><li>评论：1,254,497</li><li>顶：13,741,333</li><li>指数：<a class="p-icon p-icon-vr" title="指数" href="///red/click.php?tp=1&cp=4005347&cpp=1000536&url=/vr_show/showid_z9cd2277647d311e5b692.html" target="_blank" id="vr_id"></a></li><li class="p-row p-intro"><span class="text">简介：美女学霸贝微微，立志成为游戏工程师，化名“芦苇微微”跻身网游高手，因拒绝上传真实照片而惨遭侠侣“真水无香”无情抛弃，却意外得到江湖第一高手“一笑奈何”的垂青。为了赢得“侠侣挑战赛”，贝微微欣然答应与“一笑奈何”结盟并组队参赛。两人一路闯荡江湖早已心灵相通，可贝微微做梦也没想到，一路出生入死的伙伴竟然就是同校风云人物——师兄...</span><span class="intro-more hide">简介：美女学霸贝微微，立志成为游戏工程师，化名“芦苇微微”跻身网游高手，因拒绝上传真实照片而惨遭侠侣“真水无香”无情抛弃，却意外得到江湖第一高手“一笑奈何”的垂青。为了赢得“侠侣挑战赛”，贝微微欣然答应与“一笑奈何”结盟并组队参赛。两人一路闯荡江湖早已心灵相通，可贝微微做梦也没想到，一路出生入死的伙伴竟然就是同校风云人物——师兄肖奈。无论线上还是线下，肖奈都是能力出众的“大神”，更巧的是，他竟然就是游戏开发测试的负责人。线上是侠侣队友，线下是工作伙伴，缘分就是这么妙不可言。当贝微微发现这一真相的时候，两人就自然而然地在一起了。 </span><span class="more-default" id="pIntroMore" style="display: inline;">查看详情</span></li></ul><div class="p-interact" id="pInteract"><ul><li class="p-share"><dl><dt><span class="share-title">分享给朋友：</span></dt><dd><a href="///wechatShare/?url=/v_show/id_XMTY5NDg2MzY5Ng==.html&content=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到微信"><i class="p-icon p-icon-weixin"></i></a></dd><dd><a href="http://sns./cgi-bin/qzshare/cgi_qzshare_onekey?url=///show/id_9cd2277647d311e5b692&pics=&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到Qzone"><i class="p-icon p-icon-qzone"></i></a></dd><dd><a href="http://v./share/share.php?url=///show/id_9cd2277647d311e5b692&sourceUrl=///show/id_9cd2277647d311e5b692&pic=&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&appkey=2684493555&content=utf8" target="_blank" title="分享到新浪微博"><i class="p-icon p-icon-weibo"></i></a></dd><dd><a href="/widget/shareqq/index.html?title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&url=///show/id_9cd2277647d311e5b692&desc=在优酷上看见这条视频还不错哦：%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&pics=&site=优酷" target="_blank" title="分享到QQ好友"><i class="p-icon p-icon-qq"></i></a></dd><dd id="pShareHandle"><a href="javascript:void(0)" data-panel="fn-panel-share"><i class="fn-icon fn-icon-handle"></i></a></dd></dl></li><li class="p-divide"></li><li class="p-collect " style="display: none;" ><a href="javascript:void(0)"><i class="p-icon p-icon-collect p-icon-w15"></i><span class="c999">收藏</span></a></li><li class="p-download"><a href="javascript:void(0)" data-panel="fn-panel-download"><i class="p-icon p-icon-download p-icon-w15"></i><span class="c999">下载</span></a></li><li class="p-phone-see "><a href="javascript:void(0)" data-panel="fn-panel-phone-see"><i class="p-icon p-icon-phone-see p-icon-w15"></i><span class="c999">手机看</span></a></li></ul><div class="fn-panels" id="fnPanels"><div class="fn-panel fn-panel-share" data-ref="fn-panel-share" style="display: none"><span class="pointer"><i class="fn-icon fn-icon-pointer"></i></span><div class="fn-panel-close" title="关闭"><i class="fn-icon fn-icon-close"></i></div><div class="p0"><ul><li><a href="///wechatShare/?url=/v_show/id_XMTY5NDg2MzY5Ng==.html&content=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到微信"><i class="fn-icon fn-icon-weixin"></i></a></li><li><a href="http://sns./cgi-bin/qzshare/cgi_qzshare_onekey?url=///show/id_9cd2277647d311e5b692&pics=&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到QQ空间"><i class="fn-icon fn-icon-qzone"></i></a></li><li><a href="http://v./share/share.php?url=///show/id_9cd2277647d311e5b692&sourceUrl=///show/id_9cd2277647d311e5b692&pic=&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&appkey=2684493555&content=utf8" target="_blank" title="分享到微博"><i class="fn-icon fn-icon-weibo"></i></a></li><li><a href="/widget/shareqq/index.html?title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&url=///show/id_9cd2277647d311e5b692&desc=在优酷上看见这条视频还不错哦：%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&pics=&site=优酷" target="_blank" title="分享给QQ好友"><i class="fn-icon fn-icon-qq"></i></a></li><li><a href="/f/commit/share/openShareApi?url=///show/id_9cd2277647d311e5b692&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&desc=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&pic=" target="_blank" title="分享到百度贴吧"><i class="fn-icon fn-icon-tieba"></i></a></li><li><a href="http://share.v./index.php?c=share&a=index&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C&url=///show/id_9cd2277647d311e5b692&appkey=e7ad0b0199994bda85ecc0a44ce9915f&site=&assname=youku&pic=" target="_blank" title="分享到腾讯微博"><i class="fn-icon fn-icon-qqweibo"></i></a></li><li><a href="/dialog/share?resourceUrl=///show/id_9cd2277647d311e5b692&pic=&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到人人网"><i class="fn-icon fn-icon-renren"></i></a></li><li><a href="/recommend/?url=///show/id_9cd2277647d311e5b692&title=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到豆瓣"><i class="fn-icon fn-icon-douban"></i></a></li><li><a href="///yixinShare/?url=///show/id_9cd2277647d311e5b692&content=%E7%BB%99%E5%A4%A7%E5%AE%B6%E5%88%86%E4%BA%AB%E3%80%8A%E5%BE%AE%E5%BE%AE%E4%B8%80%E7%AC%91%E5%BE%88%E5%80%BE%E5%9F%8E%E3%80%8B%2C%E8%AF%A6%E7%BB%86%E8%B5%84%E6%96%99%E5%9C%A8%E8%BF%99%E9%87%8C" target="_blank" title="分享到易信"><i class="fn-icon fn-icon-yixin"></i></a></li></ul></div><div class="p1"><h4>把视频贴到Blog或BBS  <a href="///help/view/fid/4#q2" target="_blank">怎么贴?</a></h4><div class="tipinfo"><span class="ps-label">推荐</span>通用代码可以让你的视频在iPhone、iPad上播放！</div><div class="item"><span class="label">通用代码: </span><input type="text" class="s-input" id="link2" value="<iframe height=498 width=510 src='/embed/XMTY5NDg2MzY5Ng==' frameborder=0 allowfullscreen></iframe>" /><span class="s-btn">复制</span></div><div class="item"><span class="label">html代码: </span><input type="text" class="s-input" id="link3" value="/player.php/sid/XMTY5NDg2MzY5Ng==/v.swf" /><span class="s-btn">复制</span></div><div class="item"><span class="label">flash地址: </span><input type="text" class="s-input" id="link4" value="<embed src='/player.php/sid/XMTY5NDg2MzY5Ng==/v.swf' allowFullScreen='true' quality='high' width='480' height='400' align='middle' allowScriptAccess='always' type='application/x-shockwave-flash'></embed>" /><span class="s-btn">复制</span></div><div class="share-item">分享视频到站外获取收益  <a href="/red/click.php?tp=1&cp=4010780&cpp=1000980&url=/services/info?serid=8" target="_blank">查看详情</a></div></div><div class="p2"><p>手机扫码分享视频</p><p>二维码2小时内有效</p><div class="two-code"><img id="share_qrcode_img" src="///qr?sc=video_play&ac=open&ps={"vid":"423715924","spot":0,"tp":1,"cp":4010708,"cpp":1000976}&size=135" alt="" /></div><div class="clear"></div></div></div><div class="fn-panel fn-panel-download" id="panel_down" style="display: none;"><span class="pointer"><i class="fn-icon fn-icon-pointer"></i></span><div class="fn-panel-close" title="关闭"><i class="fn-icon fn-icon-close"></i></div><div class="panel-con clearfix"><div class="column column-left"><p class="dl-title">下载至电脑</p><div class="download-app-wrap" id="panel_down_notice"><i class="download-app-pc"></i></div><div class="download-app-btns" id="panel_down_btns"><a id="fn_pc_download_all" class="download-app-btn-blue" href="javascript:;">下载全集</a></div></div><div class="column column-right"><div class="column-con"><p class="dl-title">扫码用手机看</p><div class="v-qrcode" id="dimcode_pic"><i class="ico_play_dimcode"></i><img id="phone-qrcode-img" src="///qr?sc=video_play&ac=open&ps={"vid":"XMTY5NDg2MzY5Ng==","spot":0,"tp":1,"cp":4010708,"cpp":1000976}&size=135" alt="" /></div><p class="dl-ps">用<a href="///index/wireless" target="_blank">优酷APP</a>或微信扫码在手机上继续观看</p><p class="dl-ps">二维码2小时内有效</p></div></div></div></div><div class="fn-panel fn-panel-phone-see" data-ref="fn-panel-phone-see" style="display: none"><span class="pointer"><i class="fn-icon fn-icon-pointer"></i></span><div class="fn-panel-close" title="关闭"><i class="fn-icon fn-icon-close"></i></div><div class="column column-left"><div class="column-con"><p class="ps-title">扫码用手机继续看</p><div class="ps-twocode"><img id="phone_qrcode_img" src="///qr?sc=video_play&ac=open&ps={"vid":"XMTY5NDg2MzY5Ng==","spot":0,"tp":1,"cp":4010708,"cpp":1000976}&size=135" alt="" /></div><p class="ps-ps">用<a href="///index/wireless" target="_blank">优酷APP</a>或微信扫码在手机上继续观看</p><p class="ps-ps">二维码2小时内有效，扫码后可分享给好友</p></div></div><div class="column column-right"><div class="column-con"><p class="ps-title">没有优酷APP？立即下载</p><div class="ps-down-app"><span class="ico"><i class="fn-icon fn-icon-iphone"></i></span><a href="/cn/app/id336141475">iPhone客户端</a></div><div class="ps-down-app"><span class="ico"><i class="fn-icon fn-icon-ipad"></i></span><a href="/cn/app/id394075284">iPad客户端</a></div><div class="ps-down-app ps-orange"><span class="ico"><i class="fn-icon fn-icon-android"></i></span><a href="//./android/phone/Youku_Android_Pcyongshoujikan.apk">Android客户端</a></div><p class="ps-ps">请根据您的设备选择下载版本</p></div></div></div></div></div><div class="p-play"><a href="///v_show/id_XMTY5NDg2MzY5Ng==.html" class="p-btn" target="_blank">立即播放</a></div></div></div></div><div class="mod-area-left"><div class="mod-new fix"><div class="h"><ul class="t_tab p-tab"><li class=""><a data-id="showInfo" class="content" href="javascript:void(0)">剧集列表</a></li><li class=""><a data-id="point" class="content" href="javascript:void(0)">分集剧情</a></li><li class=""><a data-id="around_2" class="content" href="javascript:void(0)">预告片</a></li><li class=""><a data-id="around_3" class="content" href="javascript:void(0)">花絮</a></li><li class=""><a data-id="around_4" class="content" href="javascript:void(0)">饭制</a></li><li class=""><a data-id="around_6" class="content" href="javascript:void(0)">MV</a></li><li class=""><a data-id="around_7" class="content" href="javascript:void(0)">独家</a></li><li class=""><a data-id="doubanComment" class="content" href="javascript:void(0)">豆瓣</a></li></ul></div><div class="c"><div class="tab-c" id="showInfo" ></div><div class="tab-c" id="point" ></div><div class="tab-c" id="around_2" ></div><div class="tab-c" id="around_3" ></div><div class="tab-c" id="around_4" ></div><div class="tab-c" id="around_6" ></div><div class="tab-c" id="around_7" ></div><div class="tab-c" id="doubanComment" ></div></div></div></div><div class="mod-area-right"><div class="mod-new mod-p-actor fix"><div class="p-h">演职员表</div><ul class="p-thumb-small fix"><li><dl><dt><a href="///star/show/uid_UOTM2MjA=.html" target="_blank"><img src="/05140000584A1D0367BC3C33220D92B5" alt="杨洋" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UOTM2MjA=.html" title="杨洋" target="_blank">杨洋</a></dd><dd class="c999">肖奈</dd></dl></li><li><dl><dt><a href="///star/show/uid_UNjkwODA=.html" target="_blank"><img src="/0514000058537A8867BC3C40FA0DA6E3" alt="郑爽" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UNjkwODA=.html" title="郑爽" target="_blank">郑爽</a></dd><dd class="c999">贝微微</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMTU1NzAzNg==.html" target="_blank"><img src="/0514000058468ADF67BC3C57E10D3003" alt="毛晓彤" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMTU1NzAzNg==.html" title="毛晓彤" target="_blank">毛晓彤</a></dd><dd class="c999">二喜</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ1OTkyOA==.html" target="_blank"><img src="/0514000057830FFD67BC3C5E0203A09A" alt="白宇" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ1OTkyOA==.html" title="白宇" target="_blank">白宇</a></dd><dd class="c999">曹光</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ1Mzc4NA==.html" target="_blank"><img src="/051400005783108767BC3C632706998F" alt="秦语" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ1Mzc4NA==.html" title="秦语" target="_blank">秦语</a></dd><dd class="c999">晓玲</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU1MTI2NA==.html" target="_blank"><img src="/05140000576B8F6367BC3C116105D5F0" alt="宋欣佳怡" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU1MTI2NA==.html" title="宋欣佳怡" target="_blank">宋欣佳怡</a></dd><dd class="c999">丝丝</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU0OTc0NA==.html" target="_blank"><img src="/051400005783116B67BC3C0E8D09D1EF" alt="马春瑞" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU0OTc0NA==.html" title="马春瑞" target="_blank">马春瑞</a></dd><dd class="c999">孟逸然</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzM0MTk2NA==.html" target="_blank"><img src="/0514000054373F1567379F654F0D3564" alt="郑业成" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzM0MTk2NA==.html" title="郑业成" target="_blank">郑业成</a></dd><dd class="c999">郝眉</dd></dl></li></ul><ul class="p-thumb-small hide fix" id="hideThumb" style="display: none;"><li><dl><dt><a href="///star/show/uid_UOTE2ODg=.html" target="_blank"><img src="/05140000578311F367BC3C605801C581" alt="牛骏峰" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UOTE2ODg=.html" title="牛骏峰" target="_blank">牛骏峰</a></dd><dd class="c999">于半珊</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMTY1MjQzNg==.html" target="_blank"><img src="/05140000578312D267BC3C635D0EB9B7" alt="崔航" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMTY1MjQzNg==.html" title="崔航" target="_blank">崔航</a></dd><dd class="c999">丘永侯</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ5ODg0MA==.html" target="_blank"><img src="/051400005783135567BC3C0EEF043A9B" alt="刘颖伦" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ5ODg0MA==.html" title="刘颖伦" target="_blank">刘颖伦</a></dd><dd class="c999">雨瑶</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMjkwOTk3Mg==.html" target="_blank"><img src="/05140000578313B967BC3C62E7016806" alt="张赫" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMjkwOTk3Mg==.html" title="张赫" target="_blank">张赫</a></dd><dd class="c999">甄少祥</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ4Njc4OA==.html" target="_blank"><img src="/051400005783149667BC3C64460E9E18" alt="陆妍淇" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ4Njc4OA==.html" title="陆妍淇" target="_blank">陆妍淇</a></dd><dd class="c999">雷神妮妮</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU1MTI2OA==.html" target="_blank"><img src="/05140000576B901067BC3C4D9B0EB2FE" alt="刘钰瑾" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU1MTI2OA==.html" title="刘钰瑾" target="_blank">刘钰瑾</a></dd><dd class="c999">蝶梦未醒</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ2MTg3Mg==.html" target="_blank"><img src="/0514000054C7172867379F72FC023B63" alt="周宸佳" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ2MTg3Mg==.html" title="周宸佳" target="_blank">周宸佳</a></dd><dd class="c999">安娜</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ1NjE4NA==.html" target="_blank"><img src="/0514000054F81EC767379F2A6F02F979" alt="章涛" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ1NjE4NA==.html" title="章涛" target="_blank">章涛</a></dd><dd class="c999">战天下</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTcyMA==.html" target="_blank"><img src="/0514000057CCCC2A67BC3C1584057DA9" alt="胡浩博" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTcyMA==.html" title="胡浩博" target="_blank">胡浩博</a></dd><dd class="c999">阿爽</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzUwOTk4MA==.html" target="_blank"><img src="/05140000565BE81D67BC3C2C1A0CA581" alt="小小白" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzUwOTk4MA==.html" title="小小白" target="_blank">小小白</a></dd><dd class="c999">阿力</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ0Nzc4NA==.html" target="_blank"><img src="/0514000056CEBA1167BC3C2987072A61" alt="蔡纲" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ0Nzc4NA==.html" title="蔡纲" target="_blank">蔡纲</a></dd><dd class="c999">肖父</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU1NzQ0NA==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="顾凯丽" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU1NzQ0NA==.html" title="顾凯丽" target="_blank">顾凯丽</a></dd><dd class="c999">肖母</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMTYxODUzMg==.html" target="_blank"><img src="/0514000050C1AE939792734CC00175B3" alt="傅隽" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMTYxODUzMg==.html" title="傅隽" target="_blank">傅隽</a></dd><dd class="c999">贝爸</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTcyNA==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="杨曼琴" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTcyNA==.html" title="杨曼琴" target="_blank">杨曼琴</a></dd><dd class="c999">贝妈</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU0NTg5Mg==.html" target="_blank"><img src="/05140000574BAFC967BC3C24D904AE38" alt="杨雪莹" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU0NTg5Mg==.html" title="杨雪莹" target="_blank">杨雪莹</a></dd><dd class="c999">小雨青青</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTcyOA==.html" target="_blank"><img src="/0514000057BBA66367BC3C16B80643CA" alt="宋雨晴" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTcyOA==.html" title="宋雨晴" target="_blank">宋雨晴</a></dd><dd class="c999">小雨霏霏</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU0MTU0MA==.html" target="_blank"><img src="/0514000057DF51E067BC3C04050868A2" alt="刘倩妤" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU0MTU0MA==.html" title="刘倩妤" target="_blank">刘倩妤</a></dd><dd class="c999">小雨绵绵</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzM0MzEzMg==.html" target="_blank"><img src="/0514000057DF5A8567BC3C45290211D0" alt="张彬彬" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzM0MzEzMg==.html" title="张彬彬" target="_blank">张彬彬</a></dd><dd class="c999">Ko</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMTU5NzA1Ng==.html" target="_blank"><img src="/05140000583BDC7F67BC3C513C0B3E12" alt="黄柏钧" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMTU5NzA1Ng==.html" title="黄柏钧" target="_blank">黄柏钧</a></dd><dd class="c999">封总</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTczMg==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="程弘" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTczMg==.html" title="程弘" target="_blank">程弘</a></dd><dd class="c999">甄总</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzI5ODczNg==.html" target="_blank"><img src="/051400005728450467BC3C4E9500F4D1" alt="冷海铭" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzI5ODczNg==.html" title="冷海铭" target="_blank">冷海铭</a></dd><dd class="c999">李总</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU0ODk5Mg==.html" target="_blank"><img src="/0514000057BBA72D67BC3C293D00ADFE" alt="刘顾浩" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU0ODk5Mg==.html" title="刘顾浩" target="_blank">刘顾浩</a></dd><dd class="c999">王总</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMTU1NjE4NA==.html" target="_blank"><img src="/05140000548519F467379F6EC106A76C" alt="杨雨橙" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMTU1NjE4NA==.html" title="杨雨橙" target="_blank">杨雨橙</a></dd><dd class="c999">肖舅舅</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTczNg==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="边城" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTczNg==.html" title="边城" target="_blank">边城</a></dd><dd class="c999">小阳</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTc0MA==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="刘杭丽" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTc0MA==.html" title="刘杭丽" target="_blank">刘杭丽</a></dd><dd class="c999">人事</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTc0NA==.html" target="_blank"><img src="/0514000057BBA83867BC3C293A091137" alt="李欣泽" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTc0NA==.html" title="李欣泽" target="_blank">李欣泽</a></dd><dd class="c999">阿彩</dd></dl></li><li><dl><dt><a href="///star/show/uid_UOTAxMDQ0.html" target="_blank"><img src="/05140000558B95B667BC3C5D6D046ED5" alt="林玉芬" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UOTAxMDQ0.html" title="林玉芬" target="_blank">林玉芬</a></dd><dd class="c999">导演</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQxNjY4NA==.html" target="_blank"><img src="/0514000055655D4067BC3C7DCD008A66" alt="顾漫" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQxNjY4NA==.html" title="顾漫" target="_blank">顾漫</a></dd><dd class="c999">编剧</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzQ2MDUyOA==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="沈飞弦" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzQ2MDUyOA==.html" title="沈飞弦" target="_blank">沈飞弦</a></dd><dd class="c999">编剧</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTcxMg==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="欧阳晓鋆" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTcxMg==.html" title="欧阳晓鋆" target="_blank">欧阳晓鋆</a></dd><dd class="c999">编剧</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzU2NTcxNg==.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="杨文婷" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzU2NTcxNg==.html" title="杨文婷" target="_blank">杨文婷</a></dd><dd class="c999">编剧</dd></dl></li><li><dl><dt><a href="///star/show/uid_UODYwMDky.html" target="_blank"><img src="///051000005847AA8567BC3D0D7605442E" alt="王建军" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UODYwMDky.html" title="王建军" target="_blank">王建军</a></dd><dd class="c999">监制</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzIwODcxMg==.html" target="_blank"><img src="/051400005632DF6367BC3C483D0B0CB5" alt="卜宇" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzIwODcxMg==.html" title="卜宇" target="_blank">卜宇</a></dd><dd class="c999">监制</dd></dl></li><li><dl><dt><a href="///star/show/uid_UMzI4Nzk4MA==.html" target="_blank"><img src="/051400005729696467BC3C0D320497EF" alt="杨伟东" /></a></dt><dd><a class="c555 f13" href="///star/show/uid_UMzI4Nzk4MA==.html" title="杨伟东" target="_blank">杨伟东</a></dd><dd class="c999">监制</dd></dl></li></ul><div class="p-more-actor"><span class="more-default" id="moreActor">更多演员</span></div></div><div class="mod-new p-tvc-ad"><div id="ab_855" data-adid="855"></div><span class="ad-flag hide" style="display: none;"></span></div><div class="mod-new p-tvc-ad"><div class="AD_banner" id="AD_banner"></div></div><div class="mod-new mod-p-related" id="relation"></div><div class="mod-new p-dl-ad"><div id="ab_856" data-adid="856"></div><span class="ad-flag hide" ></span></div></div></div></div><div class="g-footer">

<dt>

<a target="_blank" href="///aboutcn/youtu">大优酷事业群</a>

</dt>

<dd>

<a target="_blank" href="///abouteg/youtu">Youku Tudou Inc.</a>

</dd>

<dd>

</dd>

</dl>

<dt>

优酷热门

</dt>

<dd>

</dd>

<dd>

</dd>

<dd>

</dd>

</dl>

<dd>

<a href="javascript:void(0);" class="ikuDownLoad" data-down-href="/channelinstall/ywebbottom" data-down-mac="/channelinstall/macyweb">PC客户端</a>

<a target="_blank" href="///ido">优酷iDo</a>

</dd>

<dd>

<a target="_blank" href="///index/wireless">手机客户端</a>

</dd>

<dd>

</dd>

</dl>

<dd>

<a target="_blank" href="///zpd">自频道加油站</a>

<a target="_blank" href="///red/click.php?tp=1&cp=4011029&cpp=1001005&url=/yc">自频道认证</a>

</dd>

<dd>

</dd>

</dl>

<dd><a target="_blank" href="///service/licence/">网络文化经营许可证京网文[]0934-236号</a></dd>

<dd> 药品服务许可证(京)-经营--0029</dd>

<dd>

节目制作经营许可证京字670号

</dd>

</dl>

<dd>请使用者仔细阅读优酷<a target="_blank" href="///service/agreement" class="mr0">使用协议</a>、<a target="_blank" href="///service/banquan" class="mr0">版权声明</a>、<a target="_blank" href="///service/piracy" class="mr0">反盗版盗链声明</a></dd>

<dd>不良信息举报电话: 4008100580</dd>

<dd><a target="_blank" href="///service/0108283">信息网络传播视听节目许可证0108283号</a></dd>

</dl>

<dd><a target="_blank" href="http://www./">京ICP证060288号</a></dd>

<dd><a target="_blank" href="/">北京互联网举报中心</a></dd>

<dd><a target="_blank" href="http://www./accuse.do">北京12318文化市场举报热线</a></dd>

</dl>

</dl>

<a class="aut-1" target="_blank" href="http://www./beian/view.asp?bianhao=0102400023">经营性网站<br/>备案信息</a>

<a class="aut-2" target="_blank" href=".cn/yz/pjwx.asp?wm=1786197705">中国互联网<br/>诚信联盟</a>

<a class="aut-3" target="_blank" href="/">中国互联网<br/>举报中心</a>

<a class="aut-4" target="_blank" href="/node_548446.htm">网络举报<br/>APP下载</a>

<a class="aut-5" target="_blank" href="http://www./portal/registerSystemInfo?recordcode=11000002000017">京公网安备<br/>11000002000017</a>

<a class="aut-7" target="_blank" href="/">暴恐音视频<br/>举报专区</a>

</div>

新建页面下载工具类PageDownLoadUtil

附上代码：

package zhouls.bigdata.mySpider.util;

import java.io.IOException;

import org.apache.http.HttpEntity;

import org.apache.http.client.ClientProtocolException;

import org.apache.http.client.methods.CloseableHttpResponse;

import org.apache.http.client.methods.HttpGet;

import org.apache.http.impl.client.CloseableHttpClient;

import org.apache.http.impl.client.HttpClientBuilder;

import org.apache.http.impl.client.HttpClients;

import org.apache.http.util.EntityUtils;

/**

* @author zhouls

* created by /1/11

public class PageDownLoadUtil {

public static String getPageContent(String url){

HttpClientBuilder builder = HttpClients.custom(); //这是使用HttpClient来构造登录信息，好的博客，见/a/1190000003013451

CloseableHttpClient client = builder.build();

HttpGet request = new HttpGet(url);//创建一个get请求

String content = null;

try {

CloseableHttpResponse response = client.execute(request);

HttpEntity entity = response.getEntity();//获取HttpGet

content = EntityUtils.toString(entity,"utf-8");//将HttpGet转换成string

} catch (ClientProtocolException e) {

// TODO Auto-generated catch block

e.printStackTrace();

} catch (IOException e) {

// TODO Auto-generated catch block

e.printStackTrace();

}

return content;//这个值，就是我们需要的页面内容

}

public static void main(String[] args) {

String url = "/show/id_z9cd2277647d311e5b692.html?spm=a2h0j.8191423.sMain.5~5~A!2.iCUyO9";

String content = PageDownLoadUtil.getPageContent(url);

System.out.println(content);

}

成功，爬取到网页的源代码！

本文转自大数据躺过的坑博客园博客，原文链接：/zlslch/p/6275662.html，如需转载请自行联系原作者

本内容不代表本网观点和政治立场，如有侵犯你的权益请联系我们处理。

网友评论

网友评论仅供其表达个人看法，并不表明网站立场。