.NET2.0抓取网页全部链接

1 / 1 页

跳转页

查看:517

本主题由校长 aspx1 于 2008-4-15 6:29:33 执行设置精华/取消操作

个人空间 相册
组别:教导处主任
性别:
来自:
积分:307
帖子:200
注册: 2008-03-28

2008-04-14 21:28 | 只看楼主

树型| 收藏| 小中大 1

.NET2.0抓取网页全部链接

效果图

后台代码

using System;
using System.Data;
using System.Configuration;
using System.Web;
using System.Web.Security;
using System.Web.UI;
using System.Web.UI.WebControls;
using System.Web.UI.WebControls.WebParts;
using System.Web.UI.HtmlControls;
using System.Text.RegularExpressions;
using System.Net;
using System.IO;
using System.Collections;
public partial class _Default : System.Web.UI.Page
{
protected void Page_Load(object sender, EventArgs e)
{
if (!IsPostBack)
{

}

}

protected void Button1_Click(object sender, EventArgs e)
{
TextBox2.Text = "";
string web_url = this.TextBox1.Text;//"http://blog.csdn.net/21aspnet/"
string all_code = "";
HttpWebRequest all_codeRequest = (HttpWebRequest)WebRequest.Create(web_url);
WebResponse all_codeResponse = all_codeRequest.GetResponse();
StreamReader the_Reader = new StreamReader(all_codeResponse.GetResponseStream());
all_code = the_Reader.ReadToEnd();
the_Reader.Close();
ArrayList my_list = new ArrayList();
string p = @"http://([\w-]+\.)+[\w-]+(/[\w- ./?%&=]*)?";
Regex re = new Regex(p, RegexOptions.IgnoreCase);
MatchCollection mc = re.Matches(all_code);

for (int i = 0; i <= mc.Count - 1; i++)
{
bool _foo = false;
string name = mc.ToString();
foreach (string list in my_list)
{
if (name == list)
{
_foo = true;
break;
}

}//过滤
if (!_foo)
{
TextBox2.Text += name + "\n";
}
}
}
}

前台

<%@ Page Language="C#" AutoEventWireup="true" CodeFile="Default.aspx.cs" Inherits="_Default" %> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" >
<head runat="server">
<title>抓取网页所有链接</title>

</head>
<body >
<form id="form1" runat="server">
<div>
<asp:TextBox ID="TextBox1" runat="server" Width="481px"></asp:TextBox>
<asp:Button ID="Button1" runat="server" Text="提取" />
<br />
<asp:TextBox ID="TextBox2" runat="server" Height="304px" TextMode="MultiLine" Width="524px"></asp:TextBox></div>
</form>
</body>
</html>

、哭┈゛.並不代表Ｗｏ屈服х. 退一步...並不象徵Ｗｏ認輸..→.放手.ǐ.o.並不表示Ｗｏ放棄.正如Ｗｏ微笑.並不意味Ｗｏ快樂┈┊

sunnly 个人空间相册组别:小学生性别: 来自: 积分:22 帖子:16 注册: 2008-04-10	2008-04-27 18:14 \| 树型\| 收藏\| 小中大 2 回复：.NET2.0抓取网页全部链接我怎么试了一下,不行呢?

sunnly 个人空间相册组别:小学生性别: 来自: 积分:22 帖子:16 注册: 2008-04-10	2008-04-27 18:28 \| 树型\| 收藏\| 小中大 3 回复：.NET2.0抓取网页全部链接我运行出来全是 System.Text.RegularExpressions.MatchCollection

<<上一主题|下一主题>>

1 / 1 页

跳转页

ASP.NET学习社区ASP.NET学习区ASP.NET文摘 .NET2.0抓取网页全部链接

.NET2.0抓取网页全部链接

.NET2.0抓取网页全部链接

回复：.NET2.0抓取网页全部链接

回复：.NET2.0抓取网页全部链接

ASP.NET学习社区ASP.NET学习区 ASP.NET文摘 .NET2.0抓取网页全部链接