v / examples / web_crawler
0 issues 1 contributor 4 branches 0 releases
Clone with HTTPS:

About

README
  V 99.7% 272k loc
  JavaScript 0.1% 344 loc
  C 0% 63 loc
  C++ 0% 95 loc
  Go 0% 63 loc
52 years ago
..

web_crawler

web_crawler is a very simple web crawler.
This web crawler fetches news from tuicool.com, (a chinese site similar to hacker-news.firebaseio.com).

Compile and Run

Use this to generate an executable, and then launch the web crawler:

v web_crawler.v
./web_crawler

And this to compile and launch the web crawler directly:

v run web_crawler.v

This project shows how to use http.fetch() to get http.Response, and then html.parse() to parse the returned html.

It's easy, isn't it?