Web scraping: Difference between revisions

=={{header|AutoHotkey}}==

<lang AutoHotkey>UrlDownloadToFile, http://tycho.usno.navy.mil/cgi-bin/timer.pl, time.html

FileRead, timefile, time.html

pos := InStr(timefile, "UTC")

msgbox % time := SubStr(timefile, pos - 9, 8)</lang>

=={{header|AWK}}==

This is inspired by [http://www.gnu.org/software/gawk/manual/gawkinet/html_node/GETURL.html#GETURL GETURL] example in the manual for gawk.

<tt><lang awk>#! /usr/bin/awk -f

BEGIN {

purl = "/inet/tcp/0/tycho.usno.navy.mil/80"

ORS = RS = "\r\n\r\n"

print "GET /cgi-bin/timer.pl HTTP/1.0" |& purl

purl |& getline header

while ( (purl |& getline ) > 0 )

{

split($0, a, "\n")

for(i=1; i <= length(a); i++)

{

if ( a[i] ~ /UTC/ )

{

sub(/^<BR>/, "", a[i])

printf "%s\n", a[i]

}

}

}

close(purl)

}</lang></tt>

=={{header|C sharp|C#}}==

<lang csharp>class Program

{

static void Main(string[] args)

{

WebClient wc = new WebClient();

Stream myStream = wc.OpenRead("http://tycho.usno.navy.mil/cgi-bin/timer.pl");

string html = "";

using (StreamReader sr = new StreamReader(myStream))

{

while (sr.Peek() >= 0)

{

html = sr.ReadLine();

if (html.Contains("UTC"))

{

break;

}

}

}

Console.WriteLine(html.Remove(0, 4));

Console.ReadLine();

}

}

</lang>

=={{header|Microsoft Small Basic}}==

<lang vb>

'Entered by AykayayCiti -- Earl L. Montgomery

url_name = "http://tycho.usno.navy.mil/cgi-bin/timer.pl"

url_data = Network.GetWebPageContents(url_name)

find = "UTC"

' the length from the UTC to the time is -18 so we need

' to subtract from the UTC position

pos = Text.GetIndexOf(url_data,find)-18

result = Text.GetSubText(url_data,pos,(18+3)) 'plus 3 to add the UTC

TextWindow.WriteLine(result)

'you can eleminate a line of code by putting the

' GetIndexOf insde the GetSubText

'result2 = Text.GetSubText(url_data,Text.GetIndexOf(url_data,find)-18,(18+3))

'TextWindow.WriteLine(result2)</lang>

{{out}}

<pre>

Mar. 19, 04:19:34 UTC

Press any key to continue...

</pre>

=={{header|Perl 6}}==

<lang perl6>use HTTP::Client; # https://github.com/supernovus/perl6-http-client/

my $site = "http://tycho.usno.navy.mil/cgi-bin/timer.pl";

HTTP::Client.new.get($site).content.match(/'<BR>'( .+? <ws> UTC )/)[0].say</lang>

Note that the string between '<' and '>' refers to regex tokens, so to match a literal '&lt;BR&gt;' you need to quote it, while <ws> refers to the built-in token whitespace.

Also, whitespace is ignored by default in Perl&nbsp;6 regexes.

=={{header|Run BASIC}}==

<lang runbasic>print word$(word$(httpget$("http://tycho.usno.navy.mil/cgi-bin/timer.pl"),1,"UTC"),2,"<BR>")</lang>

{{out}}

<pre>May. 09, 16:13:44</pre>

=={{header|ToffeeScript}}==

<lang coffeescript>e, page = require('request').get! 'http://tycho.usno.navy.mil/cgi-bin/timer.pl'

l = line for line in page.body.split('\n') when line.indexOf('UTC')>0

console.log l.substr(4,l.length-20)</lang>