Text processing/2: Difference between revisions

{{task|Text processing}}

 

 

The fields (from the left) are:

DATESTAMP [ VALUEn FLAGn ] * 24

1991-03-30 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1

1991-03-31 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 10.000 1 20.000 1 20.000 1 20.000 1 35.000 1 50.000 1 60.000 1 40.000 1 30.000 1 30.000 1 30.000 1 25.000 1 20.000 1 20.000 1 20.000 1 20.000 1 20.000 1 35.000 1

</pre>

 

 

=={{header|Ada}}==

{{libheader|Simple components for Ada}}

with Ada.Text_IO; use Ada.Text_IO;

with Strings_Edit; use Strings_Edit;

Close (File);

Put_Line ("Valid records " & Image (Count) & " of " & Image (Line_No) & " total");

Sample output

<pre>

1995-3-26: record at 1911 duplicates record at 1910

Valid records 5017 of 5471 total

</pre>

 

 

If their are any scientific notation fields then their will be an e in the file:

Quick check on the number of fields:

Full check on the file format using a regular expression:

Full check on the file format as above but using regular expressions allowing intervals (gnu awk):

 

 

 

Accomplished by counting how many times the first field occurs and noting any second occurrences.

1990-03-25

1991-03-31

1993-03-28

1995-03-26

 

 

'''What number of records have good readings for all instruments.'''

 

Total records 5471 OK records 5017 or 91.7017 %

 

=={{header|OCaml}}==

open Str

 

let strip_cr str =

 

let map_records =

let e = (float_of_string value, int_of_string flag) in

aux (e::acc) tail

in

aux [] ;;

aux acc tl

| [] ->

in

aux [] ;;

 

let record_ok (_,record) =

let sum_ok =

List.fold_left (fun sum this ->

if is_ok this then succ sum else sum) 0 record

in

 

let num_good_records =

let li = split (regexp "[ \t]+") line in

let records = map_records (List.tl li)

(date, records)

 

let ic = open_in "readings.txt" in

let rec read_loop acc =

in

let inputs = read_loop [] in

 

Printf.printf "number of good records: %d\n" (num_good_records inputs);

 

this script outputs:

 

=={{header|Perl}}==

use constant FIELDS => 49;

 

map {" $_\n"}

grep {$dates{$_} > 1}

 

Output:

1993-03-28

1995-03-26</pre>

 

=={{header|Python}}==

import zipfile

import StringIO

#readings = StringIO.StringIO(zfs.read('readings.txt'))

readings = open('readings.txt','r')

The results indicate 5013 good records, which differs from the Awk implementation. The final few lines of the output are as follows

<pre style="height:10ex;overflow:scroll">

* Generate mostly summary information that is easier to compare to other solutions.

 

import zipfile

import StringIO

readings = open('readings.txt','r')

<pre>bash$ /cygdrive/c/Python26/python munge2.py

Duplicate dates:

bash$ </pre>

 

<pre>$ tclsh munge2.tcl

Duplicate datestamp: 1990-03-25

5017 records with good readings = 91.7016998721%

Total records: 5471

</pre>

 

* Reads flag value and checks if it is positive

* Requires 24 value/flag pairs on each line

File_Open("|(PATH_ONLY)\output.txt")

#51 = Buf_Num // Edit buffer for output file

IT("Date format errors: ") Num_Ins(#14)

IT("Invalid data records:") Num_Ins(#15)

Sample output:

1991-03-31: duplicate record at 456

1992-03-29: duplicate record at 820

Date format errors: 0

Invalid data records: 454

</pre>