User:Thundergnat

From Rosetta Code
Revision as of 21:10, 20 February 2022 by Thundergnat (talk | contribs) (→‎Language Stats:: Update stats)
My Favorite Languages
Language Proficiency
Perl Moderately Proficient
Perl 6 Still seems like I use it all the time
Raku Use it all the time

License:

Any code which I have submitted to Rosettacode may be used under the Unlicense.

I would appreciate that any use includes a link back to the Rosettacode page from which it was obtained (but obviously would have no way to enforce that.)


Reports:


Utilities:

Tampermonkey or Greasemonkey javascript applets


Resources:


Language Stats:

As part of my reports I generate weekly (listed above) I have started to collect some statistics on languages that have a large number of entries. (For now, the cut off is 1000.) A sufficiently large number of entries should average out outliers and give at least an reasonable overview of how different languages stack up.

Note that this is purely for my own entertainment and curiosity. I strenuously want to avoid people making efforts to optimize for one metric or another. Many of these are heavily influenced by a particular stylistic choice made by a prolific entry author. None of these are good or bad. Just observations.

Comments aren't filtered out, so entries that have lots of comments will have higher character counts. That isn't a bad thing though. Quite the opposite in fact. The whole point of Rosettacode is to learn how different languages can accomplish the same task. Lots of comments is a good thing.

How the various metrics are calculated / what they mean. Averages are the sum of all of that item in every entry divided by the total number of tasks with an entry, rounded to the nearest integer or percentage.

  • Task count - The number of tasks for which there is an entry in that language.
  • Average lines per entry - The average number of lines in code blocks per entry. Multiple versions under the same task all count as lines per task. (If there are four versions and each has 25 lines, it counts as 100 for that task.)
  • Average number of character - Average number of characters inside <lang *></lang> blocks per task including whitespace.
  • Average whitespace - How many of the above characters are white space? (Including new line characters.)
  • Average percent alpha-numerics - What percentage of the non-white space characters are alphabetic or numeric?
  • Average percent non-alpha-numerics - What percentage of the non-white space characters are not alphabetic or numeric? (Punctuation, symbols, etc)
  • Average percent non-ASCII - What percentage of the non-white space characters are not ASCII characters?
  • Syntax highlighting - What syntax highlighter does it use in order from most to least common. (Note that some variation is expected, especially for tasks like Call a foreign-language function, Rosetta Code/Find bare lang tags or probably the largest source of oddball <lang *> tags: Rosetta Code/Fix_code_tags.)
As of 2022-02-20
Language Task
Count
Avg. #
Lines / Entry
Avg. #
Characters
Avg. %
White space
Avg. %
Alphanumerics
Avg. %Non
Alphanumerics
Avg. %
Non-ASCII
Syntax
highlighting
Phix 1512 53 1705 32.74 % 78.37 % 21.63 % 0.03 % Phix html5 phix r javascript csharp c
Wren 1505 55 1577 31.58 % 75.73 % 24.27 % 0.1 % ecmascript c go javascript C foo python bash bar baz xml
Julia 1483 33 975 27.82 % 77.1 % 22.9 % 0.27 % julia Julia python html5 ruby cpp html xml lua
Raku 1466 30 883 28.86 % 69.31 % 30.69 % 0.57 % perl6 c C XML shell bash html xml
Go 1459 77 1818 34.43 % 75.27 % 24.73 % 0.11 % go Go html xml c bash thrift proto html5
Perl 1433 34 918 27.03 % 68.18 % 31.82 % 0.1 % perl Perl bash Shell html5 c latex
Nim 1398 48 1326 24.65 % 75.52 % 24.48 % 1.12 % Nim nim python Python ruby C c $1 Nimrod xml
Python 1348 71 1992 30.72 % 75.46 % 24.54 % 0.04 % python Python html5 bash c cmd ebnf Shell xml pythong python3
C 1197 78 1837 28.65 % 72.55 % 27.45 % 0.01 % c C cpp bash XML Shell sh d html5 go Assembly make perl
REXX 1144 55 3358 40.33 % 68.44 % 31.56 % 8.48 % rexx REXX Rexx cobol sh
Kotlin 1131 47 1363 33.21 % 77.62 % 22.38 % 0.04 % scala kotlin Kotlin C c scheme xml HTML5 java Groovy groovy html5
Java 1124 66 2062 33.41 % 78.56 % 21.44 % 0.01 % java java5 Java Java5 c bash xml html5 foo make bar shell java 12 Java8 cmd
J 1120 27 747 26.79 % 69.56 % 30.44 % 6.37 % j J bash sh foo %s c bnf html5 baz SNUSP xml make bar C
Haskell 1112 44 1346 28.33 % 76.91 % 23.09 % 0.08 % haskell Haskell bash html5 sh text c
Mathematica 1106 11 409 17.52 % 70.72 % 29.28 % 0.04 % Mathematica mathematica foo barf "~~ x~~" baz sh bar
Racket 1090 33 1117 26.47 % 75.05 % 24.95 % 0.29 % racket Racket scheme C cmd bash html5 xml
Ruby 1087 32 824 26.23 % 76.49 % 23.51 % 0.06 % ruby Ruby bash html5 c foo baz rust bar tcl
C++ 1073 73 1986 29.23 % 72.68 % 27.32 % 0.02 % cpp Cpp C++ c CPP c++ sh html5 C d asm make bash cmake text
zkl 1011 19 688 17.98 % 69.69 % 30.31 % 0.03 % zkl c bash r csharp html5
FreeBASIC 1003 46 1204 30.62 % 82.33 % 17.67 % 0.03 % freebasic FreeBASIC FreeBasic qbasic basic Freebasic c zxbasic


Older commentary

Second pass through after a lot of minor patches to the site and custom syntax highlighting filtering added. Should be a lot more accurate less inaccurate now. Numbers probably still don't mean anything, but they aren't quite as large outright whoppers. J numbers are still way overstated due to the very common decision to just include the output inside the language tags rather than in a separate output section. Not really sure what to do about it (if anything.) I really don't want to take on trying to untangle that mess. --Thundergnat (talk) 21:29, 13 February 2022 (UTC)

Some observations: Phix numbers are completely bogus due to the custom syntax highlighting code polluting every entry. Eventually I'll look into filtering. This is a very preliminary first whack at it. I expected Raku to have a higher percent of non-ASCII characters and was very surprised by J and REXX having so much. On closer investigation, J and REXX entries make heavy use of box line drawing characters... which aren't ASCII. Syntax highlighting directives are all over the place. Case doesn't matter but spelling nominally does. Though, to be fair, most of the syntax highlighting are very minor variations, so getting it wrong probably doesn't change much. There are a whole bunch of obvious typos in there too though. Sigh. --Thundergnat (talk), 08 February

Sorry about the Phix syntax highlighting mess. I'd love to use standard Geshi, and in fact do on my own site, but waited 6 years and nothing happened. In a lovely world there would be a special page on RC containing the geshi highlighting files for all languages, that anyone could edit in the usual way with the usual single-click to undo any vandalism, and periodically (bi-annual would be plenty) some admin pushes updates into the geshi dir. I guess you could even have a <lang PhixRC> mechanism whereby "release candidate" geshi updates could be tried out on selected pages without risking damaging the whole site. Alternatively it should actually be fairly straightforward for a man of your talents to html-strip the Phix entries (just sayin), and/or I'm not above being tasked to go and clean up my own mess, which one day I still hope to be able to do (trust me, I too despise my own minor updates showing up as complete gobbledeygook). I also wonder if it would be at all useful for the syntax highlighting column to contain (first/random) links to offending pages, so I could find out what page it thinks is using say "PL/1" or "Phi"? --Pete Lomax (talk) 10:04, 10 February 2022 (UTC)