X-Git-Url: http://plrg.eecs.uci.edu/git/?a=blobdiff_plain;f=utils%2FNightlyTestTemplate.html;h=c38bb2e776bbe4e7aadfa462cd8d06863c319c0b;hb=86737665b81550fdb575f7d8cc5decc801a7813d;hp=299bd803f419465498b29daa9dcadb51e9d103c5;hpb=0137afab0ae1c51da6a96d549529cba0e87d67f3;p=oota-llvm.git diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html index 299bd803f41..c38bb2e776b 100644 --- a/utils/NightlyTestTemplate.html +++ b/utils/NightlyTestTemplate.html @@ -1,4 +1,3 @@ - LLVM Test Results for $DateString @@ -15,9 +14,9 @@ Overview
Changes
+Dejagnu Tests
Trends
Programs
-Regression

@@ -30,8 +29,8 @@

Back to:
-Test Results
-LLVM Page

+Test Results
+LLVM Page

@@ -41,28 +40,44 @@ Today's Test Results Overview

+ + + + +
+ +
Lines Of Code over Time
+Click for larger view +
+ +

Nightly Test Overview:

+

CVS Tree Overview:
  • Compilation Log - + + + + + +
    ItemCPU TimeWall Clock
    Configure CVS Tree$ConfigTime$ConfigWallTime
    Build CVS Tree$BuildTime$BuildWallTime
    Run Dejagnu Tests$DejagnuTime$DejagnuWallTime
    • +
  • Number of object files compiled: $NumObjects
    • +
  • Number of libraries linked: $NumLibraries
    • +
  • Number of executables linked: $NumExecutables
    • +
  • Build Status: $BuildStatus

    • Warnings during the build:

    -

    +$WarningsList

    @@ -80,10 +95,10 @@

    Changes to Warnings:

    -
      -
    • Warnings Added: $WarningsAdded -
    • Warnings Removed: $WarningsRemoved -

    +

    Warnings Added:

    +$WarningsAdded +

    Warnings Removed:

    +$WarningsRemoved

    Changes in the test suite:

      @@ -92,22 +107,68 @@
    • Newly passing tests: $TestsFixed
    • Newly failing tests: $TestsBroken
    +
    + + +

    +
    +
    Dejagnu Test Results +
    +
    +$DejagnuTestResults +

    A complete log of testing Feature and Regression is available for further analysis.



    Changes over Time +Changes Over Time

    -GNUplot charts showing a couple of things: -

      -
    1. LOC in CVS -
    2. Compile Time -
    3. Testing Time -
    4. Time to run some programs, say all of Olden -
    5. Time to compile something, say Olden. -
    6. Size of bytecode files for Olden -
    + +Here are some charts showing how the LLVM optimizer and code generators are +changing over time. For now we use the Olden benchmark suite to measure this, +but eventually we will switch to using SPEC CPU2000. All programs are run with +"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger +version.

    + +

    Compilation Measurements:

    + + + + + +
    +
    +Size of LLVM bytecode files +    		 +
    +Time to run the LLVM optimizer on each program +
    + +

    Program Execution Measurements:

    + + + + + + + + + +
    +
    +Execution time for CBE generated executable +    		 +
    +Execution time for the LLC generated executable +
    +
    +Execution time for program in the JIT +
    + + +

    @@ -135,38 +196,49 @@ with an asterisk: `*'. The columns of the tables are:

  • Machine code - The number of bytes of machine code generated by the JIT.
  • GCC - The time taken to execute the program when compiled - with GCC -O3.
    • + with GCC -O2.
  • CBE - The time taken to execute the program after - compilation through the C Backend.
    • + compilation through the C backend, compiled with -O2.
  • LLC - How long does the program generated by the static backend LLC take to execute
  • JIT - The amount of time spent running the program with the JIT; this includes the code generation phase (listed above) and actually running the program.
    • +
  • GCC/LLC - The speed-up of the LLC output vs the native + GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
    • +
  • GCC/CBE - The speed-up of the CBE output vs the native + GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
    • +
  • LLC-BETA - How long does the program generated by the static + backend LLC take to execute the program, when compiled with new experimental + features. This is temporary, for tuning.

    • -A complete log of testing is available -for further analysis. +A complete log of testing +SingleSource, +MultiSource, and +External programs are +available for further analysis. -

    Programs/MultiSource

    +

    Programs/External

    -$ProgramsTable +$ExternalProgramsTable
    -

    Programs/SingleSource

    +

    Programs/MultiSource

    +
    +
    +$MultiSourceProgramsTable +
    +

    Programs/SingleSource

    -

    +
    -
    Regression Tests -

    - -Not yet implemented

    +$SingleSourceProgramsTable +

    - + -