X-Git-Url: http://plrg.eecs.uci.edu/git/?a=blobdiff_plain;f=utils%2FNightlyTestTemplate.html;h=c38bb2e776bbe4e7aadfa462cd8d06863c319c0b;hb=518bb53485df640d7b7e3f6b0544099020c42aa7;hp=94ead786f086ef47c14743c7a765343463e980cf;hpb=efe8474806b933869d676c2fc3b24e348e416d9d;p=oota-llvm.git
diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html
index 94ead786f08..c38bb2e776b 100644
--- a/utils/NightlyTestTemplate.html
+++ b/utils/NightlyTestTemplate.html
@@ -1,4 +1,3 @@
-
LLVM Test Results for $DateString
@@ -15,9 +14,9 @@
Overview
Changes
+Dejagnu Tests
Trends
Programs
-Regression
|
@@ -30,8 +29,8 @@
Back to:
-Test Results
-LLVM Page
+Test Results
+LLVM Page
@@ -52,30 +51,33 @@
|
+Nightly Test Overview:
+
+ - Start: $TestStartTime
+ - Finish: $TestFinishTime
+ - Platform: $TestPlatform
+
CVS Tree Overview:
- CVS Checkout Log
- Time to check out CVS tree: $CVSCheckoutTime seconds
- Number of directories in CVS: $NumDirsInCVS
- Number of files in CVS: $NumFilesInCVS
- Number of lines of code: $LOC
+ $NumDirsInCVS dirs, $NumFilesInCVS files, $LOC
+ lines of code, checked out in $CVSCheckoutTime seconds
Compilation Log
-
- $BuildError
- Time to configure CVS tree: $ConfigTime seconds
- ($ConfigWallTime seconds wall time)
- Time to build CVS tree: $BuildTime seconds
- ($BuildWallTime seconds wall time)
- Number of object files compiled: $NumObjects
- Number of libraries linked: $NumLibraries
- Number of executables linked: $NumExecutables
-
+
+Item | CPU Time | Wall Clock |
+Configure CVS Tree | $ConfigTime | $ConfigWallTime |
+Build CVS Tree | $BuildTime | $BuildWallTime |
+Run Dejagnu Tests | $DejagnuTime | $DejagnuWallTime |
+
+Number of object files compiled: $NumObjects
+Number of libraries linked: $NumLibraries
+Number of executables linked: $NumExecutables
+Build Status: $BuildStatus
Warnings during the build:
-
+$WarningsList
@@ -93,10 +95,10 @@
Changes to Warnings:
-
-- Warnings Added: $WarningsAdded
-
- Warnings Removed: $WarningsRemoved
-
+ Warnings Added:
+$WarningsAdded
+Warnings Removed:
+$WarningsRemoved
Changes in the test suite:
@@ -105,21 +107,68 @@
- Newly passing tests: $TestsFixed
- Newly failing tests: $TestsBroken
+ |
+
+
+
+
+
+$DejagnuTestResults
+A complete log of testing Feature and Regression is available for further analysis.
-GNUplot charts showing a couple of things:
-
-- Compile Time
-
- Testing Time
-
- Time to run some programs, say all of Olden
-
- Time to compile something, say Olden.
-
- Size of bytecode files for Olden
-
+
+Here are some charts showing how the LLVM optimizer and code generators are
+changing over time. For now we use the Olden benchmark suite to measure this,
+but eventually we will switch to using SPEC CPU2000. All programs are run with
+"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
+version.
+
+
Compilation Measurements:
+
+
+
+
+
+Size of LLVM bytecode files
+ |
+
+
+Time to run the LLVM optimizer on each program
+ |
+
+
+Program Execution Measurements:
+
+
+
+
+
+Execution time for CBE generated executable
+ |
+
+
+Execution time for the LLC generated executable
+ |
+
+
+
+
+Execution time for program in the JIT
+ |
+ |
+
+
+
+
@@ -155,14 +204,27 @@ with an asterisk: `*'. The columns of the tables are:
JIT - The amount of time spent running the
program with the JIT; this includes the code generation phase (listed above)
and actually running the program.
-GCC/LLC - The speed-up of the LLC output vs the native
- GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+GCC/LLC - The speed-up of the LLC output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+GCC/CBE - The speed-up of the CBE output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+LLC-BETA - How long does the program generated by the static
+ backend LLC take to execute the program, when compiled with new experimental
+ features. This is temporary, for tuning.
A complete log of testing
-SingleSource and
-MultiSource programs are
-available for further analysis.
+SingleSource,
+MultiSource, and
+External programs are
+available for further analysis.
+
+Programs/External
+
+
+
+$ExternalProgramsTable
+ |
Programs/MultiSource
@@ -178,16 +240,5 @@ $MultiSourceProgramsTable
$SingleSourceProgramsTable
|
+
-
-
-
-
-Not yet implemented
-
-
-
-