September 2006 - Projects

Re: build-farm 349: Add `check' to the list of default actions.
by Tsuna 07 Sep '06

07 Sep '06

On 2006-09-05, Roland Levillain <roland(a)lrde.epita.fr> wrote: > Index: ChangeLog > from Roland Levillain <roland(a)lrde.epita.fr> > > Add `check' to the list of default actions. > > * buildfarm_worker/build_test.fns (test_tree): Add `check' to the > list of default actions. > > build_test.fns | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > Index: buildfarm_worker/build_test.fns > --- buildfarm_worker/build_test.fns (revision 348) > +++ buildfarm_worker/build_test.fns (working copy) > @@ -512,7 +512,7 @@ > actions="$*" > > if [ "$actions" = "" ]; then > - actions="bootstrap configure build install distcheck" > + actions="bootstrap configure build check install distcheck" > fi > > # start the build > Ca va aussi affecter transformers? Ca sert a rien pour transformers... on fait deja distcheck, on va pas perdre X heures en plus a faire un make check?! -- SIGOURE Benoit aka Tsuna (SUSv3 compliant) _____ "On a long enough timeline, the survival rate /EPITA\ Promo 2008.CSI for everyone drops to zero" -- Jack.

3 6

build-farm 357: Display Olena builds made with icpc.
by Roland Levillain 07 Sep '06

07 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Display Olena builds made with icpc. * web/build.pl (@trees_cat): Add olena-proto-1.0-icpc and olena-1.0-icpc. build.pl | 2 ++ 1 file changed, 2 insertions(+) Index: web/build.pl --- web/build.pl (revision 356) +++ web/build.pl (working copy) @@ -84,9 +84,11 @@ 'olena-proto-1.0-g++-3.4', 'olena-proto-1.0-g++-4.0', 'olena-proto-1.0-g++-4.1', + 'olena-proto-1.0-icpc', 'olena-1.0-g++-3.4', 'olena-1.0-g++-4.0', 'olena-1.0-g++-4.1', + 'olena-1.0-icpc', '---', 'ranch', '---',

1 0

build-farm 356: Compile olena-1.0 and olena-proto-1.0 with icpc.
by Roland Levillain 07 Sep '06

07 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Compile olena-1.0 and olena-proto-1.0 with icpc. * buildfarm_worker/brasilia.fns: Compile olena-1.0 and olena-proto-1.0 with icpc. (init_icc_vars, test_olena_tree): New functions. Use them to factor redundant parts of the script. brasilia.fns | 118 ++++++++++++++++++++++++++++++++--------------------------- 1 file changed, 64 insertions(+), 54 deletions(-) Index: buildfarm_worker/brasilia.fns --- buildfarm_worker/brasilia.fns (revision 355) +++ buildfarm_worker/brasilia.fns (working copy) @@ -1,9 +1,5 @@ # brasilia. -*- shell-script -*- -# 2006-07-26: Brasilia has been ``temporarily'' added to the build -# farm to compile Vaucanson 1.0. To be removed as soon as caracas is -# able to build Vaucanson properly. - # The ccache dir is located in the /work file system on brasilia. As # ~/.zshenv is not sourced by the build script, this environment var # is defined here too. @@ -11,9 +7,38 @@ # Send the logs to Roland. export MAILTO=roland(a)lrde.epita.fr +# Initialize ICC environment variables. +init_icc_vars() +{ + # ICC 9.0 directory. + icc_dir="/lrde/beyrouth/admin/lrde/usr/intel/compiler90" + # 2006-09-05: ICC 9.0 cannot work with GCC 4.1 installed on the + # same host. icpc reports this error: + # + # Command-line error: invalid GNU version number: 412 + # + # So, force ICC to consider GCC 4.0 as the default GCC. + export CXXFLAGS="-gcc-name=gcc-4.0" + # Don't use CXXFLAGS, it's CPP and LD stuffs. + export CPPFLAGS="-D_LINUX -I$icc_dir/include/c++/" + export LDFLAGS="-cxxlib-icc" + export LD_LIBRARY_PATH="$icc_dir/lib:`printenv LD_LIBRARY_PATH`" + export PATH="$icc_dir/bin:$PATH" +} + + +# Clean up. clean_buildfarm -# Vaucanson. + +# ----------- # +# Vaucanson. # +# ----------- # + +# FIXME: 2006-07-26: Vaucanson has been temporarily added to +# Brasilia. To be removed as soon as caracas is able to build +# Vaucanson properly. + ( export CC="ccache gcc-3.4" export CXX="ccache g++-3.4" @@ -27,67 +52,52 @@ bootstrap configure build check demos install distcheck ) -# ICC 9.1 is no longer working on brasilia (the license has expired -- -# but non-commercial free versions of ICC 9.1 should be available on -# August 2006). Thus, use ICC 9.0 from the `lrde' account. -# ( export CC="ccache icc" export CXX="ccache icpc" - - # 2006-09-05: ICC 9.0 cannot work with GCC 4.1 installed on the - # same host. icpc reports this error: - # - # Command-line error: invalid GNU version number: 412 - # - # So, force the use of GCC 4.0. - CXXFLAGS="-gcc-name=gcc-4.0" - - icc_dir="/lrde/beyrouth/admin/lrde/usr/intel/compiler90" - # Don't use CXXFLAGS, it's CPP and LD stuffs. - export CPPFLAGS="-D_LINUX -I$icc_dir/include/c++/" - export LDFLAGS="-cxxlib-icc" - export LD_LIBRARY_PATH="$icc_dir/lib:`printenv LD_LIBRARY_PATH`" - export PATH="$icc_dir/bin:$PATH" + init_icc_vars test_tree vaucanson-icc \ bootstrap configure build check demos install distcheck ) +# ------- # +# Olena. # +# ------- # + +# TEST_OLENA_TREE TREE CXX-COMPILER +# --------------------------------- +# A wrapper of test_tree() for Olena trees. TREE is the name of the +# project (either olena-proto-1.0 or olena-1.0), and CXX_COMPILER is +# the C++ compiler used. +test_olena_tree() +{ + # Work inside a sub-shell to avoid environment variables escaping. + ( + tree=$1 + cxx_compiler=$2 + # Use ccache. + export CXX="ccache $cxx-compiler" + # ICC-specific initializations, if needed. + if test "x$cxx_compiler" = xicpc; then + init_icc_vars + fi + test_tree "$tree-$cxx_compiler" + ) +} + # Olena 0.10a. # FIXME: The PRCS repository is not accessible from goa. #test_tree olena-0.10 - # Olena proto-1.0. -( - export CXX="ccache g++-3.4" - test_tree olena-proto-1.0-g++-3.4 -) - -( - export CXX="ccache g++-4.0" - test_tree olena-proto-1.0-g++-4.0 -) - -( - export CXX="ccache g++-4.1" - test_tree olena-proto-1.0-g++-4.1 -) - +tree_olena_tree olena-proto-1.0 g++-3.4 +tree_olena_tree olena-proto-1.0 g++-4.0 +tree_olena_tree olena-proto-1.0 g++-4.1 +test_olena_tree olena-proto-1.0 icpc # Olena 1.0. -( - export CXX="ccache g++-3.4" - test_tree olena-1.0-g++-3.4 -) - -( - export CXX="ccache g++-4.0" - test_tree olena-1.0-g++-4.0 -) - -( - export CXX="ccache g++-4.1" - test_tree olena-1.0-g++-4.1 -) +tree_olena_tree olena-1.0 g++-3.4 +tree_olena_tree olena-1.0 g++-4.0 +tree_olena_tree olena-1.0 g++-4.1 +test_olena_tree olena-1.0 icpc

1 0

build-farm 355: Have `timelimit' build without CC defined.
by Roland Levillain 06 Sep '06

06 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Have `timelimit' build without CC defined. * buildfarm_worker/build_test.fns (action_system): Don't abort because of an undefined CC environment variable when compiling `timelimit'. build_test.fns | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) Index: buildfarm_worker/build_test.fns --- buildfarm_worker/build_test.fns (revision 354) +++ buildfarm_worker/build_test.fns (working copy) @@ -289,7 +289,16 @@ esac echo "Building timelimit" - if ! $CC $TIMELIMIT_FLAGS -o $srcdir/timelimit $bf_root/timelimit.c; then + # Choose the C compiler used to build `timelimit'. + if test -n "$CC"; then + timelimit_CC="$CC" + else + # Use the default C compiler. + timelimit_CC=cc + fi + if ! $timelimit_CC $TIMELIMIT_FLAGS -o $srcdir/timelimit \ + $bf_root/timelimit.c + then echo "SYSTEM STATUS: 1" return 1 fi

1 0

build-farm 354: Harden build.pl w.r.t. URL encoding.
by Roland Levillain 06 Sep '06

06 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Let build.pl be robust to project (and host) names containing special characters w.r.t. URL encoding. * web/build.pl (build_status_link, view_global_summary) (view_all_pkg_builds, view_build, view_host_history): Protect the host and tree names using URI::Escape. build.pl | 42 ++++++++++++++++++++++++++++-------------- 1 file changed, 28 insertions(+), 14 deletions(-) Index: web/build.pl --- web/build.pl (revision 353) +++ web/build.pl (working copy) @@ -31,6 +31,7 @@ use Data::Dumper; use CGI::Form; use File::stat; +use URI::Escape; my $req = new CGI::Form; @@ -208,7 +209,10 @@ { my ($host, $tree) = (shift, shift); my (%st) = @_; - my $ret = "<a href=\"$myself?host=$host&tree=$tree\">"; + my $tree_url = "$myself?" . + "host=" . uri_escape($host) . "&" . + "tree=" . uri_escape($tree); + my $ret = "<a href=\"$tree_url\">"; my $ok = "<font color=green>ok</font>"; my $ko = "<font color=red>%d</font>"; @@ -317,7 +321,8 @@ print "<td colspan=6 class=\"project\" style=\"border: none; padding-top: 8pt;\">" . shift(@categories) . "</td></tr>\n"; next; } - print "<td><a href=\"$myself?tree=$tree\">$tree</a></td>\n"; + my $tree_url = "$myself?tree=" . uri_escape($tree); + print "<td><a href=\"$tree_url\">$tree</a></td>\n"; foreach my $host (@hosts) { my (%st) = build_info($host, $tree); my $bage = build_age($host, $tree); @@ -328,7 +333,10 @@ print "<td align=center>"; } - my $link = "<a href=\"$myself?tree=$tree&host=$host\" onmouseover=\"this.T_SHADOWWIDTH=6; this.T_WIDTH=170; return escape('<table border=0><tr><td>Revision:</td><td>$st{'revision'}</td></tr><tr><td>Last Build:</td><td>$st{'build_shortdate'}</td></tr><tr><td>Last check:</td><td>$age</td></tr></table>')\"><img width=16 src=\"%s\"></a>"; + my $tree_url = "$myself?" . + "tree=" . uri_escape($tree) . "&" . + "host=" . uri_escape($host); + my $link = "<a href=\"$tree_url\" onmouseover=\"this.T_SHADOWWIDTH=6; this.T_WIDTH=170; return escape('<table border=0><tr><td>Revision:</td><td>$st{'revision'}</td></tr><tr><td>Last Build:</td><td>$st{'build_shortdate'}</td></tr><tr><td>Last check:</td><td>$age</td></tr></table>')\"><img width=16 src=\"%s\"></a>"; # show first icon for conf/build/install/dist # or skipped, or nothing @@ -465,7 +473,7 @@ # Draw the "recent builds" view sub view_all_pkg_builds() { - my $tree=$req->param("tree"); + my $tree=uri_unescape($req->param("tree")); my @process_tree = (); if ($tree eq '*Tous*') { @process_tree = @trees; @@ -524,9 +532,9 @@ ############################################## # view one build in detail sub view_build() { - my $host=$req->param("host"); - my $tree=$req->param("tree"); - my $date=$req->param("date"); + my $host=uri_unescape($req->param("host")); + my $tree=uri_unescape($req->param("tree")); + my $date=uri_unescape($req->param("date")); $date = "$1-$2_$3-$4" if ($date =~ /([0-9]+)_([0-9]+)_([0-9]+)_([0-9]+)/); my $file="build.$tree.$host"; @@ -562,6 +570,9 @@ print util::FileLoad("../web/$host.html"); + my $tree_url = "$myself?function=History&". + "tree=" . uri_escape($tree) . "&" . + "host=" . uri_escape($host); print " <table class=\"real\"> <tr><td width=130>Host:</td><td><a href=\"$myself?host=$host\">$host</a> - $hosts{$host}</td></tr> @@ -569,7 +580,7 @@ <tr><td>Tree:</td><td>$tree</td></tr> <tr><td>Build Revision:</td><td>" . $st{'revision'} . "</td></tr> <tr><td>Build Age:</td><td>" . red_age($age) . "</td></tr> -<tr><td>Last Build:</td><td>$st{'build_date'} (<a href=\"$myself?function=History&tree=$tree&host=$host\">view history</a>)</td></tr> +<tr><td>Last Build:</td><td>$st{'build_date'} (<a href=\"$tree_url\">view history</a>)</td></tr> <tr><td>Status:</td><td>$status</td></tr> "; while (my $log = <LOG>) { @@ -618,8 +629,8 @@ ############################################## # print history logs sub view_host_history() { - my $host=$req->param("host"); - my $tree=$req->param("tree"); + my $host=uri_unescape($req->param("host")); + my $tree=uri_unescape($req->param("tree")); # FIXME: sort logs. my @logs = glob("build.$tree.$host.*.log"); @@ -639,9 +650,12 @@ my $status = build_status_link($host, $tree, %st); { $status =~ s/<\/?a[^>]*?>//g; } + my $tree_url = + "$myself?function=View+Build&host=$host" . + "&tree=$tree&date=$1_$2_$3_$4"; print " <tr> - <td><a href=\"$myself?function=View+Build&host=$host&tree=$tree&date=$1_$2_$3_$4\">$1/$2 $3H$4</a><br></td> + <td><a href=\"$tree_url\">$1/$2 $3H$4</a><br></td> <td align=center>$st{'revision'}</td> <td align=center>$status</td> </tr>"; @@ -790,7 +804,7 @@ page_top(); -my $fn_name = $req->param("function"); +my $fn_name = uri_unescape($req->param("function")); if ($fn_name eq "History") { view_host_history(); @@ -799,8 +813,8 @@ } elsif ($fn_name eq "Host Summary") { view_summary(); } else { - my $host = $req->param("host"); - my $tree = $req->param("tree"); + my $host = uri_unescape($req->param("host")); + my $tree = uri_unescape($req->param("tree")); $tree = '*Tous*' if ! defined $req->param("tree"); $host = '*Tous*' if ! defined $req->param("host");

1 0

build-farm 353: Add a recipient for cron's logs on brasilia.
by Roland Levillain 06 Sep '06

06 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Add a recipient for cron's logs on brasilia. * buildfarm_worker/brasilia.fns: Add a recipient for cron's logs. brasilia.fns | 2 ++ 1 file changed, 2 insertions(+) Index: buildfarm_worker/brasilia.fns --- buildfarm_worker/brasilia.fns (revision 352) +++ buildfarm_worker/brasilia.fns (working copy) @@ -8,6 +8,8 @@ # ~/.zshenv is not sourced by the build script, this environment var # is defined here too. export CCACHE_DIR=/work/build/ccache +# Send the logs to Roland. +export MAILTO=roland(a)lrde.epita.fr clean_buildfarm

1 0

Re: Build farm sur brasilia
by Akim Demaille 06 Sep '06

06 Sep '06

>>> "Roland" == Roland Levillain <roland(a)lrde.epita.fr> writes: > J'ai déplacé le répertoire de build sur brasilia, pour des raisons > d'espace disque. Les résultats de https://build.lrde.org/ risquent > d'être perturbés quelques heures. > Au passage, est-il nécessaire que Vaucanson soit construit sur > brasilia *et* caracas ? Apparemment, caracas se débrouille très bien > pour compiler Vaucanson, et j'aimerais ne conserver que le build > d'Olena sur brasilia. Si les archis sont identiques, aucun intérêt.

2 2

Re: build-farm 304: Add Olena to the list of tested projects
by Akim Demaille 06 Sep '06

06 Sep '06

>>> "Roland" == Roland Levillain <roland(a)lrde.epita.fr> writes: > +# Olena 0.10a. > +# FIXME: The PRCS repository is not accessible from goa. > +#test_tree olena-0.10 PRCS ???

2 2

build-farm 352: Add support for Vcs.
by Roland Levillain 05 Sep '06

05 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Add support for Vcs. * vcs/build-farm.rb: New. build-farm.rb | 15 +++++++++++++++ 1 file changed, 15 insertions(+) Index: vcs/build-farm.rb --- vcs/build-farm.rb (revision 0) +++ vcs/build-farm.rb (revision 0) @@ -0,0 +1,15 @@ +class Vcs + + protocol_version '0.1' + + def buildfarm_commit! ( *args ) + + common_commit!("build-farm 352: <%= title %>", *args) do |subject| + mail! :to => ['projects(a)lrde.epita.fr'], :subject => subject + end + + end + alias_command :bfci, :buildfarm_commit + default_commit :buildfarm_commit + +end # class Vcs

1 0

build-farm 351: Update ccache settings on brasilia.
by Roland Levillain 05 Sep '06

05 Sep '06

https://svn.lrde.epita.fr/svn/lrde-tools/trunk/build-farm Index: ChangeLog from Roland Levillain <roland(a)lrde.epita.fr> Update ccache settings on brasilia. * buildfarm_worker/brasilia.fns (CCACHE_DIR): Define this environment variable. brasilia.fns | 5 +++++ 1 file changed, 5 insertions(+) Index: buildfarm_worker/brasilia.fns --- buildfarm_worker/brasilia.fns (revision 350) +++ buildfarm_worker/brasilia.fns (working copy) @@ -4,6 +4,11 @@ # farm to compile Vaucanson 1.0. To be removed as soon as caracas is # able to build Vaucanson properly. +# The ccache dir is located in the /work file system on brasilia. As +# ~/.zshenv is not sourced by the build script, this environment var +# is defined here too. +export CCACHE_DIR=/work/build/ccache + clean_buildfarm # Vaucanson.

1 0