Einstein Toolkit Documentation - User contributions [en]

Improving the treatment of external libraries

2015-10-21T14:30:23Z

Bmundim: /* Additional Issues */

==Background==

Sometimes Cactus code needs to call code in libraries external to Cactus. In order to ensure that these libraries are available to Cactus, each is represented by a Cactus thorn. These thorns perform the following functions:

# Provide configuration variables for the user to use in their option lists to specify the location of the library on the machine. Sometimes this is as simple as <lib>_DIR = /path/to/lib, but sometimes additional options need to be set, for example if the lib and include directories are in nonstandard locations in relation to the base library path. The external library thorn translates the user's settings for these variables into compiler and linker options which are then used by Cactus when compiling and linking.
# In the case that the user doesn't specify the location of the library, the thorn attempts to locate the library in some standard locations.
# As a last resort, or if requested by the user, the thorn will build a version of the library and install it in the configuration directory. For this reason, the thorn usually contains a distribution tarball of the library which is extracted and compiled during the Cactus configuration (CST) stage. Sometimes there is also a patch which is applied to the source of the library. Having the libraries built as part of the configuration ensures that all the libraries needed are always available even if they have not been installed on the machine, but adds a significant overhead to compilation time.

==Problems with the existing mechanism==

At present, the logic for performing all of the above is implemented in configure.sh scripts in each library thorn. This logic can be quite subtle and involved, and it is desirable for this to be implemented in a central location in a careful and correct way, rather than being duplicated for each library thorn.

==Requirements==

Collecting together the behaviour required by library thorns, such a mechanism needs to make it straightforward to do the following:

* Provide a variable, <lib>_DIR which either:
** points to the library installation, in which case the thorn checks that the library in this location is usable and uses it if this is the case, otherwise compilation is aborted;
** is BUILD (caseless), in which case the thorn builds the library and uses that version;
** is NO_BUILD (causeless), in which case the thorn searches for a version on the system and uses that, unless it cannot be found, in which case the compilation is aborted;
** is unset, or is the empty string, in which case the library is first searched for, and if not found, is built (we could have a synonym AUTO (caseless) for this, to make it explicit)
* Provide variables which point to the include and library directories, but by default set these variables to <lib>/include and <lib>/lib.
* Search some standard locations for the library.
* Test that a given setting of the configuration variables works correctly; i.e. that a working version of the library is actually found at a given location

Current configuration scripts search through some "standard" directories such as /usr and /usr/local and then look in standard subdirectories such as "lib" and "lib64" for libraries with standard extensions such as ".a", ".so" and ".dylib" (for Mac OS). This search logic is very low-level, and should probably be replaced by something higher level. For example, we shouldn't make assumptions about the possible library extensions (.so etc), but instead should leave that to the linker. Similarly, many standard installations of libraries will be in locations which the linker searches automatically, so in those cases, if the linker can find the library without assistance, we should not try to second-guess it.

==Proposal==

===Building===

The thorn can provide a build.sh script which is responsible for building and installing the library in the configuration directory. Separating this into a separate script makes the system more modular, and separates the logic for whether to build from the code that builds.

===Testing===

The thorn can provide a source file conftest.cc which, if successfully compiled, linked and run, indicates that the options used to compile and link it are sufficient to find the library. When the user sets <lib>_DIR = /path/to/lib, <lib>_INC_DIRS and/or <lib>_LIB_DIRS, or sets <lib>_DIR = NO_BUILD, these are used to compile and link this program in order to test that this is possible. This testing ensures that a missing library is detected early during the configuration stage, rather than when the first source file tries to include the missing header file.

===Searching===

When the library location has not been specified, the system needs to search for the library. It will first attempt to compile, link and run the test program with no additional options. This may be successful if the library is installed in a location which is on the standard compiler include/linker paths. If this fails, a sequence of include and library directories can be tried, and the first combination which works can then be used. It may turn out that this is unnecessary, because any "standard" paths that the thorn might know about would probably be tried by the system anyway. A possible exception would be a MacPorts installation in /opt/local which is not searched for by default by the compiler. Note that this is related to the problem that if we add, e.g. /opt/local/lib to the linker path for, say, HDF5, then this might cause something else like MPICH to be found from there, even if the user has specified MPI_DIR to be something else. We don't have a solution to this problem.

===Factoring out common code===

Each library thorn's configure.sh script can call a bash function (or maybe a script) which we provide in the flesh: configure_library:

configure_library <lib> <dist> <patch>...

* <lib>: A capitalised name of the library, e.g. HDF5, HWLOC, MPI suitable for use in environment variable names.
* <dist>: A path to the source distribution tarball relative to the thorn, e.g. dist/zlib-1.2.7.tar.gz
* <patch>: A path to any patch that needs to be applied

configure_library does the following:
* Enable verbose output if requested
* Look at the variables set by the user and choose which of the following to do, and do it:
** Build the library
** Use the library from a specified location, and test that this works, otherwise abort
** Search for the library, and use it if found, otherwise abort
** Search for the library, use if found, otherwise build
* Set Cactus include and link variables so that the library will be appropriately found by Cactus, as well as the HAVE_<lib> macro

==Questions==

* How should the user get the behaviour of setting <lib>_DIR to point to a directory, i.e. explicitly using a specific installation, if there is no such directory, and the include and lib dirs need to be specified separately? Maybe setting any of these three variables (<lib>_DIR, <lib>_INC_DIRS and <lib>_LIB_DIRS) should trigger using exactly that version of the library.

===Additional Issues===

to be worked into the text above.

* "Standard" paths such as those with prefix /usr or /usr/local must not be added to INC_DIRS and LIB_DIRS (BCM: or at least it should be possible to optionally add them at the end)
* Instead of a capitalised library name, we should pass the "natural" name, and capitalise within the script. This allows nicer error messages.
* Assuming that configure_library unpacks the library: It will be necessary to pass in also the directory in which the (unpacked) configure script is found.
* <patch>: Note that multiple patches may be required.
* Running a test program: Sometimes it is not possible to run a program (e.g. for MPI). In this case, building and linking is still a good idea for testing.
* We should think about cross-compiling. It needs to be supported at least to the extent that the configuration options can specify an existing library, which is then accepted by Cactus.
* Maybe there should be a generic mechanism to skip all testing?
* Having a _DIR variable containing "BUILD" and "NO_BUILD" doesn't really make sense. Maybe we should set e.g. "HDF5=BUILD", or "HDF5=NO_BUILD", and use HDF5_DIR only for providing default values for HDF5_LIB_DIRS? In this case, "HDF5=NO_TEST" would also be possible.
* Certain environment variables (e.g. LIBS) should automatically be unset by configure_library, not by the thorn's build script. These variables have a special, non-standard meaning in Cactus, and basically all configure scripts get confused by them.

===Possible improvements===

which are not really related to the topic discussed here.

* In most cases, a library that has been built once can be re-used by all other builds on the same machine. (Exceptions exist.) Since reducing build time is mentioned as a goal above, we could install libraries into a specific directory (e.g. Cactus/exe/lib), and thus share external library builds between configurations. These would then not be deleted by a make realclean, but would be rebuilt when necessary. It is up to the option list to ensure that incompatible option lists specify different install directories. Maybe the option list name itself could be used as prefix.
* We should separate the distributed tarballs from the thorns containing the logic. This would save download time for those who don't want / need the tarballs.
* We could allow the tarballs to be downloaded directly and only when needed, without storing them in svn.

===Some high-level thoughts===

which should probably be at the top.

* Do we really want to continue to develop this mechanism? Or can we adopt rpm / dpkg / pkgconfig instead? In the long run, it may be easier to write a pkgconfig definition for LORENE than maintaining whole sets of configuration scripts ourselves.

== Building from source ==

(move this to a separate page)

The current system of storing the source tarball in the thorn SVN repository is not ideal. Included here is an email written by Ian in 2013 about this, with some ideas for improving the system.

* The tarball would not be included in the repository. RH: I would prefer to store tarballs (or their content) in a repository we control, this does not have to be the same that holds the control files, the reason is that some of the ExternalLibraries may change their hosting url/not life as long as the ET. For example the oldest version of curl still available on the webserver at http://curl.haxx.se/ is from 2000 and anything older than 2010 is in a subdirectory archeology.
* The configuration.ccl file of the thorn would have a field for the URL of a tarball to download
* At configuration time, the thorn's configure script (or something factored into a Cactus script) would download the tarball using the URL if it is necessary to build the library on that machine.
* The tarball would be cached in Cactus/librarycache or similar
* A script or makefile target would be provided to "pre-cache" the tarball of one or more thorns. RH: GetComponents can download arbitrary single files via http so we already have that possibility

A checkout of the ET now would not download any external library tarballs. If, on a given machine, a library is not installed and needs to be built, it would be downloaded when needed. If you want to make sure you have everything needed to build, for example if you are about to catch a plane, you could run something like "make get-libraries" and all library tarballs would be downloaded into Cactus/librarycache. [It would be possible to do this using simfactory, which might be able to determine via its machine database which machines need which tarballs downloaded]. You could then choose to sync this to the remote machine, or not. On a remote machine, you could run get-libraries on the head node which presumably has an internet connection so that the library tarballs are available to the build process which might, as Frank points out, not have internet access.

The vast majority of users would notice little difference; the checkout would be faster, and less disk space would be used by their Cactus trees. Edge-case users who have to compile on machines without internet connections would have a simple command to run on the head node of the machine which would restore the same functionality that we currently have.

Main Page

2015-06-12T07:16:26Z

Bmundim: /* Einstein Toolkit workshop information */

==Instructions==

Documentation for the [http://www.einsteintoolkit.org Einstein Toolkit] is a community effort and everyone is encouraged to contribute towards these pages. You need to login to the wiki to edit the documentation, to do this either

* if you already have a personal LDAP login with the CCT use this
* create you own login/password for the wiki (select local domain)

If you would like to make major changes to these pages please discuss first on the users@einsteintoolkit.org mail list.

Thanks for your contributions!

==Einstein Toolkit workshop information==

=== Current ===

* [[ET Workshop 2015| ET Workshop Summer 2015, Stockholm]]

=== Past ===

* [[ET_Workshop Summer 2013]] (shows both workshops)
** [[ET_Workshop Summer 2013 (New Users Workshop)]]
** [[ET_Workshop Summer 2013 (Developers Workshop)]]
* [[ET_Workshop Fall 2012]]
* [[ET_Workshop Spring 2012]]
* [[ET_Workshop Fall 2011]]
* [[ET_Workshop Spring 2011]]
* [http://ccrg.rit.edu/~carpet/index.php/Main_Page Carpet Developer Workshop Summer 2010]

==Einstein Toolkit Seminars==

It would be nice to organize a semi-regular series of talks with topics of general interest. This should include
not only people from within the Einstein Toolkit. The ET web page already contains a (currently quite short)
[http://einsteintoolkit.org/seminars/ list], and now it is time to propose upcoming talks. In order to record and
story voiced proposals, please use the wiki page [[Einstein Toolkit Seminar Proposals]].

==Release planning==
* [[Release Details]]
* [[Release Process]]

==Documentation==

* [[Tutorial for New Users]]
* [[Tutorial for previous release]]
* [[Simplified Tutorial for New Users]] (requires Debian, Linux Mint, Fedora or Mac OSX)
* [[Getting Started for Cactus Experts]]
* [[Thorns_we_know_of|Non-Einstein-Toolkit thorns]]
* [[Einstein Toolkit standards]]: ADMBase, HydroBase, EOSBase, SphericalSurface
* [[Supported Machines]]
* [[Using Eclipse / Mojave]]
* [[Running Cactus On Windows]]
* Adding your own analysis method
* Adding your own [[adding initial data|initial data]]
* Adding a [[adding a test case|test case]]
* CCE [http://ccrg.rit.edu/~yosef/cce.html tutorial]
* [[Visualizing magnetic field lines]]
* [[Using the multi-model mechanism in Carpet]]
* [[Working with git]]
* [[FAQ]]
* [[Compiling the Einstein Toolkit]]

==Regression Test Results==
You can run [[Simulation_Factory_Advanced_Tutorial#Test_suites | regression tests using SimFactory]].

Results from automated tests are available at https://build.barrywardell.net.

==Performance Test Results==
* [[Single-node benchmark results]] for the Einstein Toolkit
* TODO: Scalability benchmark results for the Einstein Toolkit

==Projects==

* [[Adding requirements to the Cactus scheduler]]
* [[Visualization of simulation results]]
* [[Automated testing]]
* [[Vectorization]] Improving code performance by using the CPU's vector instructions
* [[Padding]] Improving code performance by optimizing cache access
* [[Making Cactus Installable]] like any other Ubuntu package
* [[Test suite results are unwieldy]]
* [[Summer student projects]]
* [[Improving the treatment of external libraries]]
* [[Piraha Parser Discussion]]
* [[Version control]]
* [[Rewrite McLachlan]]

==Maintainers==

* [[Organization and Responsibilities]]
* [[How to Review a Patch]]
* [[Policies to retire functionality]]
* [[Preparing a Patch for Review]]
* [http://einsteintoolkit.org/release-info/parse_testsuite_results.php Release Testsuite Status], [https://build.barrywardell.net/job/EinsteinToolkit/ Trunk Testsuite Status]
* [[Standard Emails]]
* [[MHD implementation details and discussions]]
* [[Carpet Wish List]]
* [[Editing the website]]
* [[Usage poll]]
* [[Repository transition]]
* [[Tickets]]

== Getting Started with Wikis ==

* Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.
* [http://www.mediawiki.org/wiki/Help:Configuration_settings Configuration settings list]
* [http://www.mediawiki.org/wiki/Help:FAQ MediaWiki FAQ]
* [http://mail.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]

Getting Started for Cactus Experts

2014-10-13T11:40:57Z

Bmundim: /* Stable Version */

=Stable Version=

Use [https://github.com/gridaphobe/CRL/raw/ET_2014_05/GetComponents GetComponents] (the new version of GetCactus) with the Einstein Toolkit [https://svn.einsteintoolkit.org/manifest/branches/ET_2014_05/einsteintoolkit.th thornlist]. This thornlist should work on platforms supported by the Cactus team using the usual [http://www.cactuscode.org/download/configfiles configuration files] available on the Cactus web page or with the [http://www.cct.lsu.edu/~eschnett/SimFactory Simulation Factory].

Example parameter files are provided in the Einstein Toolkit SVN repository:

svn checkout https://svn.einsteintoolkit.org/cactus/EinsteinExamples/branches/ET_2014_05/par

=Development Version=

For those experts interested in the development (unstable) branch of the toolkit,
please download GetComponents at:

wget --no-check-certificate https://github.com/gridaphobe/CRL/raw/master/GetComponents
chmod 755 GetComponents

and checkout the Einstein Toolkit thornlist at:

./GetComponents -p -a https://bitbucket.org/einsteintoolkit/manifest/raw/master/einsteintoolkit.th

Problems should be directed to [mailto:users@einsteintoolkit.org users@einsteintoolkit.org] or [mailto:users@cactuscode.org users@cactuscode.org] as appropriate.

Getting Started for Cactus Experts

2014-10-13T11:38:38Z

Bmundim: /* Development Version */

=Stable Version=

Use [https://github.com/gridaphobe/CRL/raw/ET_2012_11/GetComponents GetComponents] (the new version of GetCactus) with the Einstein Toolkit [https://svn.einsteintoolkit.org/manifest/branches/ET_2012_11/einsteintoolkit.th thornlist]. This thornlist should work on platforms supported by the Cactus team using the usual [http://www.cactuscode.org/download/configfiles configuration files] available on the Cactus web page or with the [http://www.cct.lsu.edu/~eschnett/SimFactory Simulation Factory].

Example parameter files are provided in the Einstein Toolkit SVN repository:

svn checkout https://svn.einsteintoolkit.org/cactus/EinsteinExamples/branches/ET_2012_11/par

=Development Version=

For those experts interested in the development (unstable) branch of the toolkit,
please download GetComponents at:

wget --no-check-certificate https://github.com/gridaphobe/CRL/raw/master/GetComponents
chmod 755 GetComponents

and checkout the Einstein Toolkit thornlist at:

./GetComponents -p -a https://bitbucket.org/einsteintoolkit/manifest/raw/master/einsteintoolkit.th

Problems should be directed to [mailto:users@einsteintoolkit.org users@einsteintoolkit.org] or [mailto:users@cactuscode.org users@cactuscode.org] as appropriate.

Testsuite Machines

2013-11-12T07:35:43Z

Bmundim:

Preparing a Patch for Review

2012-08-30T21:23:06Z

2012-08-30T21:15:33Z

Bmundim:

<h2>Best Practices</h2>

Avoid saving tab characters in the patch. The main reason is that different text editors use different defaults to interpret tab characters as spaces. Also some people like to set 8 spaces as the default for a tab character while others prefer 4 or 3. The
end result is that the proposed code will look unformatted, making hard to the eye to read and follow the code indentations.

Preparing a Patch for Review

2012-08-30T21:11:41Z

Bmundim:

<h2>Best Practices</h2>

Main Page

2012-08-30T21:10:28Z

Bmundim: /* Maintainers */

==Instructions==

Documentation for the [http://www.einsteintoolkit.org Einstein Toolkit] is a community effort and everyone is encouraged to contribute towards these pages. You need to login to the wiki to edit the documentation, to do this either

* if you already have a personal LDAP login with the CCT use this
* create you own login/password for the wiki (select local domain)

If you would like to make major changes to these pages please discuss first on the users@einsteintoolkit.org mail list.

Thanks for your contributions!

==Einstein Toolkit workshop information==
=== Current ===
* [[ET_Workshop Fall 2012]]

=== Past ===

* [[ET_Workshop Spring 2012]]
* [[ET_Workshop Fall 2011]]
* [[ET_Workshop Spring 2011]]
* [http://ccrg.rit.edu/~carpet/wiki/Main_Page Carpet Developer Workshop Summer 2010]

==Einstein Toolkit Seminars==

It would be nice to organize a semi-regular series of talks with topics of general interest. This should include
not only people from within the Einstein Toolkit. The ET web page already contains a (currently quite short)
[http://einsteintoolkit.org/seminars/ list], and now it is time to propose upcoming talks. In order to record and
story voiced proposals, please use the wiki page [[Einstein Toolkit Seminar Proposals]].

==Documentation==

* [[Tutorial for New Users]]
* [[Tutorial for previous release]]
* [[Simplified Tutorial for New Users]] (incomplete, and requires Debian or Fedora)
* [[Getting Started for Cactus Experts]]
* [[Thorns_we_know_of|Non-Einstein-Toolkit thorns]]
* [[Einstein Toolkit standards]]: ADMBase, HydroBase, EOSBase, SphericalSurface
* [[Supported Machines]]
* [[Using Eclipse / Mojave]]
* Adding your own analysis method
* Adding your own [[adding initial data|initial data]]
* Adding a [[adding a test case|test case]]
* CCE [http://ccrg.rit.edu/~yosef/cce.html tutorial]
* [[Working with git]]
* [[FAQ]]

==Regression Test Results==
You can run regression tests with the command
./simfactory/bin/sim testsuite

Results from automated tests are available at http://damiana2.aei.mpg.de/~ianhin/testreports/EinsteinToolkitTests/results.xml .

==Projects==

* [[Adding requirements to the Cactus scheduler]]
* [[Visualization of simulation results]]
* [[Automated testing]]
* [[Vectorisation]] Improving code performance by using the CPU's vector instructions
* [[Padding]] Improving code performance by optimizing cache access
* [[Making Cactus Installable]] like any other Ubuntu package
* [[Test suite results are unwieldy]]
* [[Summer student projects]]

==Maintainers==

* [[Organization and Responsibilities]]
* [[How to Review a Patch]]
* [[Preparing a Patch for Review]]
* [[Release Details]]
* [[Release Process]]
* [http://einsteintoolkit.org/release-info/parse_testsuite_results.php Release Testsuite Status], [http://damiana2.aei.mpg.de/~ianhin/testsuites/einsteintoolkit/ Trunk Testsuite Status]
* [[Standard Emails]]
* [[MHD implementation details and discussions]]
* [[Carpet Wish List]]
* [[Editing the website]]
* [[Usage poll]]

== Getting Started with Wikis ==

* Consult the [http://meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.
* [http://www.mediawiki.org/wiki/Help:Configuration_settings Configuration settings list]
* [http://www.mediawiki.org/wiki/Help:FAQ MediaWiki FAQ]
* [http://mail.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]

ET Workshop Spring 2012

2012-04-05T10:15:34Z

Bmundim: /* Schedule */

== Spring Einstein Toolkit Workshop 2012 ==

We prepared a [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/flyer/etk2.pdf flyer], which can be printed or otherwise
distributed.

=== Announcement ===
The Einstein Toolkit (http://einsteintoolkit.org) will host its spring workshop 2012 following the April APS meeting in Atlanta, GA,
from Tuesday, April 3rd 4pm to Friday April 6th noon.

This workshop is targeted at new and potential new users of the relativity infrastructure. It will provide a general introductions
into numerical relativity (although some previous knowledge would be beneficial) and in code development within large collaborations.
Hands-on sessions will help to familiarize attendees with the Einstein Toolkit. Participants are asked to bring their own laptops.
We would like to invite especially students from physics and computer science to participate.

The number of attendees is limited, and while registration is free, it is required. We anticipate to be able to support a small
number of participants financially, by covering parts/all of their travel, hotel and meal cost. Preference will be given to students.

In order to register, write an email to workshop@einsteintoolkit.org, specify:
* your name, affiliation and title
* your estimated arrival and departure time/date
* whether you apply for support (and if so, state if you are undergraduate / graduate student / postdoc)
* your special needs

Detailed workshop information can be found at https://docs.einsteintoolkit.org/et-docs/ET_Workshop_Spring_2012.

The Einstein Toolkit Consortium.

=== Spacetime Coordinates and Contact Information ===

{| class="wikitable" border="1"
|-
! Dates
| '''Tues, 3. April @ 4pm -- Fri, 6. April @ noon'''
|-
! Location
| Room 319, Georgia Tech Student Center, Georgia Tech, Atlanta
|-
! Contacts
| Workshop email list: '''workshop@einsteintoolkit.org''', emergencies: Frank Löffler (knarf@cct.lsu.edu, +1-225-202-1752) or Tanja Bode (tanja.bode@physics.gatech.edu, +1-814-360-2715)
|-
! Hotel
| A small block of rooms was reserved at the [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG Hampton Inn Atlanta - Georgia Tech], 244 North Ave NW (404-881-0881). The group rate was '''$117 per night plus tax (appr. 16%, resulting in a ~$136 rate)''' and included a hot breakfast and high speed wireless access. A [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG group web page] was available to book online, or you could reserve by phone at 404-881-0881 and ask for the '''"Einstein Toolkit Workshop" rate'''. Attendees had until '''20. March''' to reserve.

In addition, a small block of rooms were reserved at the [http://www.hotelmidtownatlanta.com Hotel Midtown Atlanta]. The group rate was '''$89 per night''' for single occupancy, including breakfast and high-speed internet. For an additional person, add $10 (to cover breakfast costs). Though less convenient to either the APS meeting or this workshop, both can be conveniently reached by transit from the Midtown MARTA station a block away. Reservations at this rate could be done by phone only at 404-873-4800. The block of rooms was released on '''26. March'''.
|-
! Transportation - Hotel
| The best way to get to the hotels from the airport (or elsewhere) is by taking [http://itsmarta.com MARTA]'s red or gold rail line, which costs $2.50 one-way. The Hotel Midtown Atlanta is a block away from Midtown station. For the Hampton Inn, get off at the North Avenue station. It should take approximately 20 minutes to either station. From North Ave station, walk west for ~0.5 miles or transfer to MARTA bus route 26 to the stop immediately in front of the Hampton Inn.
|-
! Transportation - Workshop
| The student center is a 5-minute (~1/3 mile) walk [http://g.co/maps/hdjbt] from Hampton Inn. From the Hotel Midtown Atlanta, Georgia Tech campus (specifically the student center) can be easily reached by taking the [http://pts.gatech.edu/ride/routes_schedules/Pages/TechTrolley.aspx Georgia Tech Trolley] (free) from the Midtown MARTA station to its end station.
|-
! Transportation - From the APS (Hyatt)
| The Workshop is a 1.5 mile walk from the Hyatt where the APS is taking place. The most convenient way to reach the Workshop location on Tuesday is to take [http://itsmarta.com/1-w.aspx MARTA Bus Route 1] from Spring St [http://g.co/maps/jpf3h] (a block away from the Hyatt) directly to the workshop hotel.
|}

== Participant List ==

Below are the ET volunteers who will be presenting or heading parts of the sessions.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Tanja Bode || Georgia Tech
|-
| Dennis Castleberry || Louisiana State University
|- style="background:lightgrey;"
| Peter Diener || Louisiana State University
|-
| Josh Faber || Rochester Institute of Technology
|- style="background:lightgrey;"
| Roland Haas || Caltech
|-
| Frank Löffler || Louisiana State University
|- style="background:lightgrey;"
| Bruno Mundim || Rochester Institute of Technology
|}

The current participant list as of 4. April 2012 follows, in alphabetical order.
Please indicate whether you have already arranged for lodgings so that others looking for hotel roommates
may most easily find them. This page is editable in general (though IPs are logged), so please manage your own
lodging status.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Majd Abdelqader || Queens University
|-
| Rafael Aranha || Georgia Tech
|- style="background:lightgrey;"
| Grayson Carroll || Belmont University
|-
| Roseanne Cheng || UNC-Chapel Hill
|- style="background:lightgrey;"
| Michael Clark || Georgia Tech
|-
| Brett Deaton || Washington University
|- style="background:lightgrey;"
| Tehani K. Finch || Howard University
|-
| Gary Forrester || University of Massachusetts at Dartmouth
|- style="background:lightgrey;"
| Brian Friesen || University of Oklahoma
|-
| Rita Garrido || Georgia Tech
|- style="background:lightgrey;"
| Joshua Harris || Louisiana State University
|-
| Scott Hawley || Belmont University
|- style="background:lightgrey;"
| Matt Kinsey || Georgia Tech
|-
| Jussara Marandola Kofuji || Georgia Tech
|- style="background:lightgrey;"
| Kostas Kokkotas || Universität Tübingen
|-
| Hari Krishnan || Louisiana State University
|- style="background:lightgrey;"
| Sean McWilliams || Princeton
|-
| Philipp Moesta || Caltech
|- style="background:lightgrey;"
| Tuan Anh Nguyen || Georgia Tech
|-
| Prabath Peiris || Rochester Institute of Technology
|- style="background:lightgrey;"
| Larne Pekowsky || Georgia Tech
|-
| Prayash Sharma Pyakurel || Truman State University
|- style="background:lightgrey;"
| Christian Reisswig || Caltech
|-
| Ian Ruchlin || Rochester Institute of Technology
|- style="background:lightgrey;"
| Carl Rodriguez || Northwestern University
|-
| Chao Shi || Georgia Tech
|- style="background:lightgrey;"
| Cody Simmons || North Carolina State University
|-
| Magda Slawinska || Georgia Tech
|- style="background:lightgrey;"
| Petr Tsatsin || Florida Atlantic University
|-
| Alex Vañô Viñuales || University of the Balearic Islands
|- style="background:lightgrey;"
| Andrew Vu || Emory University
|-
| Konstantin Yakunin || Florida Atlantic University / ORNL
|}

== In-Workshop Details ==

=== Schedule ===

{| class="wikitable" border="1"
|-
| Day
| Time
| Activity
| Presenter / Responsible
|-
| Tue
| 16:00-17:30
| Setup for early birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:00-08:30
| Setup for late birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:30-09:00
| Opening, Introduction ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/introduction/introduction.pdf slides])
| Frank Löffler
|-
| Wed
| 09:00-09:30
| Introduction to Scientific Software & HPC ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/hpc_intro/hpc_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 09:30-10:00
| Introduction to Cactus (high-level) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactus_intro/cactus_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 10:00-10:30
| Discussion and break
|-
| Wed
| 10:30-11:15
| [[Introduction to General Relativity]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/genrel/genrel.pdf slides])
| Joshua Faber
|-
| Wed
| 11:15-12:00
| [[Introduction on Cactus Thorn-Writing (lower level)]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactuswriting/cactuswriting.pdf slides])
| Joshua Faber
|-
| Wed
| 12:00-13:00
| Lunch break
|-
| Wed
| 13:00-13:30
| Introduction to Workshop development environment
| Dennis Castleberry
|-
| Wed
| 13:30-14:15
| Hands-on, provided Wave-Equation example within Cactus ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/example_wavetoy.pdf slides])
| Roland Haas
|-
| Wed
| 14:15-15:15
| [[Introduction numerical methods & numerical Relativity]] ([https://docs.einsteintoolkit.org/et-docs/images/e/eb/Numerical_relativity.pdf slides])
| Bruno Mundim, Peter Diener
|-
| Wed
| 15:15-15:45
| Discussion and break
|-
| Wed
| 15:45-17:30
| Running and extending (par-file) of two provided examples: perturbed, [https://docs.einsteintoolkit.org/et-docs/images/6/69/Onepuncture.par single BH], and perturbed, single TOV star 
| Frank Löffler, Bruno Mundim
|-
| Thu
| 08:00-09:00
| Introduction in Scientific visualization - a bit of theory and a lot of practice ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/scientific_viz/scientific_viz.pdf slides])
| Tanja Bode
|-
| Thu
| 09:00-10:00
| Invited Talk I -- Matt Duez, Washington University: [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/Matt_Duez_InterpretingDataPresentationSlides.pdf The Challenge of interpreting data in numerical relativity]
|-
| Thu
| 10:00-10:30
| Discussion and break
|-
| Thu
| 10:30-11:15
| Hands-on: Using visualization tools to look at meaningful quantities ( TOV profile evolutions ) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz/handson_sviz.pdf slides])
| Tanja Bode
|-
| Thu
| 11:15-12:00
| Create movie of either BH+GW or TOV oscillations using VisIt ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/handson_viz.pdf slides], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/rho.final.session TOV session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/rho.rl4.h5.xz TOV data file], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/psi4.volume.session Psi4 session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/psir.h5.xz Psi4 data file])
| Roland Haas
|-
| Thu
| 12:00-13:00
| Lunch
|-
| Thu
| 13:00-14:15
| Hands-on: Implement your own thorn (neutron star tracking), and visualize it, in teams of about 5 people ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_analysis/handson_analysis.pdf slides]), more information at end of wiki
| Roland Haas
|-
| Thu
| 14:15-15:15
| Invited Talk II -- John Wise, Georgia Tech
|-
| Thu
| 15:15-15:45
| Discussion and break
|
|-
| Thu
| 15:45-17:30
| Hands-on: continuation
| Roland Haas
|-
| Fri
| 08:00-09:00
| Presentation of visualization of result of previous session, 6 teams: 8 min each
| Frank Löffler
|-
| Fri
| 09:00-10:00
| Invited talk III -- Gabrielle Allen, LSU
|
|-
| Fri
| 10:00-10:30
| Discussion and break
|
|-
| Fri
| 10:30-11:00
| Tour through available ET components
| Peter Diener
|-
| Fri
| 11:00-11:30
| Overview over supercomputing resources, introduction on how to get accounts / allocations, trends in HPC, reminder how to get ET help in the future
| Joshua Faber, Peter Diener
|-
| Fri
| 11:30-12:00
| The future of the ET: everything we didn't talk about (EOSs, refluxing, multiblock, MHD, radiation ect.)
| Frank Löffler
|}

=== Setup ===
* Wireless access is through the GTVisitor network. '''One''' account per person, please. It will work on multiple devices simultaneously.
* The virtual machine for the workshop is [http://cct.lsu.edu/~dcastl2/] and will run in [http://virtualbox.org virtualbox]

== Area Details ==

* For on-campus directions please consult the link of a detailed '''map of the Georgia Tech Campus''': [http://map.gtalumni.org/]
* For directions of Midtown and Downtown Atlanta follow the link [http://www.atlantadowntown.com/guide]

=== Restaurants ===
'''Places to Eat On-Campus:'''
'''Technology Square''', located on 5th Street and Spring Street, has a variety of good and cheap restaurants including:
* Tin Drum Asia Cafe
* Ray's New York Pizza
* Chuck's Famous
* Barrelhouse
* 5th Street Ribs n' Blues
* Umma's House Restaurant and Cafe
* Waffle House
* Moe's Southwest Grill
* St. Charles Deli
The '''Student Center''' [http://www.studentcenter.gatech.edu] has:
* Chick-fil-a
* Taco Bell
* Subway
* A pub style at Jackets
* Einstein's Bagels
* Ferst Place (Located on the 3rd floor)
* Ferst Food Court (Located on the 2nd floor)

'''Places to Eat Off-campus :'''
* Varsity (American)
: 61 North Ave. NW
* Goodfellas (American)
: 615 Spring Street
* The Real Chow Baby (American Stir Fry)
: 1016 Howell Mill Road
* Zen on Ten Asian Bistro (Sushi)
:1000 Northside Dr. NW
* Spoon (Thai)
: 768 Marietta Street
* The Vortex (American)
: 878 Peachtree Street NE
* Taco Mac (American)
: 933 Peachtree St NE
* La Fonda Latina (Mexican)
: 1025 Howell Mill Road
* Prickly Pear (Mexican)
: 950 West Peachtree St NE
* TheTenth Thai
: 132 10th Street Northeast (Thai)

=== Miscellaneous ===
* Publix at The Plaza Midtown (Supermarket)
: 950 W Peachtree St NW
* Midtown Market (Sundries)
: 225 10th St NE
* Walmart Supercenter (Supermarket)
: 1801 Howell Mill Rd Nw
* Walgreens (Pharmacy)
: 595 Piedmont Ave., Ste. 100
* CVS (Pharmacy)
: 842 Peachtree Street NE

=== Entertainment ===
* Manuel's Tavern [http://www.manuelstavern.com/] (also the site of Astrophysics unplugged)
* Blind Willie's [http://www.blindwilliesblues.com/]

==Hands on material==
===WaveToy===
The source code for the example thorn and the slides is available at
via
cd $HOME
./GetComponents -a https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/Cactus/misc/WaveToy.th
cd Cactus
echo 'Introduction/WaveToy' >>configs/sim/ThornList
simfactory/bin/sim build
Once built, you can run this in one line via simfactory
simfactory/bin/sim create-run wavetoy --parfile wavetoy-misc/WaveToy.par
===Static TOV===
Edit par/static_tov.par as Frank indicated and save as $HOME/Cactus/fast_tov.par

To run enter:
cd $HOME/Cactus
exe/cactus_sim fast_tov.par

===Visualization, Hands-on I===

Download the slides and some extra sample data via
cd $HOME
svn co https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz .
Make sure you have 3d data! If not, add these lines to your tov parameter file and rerun for a bit:
CarpetIOHDF5::out3d_every = 1
CarpetIOHDF5::out3d_vars = " HydroBase::rho "
These give data under the file name ''rho.xyz.h5''. Alternatively, add the following parameters
CarpetIOHDF5::out_every = 1
CarpetIOHDF5::out_vars = "HydroBase::rho"
which give data under the file ''rho.h5''. Either way works fine. We will assume the latter for the moment.

Follow the directions on the first slides to create a plot of how the evolving TOV differs from its initial state.

Other suggestions for visualization tasks are contained in the slides.

File:Numerical relativity.pdf

2012-04-05T10:14:25Z

Bmundim:

ET Workshop Spring 2012

2012-04-05T10:13:02Z

Bmundim: /* Schedule */

== Spring Einstein Toolkit Workshop 2012 ==

We prepared a [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/flyer/etk2.pdf flyer], which can be printed or otherwise
distributed.

=== Announcement ===
The Einstein Toolkit (http://einsteintoolkit.org) will host its spring workshop 2012 following the April APS meeting in Atlanta, GA,
from Tuesday, April 3rd 4pm to Friday April 6th noon.

This workshop is targeted at new and potential new users of the relativity infrastructure. It will provide a general introductions
into numerical relativity (although some previous knowledge would be beneficial) and in code development within large collaborations.
Hands-on sessions will help to familiarize attendees with the Einstein Toolkit. Participants are asked to bring their own laptops.
We would like to invite especially students from physics and computer science to participate.

The number of attendees is limited, and while registration is free, it is required. We anticipate to be able to support a small
number of participants financially, by covering parts/all of their travel, hotel and meal cost. Preference will be given to students.

In order to register, write an email to workshop@einsteintoolkit.org, specify:
* your name, affiliation and title
* your estimated arrival and departure time/date
* whether you apply for support (and if so, state if you are undergraduate / graduate student / postdoc)
* your special needs

Detailed workshop information can be found at https://docs.einsteintoolkit.org/et-docs/ET_Workshop_Spring_2012.

The Einstein Toolkit Consortium.

=== Spacetime Coordinates and Contact Information ===

{| class="wikitable" border="1"
|-
! Dates
| '''Tues, 3. April @ 4pm -- Fri, 6. April @ noon'''
|-
! Location
| Room 319, Georgia Tech Student Center, Georgia Tech, Atlanta
|-
! Contacts
| Workshop email list: '''workshop@einsteintoolkit.org''', emergencies: Frank Löffler (knarf@cct.lsu.edu, +1-225-202-1752) or Tanja Bode (tanja.bode@physics.gatech.edu, +1-814-360-2715)
|-
! Hotel
| A small block of rooms was reserved at the [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG Hampton Inn Atlanta - Georgia Tech], 244 North Ave NW (404-881-0881). The group rate was '''$117 per night plus tax (appr. 16%, resulting in a ~$136 rate)''' and included a hot breakfast and high speed wireless access. A [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG group web page] was available to book online, or you could reserve by phone at 404-881-0881 and ask for the '''"Einstein Toolkit Workshop" rate'''. Attendees had until '''20. March''' to reserve.

In addition, a small block of rooms were reserved at the [http://www.hotelmidtownatlanta.com Hotel Midtown Atlanta]. The group rate was '''$89 per night''' for single occupancy, including breakfast and high-speed internet. For an additional person, add $10 (to cover breakfast costs). Though less convenient to either the APS meeting or this workshop, both can be conveniently reached by transit from the Midtown MARTA station a block away. Reservations at this rate could be done by phone only at 404-873-4800. The block of rooms was released on '''26. March'''.
|-
! Transportation - Hotel
| The best way to get to the hotels from the airport (or elsewhere) is by taking [http://itsmarta.com MARTA]'s red or gold rail line, which costs $2.50 one-way. The Hotel Midtown Atlanta is a block away from Midtown station. For the Hampton Inn, get off at the North Avenue station. It should take approximately 20 minutes to either station. From North Ave station, walk west for ~0.5 miles or transfer to MARTA bus route 26 to the stop immediately in front of the Hampton Inn.
|-
! Transportation - Workshop
| The student center is a 5-minute (~1/3 mile) walk [http://g.co/maps/hdjbt] from Hampton Inn. From the Hotel Midtown Atlanta, Georgia Tech campus (specifically the student center) can be easily reached by taking the [http://pts.gatech.edu/ride/routes_schedules/Pages/TechTrolley.aspx Georgia Tech Trolley] (free) from the Midtown MARTA station to its end station.
|-
! Transportation - From the APS (Hyatt)
| The Workshop is a 1.5 mile walk from the Hyatt where the APS is taking place. The most convenient way to reach the Workshop location on Tuesday is to take [http://itsmarta.com/1-w.aspx MARTA Bus Route 1] from Spring St [http://g.co/maps/jpf3h] (a block away from the Hyatt) directly to the workshop hotel.
|}

== Participant List ==

Below are the ET volunteers who will be presenting or heading parts of the sessions.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Tanja Bode || Georgia Tech
|-
| Dennis Castleberry || Louisiana State University
|- style="background:lightgrey;"
| Peter Diener || Louisiana State University
|-
| Josh Faber || Rochester Institute of Technology
|- style="background:lightgrey;"
| Roland Haas || Caltech
|-
| Frank Löffler || Louisiana State University
|- style="background:lightgrey;"
| Bruno Mundim || Rochester Institute of Technology
|}

The current participant list as of 4. April 2012 follows, in alphabetical order.
Please indicate whether you have already arranged for lodgings so that others looking for hotel roommates
may most easily find them. This page is editable in general (though IPs are logged), so please manage your own
lodging status.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Majd Abdelqader || Queens University
|-
| Rafael Aranha || Georgia Tech
|- style="background:lightgrey;"
| Grayson Carroll || Belmont University
|-
| Roseanne Cheng || UNC-Chapel Hill
|- style="background:lightgrey;"
| Michael Clark || Georgia Tech
|-
| Brett Deaton || Washington University
|- style="background:lightgrey;"
| Tehani K. Finch || Howard University
|-
| Gary Forrester || University of Massachusetts at Dartmouth
|- style="background:lightgrey;"
| Brian Friesen || University of Oklahoma
|-
| Rita Garrido || Georgia Tech
|- style="background:lightgrey;"
| Joshua Harris || Louisiana State University
|-
| Scott Hawley || Belmont University
|- style="background:lightgrey;"
| Matt Kinsey || Georgia Tech
|-
| Jussara Marandola Kofuji || Georgia Tech
|- style="background:lightgrey;"
| Kostas Kokkotas || Universität Tübingen
|-
| Hari Krishnan || Louisiana State University
|- style="background:lightgrey;"
| Sean McWilliams || Princeton
|-
| Philipp Moesta || Caltech
|- style="background:lightgrey;"
| Tuan Anh Nguyen || Georgia Tech
|-
| Prabath Peiris || Rochester Institute of Technology
|- style="background:lightgrey;"
| Larne Pekowsky || Georgia Tech
|-
| Prayash Sharma Pyakurel || Truman State University
|- style="background:lightgrey;"
| Christian Reisswig || Caltech
|-
| Ian Ruchlin || Rochester Institute of Technology
|- style="background:lightgrey;"
| Carl Rodriguez || Northwestern University
|-
| Chao Shi || Georgia Tech
|- style="background:lightgrey;"
| Cody Simmons || North Carolina State University
|-
| Magda Slawinska || Georgia Tech
|- style="background:lightgrey;"
| Petr Tsatsin || Florida Atlantic University
|-
| Alex Vañô Viñuales || University of the Balearic Islands
|- style="background:lightgrey;"
| Andrew Vu || Emory University
|-
| Konstantin Yakunin || Florida Atlantic University / ORNL
|}

== In-Workshop Details ==

=== Schedule ===

{| class="wikitable" border="1"
|-
| Day
| Time
| Activity
| Presenter / Responsible
|-
| Tue
| 16:00-17:30
| Setup for early birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:00-08:30
| Setup for late birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:30-09:00
| Opening, Introduction ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/introduction/introduction.pdf slides])
| Frank Löffler
|-
| Wed
| 09:00-09:30
| Introduction to Scientific Software & HPC ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/hpc_intro/hpc_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 09:30-10:00
| Introduction to Cactus (high-level) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactus_intro/cactus_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 10:00-10:30
| Discussion and break
|-
| Wed
| 10:30-11:15
| [[Introduction to General Relativity]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/genrel/genrel.pdf slides])
| Joshua Faber
|-
| Wed
| 11:15-12:00
| [[Introduction on Cactus Thorn-Writing (lower level)]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactuswriting/cactuswriting.pdf slides])
| Joshua Faber
|-
| Wed
| 12:00-13:00
| Lunch break
|-
| Wed
| 13:00-13:30
| Introduction to Workshop development environment
| Dennis Castleberry
|-
| Wed
| 13:30-14:15
| Hands-on, provided Wave-Equation example within Cactus ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/example_wavetoy.pdf slides])
| Roland Haas
|-
| Wed
| 14:15-15:15
| [[Introduction numerical methods & numerical Relativity]] 
| Bruno Mundim, Peter Diener
|-
| Wed
| 15:15-15:45
| Discussion and break
|-
| Wed
| 15:45-17:30
| Running and extending (par-file) of two provided examples: perturbed, [https://docs.einsteintoolkit.org/et-docs/images/6/69/Onepuncture.par single BH], and perturbed, single TOV star 
| Frank Löffler, Bruno Mundim
|-
| Thu
| 08:00-09:00
| Introduction in Scientific visualization - a bit of theory and a lot of practice ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/scientific_viz/scientific_viz.pdf slides])
| Tanja Bode
|-
| Thu
| 09:00-10:00
| Invited Talk I -- Matt Duez, Washington University: [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/Matt_Duez_InterpretingDataPresentationSlides.pdf The Challenge of interpreting data in numerical relativity]
|-
| Thu
| 10:00-10:30
| Discussion and break
|-
| Thu
| 10:30-11:15
| Hands-on: Using visualization tools to look at meaningful quantities ( TOV profile evolutions ) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz/handson_sviz.pdf slides])
| Tanja Bode
|-
| Thu
| 11:15-12:00
| Create movie of either BH+GW or TOV oscillations using VisIt ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/handson_viz.pdf slides], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/rho.final.session TOV session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/rho.rl4.h5.xz TOV data file], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/psi4.volume.session Psi4 session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/psir.h5.xz Psi4 data file])
| Roland Haas
|-
| Thu
| 12:00-13:00
| Lunch
|-
| Thu
| 13:00-14:15
| Hands-on: Implement your own thorn (neutron star tracking), and visualize it, in teams of about 5 people ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_analysis/handson_analysis.pdf slides]), more information at end of wiki
| Roland Haas
|-
| Thu
| 14:15-15:15
| Invited Talk II -- John Wise, Georgia Tech
|-
| Thu
| 15:15-15:45
| Discussion and break
|
|-
| Thu
| 15:45-17:30
| Hands-on: continuation
| Roland Haas
|-
| Fri
| 08:00-09:00
| Presentation of visualization of result of previous session, 6 teams: 8 min each
| Frank Löffler
|-
| Fri
| 09:00-10:00
| Invited talk III -- Gabrielle Allen, LSU
|
|-
| Fri
| 10:00-10:30
| Discussion and break
|
|-
| Fri
| 10:30-11:00
| Tour through available ET components
| Peter Diener
|-
| Fri
| 11:00-11:30
| Overview over supercomputing resources, introduction on how to get accounts / allocations, trends in HPC, reminder how to get ET help in the future
| Joshua Faber, Peter Diener
|-
| Fri
| 11:30-12:00
| The future of the ET: everything we didn't talk about (EOSs, refluxing, multiblock, MHD, radiation ect.)
| Frank Löffler
|}

=== Setup ===
* Wireless access is through the GTVisitor network. '''One''' account per person, please. It will work on multiple devices simultaneously.
* The virtual machine for the workshop is [http://cct.lsu.edu/~dcastl2/] and will run in [http://virtualbox.org virtualbox]

== Area Details ==

* For on-campus directions please consult the link of a detailed '''map of the Georgia Tech Campus''': [http://map.gtalumni.org/]
* For directions of Midtown and Downtown Atlanta follow the link [http://www.atlantadowntown.com/guide]

=== Restaurants ===
'''Places to Eat On-Campus:'''
'''Technology Square''', located on 5th Street and Spring Street, has a variety of good and cheap restaurants including:
* Tin Drum Asia Cafe
* Ray's New York Pizza
* Chuck's Famous
* Barrelhouse
* 5th Street Ribs n' Blues
* Umma's House Restaurant and Cafe
* Waffle House
* Moe's Southwest Grill
* St. Charles Deli
The '''Student Center''' [http://www.studentcenter.gatech.edu] has:
* Chick-fil-a
* Taco Bell
* Subway
* A pub style at Jackets
* Einstein's Bagels
* Ferst Place (Located on the 3rd floor)
* Ferst Food Court (Located on the 2nd floor)

'''Places to Eat Off-campus :'''
* Varsity (American)
: 61 North Ave. NW
* Goodfellas (American)
: 615 Spring Street
* The Real Chow Baby (American Stir Fry)
: 1016 Howell Mill Road
* Zen on Ten Asian Bistro (Sushi)
:1000 Northside Dr. NW
* Spoon (Thai)
: 768 Marietta Street
* The Vortex (American)
: 878 Peachtree Street NE
* Taco Mac (American)
: 933 Peachtree St NE
* La Fonda Latina (Mexican)
: 1025 Howell Mill Road
* Prickly Pear (Mexican)
: 950 West Peachtree St NE
* TheTenth Thai
: 132 10th Street Northeast (Thai)

=== Miscellaneous ===
* Publix at The Plaza Midtown (Supermarket)
: 950 W Peachtree St NW
* Midtown Market (Sundries)
: 225 10th St NE
* Walmart Supercenter (Supermarket)
: 1801 Howell Mill Rd Nw
* Walgreens (Pharmacy)
: 595 Piedmont Ave., Ste. 100
* CVS (Pharmacy)
: 842 Peachtree Street NE

=== Entertainment ===
* Manuel's Tavern [http://www.manuelstavern.com/] (also the site of Astrophysics unplugged)
* Blind Willie's [http://www.blindwilliesblues.com/]

==Hands on material==
===WaveToy===
The source code for the example thorn and the slides is available at
via
cd $HOME
./GetComponents -a https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/Cactus/misc/WaveToy.th
cd Cactus
echo 'Introduction/WaveToy' >>configs/sim/ThornList
simfactory/bin/sim build
Once built, you can run this in one line via simfactory
simfactory/bin/sim create-run wavetoy --parfile wavetoy-misc/WaveToy.par
===Static TOV===
Edit par/static_tov.par as Frank indicated and save as $HOME/Cactus/fast_tov.par

To run enter:
cd $HOME/Cactus
exe/cactus_sim fast_tov.par

===Visualization, Hands-on I===

Download the slides and some extra sample data via
cd $HOME
svn co https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz .
Make sure you have 3d data! If not, add these lines to your tov parameter file and rerun for a bit:
CarpetIOHDF5::out3d_every = 1
CarpetIOHDF5::out3d_vars = " HydroBase::rho "
These give data under the file name ''rho.xyz.h5''. Alternatively, add the following parameters
CarpetIOHDF5::out_every = 1
CarpetIOHDF5::out_vars = "HydroBase::rho"
which give data under the file ''rho.h5''. Either way works fine. We will assume the latter for the moment.

Follow the directions on the first slides to create a plot of how the evolving TOV differs from its initial state.

Other suggestions for visualization tasks are contained in the slides.

Introduction numerical methods

2012-04-05T09:42:32Z

Bmundim:

* 3+1 spacetime decomposition
* BSSN formalism
* BHB: puncture initial data
* Method of lines
* Finite difference approximation
* GRMHD - Valencia Formulation
* Conservation laws
* Finite volume techniques
* Riemann Problem
* Example: Burgers Equation
* Approximate Riemann Solvers
* Slope Limiters
* Algorithm Overview

ET Workshop Spring 2012

2012-04-05T09:05:36Z

Bmundim: /* Schedule */

== Spring Einstein Toolkit Workshop 2012 ==

We prepared a [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/flyer/etk2.pdf flyer], which can be printed or otherwise
distributed.

=== Announcement ===
The Einstein Toolkit (http://einsteintoolkit.org) will host its spring workshop 2012 following the April APS meeting in Atlanta, GA,
from Tuesday, April 3rd 4pm to Friday April 6th noon.

This workshop is targeted at new and potential new users of the relativity infrastructure. It will provide a general introductions
into numerical relativity (although some previous knowledge would be beneficial) and in code development within large collaborations.
Hands-on sessions will help to familiarize attendees with the Einstein Toolkit. Participants are asked to bring their own laptops.
We would like to invite especially students from physics and computer science to participate.

The number of attendees is limited, and while registration is free, it is required. We anticipate to be able to support a small
number of participants financially, by covering parts/all of their travel, hotel and meal cost. Preference will be given to students.

In order to register, write an email to workshop@einsteintoolkit.org, specify:
* your name, affiliation and title
* your estimated arrival and departure time/date
* whether you apply for support (and if so, state if you are undergraduate / graduate student / postdoc)
* your special needs

Detailed workshop information can be found at https://docs.einsteintoolkit.org/et-docs/ET_Workshop_Spring_2012.

The Einstein Toolkit Consortium.

=== Spacetime Coordinates and Contact Information ===

{| class="wikitable" border="1"
|-
! Dates
| '''Tues, 3. April @ 4pm -- Fri, 6. April @ noon'''
|-
! Location
| Room 319, Georgia Tech Student Center, Georgia Tech, Atlanta
|-
! Contacts
| Workshop email list: '''workshop@einsteintoolkit.org''', emergencies: Frank Löffler (knarf@cct.lsu.edu, +1-225-202-1752) or Tanja Bode (tanja.bode@physics.gatech.edu, +1-814-360-2715)
|-
! Hotel
| A small block of rooms was reserved at the [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG Hampton Inn Atlanta - Georgia Tech], 244 North Ave NW (404-881-0881). The group rate was '''$117 per night plus tax (appr. 16%, resulting in a ~$136 rate)''' and included a hot breakfast and high speed wireless access. A [http://hamptoninn.hilton.com/en/hp/groups/personalized/A/ATLGTHX-ETW-20120403/index.jhtml?WT.mc_id=POG group web page] was available to book online, or you could reserve by phone at 404-881-0881 and ask for the '''"Einstein Toolkit Workshop" rate'''. Attendees had until '''20. March''' to reserve.

In addition, a small block of rooms were reserved at the [http://www.hotelmidtownatlanta.com Hotel Midtown Atlanta]. The group rate was '''$89 per night''' for single occupancy, including breakfast and high-speed internet. For an additional person, add $10 (to cover breakfast costs). Though less convenient to either the APS meeting or this workshop, both can be conveniently reached by transit from the Midtown MARTA station a block away. Reservations at this rate could be done by phone only at 404-873-4800. The block of rooms was released on '''26. March'''.
|-
! Transportation - Hotel
| The best way to get to the hotels from the airport (or elsewhere) is by taking [http://itsmarta.com MARTA]'s red or gold rail line, which costs $2.50 one-way. The Hotel Midtown Atlanta is a block away from Midtown station. For the Hampton Inn, get off at the North Avenue station. It should take approximately 20 minutes to either station. From North Ave station, walk west for ~0.5 miles or transfer to MARTA bus route 26 to the stop immediately in front of the Hampton Inn.
|-
! Transportation - Workshop
| The student center is a 5-minute (~1/3 mile) walk [http://g.co/maps/hdjbt] from Hampton Inn. From the Hotel Midtown Atlanta, Georgia Tech campus (specifically the student center) can be easily reached by taking the [http://pts.gatech.edu/ride/routes_schedules/Pages/TechTrolley.aspx Georgia Tech Trolley] (free) from the Midtown MARTA station to its end station.
|-
! Transportation - From the APS (Hyatt)
| The Workshop is a 1.5 mile walk from the Hyatt where the APS is taking place. The most convenient way to reach the Workshop location on Tuesday is to take [http://itsmarta.com/1-w.aspx MARTA Bus Route 1] from Spring St [http://g.co/maps/jpf3h] (a block away from the Hyatt) directly to the workshop hotel.
|}

== Participant List ==

Below are the ET volunteers who will be presenting or heading parts of the sessions.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Tanja Bode || Georgia Tech
|-
| Dennis Castleberry || Louisiana State University
|- style="background:lightgrey;"
| Peter Diener || Louisiana State University
|-
| Josh Faber || Rochester Institute of Technology
|- style="background:lightgrey;"
| Roland Haas || Caltech
|-
| Frank Löffler || Louisiana State University
|- style="background:lightgrey;"
| Bruno Mundim || Rochester Institute of Technology
|}

The current participant list as of 4. April 2012 follows, in alphabetical order.
Please indicate whether you have already arranged for lodgings so that others looking for hotel roommates
may most easily find them. This page is editable in general (though IPs are logged), so please manage your own
lodging status.

{|class="wikitable" border="2" cellpadding="2"
|-
! Name
! Affiliation
|- style="background:lightgrey;"
| Majd Abdelqader || Queens University
|-
| Rafael Aranha || Georgia Tech
|- style="background:lightgrey;"
| Grayson Carroll || Belmont University
|-
| Roseanne Cheng || UNC-Chapel Hill
|- style="background:lightgrey;"
| Michael Clark || Georgia Tech
|-
| Brett Deaton || Washington University
|- style="background:lightgrey;"
| Tehani K. Finch || Howard University
|-
| Gary Forrester || University of Massachusetts at Dartmouth
|- style="background:lightgrey;"
| Brian Friesen || University of Oklahoma
|-
| Rita Garrido || Georgia Tech
|- style="background:lightgrey;"
| Joshua Harris || Louisiana State University
|-
| Scott Hawley || Belmont University
|- style="background:lightgrey;"
| Matt Kinsey || Georgia Tech
|-
| Jussara Marandola Kofuji || Georgia Tech
|- style="background:lightgrey;"
| Kostas Kokkotas || Universität Tübingen
|-
| Hari Krishnan || Louisiana State University
|- style="background:lightgrey;"
| Sean McWilliams || Princeton
|-
| Philipp Moesta || Caltech
|- style="background:lightgrey;"
| Tuan Anh Nguyen || Georgia Tech
|-
| Prabath Peiris || Rochester Institute of Technology
|- style="background:lightgrey;"
| Larne Pekowsky || Georgia Tech
|-
| Prayash Sharma Pyakurel || Truman State University
|- style="background:lightgrey;"
| Christian Reisswig || Caltech
|-
| Ian Ruchlin || Rochester Institute of Technology
|- style="background:lightgrey;"
| Carl Rodriguez || Northwestern University
|-
| Chao Shi || Georgia Tech
|- style="background:lightgrey;"
| Cody Simmons || North Carolina State University
|-
| Magda Slawinska || Georgia Tech
|- style="background:lightgrey;"
| Petr Tsatsin || Florida Atlantic University
|-
| Alex Vañô Viñuales || University of the Balearic Islands
|- style="background:lightgrey;"
| Andrew Vu || Emory University
|-
| Konstantin Yakunin || Florida Atlantic University / ORNL
|}

== In-Workshop Details ==

=== Schedule ===

{| class="wikitable" border="1"
|-
| Day
| Time
| Activity
| Presenter / Responsible
|-
| Tue
| 16:00-17:30
| Setup for early birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:00-08:30
| Setup for late birds
| Tanja Bode, Roland Haas, Frank Löffler
|-
| Wed
| 08:30-09:00
| Opening, Introduction ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/introduction/introduction.pdf slides])
| Frank Löffler
|-
| Wed
| 09:00-09:30
| Introduction to Scientific Software & HPC ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/hpc_intro/hpc_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 09:30-10:00
| Introduction to Cactus (high-level) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactus_intro/cactus_intro.pdf slides])
| Frank Löffler
|-
| Wed
| 10:00-10:30
| Discussion and break
|-
| Wed
| 10:30-11:15
| [[Introduction to General Relativity]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/genrel/genrel.pdf slides])
| Joshua Faber
|-
| Wed
| 11:15-12:00
| [[Introduction on Cactus Thorn-Writing (lower level)]] ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/cactuswriting/cactuswriting.pdf slides])
| Joshua Faber
|-
| Wed
| 12:00-13:00
| Lunch break
|-
| Wed
| 13:00-13:30
| Introduction to Workshop development environment
| Dennis Castleberry
|-
| Wed
| 13:30-14:15
| Hands-on, provided Wave-Equation example within Cactus ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/example_wavetoy.pdf slides])
| Roland Haas
|-
| Wed
| 14:15-15:15
| [[Introduction numerical methods & numerical Relativity]] 
| Bruno Mundim, Peter Diener
|-
| Wed
| 15:15-15:45
| Discussion and break
|-
| Wed
| 15:45-17:30
| Running and extending (par-file) of two provided examples: perturbed, single [https://docs.einsteintoolkit.org/et-docs/images/6/69/Onepuncture.par BH], and perturbed, single TOV star 
| Frank Löffler, Bruno Mundim
|-
| Thu
| 08:00-09:00
| Introduction in Scientific visualization - a bit of theory and a lot of practice ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/scientific_viz/scientific_viz.pdf slides])
| Tanja Bode
|-
| Thu
| 09:00-10:00
| Invited Talk I -- Matt Duez, Washington University: The Challenge of interpreting data in numerical relativity 
|-
| Thu
| 10:00-10:30
| Discussion and break
|-
| Thu
| 10:30-11:15
| Hands-on: Using visualization tools to look at meaningful quantities ( TOV profile evolutions ) ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz/handson_sviz.pdf slides])
| Tanja Bode
|-
| Thu
| 11:15-12:00
| Create movie of either BH+GW or TOV oscillations using VisIt ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/handson_viz.pdf slides], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/rho.final.session TOV session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/rho.rl4.h5.xz TOV data file], [https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_viz/psi4.volume.session Psi4 session file], [http://www.physics.gatech.edu/~rhaas3/Workshop_Spring_2012/psir.h5.xz Psi4 data file])
| Roland Haas
|-
| Thu
| 12:00-13:00
| Lunch
|-
| Thu
| 13:00-14:15
| Hands-on: Implement your own thorn (neutron star tracking), and visualize it, in teams of about 5 people ([https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_analysis/handson_analysis.pdf slides]), more information at end of wiki
| Roland Haas
|-
| Thu
| 14:15-15:15
| Invited Talk II -- John Wise, Georgia Tech
|-
| Thu
| 15:15-15:45
| Discussion and break
|
|-
| Thu
| 15:45-17:30
| Hands-on: continuation
| Roland Haas
|-
| Fri
| 08:00-09:00
| Presentation of visualization of result of previous session, 6 teams: 8 min each
| Frank Löffler
|-
| Fri
| 09:00-10:00
| Invited talk III -- Gabrielle Allen, LSU
|
|-
| Fri
| 10:00-10:30
| Discussion and break
|
|-
| Fri
| 10:30-11:00
| Tour through available ET components
| Peter Diener
|-
| Fri
| 11:00-11:30
| Overview over supercomputing resources, introduction on how to get accounts / allocations, trends in HPC, reminder how to get ET help in the future
| Joshua Faber, Peter Diener
|-
| Fri
| 11:30-12:00
| The future of the ET: everything we didn't talk about (EOSs, refluxing, multiblock, MHD, radiation ect.)
| Frank Löffler
|}

=== Setup ===
* Wireless access is through the GTVisitor network. '''One''' account per person, please. It will work on multiple devices simultaneously.
* The virtual machine for the workshop is [http://cct.lsu.edu/~dcastl2/] and will run in [http://virtualbox.org virtualbox]

== Area Details ==

* For on-campus directions please consult the link of a detailed '''map of the Georgia Tech Campus''': [http://map.gtalumni.org/]
* For directions of Midtown and Downtown Atlanta follow the link [http://www.atlantadowntown.com/guide]

=== Restaurants ===
'''Places to Eat On-Campus:'''
'''Technology Square''', located on 5th Street and Spring Street, has a variety of good and cheap restaurants including:
* Tin Drum Asia Cafe
* Ray's New York Pizza
* Chuck's Famous
* Barrelhouse
* 5th Street Ribs n' Blues
* Umma's House Restaurant and Cafe
* Waffle House
* Moe's Southwest Grill
* St. Charles Deli
The '''Student Center''' [http://www.studentcenter.gatech.edu] has:
* Chick-fil-a
* Taco Bell
* Subway
* A pub style at Jackets
* Einstein's Bagels
* Ferst Place (Located on the 3rd floor)
* Ferst Food Court (Located on the 2nd floor)

'''Places to Eat Off-campus :'''
* Varsity (American)
: 61 North Ave. NW
* Goodfellas (American)
: 615 Spring Street
* The Real Chow Baby (American Stir Fry)
: 1016 Howell Mill Road
* Zen on Ten Asian Bistro (Sushi)
:1000 Northside Dr. NW
* Spoon (Thai)
: 768 Marietta Street
* The Vortex (American)
: 878 Peachtree Street NE
* Taco Mac (American)
: 933 Peachtree St NE
* La Fonda Latina (Mexican)
: 1025 Howell Mill Road
* Prickly Pear (Mexican)
: 950 West Peachtree St NE
* TheTenth Thai
: 132 10th Street Northeast (Thai)

=== Miscellaneous ===
* Publix at The Plaza Midtown (Supermarket)
: 950 W Peachtree St NW
* Midtown Market (Sundries)
: 225 10th St NE
* Walmart Supercenter (Supermarket)
: 1801 Howell Mill Rd Nw
* Walgreens (Pharmacy)
: 595 Piedmont Ave., Ste. 100
* CVS (Pharmacy)
: 842 Peachtree Street NE

=== Entertainment ===
* Manuel's Tavern [http://www.manuelstavern.com/] (also the site of Astrophysics unplugged)
* Blind Willie's [http://www.blindwilliesblues.com/]

==Hands on material==
===WaveToy===
The source code for the example thorn and the slides is available at
via
cd $HOME
./GetComponents -a https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/example_wavetoy/Cactus/misc/WaveToy.th
cd Cactus
echo 'Introduction/WaveToy' >>configs/sim/ThornList
simfactory/bin/sim build
Once built, you can run this in one line via simfactory
simfactory/bin/sim create-run wavetoy --parfile wavetoy-misc/WaveToy.par
===Static TOV===
Edit par/static_tov.par as Frank indicated and save as $HOME/Cactus/fast_tov.par

To run enter:
cd $HOME/Cactus
exe/cactus_sim fast_tov.par

===Visualization, Hands-on I===
Download the slides and some extra sample data via
cd $HOME
svn co https://svn.einsteintoolkit.org/documents/Workshop_Spring_2012/handson_sviz .
Make sure you have 3d data! If not, add these lines to your tov parameter file and rerun for a bit:
CarpetIOHDF5::out3d_every = 1
CarpetIOHDF5::out3d_vars = " HydroBase::rho "

2011-04-06T05:09:22Z

Bmundim: /* BlueDrop */

This page contains notes and instructions for people running the ET testsuites on various different machines. If you have experience running testsuites on a machine which is not listed here, please consider adding some information which might help others (or yourself!) in future.

=General=

To check out the ET:

mkdir etrelease
cd etrelease
curl -O https://github.com/gridaphobe/CRL/raw/master/GetComponents
chmod a+x GetComponents
./GetComponents --root=. -a https://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th
cp udb.example.pm udb.pm

In udb.pm,

* Replace "redshift" with the name of your local machine, unless you are running on one of the supported machines.

* Replace YOUR_LOGIN, YOUR_EMAIL_ADDRESS and YOUR_ALLOCATION as appropriate.

* Set sourcebasedir for your local machine to be the directory containing etrelease (do not set it to etrelease itself).

* Set your username on each machine:
set_option 'MACHINE' , 'user', 'USERNAME';

See the machine-specific notes below for any additional steps for each machine.

touch par/testsuite.par
sim sync <machine>
sim build --thornlist manifest/einsteintoolkit.th --scriptfile <machine>-testsuite.sh
sim remote <machine> create-submit par/testsuite.par NSLOTS 6:00:00

This is a dummy parameter file.

When the job is finished, you should have the required <machine>_i_j.log files in machine:etrelease/*.log. The testsuite output will also be stored in machine:TEST_XXX, where XXX is constructed from the date at which the job was run.

Update the testsuite status page by adding the log files to the release-info repository:

svn co https://svn.einsteintoolkit.org/www/release-info
cd release-info
scp machine:etrelease/*.log .

Then commit the new/updated files.

To re-run the tests with an updated checkout, run the GetComponents command above with the --update flag, rebuild, delete the "testsuites" output simulation, and resubmit the job.

=Machines=

==Kraken==

Edit simfactory/mdb.pm

- myproxy-logon -p 7514 -s myproxy.teragrid.org -T -l @USER@ -o @SOURCEDIR@/.globus/proxy-teragrid
+ myproxy-logon -p 7514 -s myproxy.teragrid.org -T -l <username> -o @SOURCEDIR@/.globus/proxy-teragrid

where <username> is your user name on Kraken. This is related to [https://trac.einsteintoolkit.org/ticket/381 Ticket #381]

Change the sourcebasedir in simfactory/udb.pm to be under /lustre/scratch. This is necessary because the Cactus directory must be visible from the compute node when running the tests (to see the parameter files, testsuite reference output and test.ccl files), and the home directory on Kraken is not visible from the compute nodes.

set_option 'kraken', 'sourcebasedir', '/lustre/scratch/USERNAME';

Copy kraken.sh as kraken-testsuite.sh in simfactory/scriptfiles. Replace the aprun command with the following:

<pre>
cd @SOURCEDIR@

export CCTK_TESTSUITE_RUN_COMMAND="aprun -n \$nprocs -d 1 \$exe \$parfile"

test_dir=TEST_$(date +%Y-%m-%d-%H%M%S)
mkdir $test_dir

CONFIGNAME=$(ls configs|tail) # SimFactory should provide the configuration name

for i in 1 2 3; do
case $i in
1 )
export CCTK_TESTSUITE_RUN_PROCESSORS=1
export OMP_NUM_THREADS=1;;
2 )
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=1;;
3 )
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=2;;
esac
make $CONFIGNAME-testsuite PROMPT=no
cp TEST/$CONFIGNAME/summary.log kraken__${CCTK_TESTSUITE_RUN_PROCESSORS}_${OMP_NUM_THREADS}.log
mv TEST $test_dir/TEST.$i
done
</pre>

==Datura==

Copy datura.sh as datura-testsuite.sh in simfactory/scriptfiles. Replace the mpirun command with the following:

<pre>
cd @SOURCEDIR@

test_dir=TEST_$(date +%Y-%m-%d-%H%M%S)
mkdir $test_dir

CONFIGNAME=$(ls configs|tail) # SimFactory should provide the configuration name

export CACTUS_STARTTIME=$(date +%s)

for i in 1 2 3; do
case $i in
1 )
export CCTK_TESTSUITE_RUN_PROCESSORS=1
export OMP_NUM_THREADS=1;;
2 )
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=1;;
3 )
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=2;;
esac
export CCTK_TESTSUITE_RUN_COMMAND="${MPIDIR}/bin/mpirun -v --mca btl openib,self --mca mpi_leave_pinned 0 -np \$nprocs -npernode $CCTK_TESTSUITE_RUN_PROCESSORS \$exe -L 3 \$parfile"
make $CONFIGNAME-testsuite PROMPT=no
cp TEST/$CONFIGNAME/summary.log datura__${CCTK_TESTSUITE_RUN_PROCESSORS}_${OMP_NUM_THREADS}.log
mv TEST $test_dir/TEST.$i
done
</pre>

==BlueDrop==

The following script is a slightly modified version of run_tests adapted to run on
the Power7 machine BlueDrop:

set -e

cd Cactus

#Blue drop (Note that we need to specify the absolute path for the bluedrop_run*.ll files):

for i in 1 2 3; do
case $i in
1 )
hostname | grep ^bd && export CCTK_TESTSUITE_RUN_COMMAND="poe \$exe \$parfile -retry -1 -llfile /home/bcmundim/bluedrop_run_1.ll"
export CCTK_TESTSUITE_RUN_PROCESSORS=1
export OMP_NUM_THREADS=1;;
2 )
hostname | grep ^bd && export CCTK_TESTSUITE_RUN_COMMAND="poe \$exe \$parfile -retry -1 -llfile /home/bcmundim/bluedrop_run_2.ll"
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=1;;
3 )
hostname | grep ^bd && export CCTK_TESTSUITE_RUN_COMMAND="poe \$exe \$parfile -retry -1 -llfile /home/bcmundim/bluedrop_run_2.ll"
export CCTK_TESTSUITE_RUN_PROCESSORS=2
export OMP_NUM_THREADS=2;;
esac
make sim-testsuite PROMPT=no
mv TEST/sim/summary.log ../${HOSTNAME}__${CCTK_TESTSUITE_RUN_PROCESSORS}_${OMP_NUM_THREADS}.log
done

Remember to change the absolute path to bluedrop_run_*.ll, as in /home/bcmundim above, to the appropriate location
of your loadlever submission script files.

Testsuite Machines

2011-04-06T05:05:51Z

Bmundim: /* BlueDrop */