new user
What is XSEDE?
The Extreme Science and Engineering Discovery Environment (XSEDE) is the most advanced, powerful, and robust collection of integrated advanced digital resources and services in the world. It is a single virtual system that scientists can use to interactively share computing resources, data, and expertise.
Steps for new users
- XSEDE User Portal
- Apply for an XSEDE allocation
- User Responsibility & Security
- Accessing Resources
- File Transfers
- Managing Your Software Environment
- Basic Job Submission
- How to Get Help
XSEDE User Portal
The XSEDE User Portal is a web-based single point of access to the following services:
- Access to your all your XSEDE accounts and allocated resources
- Method to request compute, data, and advanced support allocations resources for individual projects, Science Gateways, and for classroom training
- Interfaces for data management, data collections, and other user tasks and resources
- Access to the XSEDE Knowledge Base, Help Desk, and online training
You can register for an XSEDE User Portal account for free anytime with no allocation. You can only get an account on a resource as part of an allocation, so you either need to apply for an allocation (see Get an Allocation) or be added to an existing allocation (see Adding a User).
Apply for an XSEDE allocation
An allocation is an award of computing time on the computing resources of your choice. Only those users with an allocation may access XSEDE resources. A user may request either a Startup (or Education) Allocation or a Research Allocation. Both types of allocations include:
- An allotment of Service Units (SUs) where 1 SU = 1 hour of computing on 1 CPU. Startup allocations vary in allotment size, while a Research Allocation allotment is unlimited.
- Archival storage.
Request a Startup allocation
Submit an allocation request via the XSEDE portal. To complete the form, you will need the following information:
- An estimate of the computing time needed in SUs, or an estimate of the amount of storage needed (in Terabytes, or TB).
- A short abstract of your computational project
- The Principal Investigator's CV
Startup allocations vary in allotment size, depending on the resources requested. The total Startup allocation across all resources cannot exceed 200,000 SUs. For resource specific Startup limits, please see: LINK TO RESOURCE CATALOG
Startup and Educational requests are reviewed year-round. This type of allocation is aimed at users who want to test and develop their code on XSEDE, for users wanting to try out resources, users with limited data needs, or for classroom teaching situations. Features and uses of the Startup/Educational allocation include the following:
- Experiment with code(s) and task(s) on the various resources for one year
- Find the best mapping of your research task flow to the resources
- Document this mapping to write a Research Allocation Request: define a science goal and discuss how many SUs you will need on which systems to accomplish it over one calendar year
- Easier request process requiring a curriculum vitae and abstract (compared to a full request as in the Research Allocation request).
Request a Research allocation
For Research Allocations, a more detailed request is required. The process is outlined on the Allocations and Accounts page. Requests for Research Allocations require a more extensive application process and uploading of supporting documentation.
Submit your allocation request
Submit your request electronically via the XSEDE portal. Users will be notified via email when their allocations are approved or when they have been added to an allocation. Principal Investigators will be able to delegate an allocation manager who can manage their allocations for them. This will be done in the user portal under My XSEDE -> Allocations/Usage
User Responsibility & Security
As an XSEDE user, you'll have access to some of the best high performance computing and data resources in the country. Following are rules of acceptable use to protect these valuable, shared resources and intellectual property.
- If you have any suspicion that your account or personal computer has been compromised email help@xsede.org or call 24/7: 1-866-907-2383 immediately.
- Save your Account Information Packet in a safe place; you will need it to reset your password.
- Do NOT share login information under any circumstances. It's easy for PIs to add users through the User Portal. In addition, community and training accounts are available for special situations.
- If individuals leave your project, use the same form to remove their account from your allocation.
- When changing passphrases and passwords, use strong passwords with mixed cases and character types.
- Don't use passwordless SSH keys (see the SSH page for details).
- Protecting computing, closing terminals when done, logging out of the XSEDE User Portal when done, etc.
Accessing Resources
Logging in to XSEDE
You will be emailed an information packet containing your password. If at any time you don't remember your password, or want one for a specific resource, submit a helpdesk ticket. XSEDE resources can be accessed using two methods:
-
XSEDE User Portal
The user portal is a web-based interface. You can view all of your account information and usage, monitor usage statistics on all resources, and access documentation from this interface.
-
Command line (Unix/Linux)
The traditional method of accessing supercomputing resources. Each hardware resource on XSEDE may be accessed via SSH username/password or by grid proxies. Individual resource login
To use a single XSEDE resource, login using the username and host name of the resource. Depending on the resource, you may or may not use a password to authenticate. This information, provided in your Account Information Packet, will indicate whether you may log in using the XSEDE User Portal or using SSH at the command line. To login using the command line, use this syntax:
ssh login_name@host_name
File Transfers
Before you start computing you'll probably need to transfer some files either from another XSEDE resource or from your local machine.
- Moving data between resources on XSEDE. A number of clients are available at the RP sites, most of which are based on gridFTP. You may choose an appropriate client depending on the location and size of your transfer. This page defines the available gridFTP clients.
- Moving data to XSEDE from a local machine. This might include observational data from sensors, surveys, etc., that will be analyzed on XSEDE computing resources. Basic Unix commands will work for most transfers. Some sites have clients to assist in moving your data to XSEDE more efficiently. (see Moving Local Files to XSEDE) Transferring data between your local client machine is typically done using common Unix commands. While these commands can be used to move data between XSEDE resources, it is highly recommended that the GridFTP transfer methods described below be used for optimum performance.
Managing Your Software Environment
Basic Job Submission
The job scheduler (or batch system) must be used for computing jobs that will run for more than a few minutes. Actual job control commands are dependent upon that particular machine's job scheduler, but all schedulers follow the same general principles.
qsub <job script name> |
Submit a job to the queue |
qstat -a |
def |
qstat -u username |
def |
qdel jobid |
delete <jobid from the queue> |
man qsub |
consult the qsub manual page for more information |
How to Get Help
Help is available in many ways:
- Submit a help ticket link needed
- Email help@xsede.org
- Use the XSEDE User Portal 'MyXSEDE->Tickets' tab
- Call the XSEDE Help Desk 24/7: 1-866-907-2383
- Search the XSEDE Knowledge Base link needed.