Pawsey Supercomputing Centre Data Team

The Data Team at the Pawsey Supercomputing Centre is supporting researchers maximise the benefits of applying digital technology within their chosen discipline.

The Data Team includes:

• Mark Gray (Data Technical Specialist)
• Sean Fleming (Data Technical Specialist)
• Dan Marrable (Data Technical Specialist)
• Luke Edwards (Data Advisor)
• Jenni Harrison (Head of Data)
• Chris Schlipalius (Storage Infrastructure Specialist)
• Chris Bording (Cloud Computing Specialist)
• Gene Schneider (Web Data Portal Advisor)
• Scott Atkinson (Senior HSM System Specialist)
• Paul Newman (HSM System Specialist)
• Ashley Chew (Cloud Administrator)

News

Cortex (also know as PB Store) will be removed from service on 31st March 2015.

All data held on Cortex will be inaccessible beyond that time, by any methods and there will be no exceptions.

If you still require any data being held on Cortex, please move this data to another location as soon as possible. Please note the Pawsey Data Store is only available to individuals with collections of > 5TB in size (at the point of application). This is for technical operations, due to the size and scale of the Pawsey Data Store (Peta Scale).

Please note, Cortex traffic in 2015 has risen sharply and all data transfers will be slower than normal. Therefore please plan your data migration appropriately and please expect to move your data as soon as possible. Please ensure enough time is left for data transfers, as data will not be accessible from Cortex after 31st March 2015.

If you require additional storage from Pawsey Supercomputing Centre, and your project can meet the terms and conditions for storage as described on the iVEC web site, please use the online application form available here:

http://www.ivec.org/services/data-storage/data-stores-ivec-application-form/

If you need further information or help please contact

Workflows and Storage

The data team also provide access to tools and facilitate storage workflows. Data tools are being rolled out during 2015 but will include:

1. LiveARC (Mediaflux) and
2. Hadoop

Ever thought you were drowning in a sea of data and don’t know where to get help?

Why don’t you come along to a Data Clinic? There is help available at a ‘drop-in’ Data Clinics near you. At a Clinic you can find out:

• what data storage is available and how to access this
• how to complete the application process
• about data ingest procedures, tools and practices (e.g. what tools to use and why)
• how Data staff can help you identify bottlenecks in present workflow
• how best to share data (especially for researchers with collaborators elsewhere)
• how best to make data discoverable by others.