OSiRIS is a pilot project funded by the NSF to evaluate a software-defined storage infrastructure for our primary Michigan research universities. OSiRIS will combine a number of innovative concepts to provide a distributed, multi-institutional storage infrastructure that will allow researchers at any of our three campuses to read, write, manage and share their data directly from their computing facility locations.
Our goal is to provide transparent, high-performance access to the same storage infrastructure from well-connected locations on any of our campuses. We intend to enable this via a combination of network discovery, monitoring and management tools and through the creative use of CEPH features.
By providing a single data infrastructure that supports computational access on the data “in-place”, we can meet many of the data-intensive and collaboration challenges faced by our research communities and enable these communities to easily undertake research collaborations beyond the border of their own Universities.
My Do, University of Michigan
The Ceph-mgr plugin, influx, was written to simplify the process of retrieving cluster performance counters and to visualizing them on a dashboard. This influx plugin will periodically retrieve the performance counter and send data points to influxdb where it can be queried by a dashboard such as Grafana.
OSiRIS recently finished a 6-month engagement with the Center for Trustworthy Scientific Cyberinfrastructure which is featured on the CTSC Blog. The 2016-2017 CTSC-OSiRIS collaborative design review of OSiRIS Access Assertions produced a set of security recommendations documented in this report that the OSiRIS project plans to implement in its deployed cyberinfrastructure. CTSC identified no significant weaknesses in its review of the initial design of the OSiRIS access control system.
From our perspective, the CTSC staff was helpful in ensuring that we had a well planned and secure design for OAA. The engagment process was extremely valuable and we extend our thanks to CTSC!
At SC16 one of our project engineers had the opportunity to speak with an engineer from Puppet and after the show we had a conversation about OSiRIS for the Puppet blog.
We talked about the project background, goals, and milestones as well as detailing how we leverage Puppet and Foreman in OSiRIS. Read more at the blog post on puppet.com.
The OSiRIS project was featured in the University of Michigan Advanced Research Computing booth at Supercomputing in Salt Lake City this year.
For the week of the conference, November 14 - 18, OSiRIS deployed a 4th storage site in Salt Lake City at the Salt Palace convention center.
SCinet is a high performance advanced network created every year for the Supercomputing conference. SCinet comes together thanks to the hard work of volunteers and the support of industry vendors who donate equipment and services.
On the last day of Supercomputing a call went out to 100G booths to push as much traffic as we could across SCinet LAN and WAN links to set a new SC16 bandwidth record. Of course we had to participate!
To generate traffic we used OSiRIS 100Gb connected hosts at UM, WSU, and MSU as well as 100Gb hosts from ATLAS Great Lakes Tier 2.
The combined traffic of all participating exhibitors set a new record for pushing over 1.2 Terabybtes of traffic over the show floor and more than 1 Terabit/s across WAN circuits.