This Wiki is dedicated to the BlackPearl S3 product including the hardware and software systems:
Spectra markets this product set overall as:
BlackPearl was launched 10 years ago initially as a simple interface to a tape library. AWS S3 was very new at the time but that RESTful interface provided an excellent model for a new way to access a tape library. As that was before Glacier, Spectra provided a modified S3 interface called DS3 which had added calls to handle the complexities of a long SLA (takes an extended time to archive or restore) system. Spectra worked with a large variety of partners to create integrations with a large set of clients needing archive to tape including companies like AVID, Dalet, Globus, Cyberduck and others.
The base BlackPearl system was upgraded to include NAS capabilities and an entire system of product was made available with scale-out NAS providing backup target, general NAS, media storage, and other similar installations up to 20PB in a single rack.
BlackPearl was also upgraded to include a disk layer behind the DS3 interface called “Object Storage Disk” which can act as a tape cache/buffer or be installed independently for customers wanting a deep archive without any tape library.
Over the years, the base BlackPearl system has been enhanced with a variety of value add features including:
About 4 years ago, the Vail program was initiated to provide a fully S3 compatible object storage system and while it can run independently, the BlackPearl system is the natural place to start since it provides a controlled environment, a large variety of physical storage targets, and is already optimized for performance.
By grouping products together, namely the BlackPearl base platform, a tape library, and the overlying Vail software, a BlackPearl S3 based on-prem-Glacier solution can be provided that presents a tape system as Glacier to any S3 client.
While the base offering is very simple and provides a long term secure archive to systems via an S3 interface, the underlying value of the full Vail system is present and provides a broad set of features that make this the most valuable S3 object storage system available.