SODA Crystal

SODA Crystal provides unified metadata management platform for unstructured data for cloud and more.

Strategy and origin

Considering the state of unstructured data explosion, an efficient data management needs a strong backbone of metadata management. Hence we started thinking to build a dedicated solution for unified metadata management platform, especially for unstructured data.

There are s3 metadata management modules developed as a part of SODA Strato project.
Metadata management is more of a horizontal component across other projects or modules of SODA ODF(Open Data Framework) and any other data management platforms. Hence, when crystal project is planned, we thought of bringing the metadata management modules for s3 from SODA Strato project to this crystal project. Based on our analysis (in progress), there are different open source projects are focussing on metadata management. So the key strategy is to further investigate, derive or onboard suitable modules or projects to crystal solution along with unique features development within the project

So, the strategy is to develop the unique components (or delta with exisitng projects) in this project and integrate other open solutions to build the complete crystal platform of unified metadata management for unstructured data.

Architecture and Modules

• Collector
• Services
• Classification

Progress

• Initial architecture
• Completed : Brining the s3 metadata management modules from SODA Strato
• Completed : Analysis and Requirement recommendations - BMS and AI Driven Search features
• In progress : Refine requirements, design and development of BMS

You have any requirements for metadata management?

Please feel free to share your requirements for crystal here

How to join / contribute to this project?

Join SODA Slack and share your interest in the ‘general’ channel