Unstructured data in Collibra Data Catalog
DataXray brings unstructured data into Collibra Data Catalog. It scans file shares, cloud storage and content platforms, classifies what each file contains, and syncs the discovered assets, attributes and hierarchies into Collibra with a native connection. Business glossary terms and asset descriptions defined in Collibra propagate back onto files, and DataXray can trigger Collibra workflows, so files are governed like every other data asset.
Why Collibra needs unstructured data
Collibra gives organizations a central, collaborative place to understand, manage and trust their data, but its catalog is built around structured sources. Most of what an organization holds sits in files: documents, emails and attachments, spreadsheets, scans and archives. Without them, data maps, glossaries and records of processing activities describe only part of the estate. DataXray closes that gap by reading the files and cataloging what is in them.
What the integration delivers
The integration populates Collibra Data Catalog with unstructured assets automatically and keeps them current. DataXray does the discovery and classification; Collibra receives the result as governed assets, attributes and relations, so data stewards spend their time on decisions rather than on manual cataloging.
- Scan all unstructured data sourcesthrough 55+ native connectors to datasource types, plus a universal connector for anything else.
- Understand PII and data security risk exposureat the file level.
- Sync identified data into Collibra Data Catalogas assets, attributes and relations.
- Automate file and directory hierarchiesso the catalog mirrors how files are actually stored.
- Propagate business glossary terms, asset descriptions and hierarchiesdefined in Collibra onto the files DataXray has classified.
- Trigger Collibra workflowsautomatically.
- Support AI governanceby identifying which files are suitable for analytics and AI, and which are not.
How it works
The connection is native to Collibra Data Catalog and needs no custom development. You create a service account in Collibra, give its credentials to DataXray, and choose which DataXray datasources to sync. From then on, every file in those datasources is synced with its relevant metadata, and the catalog stays up to date as files change.
- DiscoverDataXray connects to file shares, email and attachments, content management systems and cloud storage, on-premises or in the cloud, and inventories every file.
- ClassifyIt reads each file, including scanned images via OCR, and classifies what it contains, such as PII, financial data and intellectual property, using layered classifiers and customized models that define what matters in your organization. Classification accuracy is 98.7% (measured on document-level PII/PCI detection in text-based English files).
- SyncAssets, attributes, hierarchies and classification tags are written into Collibra in a form Collibra can consume directly, and glossary terms defined in Collibra flow back.
What you can do with it
With files in the catalog, the governance work Collibra already supports extends to unstructured data. Teams can map personal data, maintain records of processing, find data fit for analytics and AI, and make retention and deletion decisions on the basis of what files contain.
- Understand your PIISee where personal data sits in files and who it relates to, with entity search to retrieve everything held on an individual.
- Create data maps and ROPAsBuild data maps for privacy regulations and maintain records of processing activities that include file content.
- Standardize descriptionsApply consistent metadata descriptions across file assets so they can be compared, located and reused.
- Assess data riskPrioritize protection where sensitive data is concentrated.
- Minimize data and manage recordsDecide retention, deletion and access on the basis of content, not location.
- Find data for analytics and AIIdentify files that are useful for analytics and building language models, and those that must be kept out.
In production
The UK Health and Safety Executive uses DataXray with Collibra. "By integrating with Collibra, we gained full control over our data. Compliance and classification are now handled with minimal manual intervention, even across complex cross-border regulations. What used to feel overwhelming is now fully automated and easy to manage." (The Health and Safety Executive)
Where it fits
Collibra is one of several governance tools DataXray feeds. The same classifications drive retention labels, redaction and protection inside DataXray, and can be pushed into Atlan, Microsoft Purview and Virtru at the same time. See Integrations, the Platform overview, or all partners.
Frequently asked questions
How is DataXray connected to Collibra?
Natively. Set up a service account in Collibra Data Catalog, provide its credentials to DataXray, and choose which datasources to sync. No custom code is required.
What does DataXray write into Collibra?
Discovered unstructured assets, their attributes and relations, file and directory hierarchies, and classification results. File contents stay in your environment.
Does information flow from Collibra back to DataXray?
Yes. Business glossary terms, asset descriptions and hierarchies defined in Collibra propagate onto the files DataXray has classified.
Can DataXray trigger Collibra workflows?
Yes. DataXray can trigger Collibra workflows automatically.
Does it support records of processing activities?
Yes. DataXray supports data maps and records of processing activities that include file content, so ROPAs cover files as well as databases.