See examples of innovation from successful companies of all sizes and from all industries
Microsoft Azure Data Manager for Agriculture
Azure Data Manager for Agriculture extends the Microsoft Intelligent Data Platform with industry-specific data connectors and capabilities to bring together farm data from disparate sources, enabling organizations to leverage high quality datasets and accelerate the development of digital agriculture solutions
Build, manage, and continuously deliver cloud apps—with any platform or language
Analyze images, comprehend speech, and make predictions using data
Simplify and accelerate your migration and modernization with guidance, tools, and resources
Gather, store, process, analyze, and visualize data of any variety, volume, or velocity
Bring the agility and innovation of the cloud to your on-premises workloads
Connect, monitor, and control devices with secure, scalable, and open edge-to-cloud solutions
Help protect data, apps, and infrastructure with trusted security services
Reach more customers—sell directly to over 4M users a month in the commercial marketplace
Microsoft Purview is a unified data governance service that helps you maximize business value of hybrid data. Microsoft Purview Data Map enables you to automate scanning and classify data at scale. Microsoft Purview Data Catalog enables self-serve data discovery to accelerate BI, Analytics, AI and ML.
Prices are estimates only and are not intended as actual price quotes. Actual pricing may vary depending on the type of agreement entered with Microsoft, date of purchase, and the currency exchange rate. Prices are calculated based on US dollars and converted using London closing spot rates that are captured in the two business days prior to the last business day of the previous month end. If the two business days prior to the end of the month fall on a bank holiday in major markets, the rate setting day is generally the day immediately preceding the two business days. This rate applies to all transactions during the upcoming month. Sign in to the
Azure pricing calculator
to see pricing based on your current program/offer with Microsoft. Contact an
Azure sales specialist
for more information on pricing or to request a price quote. See
frequently asked questions
about Azure pricing.
US government entities are eligible to purchase Azure Government services from a licensing solution provider with no upfront financial commitment, or directly through a pay-as-you-go online subscription.
US government entities are eligible to purchase Azure Government services from a licensing solution provider with no upfront financial commitment, or directly through a pay-as-you-go online subscription.
The Microsoft Purview Data Map stores metadata, annotations and relationships associated with data assets in a searchable knowledge graph.
End users consume the technical metadata, lineage, classification and other information in the Data Map through purpose-built applications such as Data Catalog, Data Estate Insights and more.
Data Map is populated at cloud scale and kept up to date through automated scanning, classification, and updates sent from data systems across cloud and on-premises configured for discovery with a Microsoft Purview account.
Data Map can be enriched by processing information contained in the Data Map to simplify search, generate insights, optimize storage of data assets and more.
Developers can also build their own apps powered by the Microsoft Purview Data Map using open APIs including Apache Atlas, scan APIs and more.
Data Map is billed across three types of activities:
Data Map Population
—examples include metadata & lineage extraction or classification based on metadata & content inspection.
Data Map Enrichment
—examples include use of resource sets to optimize storage of data lake assets, or aggregation of classifications to generate insights.
Data Map Consumption
—examples include serving up search results or rendering lineage graph. This also includes the use of Apache Atlas API to build apps on Data Map.
Example Scenario:
In addition to the above, here is more information about how pricing works in GA to help estimate costs.
Data Map can scale capacity elastically based on the request load. Request load is measured in terms of data map operations per second. As a cost control measure, a Data Map is configured by default to elastically scale within the
elasticity window
.
Data Map (Always on)
: 1 capacity unit x
$-
per capacity unit per hour x 730 hours for up to 10 GB metadata storage and 25 operations per sec
Scanning (Pay as you go)
: Total [M] min duration of all scans in a month / 60 min per hour x 32 vCore per scan x
$-
per vCore per hour
Resource Set
: Total [H] hour duration of processing Advanced Resource Set data assets in a month *
$-
per vCore per hour
Data Map Population
Automated Scanning, Ingestion & Classification
Data Map population is serverless and billed based on the duration of scans (includes metadata extraction and classification) and ingestion jobs. Automated scans using native connectors trigger both scan and ingestion jobs. Push based updates from a Microsoft Purview client (e.g., lineage push from Azure Data Factory) only trigger ingestion jobs.
Duration of these jobs can vary based on the number of systems scanned or pushing updates, data assets contained in the scanned systems, number of classifications selected, the shape of the data and performance of the system scanned.
Note: Scan and ingestion jobs do not include addition or modifications of entities using Apache Atlas, which are instead billed as Data Map Consumption based on the Capacity Units driven by request load in terms of operations/second.
Note: Microsoft Purview provisions a storage account and an Azure Event Hubs account as managed resources within the subscription that the Microsoft Purview account is provisioned in. This is required to support enhanced security features during scanning. This may incur separate charges that in most cases will not exceed 2% of charges for scanning. Refer to the Managed Resources section in the Azure portal within Azure Purview Resource JSON.
Note: Customers using Microsoft Purview to govern data in other clouds (example AWS, GCP) may incur additional charges due to data transfers and API calls associated with the publishing of meta-data into the Microsoft Purview Data Map. This charge varies by region. For scanning of data in AWS, refer to the Billing and Management console within the AWS Management Console to view these charges.
Data Map Enrichment
Advanced Resource Set
Advanced Resource Set is a built-in feature of the Data Map used to optimize the storage and search of data assets associated with partitioned files in data lakes. Billing for processing the resource set data assets is serverless and based on the duration of the processing, which can vary based on the change in partitioned files and resource set profile configured.
Insights Generation
Insights Generation aggregates metadata and classifications in the raw Data map into enriched, executive-ready reports that can be visualized in the Data Estate Insights application and granular asset level information in business-friendly format that can be exported. Report visualization and export incurs charges from Insights Report Consumption in the Data Estate Insights application.
Note: By default, Insights Generation is enabled at provisioning and can be turned off in the Management center of Microsoft Purview governance portal. Disabling Insights Generation will stop refreshing of reports in the Data Estate Insights application. By default, Insights Generation runs automatically based on Data Map updates.
Data Map Consumption
Elastic Data Map
By default, a Microsoft Purview account is provisioned with a Data Map of at least 1 Capacity Unit. 1 Capacity Unit supports requests of up to 25 data map operations per second and includes storage of up to 10 GB of metadata about data assets. The first 1MB of Data Map meta data storage is free for all customers.
The Data Map can scale capacity elastically based on the request load. Request load is measured in terms of data map operations per second. As a cost control measure, a Data Map is configured by default to elastically scale within the
elasticity window
.
A data map operation is a create, read, update, or delete of an entity in the Data Map. Examples of an entity include a data asset or a lineage relationship between two data assets. A search request may require multiple operations depending on the assets returned and complexity of the request. The storage size of an entity may vary depending on the type of entity and annotations associated with the entity.
Data Map requires an additional Capacity Unit for every 10 GB of metadata storage required. For example, a Data Map with 10 GB of metadata storage is billed at 1 Capacity Unit per hour. If the addition of new data assets increases the size to 10.1 GB, the Data Map is billed at 2 Capacity Unit per hour.
Microsoft Purview Applications
Microsoft Purview Applications are a set of independently adoptable, but highly integrated user experiences built on the Data Map including Data Catalog, Data Estate Insights and more. These applications are used by data consumers, producers, data stewards and officers that enable enterprises to ensure that data is easily discoverable, understood, high quality, and all use is per corporate and regulatory requirements.
Data Catalog
Data Catalog is an application built on Data Map for use by business users, data engineers and stewards to discover data, identify lineage relationships and assign business context quickly and easily.
Capabilities marked Included with Data Map are billed as the consumption of the Data Map Capacity Unit.
Data Estate Insights
Data Estate Insights is an application built on Data Map for use by Data Officers and Stewards to understand the data estate health and governance posture of their diverse data estate and drive corrective actions to close gaps. Data Estate Insights serve up enriched data generated through Insights Generation, which is charged separately as indicated above in the Data Map Enrichment – Insights Generation section.
Insights consumption is billed per API call. One API call returns up to 10,000 rows of tabular result.
In place sharing for Azure Blob Storage and Azure Data Lake Storage (ADLS Gen2) storage accounts
Free in preview
Connect with us directly
Get a walkthrough of Azure pricing. Understand pricing for your cloud solution, learn about cost optimization and request a custom proposal.
For a limited time, Microsoft Purview will have free scanning and classification for on-premises SQL Server that can be connected to Microsoft Purview through the scanning and classification run-time hosted on-premises. All other SQL Servers using the cloud run-time are not covered under this free scanning.
What is Data Map capacity unit?
The Data Map is a map of data assets, associated metadata and lineage connecting data assets. A capacity unit is a provisioned set of resources to keep your Data Map up and running. One capacity unit can support approximately 25 operations per second and includes 10 GB of metadata storage. This capacity is used by user experiences in Microsoft Purview Studio or Apache Atlas APIs.
What is covered in the free 1MB of data map storage? What can I get with this free quantity?
You get the first 1MB of metadata storage free as part of your Microsoft Purview account. This helps you try the Data Map capabilities by enabling you to scan a small data source (with <1MB metadata) and try out Microsoft Purview.
What are the limits on Data Map capacity that can be provisioned per Microsoft Purview account?
You can provision a Data Map with capacity unit count of 1 or above. Data Map metadata storage scales linearly in 10 GB increments per provisioned Capacity Unit. The capacity of the Data Map cannot be changed after provisioning. As a cost control measure, a Data Map is configured by default to elastically scale up within the
elasticity window
. Please refer to documentation
here
for more details on the elastic window.
How will I get charged for Data Estate Insights?
Data Estate Insights are enabled by default with the Data Map to enable governance users to experience the rich and actionable insights on their data estate.
With Data Estate Insights, you will see two line-items added to your bill.
First, the Data Map Enrichment – Data Insights Generation, for processing governance metrics and tabularizing your Data Map for governance and business consumption.
Second, the Data Insights Consumption, that are API calls made as you consume any of the reports from the Data Estate Insights application.
What is an API call in Data Estate Insight App?
Data Estate Insights API calls serve aggregated and detailed data to users across asset, glossary, classification, sensitive labels, etc. 1 Insight API call includes up to 10,000 read operations as the users consume Insights from the main dashboard or the detail pages. Each read equates to a row of tabular data in the application.
