...
It is possible extract the text contents content of PDFs and images using Optical Character Recognition (OCR). The content can then be included in searches.
...
Content extraction with Microsoft Azure Cognitive Services.
Including asset contents content in searches.
Please be aware of the important information in at the bottom of the page.
Content extraction with Microsoft Azure Cognitive Services
...
A new Computer Vision client can be created with the following steps:
Login Log in to the Azure portal (https://portal.azure.com/).
Search for “Cognitive Services”‘Cognitive Services’
Click “Add”, ‘Add’ to add a new Cognitive Service.
Search for “Computer Vision” ‘Computer Vision’ and create a new client.
...
The Computer Vision resource has a key and a server URL, which will be needed shortly. These can be found by navigating to the Computer Vision resource and locating “Keys ‘Keys and Endpoints”Endpoints’.
...
Content extraction can now be enabled in the Cognitive Service, which is part of Digizuite Core.
On the server where the DAM Center is installed, navigate to the Cognitive Service directory (typically “Webs/<yourDAM><yourDAM>/DigizuiteCore/cognitiveservice”).
Edit the “appsettings.json”-file. The following parameters in the “ComputerVisionDetails”-section are relevant:
Parameter | Description |
|---|---|
OcrKey | The key from the Computer Vision resource created above. (One of the “KEY” ‘KEY’ entries in the image above) |
OcrServerUri | The URI from the Computer Vision resource created above. (The “Endpoint” ‘Endpoint’ entry in the image above) |
OcrExtractFromPdf | If true, the text contents content of PDF files are is extracted when new PDF files are uploaded to the DAM. |
OcrExtractFromImage | If true, the text contents content of images are is extracted when new images are uploaded to the DAM. |
OcrLetAzureRequestFiles | If false, files are explicitly uploaded to the Computer Vision client. Otherwise, Azure will request the files from the DAM Center. Setting this to true is expected to be more efficient, but it requires that the DAM Center can be accessed by Azure. Thus, ensure that the DAM Center is not behind a strict firewall, if this is set to true. |
OcrTaskDelayLength | We regularly check the status of ongoing content extractions in the Computer Vision client. This gives the time interval between each check. The larger the time interval is, the less requests are made to Azure. However, it then also takes more time for the extracted contents content of the files to be available in the “Asset Content” ‘Asset Content’metafield. You most likely don’t have to change this. |
Once the information has been provided, and the “appsettings.json”-file has been saved, the contents content of PDFs and/or images are is extracted when PDFs/images are uploaded.
When the contents content of an asset have has been extracted with Microsoft Azure Cognitive Services, they are it is automatically written to the metafield “Asset content”‘Asset content’.
| Info |
|---|
The metafield “Asset content” ‘Asset content' is automatically created when installing or upgrading to 5.5. The field is created in metagroup “Content”'Content’, and it is very important that this exact field is used in the configuration as the GUID of the metadata field is used as a dependency in the system. |
Including asset content in searches (
...
when using Solr)
The extracted contents content of assets can be included in freetext searches by adding the metafield “Asset content” ‘Asset content' in the search “DigiZuite_System_Framework_Search“ as a freetext input parameter. The “'Asset content” content’ metafield can be added as a freetext input parameter by doing the following these steps:
Find “DigiZuite_System_Framework_Search“ in the ConfigManager for the product correct version of the product to enable this feature for. E.g. the product version of the MM5.the feature should be enabled for.
Add a new input parameter.
Locate and choose the metafield group “Content”‘Content’.
Choose the metafield “Asset content”‘Asset content’, and choose the “FreeText” ‘FreeText’ comparison type. Create the input parameter.
Save the modified search and populate the search cache.
...
The contents content of the asset types you selected in step Step 1 should now be included in freetext searches when new assets are uploaded.
| Info |
|---|
The contents content of existing assets can be extracted by republishing the assets. |
Including asset content in searches (
...
when using ElasticSearch
...
in MM 5.6+
...
)
Go into “Generate settings” => “Asset search”, and In Media Manager, go into ‘General settings → ‘Asset search’, and then add the field “Asset content” to “Freetext search fields”‘Asset content’ to 'Freetext search fields’.
If the “Asset content” ‘Asset content’ field is not available, make sure it’s available from the metadata editor in MM Media Manager and readable for all the people that needs need to search for it. Otherwise, otherwise the Search engine Engine will not index it.
...
Important
...
information
Please be aware of the following when using the Computer Vision resource:
The content extraction has some limitations (see https://docs.microsoft.com/en-us/azure/cognitive-services/computer-vision/concept-recognizing-text). In particular, be aware of the following limitations:
Supported file formats: JPEG, PNG, BMP, PDF , and TIFF.
For PDF and TIFF files, up to 2000 pages (only first two pages for the free tier) are processed.
The file size must be less than 50 MB (4 MB for the free tier) and dimensions at least 50 x 50 pixels and at most 10000 x 10000 pixels.
The PDF dimensions must be at most 17 x 17 inches, corresponding to legal or A3 paper sizes and smaller.
If an error occurs, an error message will end up in the CognitiveServices.error queue in RabbitMQ. You can retry the content extraction by moving the failed message to the CognitiveServices queue. Please be aware of the limitations above before retrying.
There is a cost associated with extracting contents content from files. Please see https://azure.microsoft.com/en-us/pricing/details/cognitive-services/computer-vision/ for more details.
If the extracted contents are content is included in freetext searches, they are it is searched on equal terms with the asset titles. Thus, it might be more difficult to find an asset by title.
Each time an asset is republished, its contents are content is extracted again.
Repopulating search caches might take significantly more time, if content extraction has been enabled.
Freetext searches might be slower when asset contents are content is included. However, we do not expect this to be noticeable.
The DigizuiteCore service CognitiveService must be able to make HTTP calls to Azure over https. If you run into issues, please ensure that outgoing https requests are not blocked by a firewall.
...