Usage Bundle metrics

Prev Next

The Usage Bundle contains usage metrics, settings, and environment details. Use this article to find each CSV file and understand its columns. To learn how the bundle is created and sent, see Usage Bundle.

You need the View Usage Reports permission to view or download the bundle.

Files in the bundle

File

Reports

Root folder

Files stored at the top level of the bundle.

application_usage

Daily volume, automation, and QA metrics for the whole system. See Application Usage.

environment_configuration

Environment-variable names and values. Sensitive values are removed.

browser_usage_by_day_and_user

Browsers used to access the application, by day and user.

field_machine_transcriptions_report
cell_machine_transcriptions_report
field_supervision_transcriptions_report
cell_supervision_transcriptions_report
checkbox_machine_transcriptions_report
signature_machine_transcriptions_report

Transcription details for fields, table cells, checkboxes, and signatures, separated by machine and Supervision results.

product_analytics folder

Included only when product analytics data is requested.

infrastructure

Versions of the platform components the instance runs on. See Infrastructure.

vlm_gpu_usage

ORCA request volume and processing time. See VLM GPU usage.

image_correction_usage

Rotation and mobile-capture correction results, by model, with processing times.

settings

The instance's application settings, by group and name.

analytics_metrics
analytics_metrics_per_day

Product analytics event counts, in total and by day.

entry_accuracy

Accuracy of field and cell entries by day.

entry_automation

Automation rates for field and cell entries.

classification_automation_metrics
classification_accuracy
classification_revisions
classification_qa_layout_revisions

Classification automation, accuracy, and layout revision activity.

custom_supervision_chat_usage

Custom Supervision chat activity by day.

manual_task_metrics

Manual task volume and working time by day.

throughput_metrics
hourly_pages_metrics

System throughput by day and page throughput by hour.

system_resource_usage
workers_resource_usage

Resource consumption for the system and for its workers.

base_models
base_model_workflows

Installed base models and the flows that use them.

block_counts
connector_counts
file_filter_block
file_filter_throughput

Counts of blocks and connectors in use, and File Filter block configuration and throughput.

db_entity_counts

Row counts for the platform's main database entities.

license_keys

The instance's license keys and their creation dates.

User, group, and permission CSVs

Users, authentication groups, permission groups, and the mappings between them.

Flow CSVs

Flows and flow versions, with their live and archived states.

daily_metrics folder

Included only when daily metrics are requested.

Prior-day classification events

Classification events recorded on the previous day.

Prior-day reclassified documents

Documents reclassified on the previous day.

Application Usage

The Application Usage report contains one row for each day in the selected period.

Column

Description

Calculation

Date

The reporting day.

Uses the selected date range. For days with no usage, every other column shows 0.

Number of Submissions Created

New Submission IDs created.

One per submission, dated by submission creation.

  • In v43.1 and later, it is recorded at creation;

  • in v43.0, at completion.

Number of Submissions Completed

Submissions whose status changed to Complete during the period.

Recorded when the submission completes and dated by submission completion.

Number of Documents Created

New Document IDs created.

One per document. Recorded when the submission completes and dated by submission creation.

Number of Documents Completed

Documents whose status changed to Complete during the period.

Counted as one for every document linked to a submission. Recorded when the submission completes and dated by submission completion.

Number of Pages Created

Submission pages linked to a submission created during the period.

Dated by submission creation.

  • In v43.1 and later, it is recorded at creation;

  • in v43.0, at completion.

Number of Pages Completed

Submission pages linked to a submission completed during the period.

Recorded when the submission completes and dated by submission completion.

Number of Pages Matched to Structured Layout Variations Created

Pages on Structured documents linked to a submission.

One per Structured-document page. Recorded when the submission completes and dated by submission creation.

Number of Pages Matched to Structured Layout Variations Completed

Pages on Structured documents linked to a completed submission.

Counted as one for every page on a Structured document. Recorded when the submission completes and dated by submission completion.

Number of Pages Matched to Semi-Structured Layout Variations Created

Pages on Semi-structured documents linked to a submission.

Counted as one for every page on a Semi-structured document. Recorded when the submission completes and dated by submission completion.

Number of Pages Matched to Semi-Structured Layout Variations Completed

Pages on Semi-structured documents linked to a completed submission.

Counted as one for every page on a Semi-structured document. Recorded when the submission completes and dated by submission completion.

Number of Pages with Fields on Them Created

Pages with at least one field or cell, on documents linked to a submission.

Counted as one for every qualifying page. Recorded when the submission completes and dated by submission completion.

Number of Pages with Fields on Them Completed

Pages with at least one field or cell, on completed or failed documents linked to a submission.

Counted as one for every qualifying page.

Number of Fields Created

Fields on every page of documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Fields Completed

Completed fields on every page of documents linked to a submission.

Always equal to Number of Fields Created.

Number of Characters Completed

Characters transcribed by the machine or a person in completed, non-skipped fields and cells. Data removed by PII deletion is excluded. Each checkbox counts as one character.

Recorded when the submission completes and dated by submission completion.

Seats

Users who logged in at least once that day.

Aggregated on user login, using the user's last login date.

Number of Files Submitted

Files used to create the submission.

Aggregated on submission start, using the submission's creation date.

Number of Entries Machine Transcribed

Completed fields and cells transcribed by the machine, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Entries Manually Transcribed

Completed fields and cells transcribed by a human, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Fields Machine Identified

Completed fields identified by the machine, excluding Flexible Extraction tasks, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Fields Manually Identified

Completed fields identified by a human, excluding Flexible Extraction tasks, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Pages Classified Automatically

Pages linked to a submission that were classified by the machine.

Recorded when the submission completes and dated by submission completion.

Number of Pages Classified Manually

Pages linked to a submission that were classified by a human.

Recorded when the submission completes and dated by submission completion.

Number of Unique Layout Variations Matched

Unique layouts matched to submission pages. A submission can be counted on two days if it is created and completed on different dates.

Recorded when the submission completes and dated by submission completion.

Number of QA Responses on Manual Transcription

Human Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Correct Responses on Manual Transcription

Correct human Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Responses on System Transcription

System-attributed Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Correct Responses on System Transcription

Correct system-attributed Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Responses on Machine Transcription

Machine Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Correct Responses on Machine Transcription

Correct machine Transcription QA responses for fields without manual Supervision on Structured and Semi-structured documents.

Aggregated on submission completion and Transcription QA response, using the submission's completion date.

Number of QA Responses on Manual Field Identification

Identification QA responses performed by a human, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of QA Correct Responses on Manual Field Identification

Correct Identification QA responses performed by a human, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of QA Responses on System Field Identification

Identification QA responses attributed to the system, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of QA Correct Responses on System Field Identification

Correct Identification QA responses attributed to the system, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of QA Responses on Machine Field Identification

Identification QA responses performed by the machine, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of QA Correct Responses on Machine Field Identification

Correct Identification QA responses performed by the machine, for fields on Semi-structured documents.

Aggregated on submission completion and Identification QA response, using the submission's completion date.

Number of Incremental Fields Machine Transcribed

Machine field transcriptions automated through finetuning that would otherwise require Supervision.

Recorded when the submission completes and dated by submission completion.

Organize Documents: Number of Tasks Performed

Completed Classification Supervision tasks.

One per completed task. Recorded when the Classification Supervision response is submitted and dated by task completion.

Organize Documents: Number of Pages Shown in Step 1

Pages that machine classification left unmatched and sent to a completed Classification Supervision task.

Aggregated on Classification Supervision task response, using the task's completion date.

Organize Documents: Number of Pages Categorized in Step 1

Pages left unmatched by machine classification that a human then classified, for every completed task.

Aggregated on Classification Supervision task response, using the task's completion date.

Organize Documents: Number of Documents Created in Step 1

Documents the user created or changed, such as by changing the layout, for every completed task.

Aggregated on Classification Supervision task response, using the task's completion date.

Organize Documents: Number of Documents Outputted in Step 1

Resulting documents, for every completed task.

Aggregated on Classification Supervision task response, using the task's completion date.

Organize Documents: Number of Folders Created in Step 2

Resulting folders, for every completed task.

Aggregated on Classification Supervision task response, using the task's completion date.

Number of Live Layout Variations

Live layouts that existed that day.

Aggregated at the beginning of the day.

Software Version

The software version running that day.

Aggregated at the beginning of the day.

Number of Machine Match Non-Structured Pages

Non-Structured pages linked to a submission that were classified by the machine.

Recorded when the submission completes and dated by submission completion.

Number of Human Match Non-Structured Pages

Non-Structured pages linked to a submission that were classified by a human.

Recorded when the submission completes and dated by submission completion.

Number of Releases

Releases that existed that day.

Aggregated at the beginning of the day.

Number of Archived Releases

Archived releases that existed that day.

Aggregated at the beginning of the day.

Number of Layout Variations

Layouts that existed that day.

Aggregated at the beginning of the day.

Number of Archived Layouts

Archived layouts that existed that day.

Aggregated at the beginning of the day.

Number of Layout Versions

Layout versions that existed that day.

Aggregated at the beginning of the day.

Number of Live IDP Flows

Distinct active releases deployed in live flows that day.

Aggregated at the beginning of the day.

Number of Table Cells Created

Cells on every page of documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Table Cells Completed

Completed cells on every page of documents linked to a submission.

Always equal to Number of Table Cells Created.

Number of Table Cells Machine Identified

Completed cells identified by the machine, excluding Flexible Extraction tasks, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Table Cells Manually Identified

Completed cells identified by a person. Flexible Extraction tasks are excluded.

Recorded when the submission completes and dated by submission completion.

Number of QA Responses on Manual Non-Structured Classification Pages

Classification QA responses performed by a human, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of QA Correct Responses on Manual Non-Structured Classification Pages

Correct Classification QA responses performed by a human, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of QA Responses on System Non-Structured Classification Pages

Classification QA responses attributed to the system, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of QA Correct Responses on System Non-Structured Classification Pages

Correct Classification QA responses attributed to the system, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of QA Responses on Machine Non-Structured Classification Pages

Classification QA responses performed by the machine, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of QA Correct Responses on Machine Non-Structured Classification Pages

Correct Classification QA responses performed by the machine, for non-Structured documents linked to a submission.

Aggregated when Classification QA consensus is reached, using the submission's completion date.

Number of Fields Extracted in Flexible Extraction

Completed fields transcribed in Flexible Extraction, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Table Cells Extracted in Flexible Extraction

Completed cells transcribed in Flexible Extraction, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Fields Extracted in Custom Supervision

Completed fields transcribed in Custom Supervision, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Table Cells Extracted in Custom Supervision

Completed cells transcribed in Custom Supervision, for every page on documents linked to a submission.

Recorded when the submission completes and dated by submission completion.

Number of Flows

Flows that existed that day.

Daily average of the recorded flow count, truncated to a whole number.

Number of Live Flows

Live flows that existed that day.

Daily average of the recorded live flow count, truncated to a whole number.

Number of QA Responses on Machine Full Page Transcription

Full Page Transcription QA responses performed by the machine, for documents linked to a submission.

Aggregated when Full Page Transcription QA consensus is reached, using the submission's completion date.

Number of QA Correct Responses on Machine Full Page Transcription

Correct Full Page Transcription QA responses performed by the machine, for documents linked to a submission.

Aggregated when Full Page Transcription QA consensus is reached, using the submission's completion date.

Checksum

An MD5 hash of the row's date and metric values, used to verify that the row has not been altered.

Calculated per row after all other columns are populated.

VLM GPU usage

In v43.2 and later, product_analytics/vlm_gpu_usage.csv reports ORCA requests, images, and processing time. Rows are grouped by day, task, and base model.

Column

Description

Period Start

The reporting date.

Task Name

The ORCA task: field_extraction or general_prompting.

Base Model ID

The base model used for the task.

Processing Seconds Avg

Average processing time for the reported requests.

Processing Seconds Max

Longest processing time for the reported requests.

# of requests

The number of ORCA requests.

# of images

For Field Extraction, the number of document pages processed. For general prompting, the number of images submitted.

Infrastructure

product_analytics/infrastructure.csv contains one row for each platform component and reports its version.

Component

Reported version

database

Database vendor and version.

system

Operating-system platform and version.

kubernetes

Deployed Kubernetes version.

helm-chart

Helm chart version used for deployment.