---
title: "Training a New Field Identification Model"
slug: "training-a-new-field-identification-model"
updated: 2025-07-15T05:25:58Z
published: 2025-07-15T05:25:58Z
canonical: "help.hyperscience.ai/training-a-new-field-identification-model"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://help.hyperscience.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Training a New Field Identification Model

> [!WARNING]
> **Accessing this feature**
> 
> Your access to the feature described in this article depends on your license package and pricing plan.
> 
> To learn which features are available to your organization and how to add more, contact your Hyperscience representative.

There are two ways to train a Field ID model.

1. To manually train and deploy models, go to the Model Details page, and follow the instructions in this article.
2. To automatically train and deploy Field ID models, you can enable the **Continuous Field Locator model improvement** setting.
  - For optimal performance, we recommend that you train models manually and disable the **Continuous Field Locator model improvement** setting. Only enable this setting if instructed to do so by a Hyperscience representative.
  - See [Identification Settings](/v41/docs/identification-settings) for more information about **Continuous Field Locator model improvement**.

To train and deploy models, go to the Model Details page. Once you determine a Semi-structured layout where you would like to train a model, there are two ways to get to the Model Details page:

1. Go to **Library** > **Models**, select **Identification Models** from the drop-down list at the top of the page, and then click on the name of the model.
2. Go to **Layouts**, click on the name of the layout, and then click on the name of the Identification Model on the Layout Details page.

To understand the requirements to train a model, see [Requirements for Training a New Model](/v41/docs/requirements-for-training-a-new-model).

## Multiple Occurrences Field ID model

The Multiple Occurrences (MOs) feature helps you identify multiple instances of a field. Learn more about fields with various occurrences in [Field Identification](/v41/docs/field-identification).

> [!NOTE]
> Generic Engine type
> 
> The Generic Engine type is used to train Field Identification, Table Identification, and Multiple Occurrences (MO) models. For more information, contact your Hyperscience representative.

### Multiple Occurrences checkbox

The default Field ID model can predict multiple occurrences of fields. Users can now indicate whether a field needs annotation in multiple instances by selecting the **Multiple Occurrences** checkbox in the Layout Editor.

![](https://lh7-us.googleusercontent.com/7AmpGGppsbs_6AobtT_vVtlFMxZUtsjsM25GGOe1cSpfu_IyPAuTevtw46ur_Fi6RiNydgQOblA8glDKjWRXjNiSr2PRHFsV743zffgwxGgyPq0YVhNdGPJgB2urhvvLjRmNtDQzasreEDb-TzGGlyw)

> [!NOTE]
> When creating a layout, the checkbox is deselected by default.

- When this checkbox is selected, Multiple Occurrences annotations will be enabled, and the model will look for multiple instances of a specific field.

![](https://lh7-us.googleusercontent.com/u6HTCOQ1UqGS0_fE7MqJTtm-H_LnPUqL27S0ewSUH68chSPw-jJ0qa3LBbsJbZ4u10zpKJe4zoMaM1f8a-bRNMDPANOk0CHM2MMO-eUCyxlp4iQbn0oU7C0LuojM1Fo7MXuPp4mqr6-06LGT_o6OsWK-Ry4FhlAw1_01q2Ca3dDHqBF__VcUsr-noSjz5g)

- When this checkbox is deselected, you can annotate only a single instance of the field. The model will return only one result.

![](https://lh7-us.googleusercontent.com/4VPurv0qOFaL4zZQDKI1BiPPhANKG7cGNA4EZPThhUVRTYcHhLmWaMFmCUv-EzZG-jbJ05lHLlrhNjiqfGXfTjgw_VBfAZp8jCMPM9ptYC-kpdEPIeoeLbYtjKLU8M77EWDa6Lx_kDn5OX75VcXwPbXiPeFlrEr12l9qeKg9nwp5e45mpBRkZmN0DK7bzg)

> [!NOTE]
> If you select the Multiple Occurrences checkbox for a field, annotate your dataset, and then deselect the checkbox, the annotations won’t be invalidated. Still, the Training Data Analysis will display anomalies for documents that have multiple instances of that field. Learn more about anomalies in [Labeling Anomaly Detection](/v41/docs/labeling-anomaly-detection).

### Long-form (Unstructured) Extraction Field ID model

> [!NOTE]
> **GPU trainer required**
> 
> A GPU trainer is required in order to use Long-form Extraction (f.k.a. Unstructured Extraction). Contact your Hyperscience representative for more information.
> 
> If you have an on-premise deployment of Hyperscience, you can also learn more by reviewing the "Enabling Trainers with GPUs" articles for [Docker](/deployment/docs/enabling-trainers-with-gpus-in-on-premise-docker-deployments), [Podman](/deployment/docs/enabling-trainers-with-gpus-in-on-premise-podman-deployments), and [Kubernetes](/deployment/docs/enabling-trainers-with-gpus-in-on-premise-kubernetes-deployments).

The default Field Identification models use a generic engine type that cannot extract data points from documents with unstructured text. To extract data points from Unstructured documents using a specific layout, you need to select the **Long Form Extraction** engine type for that layout before training the model. Follow the steps below to change the engine type of your layout:

1. Go to **Library** > **Layouts** and open your layout.
2. On the **Configuration** card, click the **Edit** button (![](https://cdn.us.document360.io/87894cef-4958-4f3f-be6f-b75a78c82548/Images/Documentation/image(116).png)) under the **Engine Type** setting.
3. Select **Long Form Extraction** from the drop-down menu.
4. Click **Change Type**.

![](https://cdn.us.document360.io/87894cef-4958-4f3f-be6f-b75a78c82548/Images/Documentation/2025-03-27_22-08-35 (1).gif)

> [!NOTE]
> Retraining required
> 
> Retrain your model after you’ve changed the engine type of the layout.

When training a model for Long-form Extraction, the following limits apply:

- 2,000 text segments per page
- 200 pages per document
- 200,000 text segments per document
- 100,000,000 text segments total

To initiate model training, follow the steps from the [Initiating Model Training](/v41/docs/training-a-new-field-identification-model1#initiating-model-training) section below.

## Initiating Model Training

On the Model Details page, you can see if you've completed enough QA or Field ID Supervision to initiate training. If you have not yet reached the minimum, you'll see the number of additional documents required to reach the minimum.

- Once you've reached the minimum, train a model by clicking the **Run Training** button (if there is no previous model) or **Actions** > **Run Training** (if there is an existing model).
- After initiating training, the system will show that the model is pending.

Monitor the **Notifications** in the top right of the application to keep track of model training jobs.

To cancel a model training job, see [Canceling or Retrying a Training Job](/v41/docs/canceling-or-retrying-a-training-job).

## Anomaly Detection

With the Anomaly Detection feature, the system analyzes your training data and flags potential anomalies in the annotations for you to review. When you review each flagged annotation, you can mark it as correct or edit the annotation. If you re-train a model after reviewing the anomalies, you will improve automation. You can manually initiate model training at any point, even if you haven’t reviewed all of the flagged anomalies.

For more information, see [Labeling Anomaly Detection](/v41/docs/labeling-anomaly-detection).

## Additional Notes

- If your deployment does not have a dedicated machine for training, document processing times will be severely delayed while the model trains. Without a dedicated machine, it is best to avoid processing documents while training models.
- Initiating training on subsequent models for a Semi-structured layout is identical to initiating the first model. However, when you view the Model Details page, you'll see data associated with the live model in the **Current Model** section.
- If you have PII deletion enabled on your system, or if you have imported a model from another instance, it is possible that you may not have enough documents to run training even if you have a live model. If this is the case, you'll need to wait until enough documents have been through QA or Field ID Supervision (increasing the sampling rate can reduce the wait time).
  - Just like before, you can train a new model by clicking **Run Training**.

> [!NOTE]
> **Аlways verify layout-version compatibility when switching between model versions**
> 
> The Live version of a model always uses the **most recent layout version**, regardless of which layout version it was originally trained with.
> 
> This configuration can lead to unexpected behavior, especially if changes were made to the layout after training (e.g. new fields, field-setting updates).
> 
> **Example:** If a model is trained on v3 of layout, and v4 of that layout is created after the training, the model will use v4 of the layout when deployed..

Multiple Occurrences (MOs) are used to identify multiple different instances of a field.