The GCS (Google Cloud Storage) Notifier output connection will send submission data and state-change notifications to the GCS URI you specify.
If you would like to use the GCS Notifier connection in a SaaS instance and your service is not public, you should create a firewall pinhole for the connection. Contact your Hyperscience representative for more information.
Sample use cases
Send extracted information and submission metadata to a GCS bucket for downstream processing.
Configure monitoring of the output bucket and alert other systems to take action on submissions, if needed.
Block settings table
In addition to the settings outlined below, you can also configure the settings described in Universal Integration Block Settings.
Name | Required? | Description |
---|---|---|
GCS URI | Yes | The URI of the location where the data should be stored (in the format of |
GCP Service Account JSON | Yes, if Use Workload Identity is deselected | The service account JSON credential that allows access to the GCS bucket. To edit the JSON, click Edit value, modify the JSON, and then click Done. |
Use Workload Identity | Must be selected if no value for GCS Service Account JSON is provided | Credentials are obtained by using Workload Identity Federation, which applies to Hyperscience installations inside GKE clusters. See Set up Workload Identity Federation for more information. The notifier output bucket should have IAM policy binding with the Workflow Identity Pool principal of the block’s namespace. Selected by default. |
Set up Workload Identity Federation
For Workload Identity Federation-enabled Kubernetes clusters (both SaaS and on-premise deployments), the workloadIdentityPools
principle should be IAM bound to the desired block’s bucket.
The bucket can be set up via the UI console or via the cli
command:
gcloud storage buckets add-iam-policy-binding gs://BUCKET \
--role=roles/storage.objectViewer \
--member=principal://iam.googleapis.com/projects/PROJECT_NUMBER/locations/global/workloadIdentityPools/PROJECT_ID.svc.id.goog/subject/ns/NAMESPACE/sa/KSA_NAME \
--condition=None
For more information, see Google’s Authenticate to Google Cloud APIs from GKE workloads.
Setting up the GCS Notifier
To set up the GCS Notifier, enter the settings as described in the Block settings table above.
Before deploying a flow with the GCS Notifier enabled, ensure that the credentials you’ve specified in the block settings have the storage.objects.create
permission for the specified bucket.