Logging stack fails to send to splunk with error "Token disabled"

This document (000021262) is provided subject to the disclaimer at the end of this document.

Environment

Rancher-logging chart in RKE/RKE2,  is installed and configured to send logs to Splunk

Situation

Getting the following error in fluentd logs:

#0 [clusterflow:cattle-logging-system:testflow:clusteroutput:cattle-logging-system:testoutput] Fluent::Plugin::SplunkHecOutput: Failed POST to https://X.X.X.X:8088/services/collector, response: {"text":"Token disabled","code":1}

Note: fluentd does not log to stdout, but instead to /fluentd/log/out within the container's filesystem.

Resolution

Re-check the Splunk token to see whether it's correct. You can go to the below path in Splunk admin GUI and confirm whether the token is valid and enabled. You can enable it if it's disabled.

Settings >> Data Inputs >> HTTP Event Collector >> Global Settings >> All Tokens >> Enabled

Status

Top Issue

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.