Getting started with Datadog Agent

This is a quickstart guide to getting started with Datadog Agent and Streamfold. In this guide you'll connect a Datadog Agent source to Streamfold and verify that data is flowing through your configured streams.

On the completion of this guide you will have:

1. Connected Datadog Agent to Streamfold
2. Verified data is flowing into Streamfold
3. Connected your Datadog Agent to a stream
4. Filtered, dropped or transformed incoming telemetry

Connecting Datadog Agent

We recommend picking a single agent in your infrastructure from either a test/dev or staging environment. This will ensure that you do not impact production during your initial testing of Streamfold.

Head to the new source page for the Datadog Agent. The page will include inline configuration instructions to point the Datadog Agent at Streamfold. For more advanced instructions, follow the configuration instructions for Datadog Agent that match your infrastructure setup. For example, if you are running with a YAML configuration you should add the following configuration changes to your Datadog YAML config.

On the new source page for the Datadog Agent, you'll find your ingress token value in the configuration instructions. Below we have included them with the placeholder <sf-ingress-token>.

dd_url: "https://streamfold:<sf-ingress-token>@ingress.streamfold.com"
logs_config:
  use_http: true
  logs_dd_url: "ingress.streamfold.com:443"
  api_key: "<sf-ingress-token>"
apm_config:
  apm_dd_url: "https://streamfold:<sf-ingress-token>@ingress.streamfold.com"

Once you've named your source and clicked Save, you should be set to connect your agent. Restart the agent so that it picks up the new configuration.

Verify data flow

Visit the sources list and click on the Datadog Agent source you just added to go to its detail page. Within a minute or less, you should start to see the source metrics reporting incoming data.

If you don't see any metrics appear, double-check the logs from your Datadog Agent. If there is a misconfiguration or connection error it will log failures related to delivering telemetry to the Streamfold endpoints.

Connect to a Stream

The next step is to use a Stream to connect your Datadog Agent source to a Destination. If you do not have any Destinations yet, add one before continuing.

Datadog Agent telemetry can be sent to any destination in Streamfold. If you are a Datadog customer, you can also add a Datadog destination to deliver some or all of your incoming telemetry to your Datadog account.

When you have a Destination configured, create a stream to connect your Datadog Agent and your new destination. Name your stream and click Add Stream.

Once added, you'll need to enable the stream by clicking the toggle Write to Destination. A few seconds after your stream is enabled, you will see live metrics that report how many metrics, logs and trace spans are entering and leaving the stream.

Next steps

Now that you have connected your Datadog Agent and built a stream connecting it to a destination, you have several options:

1. Use a filter to select which telemetry enters your streams
2. Drop unwanted metrics with a function
3. Drop unwanted tags from your metrics to reduce cost
4. Transform your telemetry with built-in functions