Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In this guide we will be setting up and running the Lens as a docker image deployed to your local machine, however we support a number of cloud deployments technologies, including full support of AWS.

Table of Contents

1. Configuring the Lens

All Lenses supplied by Data Lens are configurable through the use of Environment Variables. Setting up these environment variables will differ depending on how you choose to run the lens, see Running the Lens for more info.

Mandatory Configuration

For the Lens to operate the following configuration options are required. For a breakdown of every configuration option in the Document Lens, see the full list here.

Environment Variable

Description

[LICENSE]

This is the license key required to operate the lens, request your new unique license key here.

[OUTPUT_DIR_URL]

This is the directory where all generated RDF files are saved to. This also supports local and remote URLs.

[PROV_OUTPUT_DIR_URL]

This is the directory where all generated provenance files are saved to. This also supports local and remote URLs. If you do not wish to generate Provenance, you can turn it off by setting the [RECORD_PROVO] variable to false.

[LENS_RUN_STANDALONE]

Each of the Lenses are designed to be run as part of a larger end-to-end system, with the end result of data being uploaded into Semantic Knowledge Graphs or Property Graphs. As part of this process, Apache Kafka message queues are used for communicating between services.

While not a compulsory config option, for this quick start, we are going to enable standalone mode by setting this value to true, so that the Lens won't attempt to connect to external services.

2. Running the Lens

All of our Lenses are designed and built to be versatile, allowing them to be set up and ran on a number of environments, including in cloud or on-premise. This is achieved through the use of Docker Containers.

Local Docker Image

For this quick start guide, we are going to use the simplest method of deployment, and this is to run the Lens' Docker image locally. To do this, first please ensure you have Docker installed. Once installed, simply by running a command with the following structure, docker will start the container and run the Lens from your downloaded image. In the next steps, we assume the Data Lens license string has been stored into the [LICENSE] environment variable.

...

For more information of running Docker Images, see the official Docs.

3. Ingesting Data / Triggering the Lens

The easiest way to ingest a file into the Document Lens is to use the built-in APIs. Using the process GET endpoint you can specify the URL of a file to ingest and, in return, you will be provided with the URL of the generated RDF data file.

...