...
In this guide we will be setting up and running the Lens as a docker image deployed to your local machine, however we support a number of cloud deployments technologies, including full support of AWS.
Table of Contents |
---|
1. Configuring the Lens
All Lenses supplied by Data Lens are configurable through the use of Environment Variables. Setting up these environment variables will differ depending on how you choose to run the lens, see Running the Lens for more info.
Mandatory Configuration
For the Lens to operate the following configuration options are required. For a breakdown of every configuration option in the Document Lens, see the full list here.
Environment Variable | Description |
---|---|
| This is the license key required to operate the lens, request your new unique license key here. |
| This is the directory where all generated RDF files are saved to. This also supports local and remote URLs. |
| This is the directory where all generated provenance files are saved to. This also supports local and remote URLs. If you do not wish to generate Provenance, you can turn it off by setting the |
| Each of the Lenses are designed to be run as part of a larger end-to-end system, with the end result of data being uploaded into Semantic Knowledge Graphs or Property Graphs. As part of this process, Apache Kafka message queues are used for communicating between services. While not a compulsory config option, for this quick start, we are going to enable standalone mode by setting this value to |
2. Running the Lens
All of our Lenses are designed and built to be versatile, allowing them to be set up and ran on a number of environments, including in cloud or on-premise. This is achieved through the use of Docker Containers.
Local Docker Image
For this quick start guide, we are going to use the simplest method of deployment, and this is to run the Lens' Docker image locally. To do this, first please ensure you have Docker installed. Once installed, simply by running a command with the following structure, docker will start the container and run the Lens from your downloaded image. In the next steps, we assume the Data Lens license string has been stored into the [LICENSE]
environment variable.
...
For more information of running Docker Images, see the official Docs.
3. Ingesting Data / Triggering the Lens
The easiest way to ingest a file into the Document Lens is to use the built-in APIs. Using the process
GET endpoint you can specify the URL of a file to ingest and, in return, you will be provided with the URL of the generated RDF data file.
...