Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Data Lens offer all their lenses as products in AWS Marketplace. Using AWS CloudFormation Templates, we have constructed a way in which you are able to use a one-click solution to deploy any of the lenses. Each template creates an AWS ECS service that contains a task running the required lens. The template also creates all other infrastructure required to host and access the ECS service (route tables, security groups, roles). This includes a VPC, 1 public subnet, and 2 private subnets. For security, the service is run in the private subnet and can be accessed only from a bastion host in the public subnet. The second private subnet is required only to allow a load balancer to be attached to the service but is otherwise redundant. This section provides information specific to running the lenses as products from the AWS MarketPlace. For more detailed instructions on working with lenses please see the main user guide for the specific lens you are working with.

AWS Architecture

...

Quick Create Stacks

...

Once the parameters have been input and the acknowledgment check box ticked the stack can be created.

Lens Writer

...

  • ECSAMI is the machine image for the bastion host EC2 instance. This is defaulted to the Amazon recommended image and unless you have very specific requirements for the bastion host it can be left as is.

  • IngestionMode determines how the ingested data is to be processed. 'insert' ingests the new data in full and does not link it with already existing data. The new dataset adds new values to already existing subject-predicate combinations creating new additional triples. 'update', uses the new data for updating the existing data. The new dataset replaces object values in existing subject-predicate combinations amending the existing triples.

  • KeyName is the name of an existing EC2 KeyPair that can be used for SSH access to the bastion host. This will be required to run the lens as it is only possible to hit the /process endpoint of the lens with a REST request from the bastion host.

  • TripleStoreEndpoint is the endpoint for the triple store that you wish to upload RDF to.

  • TripleStorePassword is the password for the triple store. This can be left blank if your triple store does not require any authentication.

  • TripleStoreType is the type of your Triple Store and is required as the methods needed for the Lens Writer to connect vary slightly between different graphs. AllegroGraph supports the default sparql type but GraphDB, Stardog, Blazegraph, Neptune, Neo4j and RDFox have their own implementations.

  • TripleStoreUsername is the username for your Triple Store. This can be left blank if your Triple Store does not require any authentication.

...