For AI agents: visit https://substation.readme.io/llms.txt for an index of all pages formatted in Markdown and endpoints in OpenAPI.
Jump to Content
SubstationSubstationTry a DemoGet the Latest ReleaseSee the CHANGELOGCreate a Feature Request / Bug ReportJoin the Conversation
HomeGuides
Try a DemoGet the Latest ReleaseSee the CHANGELOGCreate a Feature Request / Bug ReportJoin the ConversationSubstation
Guides
HomeGuides

Introduction

  • What is Substation?
  • Architecture & Design
    • Microservices
    • Two-Phase Mutation
    • Caching Strategies

Interpreting Data

  • Interpretation Methods
  • Object Modification
  • Capsules

Evaluating Data

  • Conditions
  • Inspectors
    • Content
    • For Each
    • IP
    • JSON Schema
    • JSON Valid
    • Length
    • Random
    • Regular Expression
    • Strings
  • Operators

Transforming Data

  • Processors
    • Aggregate
    • AWS DynamoDB
    • AWS Lambda
    • Base64
    • Capture
    • Case
    • Convert
    • Copy
    • Count
    • Delete
    • DNS
    • Domain
    • Drop
    • Expand
    • Flatten
    • For Each
    • Group
    • Gzip
    • IP Database
    • HTTP
    • Hash
    • Insert
    • Join
    • KV Store
    • Math
    • Pipeline
    • Pretty Print
    • Replace
    • Split
    • Time

Delivering Data

  • Sinks
    • AWS DynamoDB
    • AWS Kinesis
    • AWS Kinesis Firehose
    • AWS S3
    • AWS SQS
    • gRPC
    • HTTP
    • Stdout
    • Sumo Logic

Enhancing Data

  • Key-Value Stores
    • AWS DynamoDB
    • CSV File
    • JSON File
    • MMDB (MaxMind Database)
    • Memory
    • Text File

Applications

  • Substation
    • Development
    • AWS Lambda
  • Kinesis Autoscaling (AWS Lambda)
  • Playground

Building Applications

  • Go Build
  • Containerization
  • Build Scripts

Managing Configurations

  • Configurations as Code
  • Configuration Library
  • Loading Secrets
  • Style Guide
  • Build Scripts

Deploying Infrastructure

  • Infrastructure as Code
  • Terraform Modules
  • AWS Examples
    • Bootstrapping New Deployments
    • Performance Monitoring with X-Ray
    • Autoscaling Kinesis Data Streams
    • Reading From and Writing to Kinesis Data Streams
    • Reading From and Writing to S3 Buckets
    • Enriching Data with DynamoDB
    • Enriching Data with Lambda
Powered by 

AWS Lambda

Suggest Edits

This application implements event-driven data ingest, transform, and load in AWS Lambda.

Ingest from AWS services is supported by setting the environment variable AWS_HANDLER:

  • API Gateway (AWS_API_GATEWAY)
  • Kinesis Data Streams (AWS_KINESIS)
  • Lambda (Asynchronous Invocation) (AWS_LAMBDA_ASYNC)
  • Lambda (Synchronous Invocation) (AWS_LAMBDA_SYNC)
  • S3 (AWS_S3)
  • S3 via SNS (AWS_S3_SNS)
  • SNS (AWS_SNS)
  • SQS (AWS_SQS)

See AWS examples for more information on common use cases.