[MLS-C01] [Exploratory Data Analysis] Kinesis Data Analytics

Posted by Oscaner on June 21, 2022

  • Use SQL to process streaming data
  • Sources: Kinesis Data Streams and Kinesis Data Firehose
  • SQL queries put to S3, Redshift, or visualization and Business Intelligence tools
  • A Kinesis Data Analytics streaming application consists of three parts
    • Streaming data sources
    • Analytics written in SQL
    • Destinations for the results
  • The streaming application continuously reads data from a streaming source, generates analytics using SQL code, and emits results to 1 to 4 destinations

Streaming Application

  • Streaming application is the primary resource in Kinesis Data Analytics
  • Create/manage streaming applications via the console or the Kinesis Data Analytics API
  • The API has operations to manage your streaming applications
  • A Kinesis Data Analytics streaming application continually read and process streaming data in real-time
  • Application code in SQL processes the incoming streaming data and produces output
  • Kinesis Data Analytics writes the output to configured destinations
  • Streaming data input from Kinesis Data Streams or Kinesis Data Firehose
  • Reference data from S3
  • Data read continuously from the streaming data sources but one time from the reference source
  • Reference data sources are used for joining against the incoming stream to enrich the data

本文由 Oscaner 创作, 采用 知识共享署名4.0 国际许可协议进行许可
本站文章除注明转载/出处外, 均为本站原创或翻译, 转载前请务必署名