streamsets Executors 說明

執行程序階段在收到事件時觸發任務。執行者不會寫入或存儲事件。
將執行程序用做事件流中數據流觸發器的一部分，以執行事件驅動的與管道相關的任務，例如在目標關閉時移動徹底寫入的文件。

能夠使用的executors

• Amazon S3 - Creates new Amazon S3 objects for the specified content, copies objects within a bucket, or adds tags to existing Amazon S3 objects.
• Email - Sends custom email to the configured recipients upon receiving an event.
• HDFS File Metadata - Changes file metadata, creates an empty file, or removes a file or directory in HDFS or a local file system upon receiving an event record.
• Hive Query - Runs user-defined Hive or Impala queries upon receiving an event record.
• JDBC Query - Runs a user-defined SQL query upon receiving an event record.
• MapR FS File Metadata - Changes file metadata, creates an empty file, or removes a file or directory in MapR FS upon receiving an event record.
• MapReduce - Starts the specified MapReduce job upon receiving an event record.
• Pipeline Finisher - Stops and transitions the pipeline to a Finished state upon receiving an event record.
• Shell - Executes a shell script upon receiving an event record.
• Spark - Starts the specified Spark application upon receiving an event record.

參考資料

https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Executors-overview.html#concept_stt_2lk_fx