- 调试窗口与事件时间
- Monitoring Current Event Time
- Handling Event Time Stragglers
调试窗口与事件时间
- Monitoring Current Event Time
- Handling Event Time Stragglers
Monitoring Current Event Time
Flink’s event time and watermark support are powerful features for handlingout-of-order events. However, it’s harder to understand what exactly is going on because the progress of timeis tracked within the system.
Low watermarks of each task can be accessed through Flink web interface or metrics system.
Each Task in Flink exposes a metric called currentInputWatermark
that represents the lowest watermark receivedby this task. This long value represents the “current event time”.The value is calculated by taking the minimum of all watermarks received by upstream operators. This means that the event time tracked with watermarks is always dominated by the furthest-behind source.
The low watermark metric is accessible using the web interface, by choosing a task in the metric tab,and selecting the <taskNr>.currentInputWatermark
metric. In the new box you’ll now be able to see the current low watermark of the task.
Another way of getting the metric is using one of the metric reporters, as described in the documentationfor the metrics system.For local setups, we recommend using the JMX metric reporter and a tool like VisualVM.
Handling Event Time Stragglers
- Approach 1: Watermark stays late (indicated completeness), windows fire early
- Approach 2: Watermark heuristic with maximum lateness, windows accept late data