Spark Jobs (?)

  • User: mining
  • Total Uptime: 676.2 h
  • Scheduling Mode: FAIR
  • Completed Jobs: 757
Event Timeline

Completed Jobs (757)

Job Id Description Submitted Duration ▾ Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
349 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/03 08:00:07 37 s 1/1
1/1
106 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/25 08:00:07 35 s 1/1
1/1
160 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/27 08:00:07 35 s 1/1
1/1
673 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/15 08:00:08 35 s 1/1
1/1
619 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/13 08:00:08 34 s 1/1
1/1
268 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/31 08:00:07 34 s 1/1
1/1
565 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/11 08:00:07 34 s 1/1
1/1
241 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/30 08:00:07 33 s 1/1
1/1
403 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/05 08:00:07 33 s 1/1
1/1
430 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/06 08:00:07 32 s 1/1
1/1
727 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/17 08:00:08 32 s 1/1
1/1
133 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/26 08:00:07 32 s 1/1
1/1
52 foreachPartition at SparkFunctionUtil.java:146 2025/08/23 08:00:08 32 s 1/1
1/1
79 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/24 08:00:07 32 s 1/1
1/1
457 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/07 08:00:07 32 s 1/1
1/1
484 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/08 08:00:07 32 s 1/1
1/1
25 foreachPartition at SparkFunctionUtil.java:146 2025/08/22 08:00:09 31 s 1/1
1/1
700 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/16 08:00:07 31 s 1/1
1/1
187 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/28 08:00:07 31 s 1/1
1/1
592 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/12 08:00:07 30 s 1/1
1/1
214 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/29 08:00:07 30 s 1/1
1/1
538 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/10 08:00:07 30 s 1/1
1/1
646 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/14 08:00:07 30 s 1/1
1/1
295 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/01 08:00:08 29 s 1/1
1/1
511 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/09 08:00:07 29 s 1/1
1/1
754 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/18 08:00:07 29 s 1/1
1/1
322 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/02 08:00:07 28 s 1/1
1/1
376 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/04 08:00:07 28 s 1/1
1/1
115 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/26 01:00:06 4 s 1/1
1/1
190 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/29 01:00:02 4 s 1/1
1/1
271 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/01 01:00:02 3 s 1/1
1/1
352 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/04 01:00:04 3 s 1/1
1/1
595 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/13 01:00:04 3 s 1/1
1/1
250 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/31 01:00:06 3 s 1/1
1/1
55 parquet at DatasetEvent.java:208 2025/08/24 01:00:02 3 s 1/1
1/1
622 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/14 01:00:03 2 s 1/1
1/1
460 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/08 01:00:04 2 s 1/1
1/1
514 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/10 01:00:03 2 s 1/1
1/1
493 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/09 01:00:07 2 s 1/1
1/1
406 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/06 01:00:03 2 s 1/1
1/1
331 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/03 01:00:06 2 s 1/1
1/1
196 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/29 01:00:07 2 s 1/1
1/1
541 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/11 01:00:04 2 s 1/1
1/1
439 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/07 01:00:06 2 s 1/1
1/1
244 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/31 01:00:03 2 s 1/1
1/1
520 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/10 01:00:07 2 s 1/1
1/1
676 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/16 01:00:03 2 s 1/1
1/1
82 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/25 01:00:03 2 s 1/1
1/1
682 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/16 01:00:06 2 s 1/1
1/1
61 foreachPartition at SparkFunctionUtil.java:146 2025/08/24 01:00:06 2 s 1/1
1/1
109 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/26 01:00:03 2 s 1/1
1/1
487 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/09 01:00:04 2 s 1/1
1/1
163 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/28 01:00:02 2 s 1/1
1/1
325 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/03 01:00:04 2 s 1/1
1/1
304 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/02 01:00:06 2 s 1/1
1/1
88 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/25 01:00:06 2 s 1/1
1/1
385 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/05 01:00:06 2 s 1/1
1/1
1 parquet at DatasetEvent.java:208 2025/08/22 01:00:06 2 s 1/1
1/1
136 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/27 01:00:04 2 s 1/1
1/1
703 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/17 01:00:03 1 s 1/1
1/1
433 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/07 01:00:04 1 s 1/1
1/1
649 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/15 01:00:03 1 s 1/1
1/1
379 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/05 01:00:04 1 s 1/1
1/1
601 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/13 01:00:07 1 s 1/1
1/1
28 parquet at DatasetEvent.java:208 2025/08/23 01:00:03 1 s 1/1
1/1
217 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/08/30 01:00:04 1 s 1/1
1/1
547 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/11 01:00:07 1 s 1/1
1/1
0 count at SparkSQLExample.java:94 2025/08/21 10:34:14 1 s 2/2
2/2
568 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/12 01:00:03 1 s 1/1
1/1
358 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/04 01:00:07 1 s 1/1
1/1
17 count at DatasetOutput.java:65 2025/08/22 08:00:07 1 s 2/2
2/2
719 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/17 08:00:06 1.0 s 2/2
2/2
466 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/08 01:00:07 1.0 s 1/1
1/1
13 count at DatasetOutput.java:65 2025/08/22 08:00:03 1.0 s 2/2
2/2
298 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/09/02 01:00:04 1.0 s 1/1
1/1
223 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/08/30 01:00:06 0.9 s 1/1
1/1
10 count at DatasetOutput.java:65 2025/08/22 08:00:00 0.9 s 2/2
2/2
15 count at DatasetOutput.java:65 2025/08/22 08:00:05 0.9 s 2/2
2/2
709 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/17 01:00:05 0.9 s 1/1
1/1
42 count at DatasetOutput.java:65 2025/08/23 08:00:04 0.9 s 2/2
2/2
44 count at DatasetOutput.java:65 2025/08/23 08:00:06 0.9 s 2/2
2/2
280 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/01 08:00:00 0.9 s 2/2
2/2
665 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/15 08:00:06 0.9 s 2/2
2/2
37 count at DatasetOutput.java:65 2025/08/23 08:00:00 0.9 s 2/2
2/2
98 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/25 08:00:06 0.9 s 2/2
2/2
611 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/13 08:00:06 0.9 s 2/2
2/2
91 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/25 08:00:00 0.9 s 2/2
2/2
718 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/09/17 08:00:05 0.9 s 1/1
1/1
71 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/24 08:00:06 0.9 s 2/2
2/2
287 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/01 08:00:06 0.9 s 2/2
2/2
277 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/09/01 01:00:06 0.9 s 1/1
1/1
260 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/31 08:00:06 0.9 s 2/2
2/2
658 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/15 08:00:00 0.9 s 2/2
2/2
125 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/26 08:00:06 0.9 s 2/2
2/2
233 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/30 08:00:06 0.9 s 2/2
2/2
64 count at DatasetOutput.java:65 2025/08/24 08:00:00 0.9 s 2/2
2/2
712 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/17 08:00:00 0.9 s 2/2
2/2
584 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/12 08:00:06 0.9 s 2/2
2/2
152 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/08/27 08:00:06 0.9 s 2/2
2/2
638 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/09/14 08:00:06 0.9 s 2/2
2/2