Spark Jobs (?)

  • User: mining
  • Total Uptime: 686.1 h
  • Scheduling Mode: FAIR
  • Completed Jobs: 757
Event Timeline

Completed Jobs (757)

Job Id Description Submitted ▴ Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
0 count at SparkSQLExample.java:94 2025/04/01 10:26:28 1 s 2/2
2/2
1 parquet at DatasetEvent.java:208 2025/04/02 01:00:07 4 s 1/1
1/1
2 parquet at DatasetEvent.java:211 2025/04/02 01:00:12 0.3 s 1/1
1/1
3 count at DatasetOutput.java:65 2025/04/02 01:00:13 0.3 s 2/2
2/2
4 collectAsList at DataStorageUtils.java:104 2025/04/02 01:00:13 0.1 s 1/1
1/1
5 parquet at DatasetEvent.java:219 2025/04/02 01:00:14 0.1 s 1/1
1/1
6 parquet at DatasetEvent.java:219 2025/04/02 01:00:15 92 ms 1/1
1/1
7 foreachPartition at SparkFunctionUtil.java:146 2025/04/02 01:00:15 0.5 s 1/1
1/1
8 count at DatasetOutput.java:65 2025/04/02 01:00:16 83 ms 2/2
2/2
9 collectAsList at DataStorageUtils.java:104 2025/04/02 01:00:16 75 ms 1/1
1/1
10 count at DatasetOutput.java:65 2025/04/02 08:00:00 2 s 2/2
2/2
11 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:02 0.8 s 1/1
1/1
12 describe at DivideNode.java:229 2025/04/02 08:00:03 0.8 s 2/2
2/2
13 count at DatasetOutput.java:65 2025/04/02 08:00:04 0.8 s 2/2
2/2
14 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:05 0.8 s 1/1
1/1
15 count at DatasetOutput.java:65 2025/04/02 08:00:06 0.9 s 2/2
2/2
16 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:07 0.8 s 1/1
1/1
17 count at DatasetOutput.java:65 2025/04/02 08:00:08 1 s 2/2
2/2
18 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:09 63 ms 1/1
1/1
19 count at DatasetOutput.java:65 2025/04/02 08:00:09 37 ms 2/2
2/2
20 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:10 27 ms 1/1
1/1
21 count at DatasetOutput.java:65 2025/04/02 08:00:10 32 ms 2/2
2/2
22 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:10 34 ms 1/1
1/1
23 count at DatasetOutput.java:65 2025/04/02 08:00:10 34 ms 2/2
2/2
24 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:10 18 ms 1/1
1/1
25 foreachPartition at SparkFunctionUtil.java:146 2025/04/02 08:00:10 33 s 1/1
1/1
26 count at DatasetOutput.java:65 2025/04/02 08:00:43 31 ms 2/2
2/2
27 collectAsList at DataStorageUtils.java:104 2025/04/02 08:00:43 15 ms 1/1
1/1
28 parquet at DatasetEvent.java:208 2025/04/03 01:00:04 1 s 1/1
1/1
29 parquet at DatasetEvent.java:211 2025/04/03 01:00:05 77 ms 1/1
1/1
30 count at DatasetOutput.java:65 2025/04/03 01:00:06 0.1 s 2/2
2/2
31 collectAsList at DataStorageUtils.java:104 2025/04/03 01:00:06 23 ms 1/1
1/1
32 parquet at DatasetEvent.java:219 2025/04/03 01:00:06 63 ms 1/1
1/1
33 parquet at DatasetEvent.java:219 2025/04/03 01:00:06 67 ms 1/1
1/1
34 foreachPartition at SparkFunctionUtil.java:146 2025/04/03 01:00:06 4 s 1/1
1/1
35 count at DatasetOutput.java:65 2025/04/03 01:00:11 68 ms 2/2
2/2
36 collectAsList at DataStorageUtils.java:104 2025/04/03 01:00:11 36 ms 1/1
1/1
37 count at DatasetOutput.java:65 2025/04/03 08:00:00 0.9 s 2/2
2/2
38 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:01 0.8 s 1/1
1/1
39 describe at DivideNode.java:229 2025/04/03 08:00:02 0.8 s 2/2
2/2
40 count at DatasetOutput.java:65 2025/04/03 08:00:03 0.8 s 2/2
2/2
41 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:03 0.8 s 1/1
1/1
42 count at DatasetOutput.java:65 2025/04/03 08:00:04 0.8 s 2/2
2/2
43 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:05 0.8 s 1/1
1/1
44 count at DatasetOutput.java:65 2025/04/03 08:00:06 0.9 s 2/2
2/2
45 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:07 15 ms 1/1
1/1
46 count at DatasetOutput.java:65 2025/04/03 08:00:07 28 ms 2/2
2/2
47 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:07 15 ms 1/1
1/1
48 count at DatasetOutput.java:65 2025/04/03 08:00:07 24 ms 2/2
2/2
49 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:07 17 ms 1/1
1/1
50 count at DatasetOutput.java:65 2025/04/03 08:00:07 27 ms 2/2
2/2
51 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:07 16 ms 1/1
1/1
52 foreachPartition at SparkFunctionUtil.java:146 2025/04/03 08:00:08 30 s 1/1
1/1
53 count at DatasetOutput.java:65 2025/04/03 08:00:37 26 ms 2/2
2/2
54 collectAsList at DataStorageUtils.java:104 2025/04/03 08:00:38 14 ms 1/1
1/1
55 parquet at DatasetEvent.java:208 2025/04/04 01:00:03 1.0 s 1/1
1/1
56 parquet at DatasetEvent.java:211 2025/04/04 01:00:04 78 ms 1/1
1/1
57 count at DatasetOutput.java:65 2025/04/04 01:00:04 79 ms 2/2
2/2
58 collectAsList at DataStorageUtils.java:104 2025/04/04 01:00:04 29 ms 1/1
1/1
59 parquet at DatasetEvent.java:219 2025/04/04 01:00:05 70 ms 1/1
1/1
60 parquet at DatasetEvent.java:219 2025/04/04 01:00:05 41 ms 1/1
1/1
61 foreachPartition at SparkFunctionUtil.java:146 2025/04/04 01:00:05 2 s 1/1
1/1
62 count at DatasetOutput.java:65 2025/04/04 01:00:07 31 ms 2/2
2/2
63 collectAsList at DataStorageUtils.java:104 2025/04/04 01:00:07 33 ms 1/1
1/1
64 count at DatasetOutput.java:65 2025/04/04 08:00:00 0.9 s 2/2
2/2
65 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:01 0.8 s 1/1
1/1
66 describe at DivideNode.java:229 2025/04/04 08:00:02 0.8 s 2/2
2/2
67 count at DatasetOutput.java:65 2025/04/04 08:00:03 0.8 s 2/2
2/2
68 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:03 0.8 s 1/1
1/1
69 count at DatasetOutput.java:65 2025/04/04 08:00:04 0.8 s 2/2
2/2
70 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:05 0.8 s 1/1
1/1
71 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/04 08:00:06 0.9 s 2/2
2/2
72 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:07 13 ms 1/1
1/1
73 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/04 08:00:07 23 ms 2/2
2/2
74 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:07 12 ms 1/1
1/1
75 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/04 08:00:07 21 ms 2/2
2/2
76 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:07 15 ms 1/1
1/1
77 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/04 08:00:07 26 ms 2/2
2/2
78 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:07 14 ms 1/1
1/1
79 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/04/04 08:00:08 36 s 1/1
1/1
80 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/04 08:00:43 23 ms 2/2
2/2
81 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/04 08:00:43 12 ms 1/1
1/1
82 parquet at DatasetEvent.java:208 parquet at DatasetEvent.java:208 2025/04/05 01:00:03 3 s 1/1
1/1
83 parquet at DatasetEvent.java:211 parquet at DatasetEvent.java:211 2025/04/05 01:00:05 69 ms 1/1
1/1
84 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 01:00:06 57 ms 2/2
2/2
85 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 01:00:06 37 ms 1/1
1/1
86 parquet at DatasetEvent.java:219 parquet at DatasetEvent.java:219 2025/04/05 01:00:06 68 ms 1/1
1/1
87 parquet at DatasetEvent.java:219 parquet at DatasetEvent.java:219 2025/04/05 01:00:06 72 ms 1/1
1/1
88 foreachPartition at SparkFunctionUtil.java:146 foreachPartition at SparkFunctionUtil.java:146 2025/04/05 01:00:06 0.2 s 1/1
1/1
89 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 01:00:07 31 ms 2/2
2/2
90 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 01:00:07 24 ms 1/1
1/1
91 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 08:00:00 0.9 s 2/2
2/2
92 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 08:00:01 0.8 s 1/1
1/1
93 describe at DivideNode.java:229 describe at DivideNode.java:229 2025/04/05 08:00:02 0.8 s 2/2
2/2
94 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 08:00:03 0.8 s 2/2
2/2
95 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 08:00:03 0.8 s 1/1
1/1
96 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 08:00:04 0.8 s 2/2
2/2
97 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 08:00:05 0.8 s 1/1
1/1
98 count at DatasetOutput.java:65 count at DatasetOutput.java:65 2025/04/05 08:00:06 0.9 s 2/2
2/2
99 collectAsList at DataStorageUtils.java:104 collectAsList at DataStorageUtils.java:104 2025/04/05 08:00:07 13 ms 1/1
1/1