Some jobs not queryable with condor_history, htcondor 25.0.12

[Steven Timm]

I am observing a very strange behavior:

A job is removed by the SYSTEM_PERIODIC_REMOVE expression.

But condor_history <clusterid.procid> does not show it even though I can grep the history file and verify that it is in the file.

[root@dunegpschedd01 ~]# condor_history 387112.89

 ID          OWNER            SUBMITTED   RUN_TIME   ST   COMPLETED CMD

[root@dunegpschedd01 ~]# condor_history | grep 387112.89

387112.89    dunejustin      7/16 09:33   0+02:10:28 X              justin-wrapper-job-d499w98p

[root@dunegpschedd01 ~]# condor_history -constraint 'ClusterID==387112 && ProcID==89'

 ID          OWNER            SUBMITTED   RUN_TIME   ST   COMPLETED CMD

387112.89    dunejustin      7/16 09:33   0+02:10:28 X              justin-wrap

Any idea why this would be happening to some, but not all jobs?

[root@dunegpschedd01 ~]# condor_history -constraint 'ClusterID==387112 && ProcID==89'

 ID          OWNER            SUBMITTED   RUN_TIME   ST   COMPLETED CMD

387112.89    dunejustin      7/16 09:33   0+02:10:28 X              justin-wrap

[root@dunegpschedd01 ~]# condor_history | grep 387112

387112.76    dunejustin      7/16 09:33   0+03:15:45 X              justin-wrapper-job-d499w98p

387112.181   dunejustin      7/16 09:33   0+02:15:32 X              justin-wrapper-job-d499w98p

387112.85    dunejustin      7/16 09:33   0+02:11:37 X   7/16 11:45 justin-wrapper-job-d499w98p

387112.89    dunejustin      7/16 09:33   0+02:10:28 X              justin-wrapper-job-d499w98p

387112.84    dunejustin      7/16 09:33   0+02:05:28 X              justin-wrapper-job-d499w98p

387112.38    dunejustin      7/16 09:33   0+02:05:29 X              justin-wrapper-job-d499w98p

387112.171   dunejustin      7/16 09:33   0+02:00:42 X              justin-wrapper-job-d499w98p

387112.32    dunejustin      7/16 09:33   0+02:00:32 X              justin-wrapper-job-d499w98p

387112.47    dunejustin      7/16 09:33   0+02:00:20 X              justin-wrapper-job-d499w98p

387112.164   dunejustin      7/16 09:33   0+01:56:03 X              justin-wrapper-job-d499w98p

387112.169   dunejustin      7/16 09:33   0+01:55:33 X              justin-wrapper-job-d499w98p

387112.96    dunejustin      7/16 09:33   0+01:51:54 X   7/16 11:26 justin-wrapper-job-d499w98p

387112.184   dunejustin      7/16 09:33   0+01:50:28 X              justin-wrapper-job-d499w98p

387112.179   dunejustin      7/16 09:33   0+01:50:26 X              justin-wrapper-job-d499w98p

387112.30    dunejustin      7/16 09:33   0+01:45:48 X              justin-wrapper-job-d499w98p

387112.104   dunejustin      7/16 09:33   0+01:45:31 X              justin-wrapper-job-d499w98p

387112.176   dunejustin      7/16 09:33   0+01:40:29 X              justin-wrapper-job-d499w98p

387112.19    dunejustin      7/16 09:33   0+01:40:31 X              justin-wrapper-job-d499w98p

387112.48    dunejustin      7/16 09:33   0+01:40:27 X              justin-wrapper-job-d499w98p

387112.79    dunejustin      7/16 09:33   0+01:40:25 X              justin-wrapper-job-d499w98p

387112.10    dunejustin      7/16 09:33   0+01:40:21 X              justin-wrapper-job-d499w98p

387112.183   dunejustin      7/16 09:33   0+01:35:33 X              justin-wrapper-job-d499w98p

387112.177   dunejustin      7/16 09:33   0+01:35:31 X              justin-wrapper-job-d499w98p

387112.180   dunejustin      7/16 09:33   0+01:35:25 X              justin-wrapper-job-d499w98p

387112.51    dunejustin      7/16 09:33   0+01:35:29 X              justin-wrapper-job-d499w98p

387112.142   dunejustin      7/16 09:33   0+01:31:53 X   7/16 11:06 justin-wrapper-job-d499w98p

387112.138   dunejustin      7/16 09:33   0+01:30:28 X              justin-wrapper-job-d499w98p

387112.157   dunejustin      7/16 09:33   0+01:30:24 X              justin-wrapper-job-d499w98p

387112.88    dunejustin      7/16 09:33   0+01:30:27 X              justin-wrapper-job-d499w98p

387112.60    dunejustin      7/16 09:33   0+01:30:25 X              justin-wrapper-job-d499w98p

387112.15    dunejustin      7/16 09:33   0+01:30:26 X              justin-wrapper-job-d499w98p

387112.0     dunejustin      7/16 09:33   0+01:29:25 X   7/16 11:03 justin-wrapper-job-d499w98p

387112.11    dunejustin      7/16 09:33   0+01:28:30 X   7/16 11:02 justin-wrapper-job-d499w98p

387112.175   dunejustin      7/16 09:33   0+01:25:29 X              justin-wrapper-job-d499w98p

387112.71    dunejustin      7/16 09:33   0+01:25:30 X              justin-wrapper-job-d499w98p

387112.37    dunejustin      7/16 09:33   0+01:25:30 X              justin-wrapper-job-d499w98p

387112.50    dunejustin      7/16 09:33   0+01:25:23 X              justin-wrapper-job-d499w98p

387112.66    dunejustin      7/16 09:33   0+01:25:20 X              justin-wrapper-job-d499w98p

387112.1     dunejustin      7/16 09:33   0+01:25:23 X              justin-wrapper-job-d499w98p

387112.117   dunejustin      7/16 09:33   0+01:21:22 X   7/16 10:55 justin-wrapper-job-d499w98p

387112.54    dunejustin      7/16 09:33   0+01:22:40 X   7/16 10:56 justin-wrapper-job-d499w98p

387112.77    dunejustin      7/16 09:33   0+01:20:34 X              justin-wrapper-job-d499w98p

387112.190   dunejustin      7/16 09:33   0+01:20:28 X              justin-wrapper-job-d499w98p

387112.185   dunejustin      7/16 09:33   0+01:20:25 X              justin-wrapper-job-d499w98p

387112.135   dunejustin      7/16 09:33   0+01:20:27 X              justin-wrapper-job-d499w98p

387112.182   dunejustin      7/16 09:33   0+01:20:24 X              justin-wrapper-job-d499w98p

387112.28    dunejustin      7/16 09:33   0+01:20:24 X              justin-wrapper-job-d499w98p

387112.63    dunejustin      7/16 09:33   0+01:20:22 X              justin-wrapper-job-d499w98p

387112.110   dunejustin      7/16 09:33   0+01:20:18 X              justin-wrapper-job-d499w98p

387112.91    dunejustin      7/16 09:33   0+01:15:28 X              justin-wrapper-job-d499w98p

387112.105   dunejustin      7/16 09:33   0+01:15:25 X              justin-wrapper-job-d499w98p

387112.150   dunejustin      7/16 09:33   0+01:15:22 X              justin-wrapper-job-d499w98p

387112.103   dunejustin      7/16 09:33   0+01:15:24 X              justin-wrapper-job-d499w98p

387112.188   dunejustin      7/16 09:33   0+01:15:21 X              justin-wrapper-job-d499w98p

387112.153   dunejustin      7/16 09:33   0+01:15:21 X              justin-wrapper-job-d499w98p

387112.145   dunejustin      7/16 09:33   0+01:15:21 X              justin-wrapper-job-d499w98p

387112.35    dunejustin      7/16 09:33   0+01:15:23 X              justin-wrapper-job-d499w98p

387112.147   dunejustin      7/16 09:33   0+01:15:17 X              justin-wrapper-job-d499w98p

387112.73    dunejustin      7/16 09:33   0+01:10:31 X              justin-wrapper-job-d499w98p

387112.113   dunejustin      7/16 09:33   0+01:10:28 X              justin-wrapper-job-d499w98p

387112.90    dunejustin      7/16 09:33   0+01:10:22 X              justin-wrapper-job-d499w98p

387112.56    dunejustin      7/16 09:33   0+01:10:22 X              justin-wrapper-job-d499w98p

387112.58    dunejustin      7/16 09:33   0+01:10:21 X              justin-wrapper-job-d499w98p

387112.93    dunejustin      7/16 09:33   0+01:10:19 X              justin-wrapper-job-d499w98p

387112.42    dunejustin      7/16 09:33   0+01:10:23 X              justin-wrapper-job-d499w98p

387112.187   dunejustin      7/16 09:33   0+01:05:23 X              justin-wrapper-job-d499w98p

387112.121   dunejustin      7/16 09:33   0+01:05:24 X              justin-wrapper-job-d499w98p

387112.31    dunejustin      7/16 09:33   0+01:05:22 X              justin-wrapper-job-d499w98p

387112.14    dunejustin      7/16 09:33   0+01:05:26 X              justin-wrapper-job-d499w98p

387112.100   dunejustin      7/16 09:33   0+01:05:17 X              justin-wrapper-job-d499w98p

387112.137   dunejustin      7/16 09:33   0+01:05:17 X              justin-wrapper-job-d499w98p

387112.98    dunejustin      7/16 09:33   0+01:01:28 X   7/16 10:36 justin-wrapper-job-d499w98p

387112.154   dunejustin      7/16 09:33   0+01:00:25 X              justin-wrapper-job-d499w98p

387112.178   dunejustin      7/16 09:33   0+01:00:20 X              justin-wrapper-job-d499w98p

387112.126   dunejustin      7/16 09:33   0+01:00:22 X              justin-wrapper-job-d499w98p

387112.49    dunejustin      7/16 09:33   0+01:00:21 X              justin-wrapper-job-d499w98p

387112.45    dunejustin      7/16 09:33   0+00:58:58 X   7/16 10:33 justin-wrapper-job-d499w98p

387112.6     dunejustin      7/16 09:33   0+00:55:36 X              justin-wrapper-job-d499w98p

387112.168   dunejustin      7/16 09:33   0+00:55:23 X              justin-wrapper-job-d499w98p

387112.99    dunejustin      7/16 09:33   0+00:55:21 X              justin-wrapper-job-d499w98p

387112.46    dunejustin      7/16 09:33   0+00:55:21 X              justin-wrapper-job-d499w98p

387112.4     dunejustin      7/16 09:33   0+00:55:28 X              justin-wrapper-job-d499w98p

387112.122   dunejustin      7/16 09:33   0+00:51:05 X              justin-wrapper-job-d499w98p

387112.161   dunejustin      7/16 09:33   0+00:50:25 X              justin-wrapper-job-d499w98p

387112.72    dunejustin      7/16 09:33   0+00:50:27 X              justin-wrapper-job-d499w98p

387112.115   dunejustin      7/16 09:33   0+00:50:22 X              justin-wrapper-job-d499w98p

387112.97    dunejustin      7/16 09:33   0+00:50:19 X              justin-wrapper-job-d499w98p

387112.86    dunejustin      7/16 09:33   0+00:50:19 X              justin-wrapper-job-d499w98p

387112.74    dunejustin      7/16 09:33   0+00:50:20 X              justin-wrapper-job-d499w98p

387112.65    dunejustin      7/16 09:33   0+00:50:20 X              justin-wrapper-job-d499w98p

387112.41    dunejustin      7/16 09:33   0+00:50:18 X              justin-wrapper-job-d499w98p

387112.152   dunejustin      7/16 09:33   0+00:48:38 X   7/16 10:22 justin-wrapper-job-d499w98p

387112.141   dunejustin      7/16 09:33   0+00:43:01 X   7/16 10:17 justin-wrapper-job-d499w98p

387112.129   dunejustin      7/16 09:33   0+00:32:44 X   7/16 10:07 justin-wrapper-job-d499w98p

387112.55    dunejustin      7/16 09:33   0+00:30:28 X   7/16 10:04 justin-wrapper-job-d499w98p

387112.40    dunejustin      7/16 09:33   0+00:42:03 X   7/16 10:16 justin-wrapper-job-d499w98p

387112.8     dunejustin      7/16 09:33   0+00:35:26 X   7/16 10:09 justin-wrapper-job-d499w98p

387112.33    dunejustin      7/16 09:33   0+00:45:24 X              justin-wrapper-job-d499w98p

387112.112   dunejustin      7/16 09:33   0+00:45:19 X              justin-wrapper-job-d499w98p

387112.127   dunejustin      7/16 09:33   0+00:45:19 X              justin-wrapper-job-d499w98p

387112.140   dunejustin      7/16 09:33   0+00:45:18 X              justin-wrapper-job-d499w98p

387112.44    dunejustin      7/16 09:33   0+00:45:24 X              justin-wrapper-job-d499w98p

387112.16    dunejustin      7/16 09:33   0+00:45:24 X              justin-wrapper-job-d499w98p

387112.186   dunejustin      7/16 09:33   0+00:40:24 X              justin-wrapper-job-d499w98p

387112.143   dunejustin      7/16 09:33   0+00:40:19 X              justin-wrapper-job-d499w98p

387112.173   dunejustin      7/16 09:33   0+00:40:19 X              justin-wrapper-job-d499w98p

387112.17    dunejustin      7/16 09:33   0+00:40:19 X              justin-wrapper-job-d499w98p

387112.3     dunejustin      7/16 09:33   0+00:40:35 X              justin-wrapper-job-d499w98p

387112.170   dunejustin      7/16 09:33   0+00:35:23 X              justin-wrapper-job-d499w98p

387112.114   dunejustin      7/16 09:33   0+00:35:24 X              justin-wrapper-job-d499w98p

387112.166   dunejustin      7/16 09:33   0+00:35:18 X              justin-wrapper-job-d499w98p

387112.132   dunejustin      7/16 09:33   0+00:35:19 X              justin-wrapper-job-d499w98p

387112.13    dunejustin      7/16 09:33   0+00:35:23 X              justin-wrapper-job-d499w98p

387112.81    dunejustin      7/16 09:33   0+00:30:22 X              justin-wrapper-job-d499w98p

387112.70    dunejustin      7/16 09:33   0+00:30:18 X              justin-wrapper-job-d499w98p

387112.57    dunejustin      7/16 09:33   0+00:30:19 X              justin-wrapper-job-d499w98p

387112.43    dunejustin      7/16 09:33   0+00:30:17 X              justin-wrapper-job-d499w98p

387112.52    dunejustin      7/16 09:33   0+00:27:54 X   7/16 10:02 justin-wrapper-job-d499w98p

387112.158   dunejustin      7/16 09:33   0+00:25:17 X              justin-wrapper-job-d499w98p

387112.116   dunejustin      7/16 09:33   0+00:24:09 X   7/16 09:58 justin-wrapper-job-d499w98p

387112.53    dunejustin      7/16 09:33   0+00:22:06 X   7/16 09:56 justin-wrapper-job-d499w98p

387112.128   dunejustin      7/16 09:33   0+00:20:21 X   7/16 09:54 justin-wrapper-job-d499w98p

387112.87    dunejustin      7/16 09:33   0+00:20:36 X   7/16 09:54 justin-wrapper-job-d499w98p

387112.165   dunejustin      7/16 09:33   0+00:19:50 X   7/16 09:54 justin-wrapper-job-d499w98p

387112.189   dunejustin      7/16 09:33   0+00:07:41 X   7/16 09:41 justin-wrapper-job-d499w98p

387112.18    dunejustin      7/16 09:33   0+00:07:41 X   7/16 09:41 justin-wrapper-job-d499w98p

387112.151   dunejustin      7/16 09:33   0+00:04:36 X   7/16 09:38 justin-wrapper-job-d499w98p

387112.20    dunejustin      7/16 09:33   0+00:02:38 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.133   dunejustin      7/16 09:33   0+00:01:45 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.131   dunejustin      7/16 09:33   0+00:01:26 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.111   dunejustin      7/16 09:33   0+00:01:52 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.108   dunejustin      7/16 09:33   0+00:01:31 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.107   dunejustin      7/16 09:33   0+00:01:56 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.101   dunejustin      7/16 09:33   0+00:01:39 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.95    dunejustin      7/16 09:33   0+00:02:00 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.83    dunejustin      7/16 09:33   0+00:01:28 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.80    dunejustin      7/16 09:33   0+00:01:50 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.75    dunejustin      7/16 09:33   0+00:01:42 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.62    dunejustin      7/16 09:33   0+00:01:45 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.64    dunejustin      7/16 09:33   0+00:01:39 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.69    dunejustin      7/16 09:33   0+00:01:32 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.67    dunejustin      7/16 09:33   0+00:01:52 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.61    dunejustin      7/16 09:33   0+00:01:33 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.59    dunejustin      7/16 09:33   0+00:01:26 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.39    dunejustin      7/16 09:33   0+00:01:40 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.23    dunejustin      7/16 09:33   0+00:02:00 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.12    dunejustin      7/16 09:33   0+00:02:03 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.27    dunejustin      7/16 09:33   0+00:01:28 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.29    dunejustin      7/16 09:33   0+00:02:10 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.21    dunejustin      7/16 09:33   0+00:01:32 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.9     dunejustin      7/16 09:33   0+00:01:43 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.5     dunejustin      7/16 09:33   0+00:01:54 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.2     dunejustin      7/16 09:33   0+00:02:32 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.191   dunejustin      7/16 09:33   0+00:01:56 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.174   dunejustin      7/16 09:33   0+00:01:31 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.172   dunejustin      7/16 09:33   0+00:01:27 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.148   dunejustin      7/16 09:33   0+00:01:41 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.163   dunejustin      7/16 09:33   0+00:01:18 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.162   dunejustin      7/16 09:33   0+00:01:45 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.155   dunejustin      7/16 09:33   0+00:01:35 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.159   dunejustin      7/16 09:33   0+00:01:57 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.130   dunejustin      7/16 09:33   0+00:01:38 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.149   dunejustin      7/16 09:33   0+00:01:50 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.146   dunejustin      7/16 09:33   0+00:01:55 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.144   dunejustin      7/16 09:33   0+00:01:56 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.139   dunejustin      7/16 09:33   0+00:01:25 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.136   dunejustin      7/16 09:33   0+00:01:59 X   7/16 09:36 justin-wrapper-job-d499w98p

387112.120   dunejustin      7/16 09:33   0+00:01:41 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.119   dunejustin      7/16 09:33   0+00:01:38 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.118   dunejustin      7/16 09:33   0+00:01:31 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.160   dunejustin      7/16 09:33   0+00:01:05 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.167   dunejustin      7/16 09:33   0+00:01:09 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.156   dunejustin      7/16 09:33   0+00:01:07 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.125   dunejustin      7/16 09:33   0+00:01:01 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.124   dunejustin      7/16 09:33   0+00:01:12 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.134   dunejustin      7/16 09:33   0+00:01:12 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.123   dunejustin      7/16 09:33   0+00:01:09 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.109   dunejustin      7/16 09:33   0+00:01:15 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.106   dunejustin      7/16 09:33   0+00:01:07 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.102   dunejustin      7/16 09:33   0+00:01:05 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.94    dunejustin      7/16 09:33   0+00:01:05 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.82    dunejustin      7/16 09:33   0+00:01:15 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.92    dunejustin      7/16 09:33   0+00:01:02 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.78    dunejustin      7/16 09:33   0+00:01:15 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.68    dunejustin      7/16 09:33   0+00:01:22 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.36    dunejustin      7/16 09:33   0+00:01:09 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.34    dunejustin      7/16 09:33   0+00:01:07 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.26    dunejustin      7/16 09:33   0+00:01:06 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.25    dunejustin      7/16 09:33   0+00:01:01 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.22    dunejustin      7/16 09:33   0+00:01:19 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.7     dunejustin      7/16 09:33   0+00:01:16 X   7/16 09:35 justin-wrapper-job-d499w98p

387112.24    dun

---

[root@dunegpschedd01 ~]# condor_history 387112

 ID          OWNER            SUBMITTED   RUN_TIME   ST   COMPLETED CMD

387112.76    dunejustin      7/16 09:33   0+03:15:45 X              justin-wrap

[root@dunegpschedd01 ~]#

This is not happening on all our machines, just 2 schedds in one pool.

We upgraded other machines to condor 25.0.12 at the same time and don't see the problem there.

My guess would be corruption in the history file in some manner, a couple characters in there that shouldn't be.  But how to tell?  Condor_history -debug gives nothing.

Steve Timm

[Cole Bollig]

Hi Steve,

Look into this and there is a very subtle bug within condor_history's logic to stop scanning early when specifying a specific job id or cluster. This exists back in v24.0 LTS series. I opened the following ticket HTCONDOR-3837.

Cheers,

Cole Bollig

---

From: 'Steven Timm' via HTCondor Users <htcondo...@g-groups.wisc.edu>
Sent: Friday, July 17, 2026 8:30 AM
To: HTCondor Users Mailing LIst Forward <htcondo...@cs.wisc.edu>
Subject: [HTCondor-users] Some jobs not queryable with condor_history, htcondor 25.0.12

 

--
Archives for older messages are found at https://www-auth.cs.wisc.edu/lists/htcondor-users/
---
You received this message because you are subscribed to the Google Groups "HTCondor Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to htcondor-user...@g-groups.wisc.edu.
To view this discussion visit https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/SA1PR09MB116417E5528BF94B3D23C0924B2C62%40SA1PR09MB11641.namprd09.prod.outlook.com.

[Steven Timm]

Hi Cole..

Thanks for getting back to me.  

Looked at the JIRA ticket you just made.  It makes sense, because normally in this pool the jobs stay in completed state for some length of time before they are then condor_rm'ed by the justin batch job factory that submits them.  In the case of a SYSTEM_PERIODIC_REMOVE This would necessarily mean that jobs would be out of order.

But I don't understand why you would say that this applies only clusterid.proc and not all clusterid.

The example I showed, demonstrated that condor_history <clusterid> returned only one job of the 200 that were initially in the cluster, even though a condor_history with grep showed that they were all there.

Steve Timm

---

From: Cole Bollig <cabo...@wisc.edu>
Sent: Friday, July 17, 2026 1:51 PM
To: HTCondor Users Mailing LIst Forward <htcondo...@cs.wisc.edu>; Steven Timm <ti...@fnal.gov>
Subject: Re: Some jobs not queryable with condor_history, htcondor 25.0.12

 

[EXTERNAL] – This message is from an external sender

[Cole Bollig]

Hi Steve,

I just had a discussion with TJ about that fact that it is not just a cluster.proc issue.

-Cole

---

From: 'Steven Timm' via HTCondor Users <htcondo...@g-groups.wisc.edu>

Sent: Friday, July 17, 2026 2:13 PM
To: Cole Bollig <cabo...@wisc.edu>; HTCondor Users Mailing LIst Forward <htcondo...@cs.wisc.edu>
Subject: [HTCondor-users] Re: Some jobs not queryable with condor_history, htcondor 25.0.12

 

To view this discussion visit https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/SA1PR09MB1164172F6DB82A9636F5A2677B2C62%40SA1PR09MB11641.namprd09.prod.outlook.com.