Repository navigation
Commit 6143505
committed
DPL Analysis: query the CCDB once per run of equal timestamps
When a CCDB table has no separate uniformity column, the analysis CCDB
fetcher called populateCacheWith for every row of the source table, so
about 19k times per timeframe for a BC-indexed table such as the ones of
propagation-service-v2, even though consecutive BCs share the same
millisecond timestamp. Reuse the previous responses whenever the lookup
key, the uniformity value or else the timestamp, is the same as the one
of the previous row. Since the key determines every FetchOp of the row,
the responses and hence the output table are unchanged.
For the LHC25b4a6 AO2D of Hyperloop test 799098 this is about 350 runs of
equal (millisecond) BC times over 1.17M BCs in 61 DFs, instead of one
query per BC.1 parent 3dda7ea commit 6143505
1 file changed
Lines changed: 4 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
235 | 235 | | |
236 | 236 | | |
237 | 237 | | |
238 | | - | |
239 | | - | |
| 238 | + | |
| 239 | + | |
240 | 240 | | |
241 | 241 | | |
242 | 242 | | |
| |||
273 | 273 | | |
274 | 274 | | |
275 | 275 | | |
276 | | - | |
277 | | - | |
278 | | - | |
279 | | - | |
280 | 276 | | |
281 | 277 | | |
282 | 278 | | |
283 | 279 | | |
284 | 280 | | |
| 281 | + | |
| 282 | + | |
285 | 283 | | |
286 | 284 | | |
287 | 285 | | |
| |||
0 commit comments