Speed up query in paused loop.

[rspier]

• Add an index on dverified.
• Stop doing explicit conversion from str to int (dverified + 0)
• dverified will always be a 10 digit unix timestamp, so string comparison results in the same as numeric.
• Query goes from ~30 sec to ~5

(Alternative considered was adding a virtual dverified_num column, but that's a lot more invasive.)

[andk]

The reason why we are using the +0 are all the dates in the table with 9 digits.

MariaDB [mod]> with cte as ( select dverified+0>1000000000 dv from uris ) select dv, count(*) cnt from cte group by dv;
+----+--------+
| dv | cnt    |
+----+--------+
|  0 |  15189 |
|  1 | 395436 |
+----+--------+
2 rows in set (3.509 sec)
MariaDB [mod]> select max(dverified) from uris where dverified > '1775030167' ;
+----------------+
| max(dverified) |
+----------------+
| 999996699      |
+----------------+
1 row in set (0.001 sec)

MariaDB [mod]> select max(dverified) from uris where dverified+0 > '1775030167' ;
+----------------+
| max(dverified) |
+----------------+
| 1776028378     |
+----------------+
1 row in set (0.915 sec)

Did you consider that?

[rspier]

Totally missed that. I'll consider re-spinning this as a virtual column, but not sure when I'm going to get to it. It almost might complicate the SQLite fallback. Really, this column should be an INT.