16.6. Case Study: Unique Keys¶
16.6.1. Prepare¶
Setup code used for all examples:
>>> DATA = [
... {'sepal_length': 5.1, 'sepal_width': 3.5, 'species': 'setosa'},
... {'petal_length': 4.1, 'petal_width': 1.3, 'species': 'versicolor'},
... {'sepal_length': 6.3, 'petal_width': 1.8, 'species': 'virginica'},
... {'sepal_length': 5.0, 'petal_width': 0.2, 'species': 'setosa'},
... {'sepal_width': 2.8, 'petal_length': 4.1, 'species': 'versicolor'},
... {'sepal_width': 2.9, 'petal_width': 1.8, 'species': 'virginica'},
... ]
16.6.2. List Append If¶
Append if object not in the list:
>>> #%%timeit -r 1000 -n 10_000
>>> result = []
>>> for row in DATA:
... for key in row.keys():
... if key not in result:
... result.append(key)
2.16 µs ± 26.5 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.3. List Append¶
Append to list and deduplicate at the end:
>>> #%%timeit -r 1000 -n 10_000
>>> result = []
>>> for row in DATA:
... for key in row.keys():
... result.append(key)
>>> result = set(result)
2.5 µs ± 32.9 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.4. Set Add¶
>>> ##%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... for key in row.keys():
... result.add(key)
2.12 µs ± 32.4 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.5. Set Update¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... result.update(row.keys())
1.57 µs ± 26.7 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.6. Set Comprehension¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set(key
... for record in DATA
... for key in record.keys())
2.06 µs ± 79.7 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.7. Set Comprehension Add¶
Add to Set Comprehension.
Code appends generator object not values, this is why it is so fast!:
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> result.add(key
... for record in DATA
... for key in record.keys())
447 ns ± 9.52 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.8. Set Comprehension Update¶
Update Set Comprehension:
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> result.update(tuple(x.keys()) for x in DATA)
2.06 µs ± 45.9 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.9. Set Comprehension Update¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... result.update(row)
16.6.10. Set Comprehension Update Tuple¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... result.update(tuple(row))
2.09 µs ± 16.1 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.11. Set Comprehension Update List¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... result.update(list(row))
2.33 µs ± 30.2 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)
16.6.12. Set Comprehension Update Set¶
>>> #%%timeit -r 1000 -n 10_000
>>> result = set()
>>> for row in DATA:
... result.update(set(row))
1.71 µs ± 54 ns per loop (mean ± std. dev. of 1000 runs, 10000 loops each)