![]() For example, many large cloud vendors have an Iron Rule that relational databases must never be used, because they're concerned precisely about this issue occurring, except at a vastly greater scale. This is a very deep rabbit hole to go down. One hiccup was that when the query cardinality estimator got confused, it would occasionally ignore the partition prefix and do a full scan somewhere, bloating the results by a factor of 2000x! This would cause dramatic slowdowns randomly, and then the DB engine would often cache the inefficient query plan, making things slow until it got rebooted. Every lookup specified it with an equality filter, so essentially it was thousands of standalone libraries in a single schema. ![]() I simply added the "library id" as a prefix to almost every table's primary key. This was the project that made realise how huge the effort-to-effect ratio that can be when computers are involved… I’ve had a far greater effect on the literacy of our state than any educator by orders of magnitude and hardly anyone in the department of education even knows my name! I watched the effect of these changes - which took me mere days of effort to implement - and the combined result was that students read about a million additional books they would not have otherwise. Things like reading competitions, recommended reading lists by age, etc… I was asked to add some features that would have been too difficult in the old distributed system. ![]() It was efficient enough to run off my laptop, if need be.ĪFAIK it was one of the top five biggest library systems in the world at the time. It served over 2,000 libraries, had 330 million titles, and had about a million users. During a centralisation of public school local servers to a data centre, I created a consolidated library enquiry system. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |