Reducing queue wait times
A developer must wait for test hardware to come available her tests can run. Today, RocketCar over-provisions hardware to keep the queue wait time reasonable for most cases. 50% of test sessions get the hardware unit they need within 1 minute.
But you might be surprised to hear that the average wait time is much worse – 5 minutes. This is because when things get busy, the queue goes much longer. The worst case scenario goes north of 60 minutes.
Yet those are precisely the time that developers need test hardware the most!
The issue for the team is that most people remember the one time that they had bad experience, and that takes away from all the excellent work this team is doing.
By reducing the time a test session occupies a hardware unit, we can reduce the queue wait time by at least 63%. The impact is even bigger in a crunch time when the queue starts to back up.