When you buy a car, the first thing you do is start it up and step on the gas. I haven't seen a person who would put the car in the parking slot and then write tests for the ECU and think about the environment that should be used for the test suite.
So why not just use the app instead of testing it?
I'll tell you how:
- we found the right focus group for our test framework and improved it as much as possible.
- we introduced an application, built on our product, into the daily life of our R&D department and found quite a lot of error
- we forgot about Jenkins task for a week and got our "internal" production system running.