We worked hard on the result table: from the way the metrics are displayed and sorted to the CSV export, we reviewed this
report item so you can get the most revealing information from it.
This short post describes the modifications made to OctoPerf for its last update, and how they can let you save time while preparing your load tests.
You may need to have a large performance test done for yesterday. In such case the process to get a license with the appropriate number of virtual users must be as straightforward as possible.
That's why we automated this process in OctoPerf, our load testing solution. Even as your performance
bench is running, you can edit the generated report:
List errors to check that your virtual users are properly configured,
Add various charts to identify performance bottleneck,
Insert text to explain what could be donne to improve response times,
Give your conclusions to the stakeholders.
You can have a complete test report, ready to be delivered, as soon as the bench ends. And now, you can directly export
it from OctoPerf into a PDF file.
Why improving our reporting system? We were aware that some features were missing to make it easier to drill-down to bottlenecks.
But, we prioritized those features low at the moment because we were focused on gaining traction for now.
If you have read How we greatly improved User Engagement, you know that we care about our customer needs.
We carefully collect and prioritize customer feedbacks. And, at some point, we decided to get back to development to make some major improvements, based on what our customers experienced with our tool.
It's a matter of good balance between gaining traction to get new clients and improving the tool to avoid loosing leads. If people try your tool, it's already 50% of the work done.
But, the other 50% are important too: our tool must solve our customer issues, and it must do it well.
We decided it was the moment to switch back to development because we were loosing some leads due to important features being missing. Let's take the tour!
The goal of any Saas Application is to convert as many trials as possible to paid customers. To improve your application, what do you absolutely need? Feedback. We are using a live chat support app to get feedback on how users are using our SaaS app.
We were greatly surprised by the results. Many of our users were stuck at the very first step of load testing their web or mobile app. We discovered several issues:
Customers were proposed to create an empty virtual user as first choice. Many of them were then stuck with this empty user, not knowing what to do next,
Customers were not finding how to return to project homepage from the virtual users edition page,
We are only collecting email when user are registering to improve visitor to trial conversion rate. We have then a lack of information about users, and need to find a way to get them later.
Let me explain now how we greatly improved our user engagement and trial conversion rate by fixing the above points.