News and information about the Hard Tech world

What is Crowdtesting?

by: Inmetrics in

| September 21, 2018 at 4:01 pm

According to Gartner, by 2020, Crowdtesting will be present in 60% of mobile testing initiatives.

Crowdtesting, or Crowdsourced Application Testing, is one of the models for Crowdsourcing applications for software testing. The Crowd model proposes the use of people for solving problems, developing some content or, in this case, performing tests.

Crowdtesting is a work model that allows users to test the application under real operating conditions, providing near-instant feedback of the product under actual operating conditions.

To put together a Crowd, testers’ profiles can be selected according to their characteristics, qualification and/or their device models. This model’s great appeal is in validating across a great diversity of devices and user profiles. In addition, the flexibility of the Crowd’s collaborative model enables individuals to test at any time and place through the Crowdtesting platform.

What are Crowdtesting’s main characteristics?

• Testing focused on emerging technologies and user experience
Crowdtesting is growing as a complementary method to classic testing services, it is highly driven by cloud and emerging technologies, and focuses on user experience.

• Different types of tests and devices
Crowdtesting is currently used primarily for functional testing of Web applications and Websites and is expanding to other devices (Wearables and IoT). In addition to functional testing, it can also be used in other areas such as security, usability and performance testing.

• Verified (vetted) or unverified (unvetted) models
Crowdtesting providers that offer application testing services are categorized as vetted providers like Smartest, or unvetted, according to the level at which they verify their testers’ qualifications and experience.

• Pure-play or Classic providers
Crowdtesting services can be offered by companies focused exclusively on this work model, such as Smartest, or by traditional IT service providers such as Inmetrics, for example.

• Mobile Platform
The Crowdtesting service is typically supported by the use of a platform that will manage mobile testing to improve the testers’ usage experience (such as recording defects directly from the mobile phone) and developers (such as device logs, videos and screenshots, CPU and memory consumption metrics, and others).

What are Crowdtesting’s main benefits?

• Feedback from real users
In Crowdtesting, you get feedback from users with different profiles, location, handsets and mobile operators. This enables you to receive more real feedback from the situations that will be faced after the application’s go-live.

• Real usage conditions
Lab tests typically use “clean” mobile phones (factory-reset after each test and/or with only standard apps installed) that may not show usage situations such as changes in the device’s default settings, changes in signal quality, battery life, disk space, and others.

• Find the best testers
Testers participating in crowdtesting earn points for successfully performed activities such as finding defects and submitting requested test evidence, and lose points in performing undue activities such as recording repeated defects or missing out on confirmation cycles. This way, over time, the best are identified and rewarded.

• Broad device coverage
The Crowd enables choosing different types of devices (Smartphones, Tablets and Smart Watches), brands (Apple, Samsung, Motorola, LG, ASUS, and others) and operating systems, with over 100 different models.

• Shorter Time-to-Market
Begin testing in a matter of hours and not days after the system and access to it are available (if applicable) and receive the results in a few days.

• Lower cost than classic testing initiatives
By using crowdtesting, there is no need to buy or rent handsets. In addition, the remuneration of the test team does not use the worked time model, but rather activities performed (such as finding defects or delivering evidence). This way, the crowdtesting cost structure becomes much more efficient than the classic model.

Although it should not be considered the only strategy, Crowdtesting is a valuable supplemental service and it can be an excellent choice for the final testing stages, providing feedback from real users and optimizing time and cost.

This article was originally posted on the Smartest website.

About Smartest

Smartest is a Brazilian startup whose mission is transforming the way you test software and uses its base of 500+ test professionals to deliver your projects.

About Inmetrics

To continuously improve your customers’ experience, you can count on a multidisciplinary team whose search for results is a daily obsession. Inmetrics optimizes digital business platforms for building robust results.