Comparison of 5 methods to gather 20 testers and what to use

Hi, Today I would like to compare what methods are available to gather testers for Google's closed testing and their advantages and disadvantages.

Background

In 2023, Google's policy for publishing apps was changed, making it difficult for individual developers to enter the market. Target developers cannot afford to go through the trial-and-error process each time they develop an app because of the work involved in gathering testers each time they develop an app.

Comparison

As an assumption, I have not used all the methods myself. Therefore, some of the information is based on speculation. Also, since this is an article for new individual developers, I will exclude methods that are not feasible, such as using in-house testers.

Here is a list of the methods that come to mind.

1. use your own friendships
2. use social networking sites
3. use developer meetups Sign up for tester services
4. use closed test apps

Using your own friendships

This one involves explaining the situation to family and friends and asking them to participate as testers.

Advantages

• You can be sure to get a tester.
• Free of charge

*Disadvantages

• Limited number of testers (especially if you are a loner like myself).
• Simply embarrassing.
• Difficult to ask for repetition (in case of multiple apps development)
• Explaining the testing method is troublesome (especially if the other party's IT literacy is low).

It is the easiest and most reliable method, but I think there are few people who can clear the test only by this method. Also, I imagine that even people who have many friends may feel uncomfortable asking for help every time.

Using SNS

This is the case of using Discord, Reddit, etc. In this case, you will be asked to test your app instead of testing their app.

Advantages

• Contact with many developers
• Free of charge
• Less explanation of background, etc.

Disadvantages

• Takes time to find a partner.
• English is required as a rule (can't find enough partners in your country?)
• You have to put in an application that you are not interested in at all.
• Sometimes people make false declarations

It is a free way to gather enough testers, but it is time-consuming. Also, if you are lied to (e.g., the number of opt-ins has not increased), it can be quite discouraging. The initial hurdle is also a bit high.

Using Meetups

This is a case where you participate in an event and ask for testers.

Advantages

• You can get various information from other developers.
• You can be sure to get testers.
• Free of charge (depending on the content)

Disadvantages

• Time consuming
• No guarantee of getting enough testers

I have never done this, but I feel that the main purpose is to exchange information in the first place, and it would be better to secure testers as an added bonus.

Apply for tester service

This is a way to apply for a service that provides devices for closed testing. If you search, you can find a variety of services.

Advantages

• Takes less time.
• No hassle

Disadvantages

• Paid for.
• Unsure if it is a reliable service

It may be the quickest way. It may be good for people who have money and think they can get it back quickly with a released application. However, I am afraid that even if you pay, there is no guarantee that you will get it tested.

Using closed testing apps

This is a case where you can use a dedicated app to test other developers' apps while having your own app testers This is a case where you can test your own app while testing other developers' apps using the app.

Advantages

• No hassle
• Free of charge
• You can choose the apps you are interested in (compared to social networking sites, etc.).
• (They will confirm the installation and) you won't be lied to.
• English is not required (no need to make the first transaction between developers)

Disadvantages

• Takes time (depending on how many testers apply).

There are no major disadvantages here; it is similar to the case using SNS, but the hurdle is much lower because the hassle is eliminated and you do not have to deal with other developers in English. On the other hand, there is a concern that it might be passive and take longer to complete the test since you have to register your own application and wait.

Comparing the whole process

There is no need to limit yourself to one method, so it is better to use multiple methods depending on your situation. I'll leave meetups aside because they are a bit special, but if you have the money and don't mind the risk of unreliability of the service, you can sign up for a tester service. For the rest of us, I think you can definitely use social networking and social networking services and dedicated applications in parallel.