Sunday, April 20, 2014

Beta Testing vs. Alpha Testing


Beta Testing is a test for a computer product prior to commerial release. Beta testing is the last stage of testing, and normally can involve sending the product to beta tests outside the company for real-world exposure. So I am going to compare the Beta Testing to the Alpha Testing to help to understand the Beta Testing.[1]

1. What they do
Beta Testing is to improve the quality of the product, integrate customer input on the complete product, and ensure release readiness. Alpha Testing has the similar role with Beta Testing  in this aspect.

2. When they happen
Beta Testing is just prior to launch, sometimes ending within weeks of even days of final release. However, Alpha Testing is towarding the end of a development process when the product is in a near fully-usable state.

3. How long they last
Beta Testing usually takes only a few weeks(sometimes up to a couple of months) with few major iterations.

4. Who will test
In the Beta Testing, tests are in the “real world” with “real customers” and the feedback can cover all the elements of the final product. In the Alpha Testing, it is usually performed by test engineers and employees.

5. What the tester can expect
The testers will expect some bugs, fewer crashes and most docs in the Beta Testing, but the testers will expect plenty of bugs, crashes and missing docs in the Alpha Testing.

6. What the they achieve
The Beta Testing is about chaos, reality and imagination. It explores the limits of a product by allowing customers to explore every element of the product in their native environments. But the Alpha Testing is about methodology, efficiency and regiment.

Screen Shot 2014-04-20 at 4.57.48 PM.png


7. When they are over
When the testers have a good idea of what your customer thinks about the product, the Beta Testing can be over. On the other hand, when the testers have a decent idea of how a product performs and whether it meets the design requirements.


Reference
[1] http://www.webopedia.com/TERM/B/beta_test.html

[2]"Beta Tester Salary in United States." Job Search. Indeed, 07 May 2014. Web. 07 May 2014. The Game Mistress. "The Importance of Beta Testing." The Importance of Beta Testing |          GameMistress. GameMistress, 19 Aug. 2012. Web. 07 May 2014.

Saturday, April 12, 2014

Cross-Cultural Usability Testing

The concept of Cross-Cultural Usability Testing now becomes very popular in the usability domain as the global trade and international competition are booming every year. As a key process in the whole product development process, more and more usability experts realize culture effects also should be carefully considered in the design of usability testing process. It is not said that the design of usability testing process must be culture oriented, but can’t be culture ignored.

屏幕快照 2014-04-12 下午5.53.18.png

Nowadays, cultures could not be singly divided to western cultures and eastern cultures. Each country has its own unique culture. Even in Europe, there are no two countries which have exactly the same cultures. And a country itself possibly has different cultures like U.S.

Each culture has its own unique characteristics, if a usability testing activities will be conducted cross different cultures, the following effect factors must be considered.

Testing Methods: it is hard to say which testing method is particularly better for which culture, but it should be careful to apply the methods and adjust them dynamically in different cultures to get the best results. A research specially on testing methods with different cultures now is ongoing.

Localization: localization of the prototype product and the testing process itself is very important. It should beyond direct translation. A bad localization will lead to more usability problems and will cover the potential more serious usability problems. It is not expected a bad designed usability testing process could detect more usability problems of the product.


Moderator &Local Institute: a native moderator is always better to conduct the testing process, to avoid potential communication caps between each others. When conducting a usability testing or evaluation in another country, finding a local institute to cooperate possibly will be very helpful and more efficient. Also the local institute will help to arrange the organizations like recruiting, equipments, testing room (usability lab), etc.


One Country is not One Culture: be careful that even one country, there are potential different cultures. When conducting a usability testing in multi-culture society, more details should be considered.

Proper usability testing methods will be the key issue of a successful cross cultural usability activity, and further research will focus on the usability methods in different culture contexts.

References:

[1] Torkil Clemmensen, Department of IT Management,
[2] Lynda.com. “UX tutorial: What is usability testing? | lynda.com.” Online Video clip. Youtube. Youtube, 26 June. 2013. Web. 13 April. 2014