Click here to Skip to main content
15,905,963 members

Survey Results

Do you test your applications using real, live users?

Survey period: 20 May 2013 to 27 May 2013

Do you test against actual users, or rely on those closest to the product? "Real user" means someone who would use your product day-to-day and who wasn't involved in any aspect of development (other than testing)

OptionVotes% 
Yes, we test against real users45242.40
We sometimes test against real users28827.02
We rarely test against real users14513.60
We never test against real users. All testing is done in-house.18116.98



 
General"Against real users" Pin
_Amy23-May-13 18:00
professional_Amy23-May-13 18:00 
GeneralChimpanzees make better testers than humans Pin
Vivi Chellappa22-May-13 15:59
professionalVivi Chellappa22-May-13 15:59 
GeneralSoftware is a war PinPopular
Nelek22-May-13 6:32
protectorNelek22-May-13 6:32 
GeneralRe: Software is a war Pin
Brisingr Aerowing23-May-13 17:00
professionalBrisingr Aerowing23-May-13 17:00 
GeneralUse the CP Test Case Pin
Nagy Vilmos21-May-13 4:52
professionalNagy Vilmos21-May-13 4:52 
GeneralIt's the last test before official release to production... Pin
AlexCode20-May-13 22:45
professionalAlexCode20-May-13 22:45 
On most projects that I've worked on we used this technique.

All tests were made withing the team to ensure quality and at the end, the release is made available to a small subset of end-users.
These users are usually not random. They often reflect specific behaviors and usages that we really want to make sure we have no surprises.
At the end, this whole selected set of testers represent the majority of live usage cases we might have.

And very important, they are willing testers, interested people on the functionalities, not just some randomly chosen people that won't actually test anything. Documentation is supplied so that the users know what to test and what's the expected behavior (no bible).

Software goes pretty much bug free when they reach these users (ok ok, a couple of bugs may be found but nothing critical or blocking)
Until now, from these tests, the most important information is usability feedback.
New features or UX refactorings require new ways of user interaction and we might fail or forget some small details that won't be forgotten by these testers.

Cheers!
Alex
GeneralWe also test our users, using the application PinPopular
Joezer BH20-May-13 21:21
professionalJoezer BH20-May-13 21:21 
GeneralRe: We also test our users, using the application Pin
Tim Corey21-May-13 6:09
professionalTim Corey21-May-13 6:09 
GeneralWe keep them... PinPopular
CDP180220-May-13 19:25
CDP180220-May-13 19:25 
GeneralWe leave a few bugs PinPopular
HaBiX20-May-13 9:09
HaBiX20-May-13 9:09 
GeneralMostly Against Real Users Pin
Matt U.20-May-13 8:28
Matt U.20-May-13 8:28 
GeneralUnfortunately Pin
Clifford Nelson20-May-13 7:42
Clifford Nelson20-May-13 7:42 
GeneralSometimes, in-house testing is impractical Pin
Gary Wheeler20-May-13 7:03
Gary Wheeler20-May-13 7:03 
Generalaltho sometimes it seems like they're ... dead Pin
Peter N Roth20-May-13 6:04
Peter N Roth20-May-13 6:04 
GeneralOmega Test Pin
Pualee20-May-13 4:43
Pualee20-May-13 4:43 
Generalalways being tested Pin
Dennis E White20-May-13 4:23
professionalDennis E White20-May-13 4:23 
General"against" Pin
Marc Clifton20-May-13 3:53
mvaMarc Clifton20-May-13 3:53 
Generalwe test against real users Pin
chriselst20-May-13 3:18
chriselst20-May-13 3:18 
GeneralEveryone tests against users: release to production PinPopular
newton.saber20-May-13 2:22
newton.saber20-May-13 2:22 
GeneralRe: Everyone tests against users: release to production PinPopular
Nemanja Trifunovic20-May-13 2:27
Nemanja Trifunovic20-May-13 2:27 
GeneralRe: Everyone tests against users: release to production Pin
Brian Schummer23-May-13 5:22
Brian Schummer23-May-13 5:22 
AnswerWe do... lots of testing Pin
Joan M20-May-13 1:59
professionalJoan M20-May-13 1:59 
GeneralRe: We do... lots of testing Pin
R. Erasmus22-May-13 1:21
R. Erasmus22-May-13 1:21 
GeneralDammed right we do Pin
Mycroft Holmes20-May-13 0:50
professionalMycroft Holmes20-May-13 0:50 
GeneralSort of... Pin
Sander Rossel20-May-13 0:15
professionalSander Rossel20-May-13 0:15 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.