Software Testing Best Practice Award

An email I received from IIST

===================================================

The International Institute for Software Testing is
giving away FIFTY days of free training.

Up to TEN companies may win. Each company will get Five
days of free training.

Apply for the IIST's Software Testing Best Practice Award
at http://www.iist.org/bestpractice and receive the following benefits:

**** Get your company featured as an Award Winning Company
In all IIST publicity channels and press releases
**** Tell everyone how great your test process is
**** Get 5 days of free training at the International
Testing Certification Super Week to be held in
Las Vegas, NV, November 26-30, 2007
Chicago, IL, March 24-28, 2008
See details at http://iist.org/superweek
**** Get your company and your test team recognized and identified
as an Award Winning Team during these remarkable events


The International Testing Certification Super Week will be
held in the following cities:

Las Vegas, NV, November 26-30, 2007
Chicago, IL, March 24-28, 2008

During these events, IIST will offer 25 Full day
in-depth courses taught by Leading Industry Experts
in Software Testing & Quality.

**** Register by September 30th, and save 20% (Las Vegas)
See details at: http://www.iist.org/stpw/lasvegas/index.php

**** Register by December 31st, 2007 and save 30% (Chicago)
See details at: http://www.iist.org/stpw/chicago08/index.php

===================================================

Requirements Testing

Testing software is an integral part of building a system. However, if the software is based on inaccurate requirements, then despite well written code, the software will be unsatisfactory. Most of the defects in a system can be traced back to wrong, missing, vague or incomplete requirements.

Requirements seem to be ephemeral. They flit in and out of projects, they are capricious, intractable, unpredictable and sometimes invisible. When gathering requirements we are searching for all of the criteria for a system's success. We throw out a net and try to capture all these criteria.

The Quality Gateway

As soon as we have a single requirement in our net we can start testing. The aim is to trap requirements-related defects as early as they can be identified. We prevent incorrect requirements from being incorporated in the design and implementation where they will be more difficult and expensive to find and correct.

To pass through the quality gateway and be included in the requirements specification, a requirement must pass a number of tests. These tests are concerned with ensuring that the requirements are accurate, and do not cause problems by being unsuitable for the design and implementation stages later in the project.

Make The Requirement Measurable

In his work on specifying the requirements for buildings, Christopher Alexander describes setting up a quality measure for each requirement.

"The idea is for each requirement to have a quality measure that makes it possible to divide all solutions to the requirement into two classes: those for which we agree that they fit the requirement and those for which we agree that they do not fit the requirement."

In other words, if we specify a quality measure for a requirement, we mean that any solution that meets this measure will be acceptable. Of course it is also true to say that any solution that does not meet the measure will not be acceptable.

The quality measures will be used to test the new system against the requirements. The remainder of this paper describes how to arrive at a quality measure that is acceptable to all the stakeholders.

Quantifiable Requirements

Consider a requirement that says "The system must respond quickly to customer enquiries". First we need to find a property of this requirement that provides us with a scale for measurement within the context. Let's say that we agree that we will measure the response using minutes. To find the quality measure we ask: "under what circumstances would the system fail to meet this requirement?" The stakeholders review the context of the system and decide that they would consider it a failure if a customer has to wait longer than three minutes for a response to his enquiry. Thus "three minutes" becomes the quality measure for this requirement.

Any solution to the requirement is tested against the quality measure. If the solution makes a customer wait for longer than three minutes then it does not fit the requirement. So far so good: we have defined a quantifiable quality measure. But specifying the quality measure is not always so straightforward. What about requirements that do not have an obvious scale?

Non-quantifiable Requirements

Suppose a requirement is "The automated interfaces of the system must be easy to learn". There is no obvious measurement scale for "easy to learn". However if we investigate the meaning of the requirement within the particular context, we can set communicable limits for measuring the requirement.

Again we can make use of the question: "What is considered a failure to meet this requirement?" Perhaps the stakeholders agree that there will often be novice users, and the stakeholders want novices to be productive within half an hour. We can define the quality measure to say "a novice user must be able to learn to successfully complete a customer order transaction within 30 minutes of first using the system". This becomes a quality measure provided a group of experts within this context is able to test whether the solution does or does not meet the requirement.

An attempt to define the quality measure for a requirement helps to rationalise fuzzy requirements. Something like "the system must provide good value" is an example of a requirement that everyone would agree with, but each person has his own meaning. By investigating the scale that must be used to measure "good value" we identify the diverse meanings.

Sometimes by causing the stakeholders to think about the requirement we can define an agreed quality measure. In other cases we discover that there is no agreement on a quality measure. Then we substitute this vague requirement with several requirements, each with its own quality measure.

Requirements Test 1

Does each requirement have a quality measure that can be used to test whether any solution meets the requirement?

By adding a quality measure to each requirement we have made the requirement visible. This is the first step to defining all the criteria for measuring the goodness of the solution. Now let's look at other aspects of the requirement that we can test before deciding to include it in the requirements specification.

Requirements Test 2

Does the specification contain a definition of the meaning of every essential subject matter term within the specification?

When the allowable values for each of the attributes are defined it provides data that can be used to test the implementation.

Requirements Test 3

Is every reference to a defined term consistent with its definition?

Requirements Test 4

Is the context of the requirements wide enough to cover everything we need to understand?

Requirements Test 5

Have we asked the stakeholders about conscious, unconscious and undreamed of requirements?

Requirements Test 5 (enlarged)

Have we asked the stakeholders about conscious, unconscious and undreamed of requirements? Can you show that a modelling effort has taken place to discover the unconscious requirements? Can you demonstrate that brainstorming or similar efforts taken place to find the undreamed of requirements?

Requirements Test 6

Is every requirement in the specification relevant to this system?

Requirements Test 7

Does the specification contain solutions posturing as requirements?

Requirements Test 8

Is the stakeholder value defined for each requirement?

Requirements Test 9

Is each requirement uniquely identifiable?

Requirements Test 10

Is each requirement tagged to all parts of the system where it is used? For any change to requirements, can you identify all parts of the system where this change has an effect?

Conclusions

The requirements specification must contain all the requirements that are to be solved by our system. The specification should objectively specify everything our system must do and the conditions under which it must perform. Management of the number and complexity of the requirements is one part of the task.

The most challenging aspect of requirements gathering is communicating with the people who are supplying the requirements. If we have a consistent way of recording requirements we make it possible for the stakeholders to participate in the requirements process. As soon as we make a requirement visible we can start testing it. and asking the stakeholders detailed questions. We can apply a variety of tests to ensure that each requirement is relevant, and that everyone has the same understanding of its meaning. We can ask the stakeholders to define the relative value of requirements. We can define a quality measure for each requirement, and we can use that quality measure to test the eventual solutions.

Testing starts at the beginning of the project, not at the end of the coding. We apply tests to assure the quality of the requirements. Then the later stages of the project can concentrate on testing for good design and good code. The advantages of this approach are that we minimise expensive rework by minimising requirements-related defects that could have been discovered, or prevented, early in the project's life.

References:

An Early Start to Testing: How to Test Requirements
Suzanne Robertson

Testing Webinar

I came to know about the EuroSTAR Webinar which is schduled for Wednesday, 5th September! I think the topic is:
An Introduction to Testing on Agile Teams – The Practices & Beyond: presented by Antony Marcano, testingReflections.com, UK.

More Details follow:
======================
Date: Wednesday, 5th September, 2007
Time: 10:00 am London-Dublin / 11:00am CET
Duration: 30 minutes

Abstract: An increasing number of organisations are considering, or are in the process of, adopting Agile software development practices. Often, how testers integrate into this process is an afterthought. Worse still, organisations assume that it changes nothing about how testers function and operate. This couldn’t be further from the truth. In fact, a capable Agile team can change the very raison d’etre of a tester in all the ways that testers have often hoped for. No longer does the tester *need* to be the gatekeeper of quality; the whole development team cares about quality like never before. No longer are testers at the end of the process; testers are involved from the outset of the project!

During this webinar, Antony discusses:

Key Points
• What is it that makes a team ‘Agile’? – Practices such as Test Driven Development are a reflection of underlying values and goals. It’s the adoption of these values and goals that allows a team to gain the greatest benefit from adopting an Agile approach to software development.

• What are the common ‘Gotchas’ for testers on Agile teams? – For example, extraordinarily short iterations producing software with end-to-end features can catch out many testing teams. This is especially true if the test team is used to being segregated from the developers as a separate team and/or rely on large amounts of manually executed scripted tests.

• What role do testers play and how can you deliver the most value? – Your primary role is no longer just to inform the project of how the software doesn’t work, but to be a welcomed guide who helps, before the first line of code is written, to make sure that the software does work.

Register Here - http://qualtechconferences.arobis.com/content.asp?id=246

Best Practices... 2

... Continued from previous post.

 

http://testingsoftware.blogspot.com/2007/06/best-practices.html

 

1. Plan real life resource intensive tasks in advance and procure resources accordingly

Some applications may require processing large number of data for final output. During

functional testing of such applications, for quick results, a tester keeps on doing testing with

small set of data, which may take very less time. But user of that application will work with real

data, which may take significant time. A QE should process real time data that requires

application long time to process the data. Testing such cases in the end is not good idea. A

failure for long duration run is difficult to isolate. Isolating of such bugs is time consuming

activities. In the end of cycle such bugs will create panic and may delay major milestone.

Proper planning should be done to ensure smooth testing for long duration tests.

 

2. Test smartly

As the project/product becomes more and more complex, testing becomes a bigger challenge.

It is indeed impossible to test each and every scenario. Hence there is a need to test smartly.

Some of the smart testing approaches that one can adopt are:

a) Catching them early

One important thing to remember is to catch the bugs as early as possible in the life cycle.

The cost of fixing a bug early in the cycle is very less in comparison to the bug logged late in the

cycle.

b) 80-20 rule

This law states that eighty percent of the functionality should be covered in twenty percent of the

test cases. This method is a very handy resource of saving time and helps to cover the most

important scenarios as fast as possible.

c) Automation

Automation helps a lot in covering a lot of regression features thereby reducing the overhead of

the test team to test out the old features. Automation saves the tester time and can do repeated

tasks over and over again.

 

3. Sanity testing on every build

The sanity testing is very important and after every check-in, the sanity needs to be run.

Sometimes a change in one module may affect the other modules as such and also the entire app/product.

Sanity on every check-in/change will ensure that the basic things are working fine.

The issue with sanity is how many tests and which tests are you going to cover in the sanity pack.

The sanity pack should contain at least one test from all the features.

4. Feature sweep, Compatibility sweep etc for every feature.

a)Feature sweep

Feature sweep covers basic test cases of functionality. For every major milestone, these test

cases should be executed to ensure that functionality is not broken.

b) Compatibility Sweep

There are many features that require test cases for multiple hardware platforms,

Operating System among others. For a application that is supported on multiple OS (e.g.

Windows, Mac OS), different hardware configuration (AMD, Intel, Dual processor, hyper

threaded machine, different RAM etc.) and hardware (e.g. different printer for printing

application) such sweeps are very important.

 

 

5. Proper documentation

Documentation is a very wide term and includes any kind of written communication that helps the

project in sailing through. Documentation can be classified into four broad categories:

1) From the developers point of view

• Feature spec

• Design document

• Commenting

2) From the testing point of view

• Test plan

• Test script

• Execution matrix

• Resource planning document

• QA plan, among others

3) Documentation meant for the external users.

• User guide

• Help files

• Readme documents

4) Project management and Product management

• Requirement Specs

• Project Schedule

As a good Quality Engineer one should try to do the right amount of documentation ensuring that

the documentation helps smooth execution of the project and also helps to catch bugs early in

the cycle. Also the QE should make sure that the Developer has done the proper documentation

and if not the QE should follow up with the developer to get it done.

 

Product Review: ManagerAssistant

Following is my review of the product "ManagerAssistant"

ManagerAssistant.com is a company which develops Workforce Management Software.




One of its products is titled the same, i.e. the product is named ManagerAssistant.


The current version of this product is 3.0. A detailed description of the product is available here - http://www.managerassistant.com/products.html
If you just feel like going through a tour, the link goes here - http://www.managerassistant.com/tour.html


What is ManagerAssistant?
To put it in simple words, ManagerAssistant is a software that helps managers for employee management.

This software empowers managers to track, evaluate, and control the behavior, performance, and activities of employees.

From a single application, ManagerAssistant software addresses the following workforce management processes and activities:

Employee review
Employee information tracking and monitoring
Hiring and recruitment
Employee evaluation
Employee attendance tracking
Employee appraisal
Vacation tracking
Incident tracking
Paid time off tracking
Employee goals
Employee training & development administration
Employee HR detailed info

Free Demo Download.

There is a free demo download available; unfortunately, this requires you to register. This may not be such a good idea where you force upon the visitors to register to download a demo.

Anyways, I can tell you a hack how to avoid the registration.

This is a php website and you can directly use this link to download the demo without registering - http://www.managerassistant.com/download.php

The download was very slow(at least for me) - it took almost an hour to download the exe file.

You did better use Download Accelerator Plus(DAP), which is available here for free - http://www.speedbit.com/

Using DAP I was able to download in almost 5-7 mins. The file is approx 111 MB.

System Requirements

- Operating System: Microsoft® Windows® Vista, XP Home/Pro, Microsoft Windows 2000 SP4 Pro, or Microsoft Windows Server 2003

- Intel Pentium® or compatible processor (700 MHz or greater)

- 512 MB RAM or greater

- 150 MB disk space

- SVGA with 256 colors (1024 x 768 with 16-bit color recommended)

Installation

Double click the executable and the installer opens up, the follow up is pretty simple. Unfortunately, the installer does not give me the option of choosing the installation directory.

The files are installed under C:\Program Files\ManagerAssistant.com\ManagerAssistant 3.0\

There is only a windows version of this product, they do not have a Linux or anything else.

If you have an earlier version of ManagerAssistant, you can even migrate the data to the new version.

Once the Installation is over, just double click on the icon to open the application.

The front page shows up like below.

Reminders: There is a set of reminders on the left hand side, you can even view only the reminders that were set by you alone.

You can view reminders for 1. For the day 2. For the week 3. For the Month

Also present is a calendar with the current date highlighted.

CheckList: Here you can add any number of folders and TO-DO list. The Completed items appear in Blue color, Pending items in Green and Overdue items in Red.

Employees Tab:

This is a very useful tab and gives the complete information of the employee.

Just right click on the right taq and you get the list of columns.

There are a total of pre-defined 79 columns and you can select/deselect these columns.

Unfortunately, there is no way to add your own columns. And you cannot re-name these columns.

You can add/edit/delete an employee record and the best of these I think is the "email as pdf" feature. This will email the emp record in a pdf.

You can filter the records, There are a variety of reports which are very good.
The data can be exported in the form of grid in 4 types - XML, HTML, Text, XLS

Attendance Tab

This is another important tab in the product. Very helpful to track the attendance of the employees.

This can be very useful when the you have employees who are employed part-time as well as full-time.

There are 4 sub tabs
1. Calendar View
2. Table View
3. Attendance overview
4. Employee Year View

The salient features here include:
a. You can select the columns to view.
b. You can sort the columns.
c. Adding an attachment to the details is allowed.
d.

Allows marking for different types of attendance out reasons like: bereavement, maternity, medical, sick, late/tardy, vacation, comp time, military duty, floating, jury duty and more.

Never a days the employee attendance is recorded by the magnetic swiping of the emp ID card at the entrance door.

It would be great if this applicaiton can be import data on a day to day basis from the the server. May be that needs a plugin or something to be added to acheive that???

Here is a report for attendance I created. This is Bar Graph created from the existing data.

Performance Review Tab

This can be used to produce reviews of employees within a short time, no need of storing the data in word formats etc...

You can send out reminder emails as well and there is self calculating ratings. You can modify the ratings and change the categories, weighted averages etc.

Also other features include - spell check, thesaurus, email as pdf, print hte reviews.

Below is a snapshot of the Review details.

The Goals Tab

This can be used to create a set of goals for the employees which they need to accomplish over a period of time. One advantage here is you can keep track of the progress of the employees.

This is how the goals tab looks like.

The Incidents Tab

Helps you to keep track of any incident that happened. This can be any good or bad incident.

You can add an attachment, Also note the plan of action.

The accomplishments Tab

Whenever an employee acheives something, you need to keep track of that, lest you may forget. The managers need to keep track of all the employees and they may forget the employee acheivements.

This tool can be very useful to keep track of the accomplishments and the employees who accomplish something great should be given bonus.

The Training Tab

Helpful in keeping track of the training a candidate takes during his employment.

The Recruitment Tab

This is helpful in recruiting.

1. you can enter the data of the candidates applying.

2. If he is selected, you can convert him into an employee - should add the employee data at the time.

But what I was looking for here the flow of recruitment process. Like when 1st round of interview is over, he(first interviewer) should be able to transfer the candidate to the second interviewer.

And then the next interviewer. Unfortunately this is missing. Generally this process is very tedious and people send emails. An application would be good.

The Expenses Tab

You can add your expenses reports here.

Customers

Here is a list of customers including which ManagerAssistant has.

Pricing

Single-User Edition Version3.0 $395.00
Network/Multi-User Edition Version 3.0 Starting at $895.00

Documentation:

The help and documentation provided with the app is very good.

Un-installation

They do not provide a un-installer link in the start - programs menu. Nor do they provide a unistall.exe in the installed directory.

You need to go to the control panel to unistall the product.

Summary

The website of ManagerAssistant is good, but it would be good if they can come up with something better. I was able to download the app by-passing the registration form.

ManasgerAssistant is a good application, with a lot of features all integrated. I found the “Employee” tab and the “Performance Review” tabs very useful. The attendance tab is also good but I was wondering if there was an integration with the swiping card attendance. If there can be a way by which we can integrate the attendance with the app, then the time-in, time-out of the employees can be noted and also the attendance. Also there should be a way by which the employees can apply for vacation through the intranet, and the app should update itself automatically.

Definitely this is a very good app for the Managers and can save a lot of time and imporve the productivity.

===============================

Disclaimer: Do not make a purchase based on this review; I suggest you to Download ManagerAssistant, test it for a few days and see if you like it yourself.

This is a sponsored review; Do you want your product to be reviewd? Check out ReviewMe

Tester Job

Received this email... thought I would share it.
-------------------------
Tensor Software Technologies, Bangalore, India, requires a Software Testing Engineer with more than 2 years of experience in Testing.

Candidates should possess the following skillsets:-

1. Design and development of test cases from software design documentation and Functional, technical and regulatory requirements


2. Defect identification, isolation and reporting


3. Familiarity with test automation tools

4. Good knowledge in System testing, performance testing
5. Hardware knowledge would be beneficial.


Please send your resumes to fakruddin.shaik@gmail.com Only if you have the required experience and skillset.

About Tensor:
Tensor is the leading manufacturer of smart card and biometric Time and Attendance, Access Control, Visitor Monitoring, and Digital CCTV equipment and software.
www.tensor.co.uk

URL Redirection...

I received an email asking about HTML Code for redirection of a web page to another?

To make a page redirect, we can use the HTML Meta Tag inside the head tag

Example:
meta equiv="refresh" content="5; url=http://www.another-site.com"

This code will redirect your webpage to the new url after 5 seconds.
The attribute http-equiv="refresh" calls for refresh of the page.
The attribute content="5; URL=http://www.another-site.com" sets the time interval in seconds after which the page redirection will take place and the destination page.

Make sure you follow the exact order of coding. i.e: content="time interval in seconds; URL=resulting page";

Note that you should not use semicolon after 'url='.So using this meta tag will redirect the page to the destination page after the time interval.