<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Good Test? Bad Test?</title>
	<atom:link href="http://www.ere.net/2007/10/31/good-test-bad-test/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.ere.net/2007/10/31/good-test-bad-test/</link>
	<description>Recruiting intelligence. Recruiting community.</description>
	<lastBuildDate>Sun, 08 Nov 2009 09:18:04 -0500</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Steve Waterhouse</title>
		<link>http://www.ere.net/2007/10/31/good-test-bad-test/comment-page-1/#comment-3196</link>
		<dc:creator>Steve Waterhouse</dc:creator>
		<pubDate>Fri, 02 Nov 2007 03:50:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2007/10/31/good-test-bad-test/#comment-3196</guid>
		<description>Dr. Williams&#039; article is a perfect selection tool for picking an assessment tool. I wish all of our prospects had a copy. 

As others mentioned correctly, the human element also comes into play and in several ways. First, with the understanding of the job and defining the correct criteria. An assessment should have a tool to help bring together multiple views of a position and a process for synthesizing a single profile. 

Second in the application of the resulting data. An assessment tool gives you insight into the individual that would not otherwise be available. A competent interviewer will use that insight to ask better questions and reach a better decision. 

A good assessment tool will improve every aspect of the hiring process but will never replace the human interaction needed to finally select an ideal applicant.

Steve Waterhouse
www.predictiveresults.com</description>
		<content:encoded><![CDATA[<p>Dr. Williams&#8217; article is a perfect selection tool for picking an assessment tool. I wish all of our prospects had a copy. </p>
<p>As others mentioned correctly, the human element also comes into play and in several ways. First, with the understanding of the job and defining the correct criteria. An assessment should have a tool to help bring together multiple views of a position and a process for synthesizing a single profile. </p>
<p>Second in the application of the resulting data. An assessment tool gives you insight into the individual that would not otherwise be available. A competent interviewer will use that insight to ask better questions and reach a better decision. </p>
<p>A good assessment tool will improve every aspect of the hiring process but will never replace the human interaction needed to finally select an ideal applicant.</p>
<p>Steve Waterhouse<br />
<a href="http://www.predictiveresults.com" rel="nofollow">http://www.predictiveresults.com</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dr. Wendell Williams</title>
		<link>http://www.ere.net/2007/10/31/good-test-bad-test/comment-page-1/#comment-3195</link>
		<dc:creator>Dr. Wendell Williams</dc:creator>
		<pubDate>Thu, 01 Nov 2007 02:12:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2007/10/31/good-test-bad-test/#comment-3195</guid>
		<description>Whatever you call it, selecting qualified people for the job starts with a thorough understanding of critical job elements. You can think of these elements as &#039;itty-bitty behaviors&#039; moving toward results. 

For example, being smart enough to learn and solve job-related problems; being able to plan and implement activities; being able to get things done through people&#039; and, so forth. Professionals call this &#039;job-analysis&#039;.

Matching people to jobs is a function of knowing exactly what you need (e.g., job-related mental skills, people skills, and motivations discovered from the job analysis), then using professionally-developed tests to evaluate applicants.

An interview is just another form of &#039;test&#039;. It has questions, answers, and a scoring guide. What makes traditional interviews inaccurate is 1) lack of clarity about what itty-bitty skills are needed, 2) poor questions, 3) self-reported answers, and 4) subjective scoring guides. 

Behavioral and siutational interviews MAY more accurate...but only when they are based on a job analysis, interviewers are trained in best-practice questioning technique, multiple interviewers integrate their individual data, and answers are  standardized.

Anything less and you &#039;role the dice&#039; with the organization&#039;s money...about 50/50 is the average.</description>
		<content:encoded><![CDATA[<p>Whatever you call it, selecting qualified people for the job starts with a thorough understanding of critical job elements. You can think of these elements as &#8216;itty-bitty behaviors&#8217; moving toward results. </p>
<p>For example, being smart enough to learn and solve job-related problems; being able to plan and implement activities; being able to get things done through people&#8217; and, so forth. Professionals call this &#8216;job-analysis&#8217;.</p>
<p>Matching people to jobs is a function of knowing exactly what you need (e.g., job-related mental skills, people skills, and motivations discovered from the job analysis), then using professionally-developed tests to evaluate applicants.</p>
<p>An interview is just another form of &#8216;test&#8217;. It has questions, answers, and a scoring guide. What makes traditional interviews inaccurate is 1) lack of clarity about what itty-bitty skills are needed, 2) poor questions, 3) self-reported answers, and 4) subjective scoring guides. </p>
<p>Behavioral and siutational interviews MAY more accurate&#8230;but only when they are based on a job analysis, interviewers are trained in best-practice questioning technique, multiple interviewers integrate their individual data, and answers are  standardized.</p>
<p>Anything less and you &#8216;role the dice&#8217; with the organization&#8217;s money&#8230;about 50/50 is the average.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Keith Halperin</title>
		<link>http://www.ere.net/2007/10/31/good-test-bad-test/comment-page-1/#comment-3193</link>
		<dc:creator>Keith Halperin</dc:creator>
		<pubDate>Wed, 31 Oct 2007 11:19:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2007/10/31/good-test-bad-test/#comment-3193</guid>
		<description>Hmmm. 
It seems that if interviews are unreliable predictors, and jobs are often too complex to break down into a series of accurate and valid assessment tests (e.g.,
&quot;How many tests would be required to accurately measure the skills, traits, and abilities which define an exceptional Engineering Manager or High School Teacher or anything that doesn&#039;t involve highly-quantifiable, causally-related results?&quot;), then *hiring is fated to be an inherently error-prone process. On the other hand, if it IS theoretically possible to create a series of ?useful? tests which can measure predictive ability in a large number of fields, then we might finally be able to end ?the tyranny of the resume,? where most individuals are constrained by what they have done as opposed to what they can do?.

A request to the readers: please don?t send me an email about how wonderful and valuable are the tests you sell to companies!

Cheers,
KH


* I suspect that (like voting systems) there is an inherent trade-off between a number of factors that we consider valuable/good in tests, but I do not know this for certain, and hope I am wrong?.</description>
		<content:encoded><![CDATA[<p>Hmmm.<br />
It seems that if interviews are unreliable predictors, and jobs are often too complex to break down into a series of accurate and valid assessment tests (e.g.,<br />
&#8220;How many tests would be required to accurately measure the skills, traits, and abilities which define an exceptional Engineering Manager or High School Teacher or anything that doesn&#8217;t involve highly-quantifiable, causally-related results?&#8221;), then *hiring is fated to be an inherently error-prone process. On the other hand, if it IS theoretically possible to create a series of ?useful? tests which can measure predictive ability in a large number of fields, then we might finally be able to end ?the tyranny of the resume,? where most individuals are constrained by what they have done as opposed to what they can do?.</p>
<p>A request to the readers: please don?t send me an email about how wonderful and valuable are the tests you sell to companies!</p>
<p>Cheers,<br />
KH</p>
<p>* I suspect that (like voting systems) there is an inherent trade-off between a number of factors that we consider valuable/good in tests, but I do not know this for certain, and hope I am wrong?.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Richard Melrose</title>
		<link>http://www.ere.net/2007/10/31/good-test-bad-test/comment-page-1/#comment-3192</link>
		<dc:creator>Richard Melrose</dc:creator>
		<pubDate>Wed, 31 Oct 2007 08:59:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2007/10/31/good-test-bad-test/#comment-3192</guid>
		<description>Under the heading of &quot;Job-Match Approach&quot;, Dr. Williams chose an example (ISTJ) drawn from a Myers-Briggs Type Indicator (MBTI), about which Dr. Williams has previously said: (i) &#039;People who take the test may find they are characterized as one kind of person today and if they take it tomorrow, they will find they are characterized significantly differently.&#039; and he said(ii) &#039;In most cases, scores on a personality test have little or nothing to do with how well you perform on the job,&#039;  

In fact, CPP, Inc. (publisher of the MBTI) clearly states that it is not ethical to use the MBTI instrument for hiring or for deciding job assignments.  MBTI is neither sufficiently reliable nor sufficiently job-related to conform to the U.S. Department of Labor?s Uniform Guidelines on Employee Selection Procedures.  Dr. Williams seems to agree.  Yet, MBTI and a plethora of copy cat, four-quadrant personality tests still serve as ?pillars of the hiring process? for many unwitting employers.

MBTI type mappings onto job titles is not what ?Job-Match? means to those who advocate best-in-class practices in hiring and promotion.  As a proponent of real job-matching, I was disappointed to see an apparent connection being made between the term, &quot;Job-Match&quot;, and what Dr. Williams characterized as: &quot;similar to the ?see what sticks? approach, except worse&quot;.

In the words of Jim Collins (&quot;Good to Great&quot; (c)2002) &quot;Get the right people on the bus, the wrong people off the bus and the right people in the right seats.&quot;  Getting the right people (employees) in the right seats (employee roles or jobs) is what job matching is all about. 

There are highly reliable, thoroughly validated, job-matching assessment instruments that consistently outperform alternative employee selection procedures (e.g. behavioral tests and standard interviews) by a significant margin.

Real job matching starts with a thorough ?job analysis? ? i.e. What does it take to perform well at this job in this employment context?  Only then, can reliable, valid and sufficiently comprehensive assessments gauge the extent to which particular candidates may have what it takes.

Job analyses examine (i) the activities and tasks that make up a job, (ii) the conditions under which they are performed and (iii) what the job requires in terms of aptitudes, attitudes, behaviors, values, interests, knowledge, skills, abilities and other qualities.

Dr. Williams intentionally used a &quot;Bad&quot; example of &quot;Job Match&quot; to make his point.  I want to point out that &quot;Good Job-Match&quot; represents a best practice that employers can use to systematically build high performance organizations.  It?s not just me saying it.  Job matching is the answer to Jim Collins mantra, from a book that has topped best seller lists for five years, now.  We&#039;ve known the power of job match for decades and today&#039;s best online assessments make it more straightforward, more powerful and more affordable, than ever</description>
		<content:encoded><![CDATA[<p>Under the heading of &#8220;Job-Match Approach&#8221;, Dr. Williams chose an example (ISTJ) drawn from a Myers-Briggs Type Indicator (MBTI), about which Dr. Williams has previously said: (i) &#8216;People who take the test may find they are characterized as one kind of person today and if they take it tomorrow, they will find they are characterized significantly differently.&#8217; and he said(ii) &#8216;In most cases, scores on a personality test have little or nothing to do with how well you perform on the job,&#8217;  </p>
<p>In fact, CPP, Inc. (publisher of the MBTI) clearly states that it is not ethical to use the MBTI instrument for hiring or for deciding job assignments.  MBTI is neither sufficiently reliable nor sufficiently job-related to conform to the U.S. Department of Labor?s Uniform Guidelines on Employee Selection Procedures.  Dr. Williams seems to agree.  Yet, MBTI and a plethora of copy cat, four-quadrant personality tests still serve as ?pillars of the hiring process? for many unwitting employers.</p>
<p>MBTI type mappings onto job titles is not what ?Job-Match? means to those who advocate best-in-class practices in hiring and promotion.  As a proponent of real job-matching, I was disappointed to see an apparent connection being made between the term, &#8220;Job-Match&#8221;, and what Dr. Williams characterized as: &#8220;similar to the ?see what sticks? approach, except worse&#8221;.</p>
<p>In the words of Jim Collins (&#8221;Good to Great&#8221; (c)2002) &#8220;Get the right people on the bus, the wrong people off the bus and the right people in the right seats.&#8221;  Getting the right people (employees) in the right seats (employee roles or jobs) is what job matching is all about. </p>
<p>There are highly reliable, thoroughly validated, job-matching assessment instruments that consistently outperform alternative employee selection procedures (e.g. behavioral tests and standard interviews) by a significant margin.</p>
<p>Real job matching starts with a thorough ?job analysis? ? i.e. What does it take to perform well at this job in this employment context?  Only then, can reliable, valid and sufficiently comprehensive assessments gauge the extent to which particular candidates may have what it takes.</p>
<p>Job analyses examine (i) the activities and tasks that make up a job, (ii) the conditions under which they are performed and (iii) what the job requires in terms of aptitudes, attitudes, behaviors, values, interests, knowledge, skills, abilities and other qualities.</p>
<p>Dr. Williams intentionally used a &#8220;Bad&#8221; example of &#8220;Job Match&#8221; to make his point.  I want to point out that &#8220;Good Job-Match&#8221; represents a best practice that employers can use to systematically build high performance organizations.  It?s not just me saying it.  Job matching is the answer to Jim Collins mantra, from a book that has topped best seller lists for five years, now.  We&#8217;ve known the power of job match for decades and today&#8217;s best online assessments make it more straightforward, more powerful and more affordable, than ever</p>
]]></content:encoded>
	</item>
</channel>
</rss>
