<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Trend Analysis: Why Is Online Assessment Gaining in Popularity?</title>
	<atom:link href="http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/</link>
	<description>Recruiting News, Recruiting Events, Recruiting Community, Social Recruiting</description>
	<lastBuildDate>Mon, 13 Feb 2012 17:55:42 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
	<item>
		<title>By: Charles Handler</title>
		<link>http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/comment-page-1/#comment-519</link>
		<dc:creator>Charles Handler</dc:creator>
		<pubDate>Sat, 04 Sep 2004 07:10:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/#comment-519</guid>
		<description>Thanks for your insight and sharing your experiences.

While I am a staunch proponent of the use of pre-employment tests, I am the first to say that they are not always the best solution in every situation.  

I believe there are many reasons why these tests are a valuable asset to organizations.  However, they are not a simple &#039;plug and play&#039; solution.
In order for assessments to add value they must be properly selected and implemented and their results properly analyzed.  I think these things go well beyond the &#039;typical&#039; vendor response you noted- that poor results must mean that the wrong test was used.  

In my opinion, for tests to be a useful tool the following must occur:

1. They must be selected based on a well defined set of desired work outcomes and it must be established that these work outcomes are best predicted using a test. In the case of personality tests- these tests have long suffered from problems due to the difficulty of tightly linking their content to job performance.  They can be &#039;fluffy&#039; and the inability to link the test to job performance criteria is type of thing makes it hard to clearly demonsrate the value the test will have.
Not every hiring situation warrants a personality test. 

2. They must be used as only one piece of information that can help facilitate the decision making process- not as an all or none proposition.  Tests offer a great compliment to the structured behavioral interviews you discuss.
As you accurately suggest, as jobs get more complex, it is going to take more then just one personality test to predict performance.  Complex job performance requires different types of data to be collected and used by qualified hiring personnel to assemble a predicitive picture of the fit between an individual and a job.

3. Managers and those using the tests must accept them as useful and be able to clearly understand the value they add.  The less job related, the more complex or cumbersome the test is, the less managers will buy into their value.

4. Their ROI should be examined whenever possible.  That is if you are testing and you have a decent volume of persons being tested for a job opening, it is imperative that you make sure to examine the predictive accuracy of the test. If the test isnt predicting, it is easy to think about refining the hiring process by looking for the problems that still exist.

5. Choose vendors wisely.  There are lots of different tests and methodologies for using them available.  Some of these are better then others.  I am aware of many situations where an organization decides to choose a vendor who may not actually be able to provide the best test for the organizations needs.  If the vendor does not have the most appropriate test, many of them will &#039;perscribe&#039; another test that they do have.
This can present problems because if you are using a test that is not optimal for the outcomes you are trying to predict- the ability of the test to demonstrate value will be greatly reduced.

At the end of the day, all hiring activities are nothing more then a prediction about how well someone will perform a job.  There are many ways to do this and testing is only one of these.  Making a good hiring decision is a blend of two things- gathering enough predicitive data to help learn about an applicant&#039;s capabilities relative to job requirements and having hiring personnel who have the experience and ability to accurately interpret this data and use it to their advantage.  No matter what the situation, the mantra must be establishing the job relatedness of the data that is collected and the understanding of the benefits and limitations of this information.

Thanks for your insights- I hope mine are useful to you.

-Charles





First of all they &lt;BR&gt;&lt;BR&gt;You can read the original article &lt;A HREF=&quot;http://www.erexchange.com/articles/db/BEB492794EB84B5799C20787CE3D2A5D.asp&quot;&gt;here&lt;/A&gt; &lt;BR&gt;&lt;BR&gt;Post your own Article Review&lt;BR&gt;http://www.erexchange.com/p/g.asp?d=M&amp;cid={53D1C488-9369-42DF-ABA1-CBAD9F787002} &lt;BR&gt;</description>
		<content:encoded><![CDATA[<p>Thanks for your insight and sharing your experiences.</p>
<p>While I am a staunch proponent of the use of pre-employment tests, I am the first to say that they are not always the best solution in every situation.  </p>
<p>I believe there are many reasons why these tests are a valuable asset to organizations.  However, they are not a simple &#8216;plug and play&#8217; solution.<br />
In order for assessments to add value they must be properly selected and implemented and their results properly analyzed.  I think these things go well beyond the &#8216;typical&#8217; vendor response you noted- that poor results must mean that the wrong test was used.  </p>
<p>In my opinion, for tests to be a useful tool the following must occur:</p>
<p>1. They must be selected based on a well defined set of desired work outcomes and it must be established that these work outcomes are best predicted using a test. In the case of personality tests- these tests have long suffered from problems due to the difficulty of tightly linking their content to job performance.  They can be &#8216;fluffy&#8217; and the inability to link the test to job performance criteria is type of thing makes it hard to clearly demonsrate the value the test will have.<br />
Not every hiring situation warrants a personality test. </p>
<p>2. They must be used as only one piece of information that can help facilitate the decision making process- not as an all or none proposition.  Tests offer a great compliment to the structured behavioral interviews you discuss.<br />
As you accurately suggest, as jobs get more complex, it is going to take more then just one personality test to predict performance.  Complex job performance requires different types of data to be collected and used by qualified hiring personnel to assemble a predicitive picture of the fit between an individual and a job.</p>
<p>3. Managers and those using the tests must accept them as useful and be able to clearly understand the value they add.  The less job related, the more complex or cumbersome the test is, the less managers will buy into their value.</p>
<p>4. Their ROI should be examined whenever possible.  That is if you are testing and you have a decent volume of persons being tested for a job opening, it is imperative that you make sure to examine the predictive accuracy of the test. If the test isnt predicting, it is easy to think about refining the hiring process by looking for the problems that still exist.</p>
<p>5. Choose vendors wisely.  There are lots of different tests and methodologies for using them available.  Some of these are better then others.  I am aware of many situations where an organization decides to choose a vendor who may not actually be able to provide the best test for the organizations needs.  If the vendor does not have the most appropriate test, many of them will &#8216;perscribe&#8217; another test that they do have.<br />
This can present problems because if you are using a test that is not optimal for the outcomes you are trying to predict- the ability of the test to demonstrate value will be greatly reduced.</p>
<p>At the end of the day, all hiring activities are nothing more then a prediction about how well someone will perform a job.  There are many ways to do this and testing is only one of these.  Making a good hiring decision is a blend of two things- gathering enough predicitive data to help learn about an applicant&#8217;s capabilities relative to job requirements and having hiring personnel who have the experience and ability to accurately interpret this data and use it to their advantage.  No matter what the situation, the mantra must be establishing the job relatedness of the data that is collected and the understanding of the benefits and limitations of this information.</p>
<p>Thanks for your insights- I hope mine are useful to you.</p>
<p>-Charles</p>
<p>First of all they </p>
<p>You can read the original article <a HREF="http://www.erexchange.com/articles/db/BEB492794EB84B5799C20787CE3D2A5D.asp">here</a> </p>
<p>Post your own Article Review<br /><a href="http://www.erexchange.com/p/g.asp?d=M&#038;cid=" rel="nofollow">http://www.erexchange.com/p/g.asp?d=M&#038;cid=</a>{53D1C488-9369-42DF-ABA1-CBAD9F787002} </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mark Walsh</title>
		<link>http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/comment-page-1/#comment-518</link>
		<dc:creator>Mark Walsh</dc:creator>
		<pubDate>Wed, 01 Sep 2004 06:25:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.ere.net/2004/09/01/trend-analysis-why-is-online-assessment-gaining-in-popularity/#comment-518</guid>
		<description>I hate to be the voice of disention, but I still hold that the most of the managers who implement these tests are only trying to justify their own existance to senior managers who don&#039;t have a clue what is going on in the recruiting department.  

In many cases, companies are implementing these tests to satisfy recent insurance company requirements.  (is there any factor of our lives the insurance companies don&#039;t control?).

I have used these tests for years, but have yet to see any proof that these tests improve the quality of anyone&#039;s workforce.  

In my experience, the performance of candidates hired using these tests were no better, and often worse, than those hired using traditional interviewing methods. When I bring this to the attention of the test creators, the industry standard answer is &#039;well, then you must not be implementing them correctly&#039; - even though in every case we had the company manage the testing process.

There is one common thread I have seen.  Candidates who pass these tests seem to have  less &#039;personality&#039; than those that failed.  In a recent 8-month hiring project I just completed, we were processing 400-800 candidates per week.  Everyone working there noticed a decrease in &#039;personality&#039; (happiness, joviality, frivolity, - basically ability to have fun)  during our weekly candidate processing after the tests than we had before they were implemented.  

I am on a project now with a company who uses a standardized test designed for Electricians.  What blows me away is that this test turns away not only the weakest electricians, but the most talented as well because the creator of the test claims that these people are &#039;too smart&#039; or &#039;too creative&#039; to make a good employee.  To me this is a total crock.  Again, this test was implemented to satisfy insurance company requirements, not because the company had any problems hiring good employees.

In 2001, I recruited for a sales company that wanted to implement the tests because of poor performance from some recent hires.  I insisted that all managers and field sales take it as well (my reasoning was to set a baseline to compare against new candidates).  Nearly all the managers failed the test, and for field sales, the scoring of the tests was the inverse of the commissions paid to the taker.  Field sales people who had been making up to $800,000/year in commissions failed miserably (the test said resoundingly &#039;DO NOT HIRE&#039;) while fresh from college, no experience types passed with top scores.  One manager made a perfect score, but his region had the worst performance in the nation and he was fired within 2 weeks after taking the test.

I would rather see companies focus on teaching solid performance based interviewing skills than waste any more money on these tests.  Unfortunately, managers and insurance companies being what they are, I can only see more of them in our future.

Now, there is ONLY one area where I think these tests might help:  situations where you need to hire large volumes of unskilled hourly labor.  Here, a personality test would be helpful.  Even in this case, these tests only work if your available workforce is large enough to allow you to throw away a percentage of candidates willing to do what you need done.&lt;BR&gt;&lt;BR&gt;You can read the original article &lt;A HREF=&quot;http://www.erexchange.com/articles/db/BEB492794EB84B5799C20787CE3D2A5D.asp&quot;&gt;here&lt;/A&gt; &lt;BR&gt;&lt;BR&gt;Post your own Article Review&lt;BR&gt;http://www.erexchange.com/p/g.asp?d=M&amp;cid={46ABF3FF-8773-477F-A877-B778566B7AF4} &lt;BR&gt;</description>
		<content:encoded><![CDATA[<p>I hate to be the voice of disention, but I still hold that the most of the managers who implement these tests are only trying to justify their own existance to senior managers who don&#8217;t have a clue what is going on in the recruiting department.  </p>
<p>In many cases, companies are implementing these tests to satisfy recent insurance company requirements.  (is there any factor of our lives the insurance companies don&#8217;t control?).</p>
<p>I have used these tests for years, but have yet to see any proof that these tests improve the quality of anyone&#8217;s workforce.  </p>
<p>In my experience, the performance of candidates hired using these tests were no better, and often worse, than those hired using traditional interviewing methods. When I bring this to the attention of the test creators, the industry standard answer is &#8216;well, then you must not be implementing them correctly&#8217; &#8211; even though in every case we had the company manage the testing process.</p>
<p>There is one common thread I have seen.  Candidates who pass these tests seem to have  less &#8216;personality&#8217; than those that failed.  In a recent 8-month hiring project I just completed, we were processing 400-800 candidates per week.  Everyone working there noticed a decrease in &#8216;personality&#8217; (happiness, joviality, frivolity, &#8211; basically ability to have fun)  during our weekly candidate processing after the tests than we had before they were implemented.  </p>
<p>I am on a project now with a company who uses a standardized test designed for Electricians.  What blows me away is that this test turns away not only the weakest electricians, but the most talented as well because the creator of the test claims that these people are &#8216;too smart&#8217; or &#8216;too creative&#8217; to make a good employee.  To me this is a total crock.  Again, this test was implemented to satisfy insurance company requirements, not because the company had any problems hiring good employees.</p>
<p>In 2001, I recruited for a sales company that wanted to implement the tests because of poor performance from some recent hires.  I insisted that all managers and field sales take it as well (my reasoning was to set a baseline to compare against new candidates).  Nearly all the managers failed the test, and for field sales, the scoring of the tests was the inverse of the commissions paid to the taker.  Field sales people who had been making up to $800,000/year in commissions failed miserably (the test said resoundingly &#8216;DO NOT HIRE&#8217;) while fresh from college, no experience types passed with top scores.  One manager made a perfect score, but his region had the worst performance in the nation and he was fired within 2 weeks after taking the test.</p>
<p>I would rather see companies focus on teaching solid performance based interviewing skills than waste any more money on these tests.  Unfortunately, managers and insurance companies being what they are, I can only see more of them in our future.</p>
<p>Now, there is ONLY one area where I think these tests might help:  situations where you need to hire large volumes of unskilled hourly labor.  Here, a personality test would be helpful.  Even in this case, these tests only work if your available workforce is large enough to allow you to throw away a percentage of candidates willing to do what you need done.</p>
<p>You can read the original article <a HREF="http://www.erexchange.com/articles/db/BEB492794EB84B5799C20787CE3D2A5D.asp">here</a> </p>
<p>Post your own Article Review<br /><a href="http://www.erexchange.com/p/g.asp?d=M&#038;cid=" rel="nofollow">http://www.erexchange.com/p/g.asp?d=M&#038;cid=</a>{46ABF3FF-8773-477F-A877-B778566B7AF4} </p>
]]></content:encoded>
	</item>
</channel>
</rss>

