+1 (208) 254-6996 [email protected]
  

ldANDSOOI< O5 EVALUATION M~TIdODS

6.2 Overview of Assessment Methods” Technical Development Phase

Don't use plagiarized sources. Get Your Custom Essay on
ldANDSOOI< O5 EVALUATION M~TIdODS
Just from $13/Page
Order Essay

The m e t h o d s listed in this section are particularly suited to user activities during the d e v e l o p m e n t and installation o f an IT-based solution and m a y be used to provide feed-back for the technical development.

A s s e s s m e n t in this phase is typically carried out under experimental conditions and not during real operation. The phase is usually completed with a technical verification to make certain that all necessary functions and features are present and work properly in compliance with the established agreement.

Method

Balanced Scorecard

Clinical~Diagnostic Performance

Cognitive Assessment

Cognitive Walkthrough

Areas of application

Ongoing optimization of the outcome of a development project by balancing focus areas by means of a set of indicators for a set of strategic objectives.

Measurement of diagnostic ‘correctness’ (for instance, measures of accuracy and precision) of IT-based expert systems and decision-support systems. ‘

Assessment of cognitive aspects of the interaction between an IT system and its u s e r s – for instance:

�9 Identification of where and why operational errors occur

�9 Identification of areas to be focused on for improvement in user friendliness.

Assessment of user ‘friendliness’ on the basis of system design, from specifications, muck-ups, or prototypes, aimed at judging how well the system complies with the users’ way of thinking for instance:

�9 Identification of where and why operational errors occur

�9 Identification of causes behind problems with respect to user friendliness and consequently identification of areas for improvement.

Page no

85

91

96

102

64

Brender, McNair, Jytte, and Jytte Brender. Handbook of Evaluation Methods for Health Informatics, Elsevier Science & Technology, 2006. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/waldenu/detail.action?docID=306691. Created from waldenu on 2022-03-04 00:20:40.

C o p yr

ig h t ©

2 0 0 6 . E

ls e vi

e r

S ci

e n ce

& T

e ch

n o lo

g y.

A ll

ri g h ts

r e

se rv

e d .

 

 

I-IANID~OOI< O~ ~VALUATION IVIETIdODS

Heuristic Evaluation

Risk Assessment

SWOT

Technical Verification

Think Aloud

Usability

This is used when no other realizable possibilities e x i s t – for instance, when:

�9 The organization does not have the necessary time or expertise

�9 There are no formalized methods �9 There is not something tangible to assess yet.

Identification and subsequent monitoring of risk factors, making it possible to take preemptive action.

Situation analysis: establishment of a holistic view of a situation or a model solution.

Verification that the agreed functions are present, and work correctly and in compliance with the agreement. This may take place, for instance, in connection with delivery of an IT system or prior to daily operations and at any subsequent change of the IT system (releases, versions, and patches).

An instrument for gaining insight into the cognitive processes as feed-back to the implementation and adaptation of IT-based systems.

Assessment of user friendliness in terms of ergonomic and cognitive aspects of the interaction (dialogue) between an IT system and its users.

132

185

196

199

204

207

6.3 Overview of Assessment Methods” Adaptation Phase

In this phase, evaluation has the purpose o f providing support for the modification or refinement o f the IT-based solution, work procedures, and functions implemented within the IT system to make them work optimally as a whole during daily operations. This phase should be fairly short, provided that the implemented solution is functioning well from the beginning.

6s

Brender, McNair, Jytte, and Jytte Brender. Handbook of Evaluation Methods for Health Informatics, Elsevier Science & Technology, 2006. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/waldenu/detail.action?docID=306691. Created from waldenu on 2022-03-04 00:20:40.

C o p yr

ig h t ©

2 0 0 6 . E

ls e vi

e r

S ci

e n ce

& T

e ch

n o lo

g y.

A ll

ri g h ts

r e

se rv

e d .

 

 

ldANDBOOI( OlZ EVALUATION IvlI~TI-IODS

N o w that real operational a s s e s s m e n t can take place, e r g o n o m i c , cognitive, and functionality a s s e s s m e n t will gain m u c h m o r e focus, as potential i n a d e q u a c i e s or s h o r t c o m i n g s will s h o w t h e m s e l v e s as operational errors, misuse, or the like.

Method

Analysis of Work Procedures

BIKVA

Clinical~Diagnostic Performance

Cognitive Assessment

Cognitive Walkthrough

Equity Implementation Model

Field Study

Focus Group Interview

Areas of appfication

Elucidation of how things are actually carried out, in comparison with the expected. This includes the actual use of the IT system in relation to its anticipated use.

Critical, subjective assessment of an existing practice.

Measurement of diagnostic ‘ correctness’ (for instance, measures of accuracy and precision) in IT-based expert systems and decision-support systems.

Assessment of cognitive aspects of the interaction between an IT system and its u s e r s – for instance:

�9 Identification of where and why operational errors occur

�9 Identification of areas to be focused on for improvement in user friendliness.

Assessment of user ‘friendliness’ on the basis of system design, from specifications, muck-ups, or prototypes, aimed at judging how well the system complies with the users’ way of t h i n k i n g – for instance:

�9 Identification of where and why operational errors occur

�9 Identification of causes behind problems with respect to user friendliness and consequently identification of areas for improvement.

Examine users’ reaction to the implementation of a new system, focusing on the impact of the changes such a system brings about for the users.

Order your essay today and save 10% with the discount code ESSAYHELP