eERL Project Summary: Introduction


     



 

NSDL
 

              Evaluation of eERL was and continues to be a multifaceted and heuristic process.

This ongoing evaluation shed light on both the progress of eERL and the perils of digital library evaluation.

Each of the following entries provides links to summary reports for the various metrics, evaluation methods, and assessment techniques deployed during the initial phases of eERL development.
     
     
     

  Bibliographies

As a prelude to evaluation, … an extensive literature search on digital library evaluation …
        
        
        

  Early ATEEL Surveys

This first survey queried potential eERL users as to their relative preferences among the existing environmental technology subject areas found in ATEEL … their use and awareness of popular Internet search tools (e.g. Google, Yahoo!), commercial databases (EBSCOhost, InfoTrac), and NSDL sponsored digital libraries (DLESE, eERL, ENC). …
     
     
     

WEBTRENDS

  Webmetrics

Access to eERL was tracked using WEBTRENDS software … from July 4, 2004 to February 1, 2005…
     
     
     

  eERL Evaluation Website

Early in the process of ATEEL/eERL evaluation it became necessary to post and array the rapidly growing numbers of assessment instruments, reports, minutes, directories of eERL participants, project timelines, bibliographies, guides, policies and presentations. As a result the eERL – ATEEL Projects website – was initiated…
     
     
     

  Think Aloud Testing

Drawing inspiration from the 2003 JCDL workshop “Usability Evaluation of Digital Libraries” (Blanford, Fields and Keith), the eERL Evaluator (Neuhaus) developed a Think Aloud Survey to gauge and record user perceptions and reactions to eERL…
     
     
     

  Classroom Implementation & Outcomes Assessment

The first measured classroom implementations of eERL were conducted during spring 2004. In March of 2004 ten eERL Collection Specialists were asked to each find two classroom instructors who would serve as eERL Classroom Implementation Volunteers….
     
     
     

  In-House Surveys

With the approach of summer 2004. evaluator Chris Neuhaus developed survey instruments to measure participant satisfaction with eERL and with the eERL organization.
     
     
     

    

  eERL Evaluation Chronology

Surveys, tests, presentations and assessments documented in this report took place between September 2002 and October 2004.  The eERL Evaluation Chronology provides a visual guide to the exact timing and and duration of each project.
     
     
     

The End?

or Just

The Beginning!

  Conclusion

If there is a single conclusion to draw from the many evaluations, surveys, and observations conducted during the past two years – it is that eERL, and the evaluation of eERL, should continue….