Chris Neuhaus - Digital Library Assessment/Evaluation

Digital Library

Evaluation and Assessment
Bibliography

rod1.jpg (15290 bytes)

Abbas, June, Cathleen Norris, and Elliot Soloway. 2001. "Analyzing Middle School Students' Use of the ARTEMIS Digital Library." Proceedings of the IEEE International Conference on Advanced Learning Techniques. (ICALT 2001) p.107-08.
http://csdl.computer.org/comp/proceedings/icalt/2001/1013/00/10130107.pdf
Aladwani, Adel M. and Prashant C. Palvia. 2002. "Developing and Validating an Instrument for Measuring User-Perceived Web Quality." Information & Management. Vol. 39. No. 6. p. 467-476.
Banwell L, K Ray, G. Coulson, C. Urquhart, R. Lonsdale, C. Armstrong, R. Thomas, S. Spink S, A. Yeoman A, R. Fenton and J. Rowley. (2004). "The JISC User Behaviour Monitoring and Evaluation Framework." Journal of Documentation. Vol. 60 No. 3 p. 302-320.
Barton, Jane. 2004. "Measurement, Management and the Digital Library." Library Review. Vol. 53 No. 3 p. 138-141.
Bertot, John C., McClure, Charles R., and William E. Moen. 2004. "Assessing Digital Libraries: Evaluation Strategies, Practices, and Issues" Proceedings of the Annual Meeting- American Society for Information Science. Vol 41 p. 561 online at - http://www.kc.tsukuba.ac.jp/dlkc/e-proceedings/papers/dlkc04pp72.pdf
Bertot, John C. 2004. "Libraries and Networked Information Services: Issues and Considerations in Measurement." Performance Measurement and Metrics. Vol. 5. No. 1 p. 11-19.
Bishop, Ann Peterson, Imani Bazzell, and Cynthia Smith. 2003. "Participatory Action Research and Digital Libraries: Reframing Evaluation." in Digital Library Use: Social Practice in Design and Evaluation. Cambridge, MA : MIT Press. p. 161-190
Bishop, Ann Peterson, Nancy A. Van House, and Barbara Buttenfield (eds.). 2003. Digital Library Use: Social Practice in Design and Evaluation. Cambridge, MA : MIT Press.
Bishop, Ann Peterson and Bertram (Chip) Bruce. 2002. "Digital Library Evaluation as Participative Inquiry." Graduate School of Library and Information Science. University of Illinois. - website [http://alexia.lis.uiuc.edu/~chip/pubs/02delos.pdf]
Bishop, Ann Peterson and Bertram (Chip) Bruce. 2002. " Usability Research as Participative Inquiry " - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Bishop, Ann Peterson, Mehra Bharat, Imani Bazzell, and Cynthia Smith. 2001. "Scenarios in the Design and Evaluation of Networked Information Services: An Example from Community Health." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 45-66.
Bishop, Ann Peterson, Clifford Lynch, Christine Borgman, Catherine C. Marshall, Susan Leigh Star, and Geoffry C. Bowker. 2000. "Digital Library Use (panel session): Social Practice in Design and Evaluation." Proceedings of the Fifth ACM Conference on Digital Libraries. San Antonio, Texas June 2000. p. 276-277.
Bishop, Ann Peterson. 1999. "Making Digital Libraries Go: Comparing Use Across Genres." International Conference on Digital Libraries. Proceedings of the Fourth ACM Conference on Digital Libraries. 1999 , Berkeley, California. (ACM Digital Library) p. 94-103.
Bishop, Ann Peterson. 1998. "Measuring Access, Use, and Success in Digital Libraries" The Journal of Electronic Publishing. Vol. 4, no. 2.
Bishop, Ann Peterson. 1998. "Digital Libraries and Knowledge Disaggregation: the Use of Journal Article Components." International Conference on Digital Libraries. Proceedings of the Third ACM conference on Digital Libraries. 1998 , Pittsburgh, Pennsylvania. (ACM Digital Library) p. 29-39.
Bishop, Ann Peterson and S.L. Star, 1996. "Social Informatics of Digital Libraries Use and Infrastructure." Annual Review of Information Science and Technology. Vol 31 p.301-401.
Bland, Rose and Allison Howard. 2003. "Library Statistics and Outcomes Assessment." in Building a Virtual Library Ardis Hanson and B.L. Levin eds. Hershey, PA: Information Science Pub. p. 194-211.
Blanford, Ann, Bob Fields, and Suzette Keith. 2003. "Usability Evaluation of Digital Libraries." JCDL 2003 - Joint Conference on Digital Libraries - May 27, 2003, Houston.
Blanford, Ann and George Buchanan. 2002. " Usability of Digital Libraries: A workshop at JCDL 2002 - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Blanford, Ann, Hanna Stelmaszewska, and Nick Bryan-Kinns. 2001. "Use of Multiple Digital Libraries: A Case Study." International Conference on Digital Libraries. JCDL 2001 June 24-28. Proceedings of the first ACM/IEEE-CS joint conference on Digital libraries 2001 , Roanoke, Virginia (ACM Digital Library) p. 179-188.
Blixrud, Julia. 2002. "Measures for Electronic Use: The ARL E-Metrics Project."delivered at the "Statistics in Practice" IFLA Preconference in Loughborough, UK, August 13-25 2002.
Block, C.C. and S.E. Israel. 2004. "The ABC's of Performing Highly Effective Think-Alouds." Reading Teacher. Vol. 58 no. 2 p. 154-167.
Blocks, D., C. Binding, D. Cunliffe, and D. Tudhope. 2002. "Qualitative Evaluation of Thesaurus-Based Retrieval." Lecture Notes in Computer Science. 2458. p. 346-361. Maristella Agosti, Constantino Thanos (Eds.): Research and Advanced Technology for Digital Libraries, 6th European Conference, ECDL 2002, Rome, Italy, September 16-18, 2002, Proceedings. Springer 2002, ISBN 3-540-44178-6
Bollen, Johan, Rick Luce, Soma Sekhara Vemulapalli, and Weining Xu. 2003. "Usage Analysis for the Identification of Research Trends in Digital Libraries." D-Lib Magazine. Vol. 9, No. 5.
Bollen, Johan and Rick Luce. 2002. "Evaluation of Digital Library Impact and User Communities by Analysis of Usage Patterns" D-Lib Magazine. Vol. 8, No. 6.
Bollen, Johan, Somasekhar Vemulapalli, and Weining Xu. 2002. "Digital Library Evaluation by Analysis of User Retrieval Patterns." Lecture Notes in Computer Science. 2458. p. 432-447. Maristella Agosti, Constantino Thanos (Eds.): Research and Advanced Technology for Digital Libraries, 6th European Conference, ECDL 2002, Rome, Italy, September 16-18, 2002, Proceedings. Springer 2002, ISBN 3-540-44178-6
Bollen, Johan and Luis Mateus Rocha. 2000. "An Adaptive Systems Approach to the Implementation and Evaluation of Digital Library Recommendation Systems." Lecture Notes in Computer Science. No. 1923 p. 2000
Borgman, Christine L., and Ronald Larsen. 2003. "ECDL 2003 Workshop Report: Digital Library Evaluation - Metrics, Testbeds and Processes Computer File." D Lib Magazine. Vol 9 No. 9. p. 1
Borgman, Christine L. 2002. "Challenges in Building Digital Libraries for the 21st Century." Lecture Notes in Computer Science 2555. p. 1-13. Ee-Peng Lim, Schubert Foo, Christopher S. G. Khoo, Hsinchun Chen, Edward A. Fox, Shalini R. Urs, Costantino Thanos (Eds.): Digital Libraries: People, Knowledge, and Technology, 5th International Conference on Asian Digital Libraries, ICADL 2002 Singapore, December 11-14, 2002, Proceedings. Springer 2002, ISBN 3-540-00261-8
Borgman, Christine L., Gregory H. Leazer, Anne J. Gilliland-Swetland, and Rich Gazan. 2001. "Iterative Design and Evaluation of a Geographic Digital Library for University Students: A Case Study of the Alexandria Digital Earth Prototype (ADEPT)." Lecture Notes in Computer Science. 2163. p. 390-401. Panos Constantopoulos, Ingeborg Sølvberg (Eds.): Research and Advanced Technology for Digital Libraries, 5th European Conference, ECDL 2001, Darmstadt, Germany, September 4-9, 2001, Proceedings. Springer 2001, ISBN 3-540-42537-3
Borgman, Christine, Anne Gilliland-Swetland, Gregory Leazer, Richard Mayer, David Gwynn, Rich Gazan and Patricia Mautone. 2000. "Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth ProtoType (ADEPT). Library Trends. Vol 49, no. 2. p. 228-250. --- Online copy at http://is.gseis.ucla.edu/adept/pubs/lt822.html
Budhu, Muniram, and Anita Coleman. 2002. "The Design and Evaluation of Interactivities in a Digital Library." D-Lib Magazine. Vol. 8. No. 11.
Butler, Keith A. 1996. "Usability Engineering Turns 10." internations Vol. 3 No. 1 p. 58-75.
Buttenfield, Barbara. 1999. "Usability Evaluation of Digital Libraries." Science & Technology Libraries. Vol. 17. No. 3/4. p. 39-59.
Byerley, Suzanne L, and Mary Beth Chambers. 2002. "Accessibility and Usability of Web-Based Library Databases for Non-Visual Users." Library Hi Tech. Vol. 20 No. 2 p. 169-78.
Byrd, Sam, Glenn Courson, Elizabeth Roderick, and Jean Marie Taylor. 2001. "Cost/Benefit Analysis for Digital Library Projects: The Virginia Historical Inventory Project (VHI)." The Bottom Line: Managing Library Finances. Vol. 14 No. 2 p. 65-75.
Byrne, Alex. 2003. "Digital Libraries: Barriers or Gateways to Scholarly Information?" The Electronic Library. Vol 21 No. 5. p. 414-21.
Cadez, Igor, David Heckerman, Christopher Meek, Padhraic Smyth and Steven White. 2003. "Model-Based Clustering and Visualization of Navigation Patterns on a Web Site." Data Mining and Knowledge Discovery. Vol. 7 p. 399-424.
Caidi, Nadia, and Anita Komlodi. 2003. "Digital Libraries Across Cultures: Design and Usability Issues Outcomes of the "Cross-Cultural Usability for Digital Libraries" workshop at JCDL '03" SIGIR Forum. Vol. 37 No. 2 p. 62-64.
Calhoun, Karen. 2002. "From Information Gateway to Digital Library Management System: A Case Analysis." Library Collections, Acquisitions, & Technical Services. Vol. 26 p. 141-150.
Carter, David and Joseph Janes. 2000. "Unobtrusive Data Analysis of Digital Reference Questions and Service at the Internet Public Library: An Exploratory Study" Library Trends. Vol. 29, no. 2. p. 251-265.
Cassel, Lillian (Boots). 2003. " CITIDEL and the XML Log Standard" (PowerPoint - Use Explorer) Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact - NSDL Annual Meeting, Washington DC
Casserly, M. 2004. "Digital Library Use: Social Practice in Design and Evaluation." Library Collections Acquisitions and Technical Services. Vol. 23 No. 3 p. 351-352.
Chao, Hungyune. 2002. "Assessing the Quality of Academic Libraries on the Web: The Development and Testing of Criteria." Library & Information Science Research. Vol. 24 p. 169-94.
Cherry, Joan M. and Wendy M. Duff. 2002. " Studying digital library users over time: a follow-up survey of Early Canadiana Online." Information Research. Vol. 7. No. 2.
Chignell, Mark H., Jacek Gwizdka and Richard C. Bodner. 1999. "Discriminating Meta-Search: A Framework for Evaluation." Information Processing and Management. Vol 35. p. 337-362.
Choudhury, Sayeed, Benjamin Hobbs and Mark Lorie. 2002. "A Frame work for Evaluating Digital Library Services" D-Lib Magazine. Vol. 8, No. 7/8.
Chowdhury, G.G. and Sudatta Chowdury. 2000. "An Overview of the Information Retrieval Features of Twenty Digital Libraries." Program: Electronic & Information Systems. Vol. 34, No. 4. p. 341-373.
Christel, Michael G., Pedro Cubilo, Junius Gunaratne, William Jerome, Eun-Ju O, and Sohini Solanki. 2002. "Evaluating a Digital Video Library Web Interface." International Conference on Digital Libraries. Poster Session: International Conference on Digital Libraries. Proceedings of the Second ACM/IEEE-CS Joint Conference on Digital Libraries. 2002 , Portland, Oregon. (ACM Digital Library). p. 389.
Christodoulou, S.P., G.D. Stryliaras, and T.S. Papatheodorou. 1998. "Evaluation of Hypermedia Application Development and Management Systems." Proceedings of the Ninth ACM Conference on Hypertext and Hypermedia : Links, Objects, Time and Space---Structure in Hypermedia Systems: Links, Objects, Time and Space---Structure in Hypermedia Systems. Pittsburgh, Pennsylvania p. 1 - 10
Clark, Jason A. 2004. "A Usability Study of the Belgian-American Research Collection: Measuring the Functionality of a Digital Library." OCLC Systems & Services. Vol. 20 No. 3 p. 115-127.
Cohen, Laura B. 2003. "A Two-Tiered Model for Analyzing Library Website Usage Statistics, Part 1: Web Server Logs." portal: Libraries and the Academy. Vol. 3 No. 2. p. 315-326.
Cohen, Laura B. 2003. "A Two-Tiered Model for Analyzing Library Web Site Usage Statistics, Part 2: Log File Analysis." portal: Libraries and the Academy. Vol 3. No. 3. p. 517-526.
Cooper, Alan. 1999. The Inmates Are Running the Asylum: Why High-Tech Products Drive Us Crazy and How to Restore the Sanity. Indianapolis, Ind. Sams.
Covey, Denise Toll. 2002. "Academic Library Assessment: New Duties and Dilemmas." New Library World. Vol. 103, No. 4. p. 156-164.
Covey, Denise Toll. 2002. Usage and Usability Assessment: Library Practices and Concerns. Washington: Digital Library Federation, Council on Library and Information Resources - website [ http://www.clir.org/pubs/abstract/pub105abst.html]
Cullen, Rowena. 2003. "Evaluating Digital Libraries in the Health Sector. Part 1: Measuring Inputs and Outputs." Health Information and Libraries Journal. Vol. 20, No. 4. p. 195-204
Cullen, Rowena. 2004. "Evaluating Digital Libraries in the Health Sector. Part 2: Measuring Impacts and Outcomes." Health Information and Libraries Journal. Vol. 21, No. 1. p. 3-13
D'Alessandro, M.P., D.M. D'Alessandro, J.R. Galvin, and W.E. Erkonen. 1998. "Evaluating Overall Usage of a Digital Health Sciences Library." Bulletin Of The Medical Library Association. Vol. 86 No. 4 p. 602-609.
Darmoni, Stefan J., Francis Roussel, Jacques Benichou, Benoit Thirion, and Nicole Pinhas. 2002. "Reading Factor: A New Bibliometric Criterion for Managing Digital Libraries." Journal of the Medical Library Association. Vol. 90. No. 3. p. 323-327.
Dempsey, Bert J, Robert C. Vreeland, Robert G. Sumner Jr., and Kiduk Yang. 2000. "Design and Empirical Evaluation of Search Software for Legal Professionals on the WWW." Information Processing & Management. Vol 36 p. 253-73.
Dhyani, Devanshu, Wee Keong Ng, and Sourav S. Bhowmick. 2002. "A Survey of Web Metrics." ACM Computing Surveys (CSUR). Vol. 34 No. 4. p. 469-503.
Dillon, Andrew. 1999. "TIME - a Multi-Leveled Framework for Evaluating and Designing Digital Libraries." International Journal on Digital Libraries. Vol. 2. No. 2/3. pp. 170-177
Dillon, Andrew, and Min Song. 1997. "An Empirical Comparison of the Usability for Novice and Expert Searchers of a Textual and a Graphic Interface to an Art-Resource Database." JoDI: Journal of Digital Information. Vol. 1 No. 1
Dorward, Jim, Derek Reinke and Mimi Recker. 2002. "An Evaluation Model for Digital Library Services Tool." International Conference on Digital Libraries. Proceeding of the Second ACM/IEEE-CS Joint Conference on Digital Libraries. 2002 , Portland, Oregon, USA. (ACM Digital Library)
Doty, Philip. 2001. "Policy Analysis and Networked Information: 'There Are Eight Million Stories'..." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 213-253.
Downey, Laura L., and Dawn M. Tice. 1999. "A Usability Case Study Using TREC and ZPRISE." Information Processing & Management. Vol. 35 p. 589-603.
Downie, J. Stephen. 2003. "Report on the Panels and Workshops of the Music Information Retrieval (MIR) and Music Digital Library (MDL) Evaluation Frameworks Project." SIGIR Forum. Vol. 37 No. 2 p. 38-44.
Downie, J. Stephen. 2002. "Worskshop on the Creation of Standardized Test Collections, Tasks and Metrics for Music Information Retrieval (MIR) and Music Digital Library (MDL) Evaluation." JCDL 2003 - Joint Conference on Digital Libraries - July 13-17, 2002, Portland, Oregon.
Downs, Robert R. and Edward A. Friedman. 1999. "Digital Library Support for Scholarly Research." Information Processing and Management. Vol 35. p. 281-291.
Dresang, Eliza T. and Melissa Gross. 2001. "Evaluating Children's Resources and Services in a Networked Environment." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 23-43.
Eason, Ken, Susan Harker, Ann Apps, and Ross MacIntyre. 2004. "Towards an Integrated Digital Library: Exploration of User Responses to a Joined-Up Service." Lecture Notes in Computer Science. No. 3232 p. 452
Edgar, Katrina D., David M. Nichols, Gordon W. Paynter, Kirsten Thomson and Ian H. Witten. 2004. "A User Evaluation of Hierarchical Phrase Browsing." Lecture Notes in Computer Science. No. 2769 p. 313-324.
Egan, Dennis E., Joel R. Remde, Thomas K Landauer, Carol C. Lochbaum, and Louis M. Gomez. 1989. "Behavioral Evaluation and Analysis of Hypertext Browser." ACM SIGCHI Bulletin , Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Wings for the Mind. p. 205-210.
Egan, Dennis E., Joel R. Remde, Louis M. Gomez, Thomas K Landauer, Jennifer Eberhardt, and Carol C. Lochbaum. 1989. "Formative Design-Evaluation of SuperBook." ACM Transactions on Information Systems (TOIS), Vol 7 No 1 p. 30-57
Eick, Stephen G. 2002. "Visual Analysis of Website Browsing Patterns." Lecture Notes in Computer Sciences 2539. p. 65-80. Katy Börner, Chaomei Chen (Eds.): Visual Interfaces to Digital Libraries [JCDL 2002 Workshop]. Springer 2002, ISBN 3-540-00247-2
Entlich, Richard G., Lorrin R. Garson, and Michael Lesk. 1996. "Testing a Digital Library: User Response to the CORE Project." Library Hi Tech. Vol 14 No. 4 p. 99-118
Esteban, Alberto Diaz, Pablo Gervás Gómez-Navarro, and Antonio García Jiménez. 2000. "Evaluating a User-Model Based Personalisation Architecture for Digital News Services." Lecture Notes in Computer Science. 1923. p. 259-268. José Luis Borbinha, Thomas Baker (Eds.): Research and Advanced Technology for Digital Libraries, 4th European Conference, ECDL 2000, Lisbon, Portugal, September 18-20, 2000, Proceedings. Springer 2000, ISBN 3-540-41023-6
"Final Report of the American Memory User Evaluation, 1991-1993." American Memory Project - Library of Congress - website [http://lcweb2.loc.gov/ammem/usereval.html]
Ford, Geoffrey. 2001. "Theory and Practice in the Networked Environment: A European Perspective." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 1-22.
Fraser, Bruce T., Charles R. McClure and Emily H. Leahy. 2002. "Toward a Framework for Assessing Library and Institutional Outcomes." in portal: Libraries and the Academy Vol 2. No. 4. p. 505-528.
French, James C. and Allison L. Powell. 2000. "Metrics for Evaluating Database Selection Techniques." World Wide Web. Vol. 3. p. 153-163.
Fuhr, Norbert, Preben Hansen, Michael Mabe, Andras Micsik, and Ingeborg Sølvberg. 2001. "Digital Libraries: A Generic Classification and Evaluation Scheme." Lecture Notes in Computer Science. 2163. p. 187-199. Panos Constantopoulos, Ingeborg Sølvberg (Eds.): Research and Advanced Technology for Digital Libraries, 5th European Conference, ECDL 2001, Darmstadt, Germany, September 4-9, 2001, Proceedings. Springer 2001, ISBN 3-540-42537-3
Garzotto, Franca, Luca Mainetti, and Paolo Paolini. 1995. "Hypermedia Design, Analysis, and Evaluation Issues." Communications of the ACM. Vol. 38, No. 8. p. 74-86.
Goncalves, Marcos Andre, Ganesh Panchanathan, Unnikrishnan Ravindranathan, Aaron Krowne, Edward A. Fox, Filip Jagodzinski, and Lillian Cassel. 2003. "The XML Log Standard for Digital Libraries: Analysis, Evolution, and Deployment." 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 312-314.
Goncalves, Marcos Andre, Ming Luo, Rao Shen, Mir Farooq Ali, and Edward A. Fox. 2002. "An XML Log Standard and Tool for Digital Library Logging Analysis." Lecture Notes in Computer Science. 2458. p. 129-143. Maristella Agosti, Constantino Thanos (Eds.): Research and Advanced Technology for Digital Libraries, 6th European Conference, ECDL 2002, Rome, Italy, September 16-18, 2002, Proceedings. Springer 2002, ISBN 3-540-44178-6
Gorman, Paul, Joan Ash, Mary Lavelle, Jason Lyman, Lois Delcambre, David Maier, Mathew Weaver, and Shawn Bowers. 2000. "Bundles in the Wild: Managing Information to Solve Problems and Maintain Situation Awareness." Library Trends. Vol. 49, no. 2. p. 266-289.
Greenstein, Daniel. 2000. "Digital Libraries and Their Challenges." Library Trends. Vol. 49, no. 2. p. 290-303.
Greisdorf, Howard and Amanda Spink. 2001. "Median Measure: An Approach to IR Systems Evaluation." Information Processing and Management. Vol. 37 p. 843-857.
Hartland-Fox, Becky and Pete Dalton. 2002. "eVALUED - an evaluation model for e-library developments." ARIADNE. Issue 31.
Heath, Fred, Martha Kyrillidou, Duane Webster, Sayeed Choudhury, Ben Hobbs, Mark Lorie and Nicholas Flores. 2003. "Emerging Tools for Evaluating Digital Library Services: Conceptual Adaptations of LibQUAL+ and CAPM." JoDI: Journal of Digital Information. Vol. 4, No. 2.
Hembise, Celine. 2000. "Appropriation of Legal Information: Evaluation of Data Bases for Researchers." Lecture Notes in Computer Science. No. 1923 p. 445
Herlocker, Jonathan L., Joseph A. Konstan, Loren G. Terveen, and John T. Riedl. 2004. "Evaluating Collaborative Filtering Recommender Systems." ACM Transactions on Information Systems (TOIS) Vol. 22 No. 1 p. 5-53.
Hert, Carol A. 2001. "User-Centered Evaluation and Its Connection to Design." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 155-173.
Hill, Linda L., Larry Carver, Mary Larsgaard, Ron Donlin, Terence Smith, James Frew, and Mary-Anna Rae. 2000. "Alexandria Digital Library: User Evaluation Studies and System Design ." Journal of the American Society for Information Science. Vol 51. No. 3. p. 246-59.
Hill, Linda L., Ron Dolin, James Frew, Randall B. Kemp, Mary Larsgaard, Daniel R. Montello, Mary-Anna Rae, and Jason Simpson. 1997. "User Evaluation: Summary of the Methodologies and Results for the Alexandria Digital Library, University of California at Santa Barbara." in ASIS97 Digital Collections: Implications for Users, Funders, Developers and Maintainers - Proceedings of the 60th ASIS Annual Meeting. Vol. 34. p. 225-243.
Hollmann, Jochen, Anders Ardö, Per Stenström. 2004. "An Evaluation of Document Prefetching in a Distributed Digital Library." Lecture Notes in Computer Science. No. 2769 p. 276-287.
Holmquist, Selma, and N. Hari Narayanan. 2000. "Tightly Coupling Authoring and Evaluation in an Integrated Tool to Support Iterative Design of Interactive Hypermedia Educational Manuals." Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. New York City, New York p. 155 - 164
Hook, Kristina. 1998. "Designing and Evaluating Intelligent User Interfaces." International Conference on Intelligent User Interfaces. Proceedings of the 4th International Conference on Intelligent User Interfaces. Los Angeles, California. p. 5-6
Hook, Kristina. 1997. "Evaluating the Utility and Usability of an Adaptive Hypermedia System." International Conference on Intelligent User Interfaces. Proceedings of the 2nd International Conference on Intelligent User Interfaces. Orlando, Florida, United States p. 179-86
Hovater, Jessica, M. Krot, D.L. Kiskis, Ilona Holland and Micah Altman. 2002. Usability Testing of the Virtual Data Center - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Ivory, Melody Y., and Marti A. Hearst. 2001. "The State of the Art in Automating Usability Evaluation." ACM Computing Surveys (CSUR), Vol 33 No. 4 p. 470-516.
Jacobson, Frances F. and Emily N. Ignacio. 1997. "Teaching Reflection: Information Seeking and Evaluation in a Digital Library Environment." Library Trends. Vol. 45 No. 4 p. 771-802.
Janes, Joseph. 2001. "Digital Reference Services in Public and Academic Libraries." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 175-195.
Jansen, Bernard J., Amanda Spink, and Tefko Saracevic. 2000. "Real Life, Real Users, and Real Needs: A Study and Analysis of User Queries on the Web." Information Processing and Management. Vol 36. p. 207-227.
Jayawardana, Champa, K. Priyantha Hewagamage, and Masahito Hirakawa. 2001. "A Personalized Information Environment for Digital Libraries." Information Technology and Libraries. Vol. 20. No. 4. p. 185-197.
Jones, Casey and Tamara Sumner. 2002. " Evaluation of the National Science Digital Library - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Jones, Steve, and Gordon W. Paynter. 2003. "An Evaluation of Document Keyphrase Sets." Journal of Digital Information. Vol 4 No 1
Jones, Steve, and Gordon W. Paynter. 2002. "Automatic Extraction of Document Keyphrases for Use in Digital Libraries: Evaluation and Applications." Journal of the American Society for Information Science and Technology. Vol 53 No. 8 p. 653-677.
Jones, Steve, Sally Jo Cunningham, Rodger J. McNab, Stefan Boddie. 2000. "A Transaction Log Analysis of a Digital Library." International Journal on Digital Libraries. Vol. 3 No. 2 p. 152-169.
Jones, Steve, Sally Jo Cunningham, Rodger J. McNab. 1998. "An Analysis of Usage of a Digital Library." Lecture Notes in Computer Science. p. 261-277. Christos Nikolaou, Constantine Stephanidis (Eds.): Research and Advanced Technology for Digital Libraries, Second European Conference, ECDL '98, Heraklion, Crete, Greece, September 21-23, 1998, Proceedings.
Kantor, Paul B. "White Paper." - website [http://www.scils.rutgers.edu/~kantor/dlmetric.html]
Kantor, Paul B. and Tefko Saracevic. 1999. "Quantitative Study of the Value of Research Libraries: A Foundation for the Evaluation of Digital Libraries." in ASIS99 Knowledge: Creation, Organization and Use - Proceedings of the 62nd Annual Meeting of the American Society for Information Science. Vol. 36. p. 407-419.
Kassim, Ahmed Rafee Che, and Thomas R. Kochtanek. 2003. "Designing, Implementing, and Evaluating an Educational Digital Library Resource." Online Information Review. Vol. 27 No. 3 p. 160-168.
Keith, Suzette, Ann Blandford, Bob Fields and Yin Leng Theng. 2002. An Investigation Into the Application of Claims Analysis to Evaluate Usability of a Digital Library Interface - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Kengeri, Rekha, Cheryl D. Seals, Hope D. Harley, Himabindu P. Reddy, Eward A. Fox. 1999. "Usability Study of Digital Libraries: ACM, IEEE-CS, NCSTRL, NDLTD." International Journal on Digital Libraries. Vol. 2 No. 2/3 pp. 157-169.
Khoo, Michael. 2001. "Ethnography, Evaluation, and Design as Integrated Strategies: A Case Study from WES." Lecture Notes in Computer Science. 2163. p. 263-274. Panos Constantopoulos, Ingeborg Sølvberg (Eds.): Research and Advanced Technology for Digital Libraries, 5th European Conference, ECDL 2001, Darmstadt, Germany, September 4-9, 2001, Proceedings. Springer 2001, ISBN 3-540-42537-3
Kibirige, Harry M. 2000. "Telecommunications Alternatives in Accessing Image Intensive Digital Libraries." Vol. 18, No. 5. p. 347-353.
Kilker, Julian and Geri Gay. 1998. "The Social Construction of a Digital Library: A Case Study Examining Implications for Evaluation." Information Technology and Libraries. Vol. 17, No. 2. p. 60-70.
Kim, Kyunghye. 2002. " A Model-Based Approach to Usability Evaluation for Digital Libraries ." - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Kirkpatrick, Andrew. 2003. "Accessibility in Digital Libraries." (PowerPoint - Use Explorer) Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact - NSDL Annual Meeting, Washington DC
Klas, Claus-Peter, Norbert Fuhr, and André Schaefer. 2004. "Evaluating Strategic Support for Information Access in the DAFFODIL System." Lecture Notes in Computer Science. No. 3232 p. 476
Komlodi, Anita, Nadia Caidi, and Kristin Wheeler. 2004. "Cross-Cultural Usability of Digital Libraries." Lecture Notes in Computer Science. No. 3334 p. 584
Kurtz, Michael J., Eichhorn Guenther, Alberto Accomazzi, Carolyn S. Grant, Markus Demleitner, and Stephen S. Murray. 1999. "The NASA ADS Abstract Service and the Distributed Astronomy Digital Library." D-Lib Magazine. Vol. 5, No. 11.
Kwak, Byeong Heui, Woochun Jun, Le Gruenwald, and Suk-Ki Hong. 2002. "A Study on the Evaluation Model for University Libraries in Digital Environments." Lecture Notes in Computer Science. 2458. p. 204-217. Maristella Agosti, Constantino Thanos (Eds.): Research and Advanced Technology for Digital Libraries, 6th European Conference, ECDL 2002, Rome, Italy, September 16-18, 2002, Proceedings. Springer 2002, ISBN 3-540-44178-6
Landoni, Monica and Paloma Diaz. 2003. "E-education: Design and Evaluation for Teaching and Learning." Journal of Digital Information. Vol. 3 No 4
Lankes, David. 2001. "Assessing the Provision of Networked Services: ERIC as an Example." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 67-83.
Larsen, Ronald L. 2002. "The DLib Test Suite and Metrics Working Group: Harvesting the Experience from the Digital Library Initiative." - website [http://www.dlib.org/metrics/public/papers/The_Dlib_Test_Suite_and_Metrics.pdf]
Lazar, Johathan and Jennifer Preece. 2001. "Using Electronic Surveys to Evaluate Networked Resources: From Idea to Implementation." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 137-154.
Leazer, Gregory H., Anne J. Gilliland-Swetland, and Christine L. Borgman. 2000. "Evaluating the Use of a Geographic Digital Library in Undergaduate Classrooms: ADEPT." International Conference on Digital Proceedings of the Fifth ACM Conference on Digital Libraries Table of Contents. San Antonio, Texas.
Lee, Yang W., Diane M. Strong, Beverly K. Kahn, and Richard Y. Wang. 2002. "AIMQ: A Methodology for Information Quality Assessment." Information & Management. Vol. 40 p. 133-46.
Leouski, Anton, and James Allan. 1998. "Evaluating a Visual Navigation System for a Digital Library." Lecture Notes in Computer Science. p. 535-554. Christos Nikolaou, Constantine Stephanidis (Eds.): Research and Advanced Technology for Digital Libraries, Second European Conference, ECDL '98, Heraklion, Crete, Greece, September 21-23, 1998, Proceedings
Liddy, Elizabeth D., Eileen E. Allen, Christina M. Finneran, Geri Gay, Helene Hembrooke, and Laura Granka. 2003. "MetaTest: Evaluation of Metadata from Generation to Use." Poster Session: 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 398
LiLiew, C. 2004. "Cross-cultural Design and Usability of a Digital Library Supporting Access to Maori Cultural Heritage Resources: An Examination of Knowledge Organization Issues." Advances in Knowledge Organization. Vol. 9 p. 127-132.
Long, Holley. 2002. "An Assessment of the Current State of Digital Library Evaluation." Master's Paper. University of North Carolina at Chapel Hill.
Lochore, Stephen. 2004. "How Good are the Free Digital Reference Services? A Comparison of Library-Based and Expert Services." Library Review. Vol. 53 No. 1 p. 24-29.
Lopez, Manuel J. Maña, Manuel de Buenaga Rodríguez, and José María Gómez Hidalgo. 1999. "Using and Evaluating User Directed Summaries to Improve Information Access." Lecture Notes in Computer Science. 1696. p. 198-214. Serge Abiteboul, Anne-Marie Vercoustre (Eds.): Research and Advanced Technology for Digital Libraries, Third European Conference, ECDL'99, Paris, France, September 22-24, 1999, Proceedings. Springer 1999, ISBN 3-540-66558-7
Lowe, David B., Andrew J. Bucknell, and Richard G. Weddy. 1999. "Improving Hypermedia Development: a Reference Model-Based Process Assessment Method." Proceedings of the Tenth ACM Conference on Hypertext and Hypermedia : Returning to Our Diverse Roots. Darmstadt, Germany. February 1999. p. 139-146.
Lynch, Clifford. 2001. "Measurement and Evaluation in the Networked Information World." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 293-326.
MacCall, Steven L., Ana D. Cleveland, and Ian E. Gibson. 1999. "Outline and Preliminary Evaluation of the Classical Digital Library Model." Proceedings of the ASIS Annual Meeting. Vol 36 p. 33-46
Madle, Gemma, Patty Kostkova, Jane Mani-Saada and Julius R. Weinberg. 2004. "Evaluating the Changes in Knowledge and Attitudes of Digital Library Users." Lecture Notes in Computer Science. No. 2769 p. 29-40
Mahoui, Malika and Sally Jo Cunningham. 2001. "Search Behavior in a Research-Oriented Digital Library." Lecture Notes in Computer Science. 2163. p. 13-24. Panos Constantopoulos, Ingeborg Sølvberg (Eds.): Research and Advanced Technology for Digital Libraries, 5th European Conference, ECDL 2001, Darmstadt, Germany, September 4-9, 2001, Proceedings. Springer 2001, ISBN 3-540-42537-3
Mahoui, Malika and Sally Jo Cunningham. 2000. "A Comparative Transaction Log Analysis of Two Computing Collections." Lecture notes in Computer Science. 2163. p. 418-423. José Luis Borbinha, Thomas Baker (Eds.): Research and Advanced Technology for Digital Libraries, 4th European Conference, ECDL 2000, Lisbon, Portugal, September 18-20, 2000, Proceedings. Springer 2000, ISBN 3-540-41023-6
Manduca, C.A., McMartin, F.P. and Mogk, D.W. 2001. Pathways to Progress: Vision and Plans for Developing the NSDL, National Science, Mathematics, Engineering, and Technology (SMET) Education Digital Library (NSDL)." - http://nsdl.comm.nsdlib.org/Comm.Center_Archive/workgroups/whitepaper.pdf. Evaluation discussed on p. 20-21.
Marchionini, Gary. 2000. "Evaluating Digital Libraries: A Longitudinal and Multifaceted View." Library Trends. Vol. 49. No. 2. p. 304-333 --- Online copy at http://www.ils.unc.edu/~march/perseus/lib-trends-final.pdf
Marchionini, Gary. 1998. "Interfaces and Tools for the Library of Congress National Digital Library Program." Information Processing & Management. Vol. 34, No. 5. p. 535-555.
Marchionini, Gary, Catherine Plaisant, and Anita Komlodi. 1999. "The People in Digital Libraries: Multifaceted Approaches to Assessing Needs and Impact." - website [http://www.ils.unc.edu/~march/revision.pdf]
Marchionini, Gary. 1995. "User-Centered Methods for Library Interface Design." ACM SIGOIS Bulletin. Vol 16 No. 2 p. 34-36.
Marchionini, Gary and Gregory Crane. 1994. "Evaluating Hypermedia and Learning: Methods and Results from the Perseus Project." ACM Transactions on Information Systems. Vol. 12, No. 1. p. 5-34.
Marcondes, Carlos Henrique and Luis Fernando Sayão. 2003. "Brazilian Digital Library of Theses and Dissertations." The International Information & Library Review. Vol. 35 No. 2-4 p. 265-279.
Matylonek, John. 2002. " Maintaining Quality of Library Web Sites Using Cluster and Path Analysis." LIBRES: Library and Information Science Research Electronic Journal. Vol. 12, No. 1.
Matylonek, John. 2001. "The Design of Complex Library Web Sites." Transforming Traditional Libraries. Vol. 1, No. 2
McClure, Charles R. 2002. "Assessing Quality in Digital Reference" - website at http://quartz.syr.edu/quality/
McClure, Charles R. and John C. Bertot. 2001. Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today.
McClure, Charles R. and J. Timothy Sprehe. 2001. "Using U.S. Information Policies to Evaluate Federal Web Sites." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 255-292.
McClure, Charles R., R. David Lankes, Melissa Gross, and Beverly Choltco-Devlin. 2002. Statistics, Measures, and Quality Standards for Assessing Digital Reference Library Services: Guidelines and Procedures. Syracuse, N.Y.: Information Institute of Syracuse, School of Information Studies, Syracuse University. - Draft Copy at http://quartz.syr.edu/quality/Field_Test_Draft.pdf
McCrea, Richard. 2004. "Evaluation of Two Library-Based and One Expert Reference Service on the Web." Library Review. Vol. 53 No. 1 p. 11-16.
McMullen, Susan. 2001. "Usability Testing in a Library Web Site Redesign Project." Reference Services Review. Vol. 29, No. 1. p. 7-22.
Melucci, Massimo, and Nicola Orio. 2002. "Evaluating Automatic Melody Segmentation Aimed at Music Information Retrieval." JCDL 2003 - Joint Conference on Digital Libraries - July 13-17, 2002, Portland, Oregon.
Mendonca, E.A. and J.J. Cimino. 1999. "Evaluation of the Information Sources Map." Proceedings: AMIA Symposium. p. 873-877
Meyyappan, N, Schubert Foo, G.G. Chowdhury. 2004. "Design and Evaluation of a Task-Based Digital Library for the Academic Community." Journal of Documentation. Vol. 60 No. 4 p. 449-475.
Moen, William. 2001. "Assessing Interoperability in the Networked Environment: Standards, Evaluation, and Testbeds in the Context of Z39.50." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 85-109.
Moen, William E., Charles R. McClure. 1997. "An Evaluation of the Federal Government’s Implementation of the Government Information Locator Service (GILS)." submitted to General Services Administration Office of Information Technology Integration. Washington, DC.
Monopoli, Maria, David Nicholas, Panagiotis Georgiou, Marina Korfiati. 2002. "A User-Oriented Evaluation of Digital Libraries: Case Study the "Electronic Journals" Service of the Library and Information Service of the University of Patras, Greece. Aslib Proceedings. Vol. 54 No. 2 p. 103-117.
Morse, Emile. 2002. "Evaluation Methodologies for Information Management Systems" D-Lib Magazine. Vol. 8, No. 9
Mowshowitz, Abbe and Akira Kawaguchi. 2002. "Assessing Bias in Search Engines." Information Processing and Management. Vol. 38 p. 141-156.
Mudrock, Theresa. 2002. "Revising Ready Reference Sites: Listening to Users through Server Statistics and Query Logs." Reference & User Services Quarterly. Vol. 42, No. 2. p. 155-63.
Mukaiyama, Hiroshi. 2000 "A Large Scale Component-Based Multi-media Digital Library System: Development Experience and User Evaluation." Lecture Notes in Computer Science. No. 1923 p. 336
Musante, Susan. 2003. "Evaluating MicrobeLibrary on Many Levels: Library Use, User Needs, Accessibility Issues, and Educational Impact." (PowerPoint - Use Explorer) Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact - NSDL Annual Meeting, Washington DC
Nicholas, David, Paul Huntington, Peter Williams and Tom Dobrowolski. 2004. "Re-Appraising Information Seeking Behaviour in a Digital Environment: Bouncers, Checkers, Returnees and the Like
Nicholas, David, Paul Huntington, Nat Lievesley, and Richard Withey. 1999. "Cracking the Code: Web Log Analysis." Online & CD-ROM Review. Vol. 23 No. 5. p. 263-69.
Nitecki, Danuta A., and William Rando. 2004. "A Library and Teaching Center Collaboration to Assess the Impact of Using Digital Images on Teaching, Learning, and Library Support." VINE. Vol. 34 No. 3 p. 119-125.
Nowick, Elaine. 2001. " Using Server Logfiles to Improve Website Design." Library Philosophy and Practice. Vol. 4, No. 1.
NSDL. 2003. " Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact" NSDL Annual Meeting 2003
O'Donnell, James J.. 2000. "LC21 - Hopes and Cautions for the Library of Congress." D-Lib Magazine. Vol. 6 No. 10
Palmer, David and Bridget Robinson. 2000. "Agora: the hybrid library from a users perspective." ARIADNE. Issue 26.
Pang, Natalie Lee-San and Pang-Leang Hiew. 2004. "Assessing Users, Uses, and Usage of a Collaborated Digital Library." Lecture Notes in Computer Science. No. 3334 p. 666
Parsons, Ann Marie. 2000. "The Trouble with Tools: Designing Effective Survey Mechanisms." Digital Library Federation Newsletter. Volume 1 Number 2 July 2000
Peng, Lew Kan, Chennupati K Ramaiah and Schubert Foo. 2004. "Heuristic-Based User Interface Evaluation at Nanyang Technological University in Singapore." Program: Electronic Library & Information Systems. Vol. 38 No. 1 p. 42-59.
Perlman, Gary. 1994. "Practical Usability Evaluation." Conference on Human Factors and Computing Systems. Conference Companion on Human Factors in Computing Systems. Boston, Massachusetts. p. 407-08
Perlman, Gary, Dennis E. Egan, Kate Ehrlich, Gary Marchionini, Jakob Nielsen, and Ben Shneiderman. 1990. Panel - "Evaluating Hypermedia Systems." Conference on Human Factors and Computing Systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Empowering People. Seattle, Washington. p 387-90
Perlman, Gary. 1989. "Asynchronous Design/Evaluation Methods for Hypertext Technology Development." Conference on Hypertext and Hypermedia - Proceedings of the Second Annual ACM Conference on Hypertext. Pittsburgh, Pennsylvania, United States p. 61-81.
Peters, Thomas. 2000. "Assessing Digital Library Services." Library Trends. Vol. 49. No. 2. p. 221-227.
Peters, Thomas. 2000. "Current Opportunities for the Effective Meta-Assessment of Online Reference Services." Library Trends. Vol. 49. No. 2. p. 334-349.
Peterson, Elaine and Vicky York. 2003. "User Evaluation of the Montana Natural Resource Information System (NRIS): In-Depth Evaluation of Digital Collections Using Snowball Sampling and Interviews." D-Lib Magazine. Vol. 9 No. 7/8
Petrie, Helen, Sarah Morley, Peter McNally, Anne-Marie O'Neill, and Dennis Majoe. 1997. "Initial Design and Evluation of an Interface to Hypermedia Systems for Blind Users." Conference on Hypertext and Hypermedia. Proceedings of the Eighth ACM Conference on Hypertext. Southampton, United Kingdom. p. 48-56
Pitkow, James E. and Krishna A Bharat. 1994. "Webviz: A Tool For World-Wide Web Access Log Analysis."
Polydoratou, Panayiota, Michael Pendalton, David Nichols. 2002. "The Use and Functionality of the Environmental Data Registry: An Evaluation of User Feedback." Lecture Notes in Computer Science 2555. p. 406-418. Ee-Peng Lim, Schubert Foo, Christopher S. G. Khoo, Hsinchun Chen, Edward A. Fox, Shalini R. Urs, Costantino Thanos (Eds.): Digital Libraries: People, Knowledge, and Technology, 5th International Conference on Asian Digital Libraries, ICADL 2002 Singapore, December 11-14, 2002, Proceedings. Springer 2002, ISBN 3-540-00261-8
Pottenger, William M., Bruce R. Schatz, Duncan H. Lawrie, and Robert E. McGrath. 1998. "Evaluation of Concept Space and Category Map Semantic Indexes." CANIS Community Systems Laboratory. University of Illinois at Urbana-Champaign - website [http://www.canis.uiuc.edu/~billp/metricsWG-position.html]
Quam, Eileen. 2001. "Informing and Evaluating a Metadata Initiative: Usability and Metadata Studies in Minnesota's Foundations Project." Government Information Quarterly. vol 18 p. 181-94.
Quintana, Yuri, Mohamed Kamel, and Rob McGeachy. 1993. "Formal Methods for Evaluating Information Retrieval in Hypertext Systems." Annual ACM Conference on Systems Documentation - Proceedings of the 11th Annual International Conference on Systems Documentation. Waterloo, Ontario, Canada p. 259-72.
Ragains, Patrick. 2001. "A Primer on Developing and Using Course-Related Library Web Pages." Research Strategies. Vol. 18 p. 85-93.
Rapp, David N., Holly A. Taylor, and Gregory R. Crane. 2003. "The Impact of Digital Libraries on Cognitive Processes: Psychological Issues of Hypermedia." Computers in Human Behavior. Vol 19 p. 609-628.
Redalen, Aaron and Naomi Miller. 2000. "Evaluating Website Modifications at the National Library of Medicine through Search Log Analysis" D-Lib Magazine Vol 6 No 1 (January 2000).
Reeves, T.C. and J. G. Hedberg. 2003. "Interactive learning systems evaluation." Englewood Cliffs, NJ: Educational Technology Publications.
Reeves, T. C., X. Apedoe, X, and Y. Woo. 2004. Evaluating digital libraries: A user-friendly guide. NSDL, Educational Impact and Evaluation Standing Committee
Rehman, Sajjad ur, and Vivian Ramzy. 2004. "Awareness and Use of Electronic Information Resources at the Health Sciences Center of Kuwait University." Library Review. Vol. 53 No. 3 p. 150-156.
Renninger, K. Ann. 2003. " The Math Forum/Math Tools: Evaluation." (PowerPoint - Use Explorer) Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact - NSDL Annual Meeting, Washington DC
Rieger, Robert, and Geri Gay. 1999. "Tools and Techniques in Evaluating Digital Imaging Projects." RLG DigiNews. June 15, 1999, Vol. 3. No. 3.
Rosenstein, Mark. 2000. "What is Actually Taking Place on Web Sites: E-Commerce Lessons from Web Server Logs." Proceedings of the 2nd ACM Conference on Electronic Commerce. Minneapolis, Minnesota p. 38-43.
Rousseau, Gabriel K., Brian A. Jamieson, Wendy A. Rogers, Sherry E. Mead and Richard A. Sit. 1998. "Assessing the Usability of On-Line Library Systems." Behaviour & Information Technology. Vol. 17 No. 5 p. 274-81.
Roussel, Francis, Stefan J. Darmoni, and Benoit Thirion. 2001. "Cost Effectiveness of a Medical Digital Library." Medical Informatics and the Internet in Medicine. Vol. 26 No. 4 p. 325-30.
Rubin, Jeffrey H. 2001. "Introduction to Log Analysis Techniques: Methods for Evaluating Networked Services." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 197-212.
Ryan, Joe, Charles R. McClure, John C. Bertot. 2001. "Choosing Measures to Evaluate Networked Information Resources and Services: Selected Issues." in Evaluating Networked Information Services : Techniques, Policy, and Issues. Medford, N.J.:Information Today. p. 111-135.
Salampasis, Michail, Konstantinos I. Diamantaras. 2002. "Experimental User-Centered Evaluation of an Open Hypermedia System and Web Information Seeking Environments." Journal of Digital Information. Vol 2 No 4.
Salampasis, Michail. 1998. "Evaluation of Information-Seeking Performance in Hypermedia Digital Libraries." Interacting with Computers. Vol. 10. No. 3. p. 269-284.
Sandusky, Robert J. 2002. " Digital Library Attributes: Framing Usability Research ." - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Saracevic, Tefko. 2000. "Digital Library Evaluation: Toward an Evolution of Concepts" Library Trends. Vol. 49. No. 2. p. 350-369.
Saracevic, Tefko, and Lisa Covi. 2000. "Challenges for Digital Library Evaluation." in ASIS2000 Knowledge Innovations: Celebrating Our Heritage, Designing Our Future. - Proceedings of the 63rd Annual Meeting of the American Society for Information Science. Draft Copy
Savoy, Jacques and Justin Picard. 2001. "Retrieval Effectiveness on the Web." Information Processing & Management. Vol. 37 p. 543-569.
Seadle, Michael. 2003. "Outcome-Based Evaluation." Library Hi Tech. Vol. 21 No. 1. p. 5-7.
Seadle, Michael. 2000. "Project Ethnography: An Anthropological Approach to Assessing Digital Library Services." Library Trends. Vol. 49. No. 2. p. 370-385.
Sellen, Mary and Brenda Hazard. 2001. "User Assessment of Electronic Reserves and Implications for Digital Libraries." Journal of Interlibrary Loan. Vol. 12. No. 1. p. 73-83.
Sfakakis, Michalis and Sarantos Kapidakis. 2002. "User Behavior Tendencies on Data Collections in a Digital Library." Lecture Notes in Computer Science. 2458. p. 550-559. Maristella Agosti, Constantino Thanos (Eds.): Research and Advanced Technology for Digital Libraries, 6th European Conference, ECDL 2002, Rome, Italy, September 16-18, 2002, Proceedings. Springer 2002, ISBN 3-540-44178-6
Shim, Wonsik and Paul B. Kantor. 1999. "Evaluation of Digital Libraries: A DEA Approach." in ASIS99 Knowledge: Creation, Organization and Use - Proceedings of the 62nd Annual Meeting of the American Society for Information Science. Vol 36. p. 605-615.
Shiri, Ali, Nicholson, Dennis, and Emma McCulloch. 2004. "User Evaluation of a Pilot Terminologies Server for a Distributed Multi-Scheme Environment." Online Information Review. Vol. 28 No. 4 p. 273-283.
Song, Ji Hee, and George M. Zinkhan. 2003. "Features of Web Site Design, Perceptions of Web Site Quality, and Patronage Behavior." Proceedings of the Annual Meeting of the Association of Collegiate Marketing Educators.
Spasser, Mark A. 2002. "Realist Activity Theory for Digital Library Evaluation: Conceptual Framework and Case Study." Computer Supported Cooperative Work (CSCW). Vol 11. No. 1 January 2002 p. 81-110
Spink, Amanda. 2002. "A User-Centered Approach to Evaluating Human Interaction with Web Search Engines: An Exploratory Study." Information Processing and Management. Vol. 38 p. 401-426.
Stelmaszewska, Hanna and Ann Blandford. 2002. " Patterns of Interactions: User Behaviour in Response to Search Results ." - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Stoeffler, Matt and James Reed. 2002. " A User Study of Multi-Collection Text Retrieval ." - JCDL'02 Workshop on Usability of Digital Libraries. Joint Conference on Digital Libraries - July 18, 2002, Portland Oregon.
Su, L.T. 1992. "Evaluation Measures for Interactive Information Retrieval." Information Processing & Management. Vol 28, No. 4 p. 503-16.
Sumner, Tamara, Michael Khoo, Mimi Recker, and Mary Marlino. 2003. "Understanding Educator Perceptions of 'Quality' in Digital Libraries." 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 269-279.
Sumner, Tamara, Sarah Giersch, and Casey Jones. 2003. "Steps Towards Establishing Shared Evaluation Goals and Procedures in the National Science Digital Library." Poster Session: 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 407.
Sumner, Tamara, Sonal Bhushan, Faisal Ahmad, and Lynne Davis. 2003. "A Comparison of Two Educational Resource Discovery Systems." Poster Session: 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 408.
Sumner, Tamara, Melissa Dawe, and Holly Devaul. 2002. "Creating Reusable Education Components: Lessons from DLESE." Journal of Geoscience Education. Vol. 50 No. 1 pp. 25-30.
Sumner, Tamara, and Melissa Dawe. 2001. "Looking at Digital Library Usability from a Reuse Perspective." JCDL 2001 June 24-28. Proceedings of the first ACM/IEEE-CS joint conference on Digital libraries 2001 , Roanoke, Virginia (ACM Digital Library). p. 416-425
Tang, Muh-Chyun, and Ying Sun. 2003. "Evaluation of Web-Based Search Engines Using User-Effort Measures." LIBRES: Library and Information Science Research Electronic Journal Vol. 13 No. 2
Taniguchi, Toshio. 2003. "Digital Library Evaluation." The Journal of Information Science and Technology Association. Vol. 53 No. 12 pp. 602-608.
Teng, Xia, Brandon Muramatsu, Jian Wei Zhang, Joseph G. Tront, Flora McMartin, and Alice Agogino. 2004. Lecture Notes in Computer Science. No. 3143 p. 2004
Unruh, K.T., K.E. Pettigrew, and J.C. Durance. 2002. "Evaluation of Digital Community Information Systems." International Conference on Digital Libraries. Proceedings of the Second ACM/IEEE-CS Joint Conference on Digital Libraries. 2002 , Portland, Oregon. (ACM Digital Library)
van Waes, Luuk. 1998. "Evaluating On-Line and Off-Line Searching Behavior Using Thinking-Aloud Protocols to Detect Navigation Barriers." Annual ACM Conference on Systems Documentation - Proceedings of the 16th Annual International Conference on Computer Documentation. Quebec, Quebec, Canada p. 180-83.
Viles, Charles L. and James C. French. 1999. "Content Locality in Distributed Digital Libraries." Information Processing & Management. Vol. 35. p. 317-336.
Waard, Jewel. 2003. "A Quantitative Analysis of Unqualified Dublin Core Metadata Element Set Usage within Data Providers Registered with the Open Archives Initiative." 2003. 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries. p. 315-317.
Walker, Christine and Chris Neuhaus. 2003. " Digital Library Evaluation: Measuring Impact, Quantifying Quality, or Tilting at Windmills?." (PowerPoint - Use Explorer) Evaluating Digital Libraries on Many Levels: Library Use, User Needs, Accessibility Issues and Educational Impact - NSDL Annual Meeting, Washington DC
Wang, Peiling, William B. Hawk, and Carol Tenopir. 2000. "Users' Interaction with World Wide Web Resources: An Exploratory Study Using a Holistic Approach." Information Processing and Management. Vol. 36 p. 229-51.
Weiss-Lijn, Janet T. McDonnell, and Leslie James. 2002. "An Empirical Evaluation of the Interactive Visualization of Metadata to Support Document Use." Lecture Notes in Computer Science. 2539. p. 50-64. Katy Börner, Chaomei Chen (Eds.): Visual Interfaces to Digital Libraries [JCDL 2002 Workshop]. Springer 2002, ISBN 3-540-00247-2
Wiil, Uffe Kock. 1998. "Evaluating Hyperdisco as an Infrastructure for Digital Libraries" The Danish National Centre for IT Research. In Proceedings of the ACM Symposium on Applied Computing (SAC '98)- website [http://www.cs.aue.auc.dk/~kock/Publications/HyperDisco/sac98.pdf]
Wildemuth, Barbara M., Gary Marchionini, Meng Yang, Gary Geisler, Todd Wilkens, Anthony Hughes and Richard Gruss. 2003. "How Fast Is Too Fast? Evaluating Fast Forward Surrogates for Digital Video." 2003 Joint Conference on Digital Libraries, Rice University, Houston, Texas, May 27-31 2003, IEEE Technical Committee on Digital Libraries p. 221-230.
Williams, D.D. and T.C. Wilson. 2002. "An Illustration of the Need for Situational Responsiveness in Technology-Related Evaluations." Evaluation and Program Planning Vol. 25 p. 95-100
Williams, Michael. 1998. "An Evaluation of Passage-Level Indexing Strategies for a Technical Report Archive" LIBRES: Library and Information Science Research. Vol. 8, No. 1.
Wilson, Ruth and Monica Landoni. 2001. "Evaluating Electronic Textbooks: A Methodology." Lecture Notes in Computer Science. 2163. p. 1-12. Panos Constantopoulos, Ingeborg Sølvberg (Eds.): Research and Advanced Technology for Digital Libraries, 5th European Conference, ECDL 2001, Darmstadt, Germany, September 4-9, 2001, Proceedings. Springer 2001, ISBN 3-540-42537-3
Yamada, Shoji, Jung-Kook Hong, and Shigeharu Sugita. 1995. "Development and Evaluation of Hypermedia for Museum Education: Validation of Metrics." ACM Transactions on Computer-Human Interaction (TOCHI). Vol. 2 , No. 4 p. 284-307
Yan, Hongfei, Jianyong Wang, Xiaoming Li and Lin Guo. 2002. "Architectural Design and Evaluation of an Efficient Web-Crawling System." The Journal of Systems and Software. Vol. 60. p. 185-193.
Yang, Shu Ching. 2001. "An Interpretive and Situated Approach to an Evaluation of Perseus Digital Libraries." Journal of the American Society for Information Science and Technology. Vol. 52 No. 14 p. 1210-23.
Young, Peter R. 1997 "Measurement of Electronic Services in Libraries: Statistics for the Digital Age." Paper presented to the 63rd IFLA General Conference, Copenhagen, Denmark, August 31- September 5, 1997
Yu, Liangzhi and Ann Apps. 2000. "Studying E-Journal User Behavior Using Log Files: The Experience of SuperJournal." Library & Information Science Research. Vol. 22. No. 3. p. 311-338.

Updated
February 1, 2005
Chris Neuhaus