 |
DELOS Workshop
on
Evaluation of digital libraries: Testbeds, measurements, and metrics
6-7 June 2002, MTA SZTAKI,
Budapest, Hungary
Workshop Report and presentations are available here!
General Information
The DELOS Working Group 2.1 of the ERCIM DELOS Network
of Excellence on Digital Libraries aims at providing a Digital Library Evaluation
Forum and a Digital Library Test Suite which will provide researchers with
information for the selection of potential digital library testbeds and new research or
evaluation targets.
The fourth workshop of the DELOS Network of Excellence, will run from Thursday
June 6th through Friday June 7th 2002 in Budapest, Hungary, examines issues related to
"Evaluation of digital libraries: Testbeds, measurements, and metrics".
The workshop is organized by MTA SZTAKI, the Department of Distributed Systems
The scope of the workshop
Digital libraries can be viewed from a number of perspectives. They can be new forms of
information institutions, multimedia information retrieval systems, or information systems
that support the creation, use, and searching of digital content. Digital libraries are
not an end in themselves; rather, they are enabling technologies for digital asset
management, electronic commerce, electronic publishing, teaching and learning, and other
activities. Accordingly, digital libraries need to be evaluated in the context of specific
applications. The methods and metrics for evaluating digital libraries will vary by
whether they are viewed as institutions, as information systems, as new technologies, or
as new services.
The DL research communities need large test beds in order to be able to evaluate and
demonstrate new concepts. Research results are most valuable when they are compared with
other approaches and validated against many sets of data. Considering users, collections
and systems as the major components of a digital library, evaluations may involve only a
subset of these components. Besides the evaluation context, the underlying criteria have
to be specified. Also, for comparing different evaluations, specification of the test
material employed is essential. Since there are no standard description schemes yet and
only little work has been done in this area so far, papers on ongoing research are
especially invited.
We invite papers for the workshop that focus on generalizable metrics or that focus on
methods and measures specific to individual digital library contexts. These include, but
are not limited to, education, publishing, cultural heritage, science and technology,
medicine, sound, and images.
Context-specific evaluation methods should provide background on the application,
explanations of how and why evaluation is tailored, and the expected use of results (e.g.,
to improve learning, improve retrieval, improve navigation facilities).
Papers may also indicate how their approaches might be adapted to other contexts. We
especially invite evaluation papers that address organizational contexts or that address
digital libraries for creation and use of content, as well as for information retrieval.
Thus, this workshop should bring together researchers from different fields, such as
libraries, publishers, computer science, content providers, user communities, and others,
in order to exchange their ideas about DL evaluation.
Official language
The official language of the Workshop is English.
Deadlines
| April 15 |
Initial submission of 5-page abstract in PDF format |
| May 1 |
Notification of acceptance |
| May 24 |
Final cameraready copy for the workshop proceeding (in PDF format) |
| June 6-7 |
Workshop |
Paper Submissions
Authors are invited to submit their contributions in the form of extended abstracts of
their papers or position papers in PDF format by April 15. (The number of allowed participants
is limited.) Final papers should not
exceed 7 pages. All contributions should be submitted electronically to: submission@dsd.sztaki.hu
Workshop Organizers
General Chair:
Dr. László KOVÁCS
Head of Department of Distributed Systems
MTA SZTAKI,
Computer and Automation Research Institute of the Hungarian Academy of Sciences
H-1111 Budapest XI. Lágymányosi u. 11. Room 312 HUNGARY
Phone: (361) 209-5286 Fax: (361) 209-5288 E-mail:
laszlo.kovacs@sztaki.hu
http://www.sztaki.hu/dsd/kovacs.html
Program Co-Chairs:
Christine L. Borgman
Professor and Presidential Chair
in Information Studies
Department of Information Studies, Graduate School of Education and Information Studies,
235 GSE&IS Bldg, Box 951520
University of California, Los Angeles
Los Angeles, CA 90095-1520
Phone: (310) 825-6164; Fax: (310) 206-4460 Email:
cborgman@ucla.edu
http://is.gseis.ucla.edu/cborgman/
Ingeborg Torvik Sřlvberg
Professor in Information Management
The Norwegian University of Science and Technology, Department of Computer and Information
Science,
7491 Trondheim, Norway
Phone: +47 73596027; Fax: +47 73594466; Email:
ingeborg.solvberg@idi.ntnu.no
http://www.idi.ntnu.no/~solvberg/
Programm Committee Members:
Nicholas Belkin, Rutgers University
Ann Bishop, University of Illinois
Christine Borgman, UCLA
Norbert Fuhr, University of Dortmund, Germany
Annemieke de Jong, Netherlands Audiovisual Archive, the Netherlands
Ronald Larsen, University of Maryland
Clifford Lynch, Coalition for Networked Information, USA
Annelise Mark Pejtersen, Risř National Laboratory, Denmark
Stephan Schneider, TECHMATH, Germany
Ingeborg T. Sřlvberg, Norwegian University of Science and Technology
|
|
